GCP Data Engineer with IICS

Job Title: Data Engineer (GCP, Informatica IICS & Data Migration)

Location: Atlanta

Job Summary:

We are looking for a Data Engineer with expertise in Google Cloud Platform (GCP) and Informatica Intelligent Cloud Services (IICS) to lead data migration activities from various source databases to GCP-based data warehouses (BigQuery, Cloud SQL, etc.). The ideal candidate should have strong experience in ETL/ELT development, data transformation logic, and performance optimization to ensure seamless data movement and high data integrity.

Key Responsibilities:

• Data Migration & ETL Development: Design and implement data migration strategies to move data from on-premise or cloud-based relational databases (Oracle, SQL Server, MySQL, PostgreSQL) to GCP-based data warehouses (BigQuery, Cloud SQL, Spanner).
• Data Integration & Transformation: Develop and optimize ETL/ELT pipelines using Informatica IICS (Cloud Data Integration, Cloud Mass Ingestion, Cloud Application Integration) for efficient data transformation.
• Workflow Orchestration: Automate and manage data migration tasks using IICS Taskflows, Cloud Composer (Apache Airflow), and Dataflow.
• Schema Mapping & Data Modeling: Perform schema conversions, data type mappings, and entity relationships to align with data warehouse standards.
• Data Transformation & Business Logic Implementation: Implement complex transformation logic, aggregations, and business rules within IICS, SQL, or Dataflow.
• Data Validation & Quality Assurance: Ensure data accuracy and consistency post-migration using data reconciliation techniques and automated validation scripts.
• Performance Optimization: Optimize data ingestion, transformation, and query performance to ensure efficient data processing and storage costs.
• Security & Compliance: Implement data governance, IAM roles, encryption, and audit logging to ensure compliance with industry standards (GDPR, HIPAA, SOC2).
• Monitoring & Troubleshooting: Set up alerts, logging, and monitoring using Stackdriver, Cloud Monitoring, Informatica Operational Insights.
• Collaboration: Work closely with DBAs, data analysts, BI teams, and application developers to ensure smooth migration and business continuity.

Required Qualifications:

• Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• Experience: 6 years in data engineering with hands-on experience in data migration, GCP, and Informatica IICS.
• Cloud Certifications (Preferred):
• Google Professional Data Engineer Certification
• Informatica IICS Cloud Data Integration Certification

Technical Skills:

• Cloud Services (GCP): BigQuery, Cloud SQL, Spanner, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow)
• ETL/ELT & Data Integration: Informatica IICS (Cloud Data Integration, Cloud Mass Ingestion, Cloud Application Integration)
• Databases & Data Warehousing: Oracle, SQL Server, MySQL, PostgreSQL, BigQuery, Cloud SQL
• Programming & Scripting: SQL, Python, Shell Scripting
• Data Processing & Streaming: Apache Beam, Dataflow, Kafka
• Workflow Orchestration: IICS Taskflows, Apache Airflow (Cloud Composer)
• DevOps & CI/CD: Terraform, Docker, Kubernetes, GitHub Actions
• Security & Compliance: IAM, Data Encryption, VPC, Audit Logging

Soft Skills:

• Strong analytical and problem-solving skills
• Ability to manage large-scale data migration projects
• Excellent communication and collaboration with cross-functional teams
• Experience in agile development methodologies