What are the responsibilities and job description for the ETL Engineer (GCP Focus) position at Zortech Solutions?
Job Details
Job Description
Job Description
Role: ETL Engineer (GCP Focus)
Location: Remote-Canada
Duration: 6-12 Months
Job Description:
- We are seeking an experienced Senior ETL Engineer to join our team, where you will be responsible for designing, developing, and maintaining scalable data pipelines in Google Cloud Platform (GCP), with additional knowledge of Azure and DataStage tools. This role will enable you to work with cutting-edge cloud technologies to transform complex data sets into actionable insights that drive key business decisions.
Key Responsibilities:
- Design, develop, and maintain ETL processes using GCP technologies such as BigQuery, Cloud Dataflow, Pub/Sub, and Cloud Storage.
- Work with cross-functional teams to gather and analyze data requirements, ensuring efficient data integration across cloud platforms (GCP and Azure).
- Design and develop complex ETL batch jobs and data workflows, optimizing for scalability, performance, and reliability.
- Write and troubleshoot complex SQL queries to extract, transform, and load data efficiently.
- Ensure data quality and integrity through automated validation and monitoring processes.
- Collaborate with team members to improve existing ETL processes and identify performance bottlenecks.
- Document all new developments and modifications to ETL processes, ensuring clear and comprehensive records.
- (Nice to have) Experience with DataStage 11.7 for building scalable data solutions and data conversion processes.
Preferred Skills and Experience:
- 5 years of hands-on ETL development experience.
- Strong experience with ETL development in Google Cloud Platform (GCP).
- Expertise in writing complex SQL queries and troubleshooting data pipelines.
- Knowledge of Azure and ability to integrate solutions across multi-cloud environments.
- Experience with DataStage 11.7 (or similar tools) for legacy or hybrid cloud implementations.
- Strong problem-solving and troubleshooting skills, with the ability to identify and address bottlenecks in data processing.
- Experience with data mapping and designing scalable, distributed systems.
- Ability to create clear documentation for all new and modified ETL processes.
"#L!-CEIPAL"
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
RQ07956 - Sr Software Developer - ETL
Rubicon Path -
Almont, CO
RQ07957 - Sr. Software Developer - ETL
Rubicon Path -
Almont, CO
Senior Software Developer - AWS Glue and ETL (Contract Role)
Messagepoint -
Almont, CO
