What are the responsibilities and job description for the Data & BI - Senior Data Engineer position at capgemini?
We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with cross-functional teams, and ensuring efficient data processing.
Key Responsibilities:
Design, develop, test, and deploy Matillion ETL jobs in accordance with project requirements.
Collaborate with the Data and BI team to understand data integration needs and translate them into Matillion ETL solutions.
Create and modify Python code/components in Matillion jobs.
Identify opportunities for performance optimization and implement enhancements to ensure efficient data processing.
Collaborate with cross-functional teams, including database administrators, data engineers, and business analysts, to ensure seamless integration of ETL processes.
Create and maintain comprehensive documentation for Matillion ETL jobs, ensuring knowledge transfer within the team.
Create, test, and deploy SQL Server Integration Service (SSIS) packages and schedule them via Active Batch scheduling tool.
Create Matillion deployment builds using Azure DevOps CI/CD pipeline and perform release manager activities.
Review code of other developers (L2, L3-BI/DI) to ensure code standards and provide approval as part of code review activities.
Resolve escalation tickets from the L2 team as part of the on-call schedule.
Working knowledge of API and Postman tool is an added advantage.
Qualifications:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
5 years of experience in data engineering, with a focus on ETL processes.
Proficiency in Matillion, SSIS, Azure DevOps, and ETL.
Strong knowledge of SQL, Python, and data integration techniques.
Experience with performance optimization and data processing enhancements.
Excellent collaboration and communication skills.
Ability to work in a fast-paced, dynamic environment.
Preferred Skills:
Experience with cloud platforms such as AWS or Azure.
Knowledge of data warehousing and data modeling.
Familiarity with DevOps practices and CI/CD pipelines.
Strong problem-solving skills and attention to detail.
The pay range that the employer in good faith reasonably expects to pay for this position is $30.05/hour - $46.95/hour. Our benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.
Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.
Salary : $30 - $47