What are the responsibilities and job description for the Sr Data Engineer position at capgemini?
Responsibilities:
- Design, develop, and maintain scalable data pipelines and architectures for data processing and integration.
- Implement data streaming solutions to handle real-time data ingestion and processing.
- Utilize Python and PySpark to develop and optimize data workflows.
- Good to have AWS skills to leverage AWS services such as S3, Redshift, Glue, Kinesis, and Lambda for data storage, processing, and analytics.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality, integrity, and security across all data pipelines.
- Monitor and troubleshoot data pipeline performance and reliability.
- Mentor junior data engineers and provide technical guidance.
- Stay updated with the latest trends and technologies in data engineering and streaming.
Qualifications:
- Bachelor's degree in computer science, engineering.
- 8 years? experience in ETL development role.
- Experience working in Python, PySpark and real time streaming pipeline
- Ability to communicate effectively.
- Strong process documentation skills.
The pay range that the employer in good faith reasonably expects to pay for this position is $44.84/hour - $70.07/hour. Our benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.
Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.
Salary : $45 - $70
