What are the responsibilities and job description for the AWS Data Engineer - California Candidates ONLY position at TEKsystems?
*Description*
The IT Data Integration Engineer / AWS Data Engineer is tasked with the design, development, and management of data integration processes to ensure seamless data flow and accessibility across the organization. This role is pivotal in integrating data from diverse sources, transforming it to meet business requirements, and loading it into target systems such as data warehouses or data lakes. The aim is to support the organization's data-driven decision-making by providing high-quality, consistent, and accessible data.
Daily Tasks Performed:
Develop and Maintain Data Integration Solutions:
o Design and implement data integration workflows using AWS Glue/EMR, Lambda, Redshift
o Demonstrate proficiency in Pyspark, Apache Spark and Python for data processing large datasets
o Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems.
* Ensure Data Quality and Integrity:
o Validate and cleanse data to maintain high data quality.
o Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines
* Optimize Data Integration Processes:
o Enhance the performance, optimization of data workflows to meet SLAs, scalability of data integration processes and cost-efficiency on AWS cloud infrastructure.
o Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance
o Regularly review and refine integration processes to improve efficiency.
* Support Business Intelligence and Analytics:
o Translate business requirements to technical specifications and coded data pipelines
o Ensure timely availability of integrated data for business intelligence and analytics.
o Collaborate with data analysts and business stakeholders to meet their data requirements.
* Maintain Documentation and Compliance:
o Document all data integration processes, workflows, and technical & system specifications.
o Ensure compliance with data governance policies, industry standards, and regulatory requirements.
*Additional Skills & Qualifications*
Bachelor's degree in computer science, information technology, or a related field. A master's degree can be advantageous.
* 7-10 years of experience in data engineering, database design, ETL processes,
* 5 in programming languages such as PySpark, Python
* 5 years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, Postgres, RDS, Lambda, PySpark)
* 3 years of experience of working with databases/ data marts/data warehouses
* Proven experience in ETL development, system integration, and CI/CD implementation.
* Experience in complex database objects to move the changed data across multiple environments
* Solid understanding of data security, privacy, and compliance.
* Excellent problem-solving and communication skills.
* Display good communication skills to effectively collaborate with multi-functional teams
* Participate in agile development processes including sprint planning stand-ups and retrospectives
* Provide technical guidance and mentorship to junior developers
* Attention to detail and a commitment to data quality.
* Continuous learning mindset to keep up with evolving technologies and best practices in data engineering.
*Pay and Benefits*
The pay range for this position is $60.00 - $72.00/hr.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
* Medical, dental & vision
* Critical Illness, Accident, and Hospital
* 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
* Life Insurance (Voluntary Life & AD&D for the employee and dependents)
* Short and long-term disability
* Health Spending Account (HSA)
* Transportation benefits
* Employee Assistance Program
* Time Off/Leave (PTO, Vacation or Sick Leave)
*Workplace Type*
This is a hybrid position in Torrance,CA.
*Application Deadline*
This position is anticipated to close on Apr 29, 2025.
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
The IT Data Integration Engineer / AWS Data Engineer is tasked with the design, development, and management of data integration processes to ensure seamless data flow and accessibility across the organization. This role is pivotal in integrating data from diverse sources, transforming it to meet business requirements, and loading it into target systems such as data warehouses or data lakes. The aim is to support the organization's data-driven decision-making by providing high-quality, consistent, and accessible data.
Daily Tasks Performed:
Develop and Maintain Data Integration Solutions:
o Design and implement data integration workflows using AWS Glue/EMR, Lambda, Redshift
o Demonstrate proficiency in Pyspark, Apache Spark and Python for data processing large datasets
o Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems.
* Ensure Data Quality and Integrity:
o Validate and cleanse data to maintain high data quality.
o Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines
* Optimize Data Integration Processes:
o Enhance the performance, optimization of data workflows to meet SLAs, scalability of data integration processes and cost-efficiency on AWS cloud infrastructure.
o Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance
o Regularly review and refine integration processes to improve efficiency.
* Support Business Intelligence and Analytics:
o Translate business requirements to technical specifications and coded data pipelines
o Ensure timely availability of integrated data for business intelligence and analytics.
o Collaborate with data analysts and business stakeholders to meet their data requirements.
* Maintain Documentation and Compliance:
o Document all data integration processes, workflows, and technical & system specifications.
o Ensure compliance with data governance policies, industry standards, and regulatory requirements.
*Additional Skills & Qualifications*
Bachelor's degree in computer science, information technology, or a related field. A master's degree can be advantageous.
* 7-10 years of experience in data engineering, database design, ETL processes,
* 5 in programming languages such as PySpark, Python
* 5 years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, Postgres, RDS, Lambda, PySpark)
* 3 years of experience of working with databases/ data marts/data warehouses
* Proven experience in ETL development, system integration, and CI/CD implementation.
* Experience in complex database objects to move the changed data across multiple environments
* Solid understanding of data security, privacy, and compliance.
* Excellent problem-solving and communication skills.
* Display good communication skills to effectively collaborate with multi-functional teams
* Participate in agile development processes including sprint planning stand-ups and retrospectives
* Provide technical guidance and mentorship to junior developers
* Attention to detail and a commitment to data quality.
* Continuous learning mindset to keep up with evolving technologies and best practices in data engineering.
*Pay and Benefits*
The pay range for this position is $60.00 - $72.00/hr.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
* Medical, dental & vision
* Critical Illness, Accident, and Hospital
* 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
* Life Insurance (Voluntary Life & AD&D for the employee and dependents)
* Short and long-term disability
* Health Spending Account (HSA)
* Transportation benefits
* Employee Assistance Program
* Time Off/Leave (PTO, Vacation or Sick Leave)
*Workplace Type*
This is a hybrid position in Torrance,CA.
*Application Deadline*
This position is anticipated to close on Apr 29, 2025.
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
Salary : $60 - $72
