What are the responsibilities and job description for the Lead AWS Data Engineer position at Cinergy Technology Inc?
Job Details
Job Title: Lead AWS Data Engineer
Location: Charlotte, NC
Duration: Long Term
Required Experience:
Strong experience working with AWS Glue Crawler, managing jobs, and automating ETL processes.
Expertise in AWS Glue Crawlers, ETL jobs, and workflows, including experience in automating data discovery, transformation, and cataloging for migration projects.
Expertise in Amazon Redshift architecture, query optimization, performance tuning, and working with large datasets.
Experience in migrating data from on-premise or legacy data warehouses to Amazon Redshift, with a focus on optimizing schema design, query performance, and data load processes.
Expertise in building scalable and high-performance data pipelines in AWS cloud environment.
Strong skills in SQL, Python, and other data processing frameworks (e.g., PySpark) for data wrangling and transformation.
Experience with AWS services such as S3, Lambda, Glue, Redshift, Kinesis, and Athena.
Experience leading teams and mentoring junior engineers, fostering a collaborative and productive work environment.
Familiarity with version control (e.g., Git) and CI/CD tools and pipelines to automate data pipeline deployment.
Expertise in designing data models, schemas, and setting up efficient data warehousing solutions.
