What are the responsibilities and job description for the AWS Data Engineer - Chicago IL - W2 position at Cliecon Solutions Inc?
Job Title : AWS Data Engineer
Location : Chicago IL
Duration : 612 Months
Job description :
Typical duties and responsibilities :
Design and build scalable data pipelines using AWS services like AWS Glue Amazon Redshift and S3.
Develop efficient ETL processes for data extraction transformation and loading into data warehouses and lakes.
Create and manage applications using Python SQL Databricks and various AWS technologies.
Quickly develop innovative ProofofConcept (POC) solutions and services to address emerging needs.
Provide Run / DevOps support and manage the ongoing operation of data services.
Automate repetitive tasks and build reusable frameworks to improve efficiency.
Collaborate with teams to design and develop data products that support marketing and other business functions.
Ensure our data services are reliable maintainable and seamlessly integrated with existing systems
Required skills and experience :
Bachelors degree in Computer Science Engineering or a related field.
10 years of experience with AWS services including S3 Lambda API Gateway and SQS.
7 years of experience with data processing tools like Spark Hive Kafka and Airflow.
Strong skills in data engineering on AWS with proficiency in Python.
Experience with batch job scheduling and managing data dependencies.
Knowledge with DevOps automation tools like GitLab Bitbucket Jenkins and Maven.
Key Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Vacancy : 1
