What are the responsibilities and job description for the Data Engineer position at ATech Placement?
We are looking for a Data Engineer to design, build and operate large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, RedShift, Lambda, Glue
Technical Skills and Requirements
- Work experience with ETL, Data Modeling, and Data Architecture.
- Experience with Big Data technologies such as Hadoop / Hive / Spark.
- Skilled in writing and optimizing SQL.
- Experience operating very large data warehouses or data lakes.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
Preferred Experience