What are the responsibilities and job description for the Big Data Engineer position at ConsultNet?
Senior Data Engineer
Remote- must work standard EST hours
Long term contract / contract to hire
Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data Engineer role supports data delivery, serving, design, monitoring, and security management for data science, graph, and machine learning engineering teams.
Requirements
- 7 years of relevant experience
- Demonstrable AWS knowledge - EC2, ECS, Lambda, S3, EMR
- Strong programming ability in Python or Scala
- Experience with SQL and relational data
- 3 years experience in one or more big data technology : S3, HDFS, Spark, Presto, etc. SPARK preferred
- Experience designing and implementing ETL pipelines to support Data Science and / or Machine Learning.
Nice to have
