What are the responsibilities and job description for the Data Engineer position at TechnoGen?
Requirement Details :
Position : Data Engineer
Location : Bentonville, Arkansas
Duration : Longterm
Primary Skills : SPARK,Java / Scala,SQL,Kafka,Airflow,GCP,BigQuery,Dataproc
Knowledge & Experience :
- Proficient in distributed computing ex : Spark with Java / Scala. Preferred to have Java over Scala
Proficient in SQL
Proficient in Kafka and Spark streaming
Experience in Workflow management using Airflow or similar tool
Experience in dealing with large volumes of data (Flat files, APIs and streaming)
Google Cloud Platform with BigQuery and DataProc is a plus
Knowledge in data modeling
