What are the responsibilities and job description for the Big Data Engineer : Dell position at ShiftCode Analytics?
Interview : Video
Visa : All apart from H1b , cpt and TN
This is hybrid from day-1.
Description : Requirements :
- 5 years' experience in data engineering work
- Previous experience as a Big Data Engineer
- In-depth knowledge of Hadoop, Spark, Airflow
- Technical expertise with data models, data mining, and segmentation techniques
- Hands-on experience with SQL database, Redis
- Familiarity with Kubernetes and Docker tools
- Familiarity with S3, Apache Parquet and Apache Iceberg
- Understand how to extract data
- Experience with Graph databases
- Knowledge of programming languages (e.g. Python)
- Experience with Streaming - Kafka or RMQ
- Experience with Gitlab based CI / CD
- Experience with Data catalog
Added advantage :
Responsibilities :