What are the responsibilities and job description for the Data Engineer position at VRK IT Vision Inc?
I hope you are doing great!
Please find the below JD and revert me back ASAP!
Title : Data Engineer
Location : North Quincy, MA
Onsite / Hybrid : 3-Days hybrid
Visa type - H1b or H4-EAD or GC or USC.
JD for Data Engineer Position requirement :
Skillset : Spark, Scala
Skill Sets Required
- Good decision-making and problem solving skills
- Solid understanding of Databricks fundamentals / architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).
- Solid Knowledge on medallion architecture, DLT and unity catalog within Databricks.
- Experience in migrating data from on-prem Hadoop to Databricks / AWS
- Understanding of core AWS services, uses, and AWS architecture best practices
- Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
- Solid knowledge on Airflow
- Solid knowledge on CI / CD pipeline in AWS technologies
- Application migration of RDBMS, java / python applications, model code, OpenSearch etc.
- Solid programming background on scala and / or python with Spark
- Experience with Docker and Kubernetes is a plus
