What are the responsibilities and job description for the Azure Data Engineer position at Headway Tek Inc?
Proficiency in Python, SQL, Databricks, Snowflake Data Modeling, ETL process, Apache Spark and PySpark, data integration and workflow orchestration, real time data processing experience/frameworks, Cloud experience (Azure preferred)
Job Description
- Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure]
- Experienced in migrating data from on-prem to cloud-based solution architectures [Azure]
- Extensive experience with Python, Spark and SQL
- Experience in developing ETL processes. Proficient with Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics or equivalent tools and technologies
- Experience building data lakes & data warehouses to support operational intelligence and business intelligence.
- Excellent written and verbal communication skills