What are the responsibilities and job description for the Azure Data Engineer - ETL & Real-Time Processing Specialist position at Artmac?
Who We Are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description
Job Title : Azure Data Engineer - ETL & Real-Time Processing Specialist
Job Type : C2C
Experience : 6-8 years
Location : Cincinnati, Ohio
Responsibilities
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description
Job Title : Azure Data Engineer - ETL & Real-Time Processing Specialist
Job Type : C2C
Experience : 6-8 years
Location : Cincinnati, Ohio
Responsibilities
- Minimum 5 years of experience in a Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure]
- Experienced in migrating data from on-prem to cloud-based solution architectures [Azure].
- Proficiency in Python, SQL, Databricks, Snowflake Data Modeling, ETL process, Apache Spark and PySpark, data integration and workflow orchestration, real-time data processing experience/frameworks, Cloud experience (Azure preferred)
- Extensive experience with Python, Spark, and SQL.
- Experience in developing ETL processes. Proficient with Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics, or equivalent tools and technologies
- Experience building data lakes & data warehouses to support operational intelligence and business intelligence.
- Excellent written and verbal communication skills.
- Bachelor’s degree in Computer Science, Information Security, or a related field.
