What are the responsibilities and job description for the Azure Data Engineer (Python, Scala, Spark, ETL) position at Artmac?
Who We Are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description
Job Title : Azure Data Engineer (Python, Scala, Spark, ETL)
Job Type : W2
Experience : 8-10 years
Location : Philadelphia, Pennsylvania
Responsibilities
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description
Job Title : Azure Data Engineer (Python, Scala, Spark, ETL)
Job Type : W2
Experience : 8-10 years
Location : Philadelphia, Pennsylvania
Responsibilities
- 6 to 12 years of experience in Python, Scala, Spark, ETL Design, and Implementation.
- Proven experience with Azure Synapse Analytics and Azure Data Factory.
- Expert-level certifications: Microsoft Certified: Azure Data Engineer Associate or Databricks Certified Data Engineer Associate.
- Intermediate knowledge of streaming data technologies (EventHub, IoT Edge, Kafka, Delta Live Tables, FiveTran HVR).
- Proficiency in Azure Data & Solution Architecture and awareness of the Azure Well-Architected Framework.
- Familiarity with Azure Administration and Azure Access Management.
- Strong analytical, problem-solving, and communication skills.
- Experience in optimizing data storage and retrieval performance.
- Knowledge of cloud security best practices in an Azure environment.
- Experience with CI/CD pipelines for data engineering workflows.
- Familiarity with data modeling and database design principles.
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
