What are the responsibilities and job description for the Senior Azure Data Engineer position at Purple Drive Technologies LLC?
Job Details
Senior Data Engineer
We are seeking a highly experienced Senior Azure Data Engineer with over 12 years of expertise in data warehousing. The ideal candidate will have extensive experience with the Azure platform, developing Azure Data Factory (ADF) pipelines, and working with PySpark. Knowledge of Databricks or Synapse is essential. Good to have MS Fabric experience.
Responsibilities
- Design and BuildData Pipelines: Develop and manage modern data pipelines and data streams using Azure Data
- Database Management: Develop and maintaindatabases, data systems, and processing systems.
- Data Transformation: Transform complex rawdata into actionable business insights using PySpark.
- Technical Support: Collaborate with stakeholders and teams to assist withdata-related technical issues.
- DataArchitecture: Ensure data architecture supports business requirements and scalability.
- Process Improvements: Identify, design, and implement process improvements, such as automating manual processes and optimizingdata
- BigData Solutions: Utilize Databricks or Synapse for big data processing and analytics.
Skills and Qualifications
- DataManagement and Storage: Proficiency with Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Blob Storage, etc.
- DataIntegration and ETL: Extensive experience with Azure Data Factory for data integration and ETL processes.
- BigData and Analytics: Knowledge of big data technologies like Azure Databricks and Synapse.
- Programming Languages: Proficiency in SQL, Python, and PySpark.
- Analytical Skills: Strong analytical and problem-solving skills.
- Communication: Excellent communication and teamwork skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Salary : $140,000 - $160,000
