What are the responsibilities and job description for the Azure Data Enginer position at Quality Theorem?
Key Responsibilities:
- Design, implement, and maintain robust data pipelines for ingesting and processing data from various sources, including Azure Data Lake, on-premises systems, and cloud environments.
- Lead data migration projects, ensuring seamless integration from legacy systems to Azure-based solutions.
- Utilize Azure Stack and Fabric data tools to optimize data storage, retrieval, and management processes.
- Perform data transformation and manipulation using PySpark, T-SQL, and other SQL Server tools.
- Collaborate with the analytics and BI teams to integrate data into Power BI and Power Platform for enhanced business insights.
- Optimize and maintain MS SQL Server databases to ensure high performance and data security.
- Support logistics management through data modeling and developing scalable data solutions tailored to supply chain requirements.
Qualifications:
- Proficiency in Azure Data Stack (Azure Data Lake, AzureDB) and on-premises SQL Server.
- Strong experience with data transformation, T-SQL, and PySpark.
- Familiarity with Power BI and Power Platform for creating insightful data visualizations and dashboards.
- Background in logistics management or relevant experience in managing data for supply chain applications.
- Proven experience in managing data pipelines, ETL processes, and database management.
- Hands-on experience with Fabric data tools and other data storage solutions.
Salary : $130,000 - $175,000