What are the responsibilities and job description for the Senior Data Engineer (Azure) position at Allianz Trade in North America?
What you do:
The Senior Data Engineer (Azure) is responsible for design, build and maintenance of our Azure data platform to meet the needs of our data and analytics organization and serve the needs of key stakeholders and decision makers. The ideal candidate has a strong understanding of data architecture, data processing, and the Azure platform. You will report to the Manager of Data Engineering.
Key Responsibilities:
Technical
Proven ability to design and build complex, scalable, efficient, and reliable data pipelines in cloud
Strong programming skills in Python
Manage data lake environment, including blob storage
Help implement new data mapping, pipelines, and delivery
Experience developing interactive dashboards for monitoring data pipelines, and capturing systems performance metrics
Solid understanding of relational databases (Azure SQL), and NoSQL databases
Apply best practices for cloud-based performance, security, and cost optimization
Familiarity with CI/CD pipelines and version control
Strategic Thinking
Collaborate with analytics and data science teams to understand company needs and ensure our data platform can enable use cases across the business
Partner with data governance team and adhere to data governance policies and standards to ensure data integrity and compliance
Process and Documentation
Participate and help lead in all aspects of project lifecycle from requirement gathering, data modeling, development, deployment, and monitoring
Execute on and continuously improve team process, standards, documentations, and other best practices
What you bring:
4-5 years’ experience
Bachelor's degree
Experience in Azure cloud platform building data pipelines
Experience with Python and Spark
Experience with blob storage
Salary : $81,000 - $131,000