What are the responsibilities and job description for the Azure Data Engineering Manager position at Logix Guru?
We are seeking a highly motivated and experienced Data Engineering Manager to lead our data engineering team. As the Data Engineering Manager, you will be responsible for designing, building, and maintaining our robust, scalable, and reliable data infrastructure. You will play a pivotal role in empowering data-driven decision-making across the organization by ensuring the availability, quality, and performance of our data assets.
Responsibilities :
Leadership & Team Management :
1. Lead, mentor, and develop a team of data engineers, fostering a collaborative and innovative environment.
2. Set clear goals, provide performance feedback, and conduct performance reviews.
3. Recruit, onboard, and train new data engineering team members.
Drive team efficiency and effectiveness by promoting best practices in data engineering.
Data Infrastructure Design & Development :
1. Design and build scalable, robust, and reliable data pipelines for ingestion, processing, and storage of large datasets.
2. Develop and maintain data warehouses, data lakes, and other data storage solutions.
3. Implement and maintain data quality monitoring and alerting systems.
Technical Strategy & Roadmap :
1. Develop and execute the data engineering roadmap, aligning with the company's overall data strategy and business goals.
2. Evaluate and recommend new technologies and tools to improve data engineering capabilities.
3. Stay up-to-date with the latest trends and best practices in data engineering.
Collaboration & Communication :
1. Collaborate with functional leaders in Finance, Pricing, Operations, Sales, and Supply Chain to use data-driven methodologies to develop routines that improve margin, increase fill-rate, optimize inventory, and increase sales.
2. Communicate technical concepts clearly and effectively to both technical and non-technical audiences.
3. Promote data literacy and data-driven decision-making across the organization.
4. Participate in cross-functional meetings and contribute to overall project planning.
Required Skills & Experience :
- Bachelor’s degree in computer science, Data Science, or equivalent experience.
- 7 years of experience in data engineering, with at least 3 years in a leadership role.
- Proven experience in designing, building, and maintaining large-scale data pipelines and data warehouses.
- Strong proficiency in the following technologies :
- Cloud Platforms : Azure (preferred) Azure Data Lake Storage, Azure Data Factory, Azure Databricks
- Programming Languages : Python (required)
- Databases : SQL (required), Oracle, SQL Server
- Data Visualization : Tableau, Power BI
- Deep understanding of data modeling principles and best practices.
- Experience with data quality monitoring and data governance frameworks.
- Excellent problem-solving, analytical, and communication skills.
- Strong understanding of data security principles and best practices.
Preferred Skills & Experience :
