Data Engineering Manager

Job Overview:

The Data Engineering Manager will lead the design, development, and optimization of the data infrastructure on Alibaba Cloud, leveraging tools like MaxCompute, Hologres, and PAI. This role manages data pipelines, ensures data integrity and security, and drives efficient data workflows across the organization. In addition, this role collaborates with cross-functional teams to support business objectives. The ideal candidate has deep expertise in big data warehousing, Alibaba Cloud tools, and a strong ability to adapt to other or emerging big data warehouse technologies (Databricks, GCP etc), ensuring a future-ready data infrastructure.

Responsibilities:

1. Data Infrastructure and Engineering

• Based on our existing data warehouse on Alicloud, enhance and revamp existing data architectures and data pipelines
• Design and manage robust, scalable data architectures on Alibaba Cloud, including Hologres and MaxCompute, to support the organization’s data needs
• Build, optimize, and maintain ETL/ELT processes to facilitate data ingestion, transformation, and loading across various data sources
• Lead integration of data from multiple systems into the data warehouse, ensuring seamless data flow and accessibility
• Evaluate and integrate new big data warehouse tools as they emerge, ensuring infrastructure can evolve with technological advancements

2. Team Leadership and Development

• Lead and mentor a team of data engineers, providing guidance on best practices, development standards, and technical solutions
• Manage project resources, timelines, and deliverables, ensuring projects align with business priorities and are completed on schedule
• Foster a culture of continuous learning and skill development within the team to keep up with industry best practices and evolving technologies

3. Data Governance & Compliance

• Implement processes and checks to ensure high data quality, accuracy, and consistency across systems
• Ensure data practices comply with regulatory and internal governance standards, working closely with data governance and security teams
• Oversee data security, manage user access, and maintain robust permissions frameworks in Alibaba Cloud environments

4. Collaboration and Strategy

• Work with data science, analytics, and business teams to understand data needs and translate them into actionable data engineering solutions
• Contribute to data strategy planning by identifying key opportunities for improving data infrastructure and aligning with business objectives
• Continuously monitor and optimize the data infrastructure to enhance performance, scalability, and cost efficiency on Alibaba Cloud

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or related field
• 7 years in data engineering, with at least 2 years in a management role, and strong expertise in Alibaba Cloud, particularly MaxCompute and Hologres
• Proficient in big data technologies (e.g., Hologres, MaxCompute, DataWorks, Flink), Strong SQL, Python, or Spark skills for data manipulation and processing
• Strong analytical, problem-solving, and project management skills; Excellent communication and collaboration abilities
• Ability to lead and mentor teams in a fast-paced environment
• Team player with strong collaboration skills, able to work effectively with both internal and external teams