Data Engineering Lead

Details:

• Contract duration : 12 months, renewable
• The candidate must have architect level experience.
• Min 12 years of experience
• Consulting Environment
• End client: Retail

Scope:

• Lead and own end-to-end data projects—from understanding business needs to designing, implementing, and delivering scalable, automated data solutions that drive impact.
• Act as the go-to data expert, providing technical and strategic guidance to business users, solving complex data challenges, and ensuring high-quality analytics solutions.
• Collaborate with cross-functional teams, including product owners, architects, IT partners, and business stakeholders, to define data strategies and execute proof-of-concept (PoC) initiatives for new technologies and methodologies.
• Manage and engage with third-party vendors and technology partners, ensuring seamless integration, performance optimization, and risk mitigation.
• Play a key role in increasing the organization’s data maturity, driving adoption of best practices, governance frameworks, and scalable data architectures that empower self-service analytics.

Requirements:

• Education & Experience: Bachelor’s degree in Engineering, Computer Science, or equivalent, with 8 years of experience in Data Analytics, Data Warehousing, or Business Intelligence.
• Ability to translate business needs into scalable data solutions and influence cross-functional teams.
• Experience in a multi-vendor, geographically distributed environment with strong vendor management capabilities.
• Proven track record of leading data-driven initiatives, improving data maturity, and supporting production systems.

Mandatory:

• Strong SQL skills with expertise in MPP databases (Snowflake, BigQuery), RDBMS (PostgreSQL, MSSQL), and NoSQL databases (Cosmos DB, Elasticsearch).
• Hands-on experience with ETL/ELT pipeline development, using tools like dbt, Airflow, and Kubernetes.
• Familiarity with distributed data processing frameworks (Spark, Hadoop, Flink) and real-time messaging systems (Kafka, Azure Event Hub).
• Experience with CI/CD pipelines using GitHub Actions and deploying analytics solutions in cloud environments (Azure, Alicloud, GCP).
• Familiarity with BI tools such as PowerBI, Microstrategy, or Tableau.