Data Lead

Key Responsibilities:

• Lead migration of 40 years of legacy data to Azure Data Lake, utilizing medallion architecture (Bronze/Silver/Gold tiers).
• Separate active transactional data (Azure SQL) from archival/analytics data in the data lake.
• Develop and optimize pipelines for large-scale reporting and AI-driven analytics with high-quality datasets.
• Establish and enforce data governance policies to ensure compliance with privacy and security regulations.
• Oversee technical implementation using tools like Databricks, Azure Data Factory, and Delta Lake.

Ongoing Contributions:

• Build and maintain data pipelines to support reporting and analytics needs.
• Collaborate with infrastructure and DevOps teams for seamless backend integration.
• Document technical processes and governance frameworks for clients and internal teams.
• Provide strategic input for future data initiatives, including potential Master Data Product development.

Required Skills and Qualifications:

• Expertise with Azure Data Platform (Azure Data Lake, SQL, Data Factory), Databricks, Python, and Spark.
• Experience with ETL processes, medallion architecture, and large-scale data migrations (10 TB).
• Bachelor's degree in Computer Science or related field (or equivalent experience); Azure/Data certifications preferred.
• 7–10 years in data engineering or architecture, with industry experience in healthcare, government, or research as a plus.
• Strong leadership, client-facing communication, and problem-solving skills.