What are the responsibilities and job description for the Azure Databricks Platform Architect position at Jobleads-US?
Job Overview:
Jobleads-US is seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of our enterprise-wide data platform.
Key Responsibilities:
- Lead the design, implementation, and optimization of our enterprise-wide data platform using Azure Databricks, Azure Data Lake, Azure Event Hub, and related Azure data services.
- Collaborate with internal technical teams to align solutions following operating procedures and Architecture principles.
- Create and maintain infrastructure-as-code (IaC) templates for reproducible and scalable data platform deployments.
Requirements:
- Expert-level knowledge of Python, SQL, Spark (PySpark), and Delta Lake.
- Strong understanding of data Lakehouse architecture principles, and cloud-native data processing and analytics solutions.
- Proficiency in infrastructure-as-code tools (Terraform, Github Actions) and integration with Github Enterprise for Code and Infrastructure deployments.
- Advanced knowledge of data modeling, performance tuning, and optimization techniques.
- Experience with design and implementation of ETL pipelines with Azure Databricks.
- Experience with design of Observability and Cost Management for the platform.
- Experience migrating data and code to use the new architecture and operationalizing the platform.
