What are the responsibilities and job description for the Azure Databricks Architect position at Hecta Data LLC DBA Vilwaa?
Job Details
Job Description: Azure Databricks Architect Location: Las Vegas, NV(Onsite)
We are seeking a highly skilled and experienced Azure Databricks Architect to join our team. The ideal candidate will have a strong background in designing, implementing, and optimizing solutions using Azure Databricks. This role requires a deep understanding of Azure cloud services, Databricks architecture, and the ability to solve complex data engineering and analytics challenges.
Key Responsibilities:
Design and implement scalable, high-performance data solutions using Azure Databricks.
Architect and optimize data pipelines for batch and real-time data processing.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Provide expertise in Azure cloud services, including storage, networking, and security, to ensure robust and secure data solutions.
Troubleshoot and resolve performance, scalability, and reliability issues in Databricks environments.
Develop and enforce best practices for data engineering, data governance, and data security.
Mentor and guide junior team members on Databricks and Azure technologies.
Stay updated with the latest advancements in Azure, Databricks, and big data technologies to drive innovation.
Required Skills:
Proven experience as an Azure Databricks Architect or similar role.
Strong expertise in Azure cloud services (e.g., Azure Data Lake, Azure Synapse, Azure SQL, etc.).
In-depth knowledge of Databricks architecture, including cluster optimization, Delta Lake, and Spark.
Hands-on experience with data pipeline design, ETL/ELT processes, and data modeling.
Proficiency in programming languages such as Python, Scala, or SQL.
Strong problem-solving skills and the ability to troubleshoot complex technical issues.
Excellent communication and collaboration skills to work effectively with stakeholders and team members.
Preferred Skills:
Experience with CI/CD pipelines and DevOps practices for data solutions.
Knowledge of data governance and data security best practices in Azure.
Familiarity with machine learning workflows and integration with Databricks.
Certifications in Azure (e.g., Azure Solutions Architect, Azure Data Engineer) or Databricks.
