What are the responsibilities and job description for the Databricks Architect at Las Vegas, NV position at smart folks inc?
Job Description
Job Description
Role : Databricks Architect
Location : Las Vegas, NV (Day 1 Onsite)
Contract
Job Description :
We are seeking a skilled and experienced Cloud Azure Databricks Architect to join our dynamic team. The ideal candidate will have extensive experience in building, managing, and optimizing data pipelines and solutions on Azure Databricks. They should also possess strong expertise in PySpark, Python, SQL, Unity Catalog, and excellent communication skills.
Key Responsibilities :
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Implement and manage Unity Catalog for data governance, access control, and metadata management.
- Create naming standards, guidelines, practical design patterns and frameworks for data processing.
- Optimize data pipelines for performance, scalability, and cost-effectiveness.
- Create documentation for data workflows, processes, and solutions.
- Communicate effectively with stakeholders to provide project updates and insights.
- Microservices & API Design : Experienced in designing scalable, loosely coupled architectures.
- Data & AI Strategy : Skilled in integrating data management and AI / ML components into architectural designs.
Required Skills and Qualifications :
