What are the responsibilities and job description for the Sr. Databricks & Azure Data Platform Engineer position at Urpan Technologies, Inc.?
Job Details
Core skills
DATA BRICKS
Unity Catalog
Unity Catalog Governance
Data Governance
Data Modeling
Azure, AWS, ADF,
Spark, Py-Spark,
Spark Streaming,
ML, MLOPs,
Languages: Python, SQL, Scala, Shell Script, Java, ReactJS, HTML, CSS, PostgreSQL
Kafka
responsibilities -
-A senior technical expert responsible for designing, building, and optimizing data solutions using Databricks and Azure Data technologies.
-This principal engineer /Architect oversees the architecture, integration, design, development and deployment of reusable patterns and solutions ensuring that they are scalable, secure and efficient. -Responsible for managing the platform effectively with automation and leverage emerging capabilities in the marketplace.
-It requires proven experience of working with developers, analysts, and data scientists to implement data pipelines, real-time analytics machine learning models.
-This Architect / engineer ensures modern best practices are developed and adhered to in a cloud data ecosystem for data governance, data architecture and DataOps, while providing guidance on performance tuning, cost optimization and system Platform m reliability.
