Azure Data Engineer (Unity Catalog & Privacera) - w2 role

Job Description:

• Design and implement data architecture leveraging technologies such as Databricks, Unity Catalog, Privacera, and Collibra.
• Develop, optimize, and manage data pipelines for ETL processes using Databricks, with a focus on data integrity and quality.
• Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices.
• Ensure data security and compliance with regulations using Databricks and Privacera's features.
• Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices.
• Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups.
• Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions.