What are the responsibilities and job description for the Data Bricks Consultant position at Zenith services?
Job Description :
We are looking for a highly skilled Databricks Consultant with handson experience in Databricks Pipeline Azure Cloud and PySpark . The ideal candidate will have a strong background in data engineering and cloud technologies working directly with our direct client in an onsite capacity.
Key Responsibilities :
Design develop and optimize Databricks pipelines for largescale data processing.
Implement and maintain PySparkbased data transformations .
Work with Azure Cloud services including Azure Data Lake Azure Data Factory and other data components.
Collaborate with data analysts and business teams to understand data requirements and deliver scalable solutions.
Ensure data security performance tuning and best practices in Databricks and Azure environments.
Required Skills & Qualifications :
8 years of experience in data engineering with handson Databricks expertise.
Strong proficiency in PySpark SQL and Python .
Experience working with Azure Cloud including Azure Data Lake Azure Data Factory and Azure Synapse .
Knowledge of CI / CD pipelines DevOps practices and version control tools like Git.
Strong problemsolving skills and ability to work in a fastpaced environment.
Excellent communication skills and ability to work onsite with stakeholders.
Key Skills
Abinitio,EAM,Crane,Cabling,ESL Teaching,Accident Investigation
Employment Type : Remote
Experience : years
Vacancy : 1