Databricks Tech Lead

Hi,

Our client is looking for a Databricks Tech Lead with a Long-Term Contract project in Hartford, CT below is the detailed requirement.

Position: Databricks Tech Lead

Location: Hartford, CT

Contract

Required Skills : Amazon DynamoDB, Amazon SQS, Amazon Lamda, AWS S3, Python, AWS Services, Data Factory, Databricks CLI, Databricks Workflows, Databricks Delta Lake, Databricks SQL, Databricks

Job Description:

• Over 12 years of experience in data management projects and minimum 5 years of professional experience with Databricks
• Lead the design, development, and maintenance of Databricks-based data platforms and pipelines
• Technical Requirements Gathering and Development of Functional Specifications.
• Design, develop, and maintain scalable data pipelines and ETL processes using AWS Databricks, Data Factory, and other AWS services.
• Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks..
• Leverage DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure.
• Must have excellent coding skills either Python or Scala, preferably Python.
• Work with architect and lead engineers for solutions to meet functional and non-functional requirements..
• Must have excellent coding skills either Python or Scala, preferably Python.
• Must have implemented at least 2 project end-to-end in Databricks.
• Experience working in MDM implementation is an asset
• Must have experience on Databricks consisting of various components like Delta lake, dbConnect and db API 2.0
• Databricks workflow orchestration - Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
• Must have good understanding to create complex data pipeline
• Must have good knowledge of Data structure & algorithms.
• Must have strong performance optimization skills to improve efficiency and reduce cost.
• Must have worked on both Batch and streaming data pipeline.
• Must have worked on AWS and most common services like S3,Lambda, CosmosDB/DynamoDB,SQS, Cloud databases.
• Must have strong communication skills and have worked leading a team of size five plus

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.