Databricks engineer only W2

Job Description

Responsibilities :

• 4 years of Databricks Experience
• 1 years of AirFlow Experience
• 1 years of IBM StreamSet Experience
• Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis / Kafka, and Lambda to build serverless applications.
• Solid understanding of Databricks fundamentals / architecture and hands-on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML, and SQL warehouse).
• Knowledge of medallion architecture, DLT, and unity catalog within Databricks.
• Experience in migrating data from on-prem Hadoop to Databricks / AWS.
• Understanding of core AWS services, uses, and AWS architecture best practices.
• Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
• Solid knowledge of Airflow.
• Solid knowledge of CI / CD pipeline in AWS technologies.
• Application migration of RDBMS, Java / Python applications, model code, elastic, etc.
• Solid programming background in Scala, Python, SQL.

Company Description

About Kyyba :

Founded in 1998 and headquartered in Farmington Hills, MI, Kyyba has a global presence delivering high-quality resources and top-notch recruiting services, enabling businesses to effectively respond to organizational changes and technological advances.

At Kyyba, the overall well-being of our employees and their families is important to us. We are proud of our work culture which embodies our core values; incorporating value, passion, excellence, empowerment, and happiness, creating a vibrant and productive atmosphere. We empower our employees with the resources, incentives, and flexibility that they need to support a healthy, balanced, and fulfilling career by providing many valuable benefits and a balanced compensation structure combined with career development.

J-18808-Ljbffr