What are the responsibilities and job description for the ML Engineer with Unity Catalog / Databricks position at Hexplora?
Job Details
Title : ML Engineer with Unity Catalog / Databricks / Feature Store/ Java 11/ Python/ Kubernetes/
Location: Seattle ,WA (Hybrid -Flexible for remote)
Note :
JAVA SKILL IS CORE TO THIS ROLE AS CLIENT HAS FEW LEGACY APPLICATIONS IN JAVA
The ML Engineers will be supporting 3 web services applications - tech stack - Java 11// Python // Azure // AKS // APIM.
Client looking for an ML engineer with expertise in Unity Catalog and Feature Store in Databricks to help us build and maintain a solid foundation for our data and machine learning workflows. You will work on organizing data, managing access, and enabling machine learning models to operate efficiently in production
Responsibilities :
- Set up and manage Unity Catalog in Databricks to organize and secure data access across teams
- Design and operationalize Feature Stores to support machine learning models in production
- Build efficient data pipelines to process and serve features to ML workflows
- Collaborate with teams using Databricks, Azure Cosmos DB, and other Azure tools to integrate data solutions
- Monitor and optimize the performance of pipelines and feature stores
Required Skills:
- Strong experience with Unity Catalog in Databricks for managing data assets and access control
- Hands-on experience working with Databricks Feature Store or similar solutions
- Knowledge of building and maintaining scalable ETL pipelines in Databricks
- Familiarity with Azure tools like Azure Cosmos DB and ACR
- Understanding of machine learning workflows and how feature stores fit into the pipeline
- Strong problem-solving skills and a collaborative mindset
- Proficiency with Java
- Proficiency in Python and Spark for data engineering tasks
- Experience with monitoring tools like Splunk or Datadog to ensure system reliability
- Familiarity with AKS for deploying and managing containers
Infowave Systems is an equal opportunity employer that is committed to diversity and inclusion in the workplace.
