What are the responsibilities and job description for the MLOps Engineer position at IDR, Inc.?
Job Details
IDR is seeking an MLOps Engineer to join one of our top clients in the Healthtech-startup space (fully remote). If you are looking for an opportunity to join a large organization and work within an ever-growing team-oriented culture, please apply today!
Position Overview:
We are looking for an experienced MLOps Engineer to support the development and scaling of ML infrastructure at a cutting-edge, AI-focused startup. This role will focus on automating, monitoring, and optimizing machine learning pipelines in a cloud-native environment, primarily using GCP and Kubernetes. You’ll work closely with data scientists, ML engineers, and DevOps teams to ensure scalable and reliable deployment of machine learning models.
Required Skills:
-
4 years of experience building MLOps solutions and ML infrastructure, ideally at a large-cap, AI-driven startup
-
Strong experience with GCP services, including Cloud Storage, Vertex AI, IAM, GKE, Compute Engine, and BigQuery
-
Expert-level knowledge of Kubernetes, GKE, and container orchestration for ML model deployment
-
Familiarity with monitoring and observability tools like Prometheus, Grafana, and OpenTelemetry
-
Hands-on experience automating infrastructure with Terraform
-
Experience implementing CI/CD pipelines for ML workflows (e.g., GitOps, Kubeflow Pipelines, MLflow)
-
Experience supporting multi-cloud or hybrid cloud ML deployments
Nice-to-Have Skills and Experiences:
-
Experience with Weights and Biases
-
Experience contributing to 0-1 ML infrastructure initiatives
-
Background in LLM fine-tuning and inference optimization (e.g., quantization, distillation)
-
Proficiency in LLM model serving frameworks such as TGI, VLLM, and SGLANG
What’s in it for you?
-
Work with cutting-edge ML infrastructure and deployment strategies
-
Fully remote work flexibility
-
Opportunity to shape infrastructure at an innovative, AI-driven startup
-
Collaborative and forward-thinking engineering culture
Why IDR?
-
Competitive compensation packages
-
Industry-leading benefits
-
Dedicated Engagement Manager who is committed to you and your success
-
Access to a network of top employers nationwide
Compensation Details: $60-65/hr W2
Salary : $60 - $65
