Demo

ML Platform Engineer

Bayone
Sunnyvale, CA Full Time
POSTED ON 3/5/2025
AVAILABLE BEFORE 5/21/2025

Please send only top two profiles for now. Kindly send with test report. Kindly send it to this email thread.

Client's exp. Is a plus.

Location : [Location / Remote Option]

Key Responsibilities :

  • Design and implement scalable model serving platforms for both batch and real-time inference
  • Build model deployment pipelines with automated testing and validation
  • Develop monitoring, logging, and alerting systems for ML services
  • Create infrastructure for A / B testing and model experimentation
  • Implement model versioning and rollback capabilities
  • Design efficient scaling and load balancing strategies for ML workloads
  • Collaborate with data scientists to optimize model serving performance

Technical Requirements :

  • 7 years of software engineering experience, with 3 years in ML serving / infrastructure
  • Strong expertise in container orchestration (Kubernetes) and cloud platforms
  • Experience with model serving technologies (TensorFlow Serving, Triton, KServe)
  • Deep knowledge of distributed systems and microservices architecture
  • Proficiency in Python and experience with high-performance serving
  • Strong background in monitoring and observability tools
  • Experience with CI / CD pipelines and GitOps workflows
  • Nice to Have :

  • Experience with model serving frameworks :
  • TorchServe for PyTorch models

  • TensorFlow Serving for TF models
  • Triton Inference Server for multi-framework support
  • BentoML for unified model serving
  • Expertise in model runtime optimizations :
  • Model quantization (INT8, FP16)

  • Model pruning and compression
  • Kernel optimizations
  • Batching strategies
  • Hardware-specific optimizations (CPU / GPU)
  • Experience with model inference workflows :
  • Pre / post-processing pipeline optimization

  • Feature transformation at serving time
  • Caching strategies for inference
  • Multi-model inference orchestration
  • Dynamic batching and request routing
  • Experience with GPU infrastructure management
  • Knowledge of low-latency serving architectures
  • Familiarity with ML-specific security requirements
  • Background in performance profiling and optimization
  • Experience with model serving metrics collection and analysis
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a ML Platform Engineer?

    Sign up to receive alerts about other jobs on the ML Platform Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $104,754 - $125,215
    Income Estimation: 
    $134,206 - $155,125
    Income Estimation: 
    $81,253 - $112,554
    Income Estimation: 
    $89,966 - $112,616
    Income Estimation: 
    $95,407 - $122,738
    Income Estimation: 
    $103,114 - $138,258
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $154,597 - $194,610
    Income Estimation: 
    $172,688 - $210,712
    Income Estimation: 
    $170,589 - $211,671
    Income Estimation: 
    $178,619 - $225,190
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $103,114 - $138,258
    Income Estimation: 
    $118,163 - $145,996
    Income Estimation: 
    $120,777 - $151,022
    Income Estimation: 
    $129,363 - $167,316
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $129,363 - $167,316
    Income Estimation: 
    $145,845 - $177,256
    Income Estimation: 
    $147,836 - $182,130
    Income Estimation: 
    $154,597 - $194,610
    Income Estimation: 
    $86,891 - $130,303
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Bayone

    Bayone
    Hired Organization Address Raleigh, NC Full Time
    Rate Negotiable M-F 8am-5pm (flexibility allowed) and Hybrid in office / remote Responsibilities : Calendar Management :...
    Bayone
    Hired Organization Address Houston, TX Full Time
    Position : Customer Success Manager Responsibilities : Sr Customer Success Manager - Provide oversight and orchestrate P...
    Bayone
    Hired Organization Address Santa Clara, CA Full Time
    Role : Network Engineer Automation Location : Bengloare - Remote South India Duration : Contract Role Must Have : Networ...
    Bayone
    Hired Organization Address Mountain View, CA Full Time
    About the job : As a UX writer, you are an advocate for Google design, shaping product experiences by creating useful, m...

    Not the job you're looking for? Here are some other ML Platform Engineer jobs in the Sunnyvale, CA area that may be a better fit.

    Lead Software Engineer - ML Platform

    Adobe Systems, San Jose, CA

    Staff Software Engineer, ML Platform

    Woven by Toyota, Palo Alto, CA

    AI Assistant is available now!

    Feel free to start your new journey!