Demo

Machine Learning Engineer (New York)

Skyfall AI
New York, NY Full Time
POSTED ON 3/3/2025
AVAILABLE BEFORE 6/2/2025

About the company

Skyfall is disrupting the entire AI ecosystem by building the first world model for the enterprise. The goal of the ‘Enterprise world Model’ is to overcome the severe limitations of LLMs (Safety, Hallucinations, Expensive training) in order to provide the enterprises significant value by having a comprehensive understanding of the complex interplay between data, people and processes with organizations.

The Skyfall founding team consists of Maluuba founders who were previously pioneers in the Deep learning revolution. Maluuba worked with AI pioneers such as Yoshua Bengio and Richard Sutton before it was acquired by Microsoft for $160M and became Microsoft’s AI research center in Canada.

Job Overview

Skyfall is hiring multiple ML Engineers to deploy and optimize large language models (LLMs) in production. You’ll be responsible for fine-tuned and RLHF-trained LLM deployment, optimizing inference for cost and latency, and building scalable training pipelines using DeepSpeed, Accelerate, and Ray. The role involves designing distributed training infrastructure, managing multi-cloud ML deployments, and implementing cutting-edge model compression techniques. Skyfall is hiring multiple ML Engineers across New York, Toronto and Bangalore.

Key Responsibilities

  • Deploy post-trained LLMs (fine-tuned or RLHF-trained) into production environments.
  • Optimize LLM inference for cost and latency, leveraging techniques like model quantization, FlashAttention, and vLLM.
  • Develop scalable training and inference pipelines using DeepSpeed, Accelerate, and Ray.
  • Build internal tools for the data science and research teams to enable multi-GPU training and large-scale experimentation.
  • Design and maintain distributed training infrastructure, ensuring efficient resource allocation.
  • Develop cluster management tools for external compute infrastructure, potentially spanning multiple cloud vendors.
  • Implement continuous model evaluation pipelines to track model drift, inference performance, and cost efficiency.
  • Research and implement state-of-the-art model compression and inference acceleration techniques.

Minimum Requirements

  • 3 years of experience in ML engineering, model deployment, and large-scale training.
  • Experience with vector databases (FAISS, Pinecone, Weaviate) for retrieval-augmented generation (RAG).
  • Experience with multi-cloud ML deployment across AWS, GCP, and Azure.
  • Hands-on experience deploying LLMs or similar large-scale models in a production setting.
  • Expertise in multi-GPU training, model parallelism, and inference optimizations.
  • Strong knowledge of ML system performance tuning, latency optimization, and cost reduction strategies.
  • Experience in building and managing large-scale ML clusters across cloud or hybrid environments.
  • Solid understanding of LLM fine-tuning techniques, RLHF, and model evaluation metrics.
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Machine Learning Engineer (New York)?

    Sign up to receive alerts about other jobs on the Machine Learning Engineer (New York) career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $77,900 - $95,589
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $179,606 - $233,815
    Income Estimation: 
    $211,413 - $298,244
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $149,493 - $192,976
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Not the job you're looking for? Here are some other Machine Learning Engineer (New York) jobs in the New York, NY area that may be a better fit.

    Senior Machine Learning Engineer

    Rose AI, New York, NY

    Machine Learning Engineer

    Aarna Software and Solutions LLC, New York, NY

    AI Assistant is available now!

    Feel free to start your new journey!