Demo

Machine Learning Engineer

North
New York, NY Full Time
POSTED ON 2/28/2025
AVAILABLE BEFORE 5/25/2025

About North

The public cloud is home to $200B in annual technology spend, yet 95% of it is still managed with credit cards and spreadsheets. With AI accelerating cloud growth towards $1T by 2030, businesses need better tools to manage, optimize, and scale their cloud investments.

At North, we’re building the next-generation cloud spend management platform, giving companies clarity, control, and automation over their cloud finances. Our mission is to help organizations take charge of their cloud costs and maximize efficiency in the AI-driven era.

Backed by top-tier investors and trusted by leading customers like Brave, StayNTouch, and DataBiologics, we’re assembling a world-class team to redefine how businesses manage cloud spend. If you’re looking for impact, growth, and the opportunity to shape the future of cloud finance, North is the place to be.

About the role

We’re looking for a Machine Learning Engineer to join our team and play a key role in developing, deploying, and optimizing our AI capabilities. You’ll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.

This is a hands-on, senior-level role—perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you’re a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we want to hear from you.

What you’ll do

  • Design, build, and deploy ML models for cloud automation and optimization
  • Work with LLMs, fine-tuning, optimizing, and integrating them into our platform
  • Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
  • Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
  • Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
  • Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
  • Collaborate with engineering, product, and leadership teams to align AI development with business goals.
  • Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
  • Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North’s AI capabilities.

What you’ll need

  • 5 years of hands-on experience in ML, AI model development, and infrastructure deployment.
  • Experience with Terraform and Git for infrastructure management and version control.
  • Strong Python skills (bonus if you’re comfortable with Go, SQL).
  • Proficiency with ML frameworks like PyTorch, Hugging Face, LangChain, vertex databases, and open source models like Llama.
  • Experience deploying ML models at scale (cloud-based, distributed systems, or edge deployments).
  • Security-first mindset—deep understanding of AI security risks and best practices.
  • Ability to move fast and iterate, taking ideas from concept to production.
  • Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
  • Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.
  • A proactive, solution-oriented mindset—you’re not just an executor, but a thought leader who can challenge assumptions and improve the product.
  • Nice to haves

  • Experience working in a startup
  • Built and deployed ML products or features in a production environment
  • Hands-on implementation experience—we need builders, not just strategists
  • Experience working with financial cloud data across GCP, AWS, and Azure
  • Past experience in a cloud financial project or role
  • AWS technical certification (or equivalent cloud certification)
  • Experience deploying models in Amazon Bedrock or on AWS
  • Work location

    This is a hybrid role in our New York office (in West Village). You will work part of the time in the office and part of the time remote / work-from-home.

    Benefits (for U.S.-based full-time employees)

  • Unlimited PTO.
  • NYC office access—work in West Village as desired.
  • 16-week fully paid parental leave (mothers can extend to 20 weeks at 50% pay).
  • Mandatory company-wide breaks : last week of August & Dec 23–Jan 3.
  • Healthcare : Anthem BlueCross Gold PPO, 75% employer-covered.
  • 30-day sabbatical every 4 years.
  • Ramp credit card for approved expenses.
  • Compensation

    The base pay for this role is : $160k-$220k per year. Actual compensation may vary and will be based on a candidate's qualifications, skills, experience, and location.

    Join us!

    If you’re a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we’d love to hear from you. Apply today.

    Salary : $160,000 - $220,000

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Machine Learning Engineer?

    Sign up to receive alerts about other jobs on the Machine Learning Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $103,114 - $138,258
    Income Estimation: 
    $118,163 - $145,996
    Income Estimation: 
    $120,777 - $151,022
    Income Estimation: 
    $129,363 - $167,316
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $129,363 - $167,316
    Income Estimation: 
    $145,845 - $177,256
    Income Estimation: 
    $147,836 - $182,130
    Income Estimation: 
    $154,597 - $194,610
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $149,493 - $192,976
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at North

    North
    Hired Organization Address New York, NY Full Time
    About North ( The public cloud is home to $200B in annual technology spend, yet 95% of it is still managed with credit c...
    North
    Hired Organization Address Dubuque, IA Full Time
    Who We Are We are an industry leader in merchant services. We are highly rated with the Better Business Bureau and have ...
    North
    Hired Organization Address New York, NY Full Time
    About North The public cloud is home to $200B in annual technology spend, yet 95% of it is still managed with credit car...
    North
    Hired Organization Address New York, NY Full Time
    About North The public cloud is home to $200B in annual technology spend, yet 95% of it is still managed with credit car...

    Not the job you're looking for? Here are some other Machine Learning Engineer jobs in the New York, NY area that may be a better fit.

    Machine Learning Engineer

    Arthur, New York, NY

    Machine Learning Engineer

    Hillview Consulting Solutions, New York, NY

    AI Assistant is available now!

    Feel free to start your new journey!