Demo

Senior Machine Learning Engineer

Harnham
Boston, MA Full Time
POSTED ON 4/8/2025
AVAILABLE BEFORE 5/7/2025

Senior Machine Learning Engineer (LLMs & Scalable Systems)

Location: Remote-first (with ~5 hours overlap with US Eastern Time)

Compensation: $200k base equity performance bonus


A fast-growing AI startup in the digital advertising space is looking for a Senior Machine Learning Engineer to lead the development and optimization of large language model (LLM) applications. This company is building transparent, customizable AI tools that allow advertisers to retain full control over their data while improving campaign efficiency across platforms. The company is NYC-based, but the technical teams are fully remote.


This is a unique opportunity to join a small, empowered technical team with a high degree of ownership, real impact, and no corporate red tape. Backed by a major global agency partner, the company is rapidly expanding and applying LLMs to uncover patterns in unstructured data, automate insights, and enable real-time optimization.


Key Responsibilities

  • Design, build, and deploy machine learning solutions leveraging LLMs and foundational models
  • Optimize embedding processes and reduce model runtime
  • Work with large-scale systems to deliver scalable, production-ready solutions
  • Run experiments and monitor model performance in live environments
  • Utilize cloud tools such as AWS, Databricks, and Snowflake for deployment and ML lifecycle management

In the First 90 Days

  • Build predictive models using demographic and behavioral data
  • Consolidate embedding pipelines and streamline performance
  • Significantly improve model efficiency and deployment workflows
  • Contribute to the next generation of LLM-powered features

Ideal Candidate Profile

  • Proven years of industry experience in machine learning, AI, or related fields
  • Master’s or PhD in Computer Science, Statistics, or similar
  • Deep experience with LLMs, foundation models, and libraries like Hugging Face
  • Skilled in writing production-level code, with experience in performance monitoring and testing
  • Proficient in object-oriented programming and working with APIs (REST, GraphQL, gRPC, etc.)
  • Background in large-scale system development is essential
  • Previous exposure to advertising or mentoring junior engineers is a plus

The Company Offers

  • Remote-first setup with flexible work hours
  • Competitive compensation: $200k base equity performance bonus
  • Unlimited PTO
  • Support for continuing education and professional growth
  • Two company off-sites per year
  • Collaborative, non-corporate environment


How to Apply


If this opportunity sounds interesting, and you fit the above requirements, send your resume to Virginia via the Apply link on this page.


Keywords:

LLMs | Foundation Models | Hugging Face | Embedding Optimization | Neural Networks | AWS | Databricks | Snowflake | Scalable Systems | Distributed Systems | GraphQL | REST APIs | gRPC | Model Deployment | Model Monitoring | MLOps | Predictive Modeling | Unstructured Data | Behavioral Data

Salary : $180,000 - $200,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior Machine Learning Engineer?

Sign up to receive alerts about other jobs on the Senior Machine Learning Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$77,900 - $95,589
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Harnham

Harnham
Hired Organization Address Hudson, NH Full Time
Director of Social Media Fitness & Wellness Location : Hybrid (Boston / NH) Compensation : $160,000–$180,000 bonus About...
Harnham
Hired Organization Address New York, NY Full Time
Are you looking to play a key role in a fast-growing FinTech startup? To build a cutting-edge platform from the ground u...
Harnham
Hired Organization Address New York, NY Full Time
Full Stack Engineer Financial Services NYC (Hybrid) $100,000 - $130,000 Bonus The Company We are partnering with a forwa...
Harnham
Hired Organization Address New York, NY Full Time
Senior Machine Learning Engineer - LLMs New York, New York 180,000-$200,000 base salary equity benefits Harnham is partn...

Not the job you're looking for? Here are some other Senior Machine Learning Engineer jobs in the Boston, MA area that may be a better fit.

Senior Machine Learning Engineer

Tech Stars Group LLC, Boston, MA

Senior Machine Learning Engineer

John Hancock, Boston, MA

AI Assistant is available now!

Feel free to start your new journey!