Demo

Junior AI/ML Engineer - LLM-Based Content Moderation

Trust and Safety Laboratory, Inc.
Palo Alto, CA Full Time
POSTED ON 2/17/2025
AVAILABLE BEFORE 5/15/2025

About TrustLab

Online misinformation, hate speech, child endangerment, and extreme violence are some of the world's most critical and complex problems. TrustLab is a fast-growing, VC-backed startup, founded by ex-Google, TikTok and Reddit executives determined to use software engineering, ML, and data science to tackle these challenges and make the internet healthier and safer for everyone. If you're interested in working with the world's largest social media companies and online platforms, and building technologies to mitigate these issues, you've come to the right place.

About the role

  • We are seeking an AI / ML Engineer with expertise in Large Language Models (LLMs) to enhance the precision and recall of classification systems detecting content abuse, including hate speech, sexual content, misinformation, and other policy-violating material. You will work with cutting-edge AI models to refine detection mechanisms, improve accuracy, and minimize false positives / negatives.

Responsibilities

  • Design, develop, and optimize AI models for content moderation, focusing on precision and recall improvements.
  • Fine-tune LLMs for classification tasks related to abuse detection, leveraging supervised and reinforcement learning techniques.
  • Develop scalable pipelines for dataset collection, annotation, and training with diverse and representative content samples.
  • Implement adversarial testing and red-teaming approaches to identify model vulnerabilities and biases.
  • Optimize model performance through advanced techniques such as active learning, self-supervision, and domain adaptation.
  • Deploy and monitor content moderation models in production, iterating based on real-world performance metrics and feedback loops.
  • Stay up-to-date with advancements in NLP, LLM architectures, and AI safety to ensure best-in-class content moderation capabilities.
  • Collaborate with policy, trust & safety, and engineering teams to align AI models with customer needs.
  • Minimum Qualifications

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
  • 1 years of experience in AI / ML, with a focus on NLP, deep learning, and LLMs.
  • Proficiency in Python and deep learning frameworks such as TensorFlow, PyTorch, or JAX.
  • Experience in fine-tuning and deploying transformer-based models like GPT, BERT, T5, or similar.
  • Familiarity with evaluation metrics for classification tasks (e.g., F1-score, precision-recall curves) and best practices for handling imbalanced datasets.
  • Preferred skills

  • Experience working with large-scale, real-world content moderation datasets.
  • Knowledge of regulatory frameworks related to content moderation (e.g., GDPR, DSA, Section 230).
  • Familiarity with knowledge distillation and model compression techniques for efficient deployment.
  • Experience with reinforcement learning (e.g., RLHF) for AI safety applications.
  • Opportunities and perks

  • Work on cutting-edge AI technologies shaping the future of online safety.
  • Collaborate with a multidisciplinary team tackling some of the most challenging problems in content moderation.
  • Competitive compensation, comprehensive benefits, and opportunities for professional growth.
  • The pay range for this role is :

    100,000 - 130,000 USD per year (Palo Alto)

    Salary : $100,000 - $130,000

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Junior AI/ML Engineer - LLM-Based Content Moderation?

    Sign up to receive alerts about other jobs on the Junior AI/ML Engineer - LLM-Based Content Moderation career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $66,993 - $81,397
    Income Estimation: 
    $87,578 - $109,717
    Income Estimation: 
    $55,835 - $70,896
    Income Estimation: 
    $69,949 - $89,401
    Income Estimation: 
    $69,949 - $89,401
    Income Estimation: 
    $87,760 - $112,265
    Income Estimation: 
    $87,760 - $112,265
    Income Estimation: 
    $109,928 - $139,218
    Income Estimation: 
    $109,928 - $139,218
    Income Estimation: 
    $114,231 - $148,398
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Trust and Safety Laboratory, Inc.

    Trust and Safety Laboratory, Inc.
    Hired Organization Address Palo Alto, CA Full Time
    About TrustLab Online misinformation, hate speech, child endangerment, and extreme violence are some of the world's most...

    Not the job you're looking for? Here are some other Junior AI/ML Engineer - LLM-Based Content Moderation jobs in the Palo Alto, CA area that may be a better fit.

    Senior AI/ML Engineer - LLM-Based Content Moderation

    Trust and Safety Laboratory, Inc., Palo Alto, CA

    AI Assistant is available now!

    Feel free to start your new journey!