Demo

Director, Agent Research

Scale AI, Inc.
San Francisco, CA Full Time
POSTED ON 1/15/2025
AVAILABLE BEFORE 4/7/2025

About the Role

As Director of Agents Research, you will lead teams focused on developing LLM-based autonomous systems for real-world applications. In this hands-on technical leadership role, you'll oversee research initiatives and collaborate with engineering teams to bring innovations to production.

You'll play a key role in advancing our hybrid model-in-the-loop system, which currently processes tens of millions of data points for frontier labs and industry leaders monthly, with plans to scale to billions. Your expertise will drive R&D strategy across critical areas including :

  • Agent architecture development and scaffolding
  • Data collection workflows and management
  • Performance evaluation frameworks
  • Testing environments and benchmarking
  • Browser and SWE agent development

Leveraging Scale's unique position as a leader in frontier data, you'll drive the development of autonomous agents capable of handling complex tasks, ensuring our solutions meet high performance and scalability standards.

Responsibilities

  • Lead cutting-edge research in AI agent architectures and autonomous systems development.
  • Design scalable evaluation frameworks to measure and optimize agent performance across billions of tasks.
  • Transform research breakthroughs into production-ready ML solutions through close collaboration with engineering.
  • Drive thought leadership in AI agent research through publications and industry engagement.
  • Build and mentor a high-performing research team focused on pushing technological boundaries.
  • Qualifications

  • PhD in computer science, ML, or AI or equivalent experience.
  • 5 years leading technical research teams.
  • Strong publication record in top ML conferences.
  • Deep expertise in large-scale model training and deployment.
  • Successful track record building and managing high-performing research teams.
  • Advanced proficiency in PyTorch, TensorFlow, or Jax.
  • J-18808-Ljbffr

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Director, Agent Research?

    Sign up to receive alerts about other jobs on the Director, Agent Research career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $219,423 - $248,819
    Income Estimation: 
    $280,031 - $485,657
    Income Estimation: 
    $102,235 - $138,214
    Income Estimation: 
    $163,385 - $228,704
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Scale AI, Inc.

    Scale AI, Inc.
    Hired Organization Address Washington, DC Full Time
    Scale's Public Sector is growing and we are seeking a dynamic Director, Public Sector Deployment Strategy to spearhead t...
    Scale AI, Inc.
    Hired Organization Address Washington, DC Full Time
    At Scale, we believe that AI will dramatically improve the world, and our mission is to accelerate the development of AI...
    Scale AI, Inc.
    Hired Organization Address Washington, DC Full Time
    Military Writing Specialist Are you interested in teaching next-gen AI models to write about defense-related topics? Abo...
    Scale AI, Inc.
    Hired Organization Address New York, NY Full Time
    About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been th...

    Not the job you're looking for? Here are some other Director, Agent Research jobs in the San Francisco, CA area that may be a better fit.

    Director, Agent Research

    Tbwa Chiat/Day Inc, San Francisco, CA

    Director of Research

    Future Partners, San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!