Demo

Quality Engineer - AI

Millennium Management
Miami, FL Full Time
POSTED ON 2/21/2025
AVAILABLE BEFORE 5/19/2025

Quality Engineer - AI

We are seeking a highly technical and versatile Quality Engineer to join our team. This role will focus on developing and executing comprehensive test plans, automating test cases, and ensuring the quality of our cutting-edge AI software and tools. The ideal candidate possesses a strong understanding of AI / LLM concepts and a proven track record in software quality assurance. This candidate will have a unique opportunity to help shape and influence quality best practices on highly visible AI products in the firm.

Responsibilities :

  • Design, develop, and execute test plans and test cases for AI software and tools, covering functional, performance, and security aspects.
  • Automate test cases using Python and relevant testing frameworks.
  • Implement and maintain automated integration, regression, and end-to-end testing pipelines.
  • Work with OpenAI, Anthropic, and other vendor Model APIs, including API testing framework development and maintenance.
  • Utilize code quality frameworks like SonarQube to ensure code quality and maintainability.
  • Collaborate with development teams to identify and resolve software defects.
  • Contribute to the continuous improvement of our QA processes and methodologies.
  • Stay up-to-date with the latest advancements in AI / LLM testing and quality assurance.

Required Skills and Experience :

  • Strong proficiency in Python, including experience with testing frameworks (FastAPI experience is a plus).
  • Experience with front-end testing frameworks for Angular / React.
  • Proven experience working with OpenAI, Anthropic, and other vendor Model APIs, including API testing frameworks.
  • Hands-on experience with code quality frameworks like SonarQube.
  • Familiarity with container runtime environments like Kubernetes.
  • Expertise in automating integration, regression, and end-to-end testing.
  • Proficiency with synthetic testing and Realtime User Monitoring (RUM) tools.
  • Desired Skills and Experience :

  • Experience with AI / LLM Test Evaluation Harnesses.
  • Experience with benchmarking AI / RAG response quality and correctness.
  • Familiarity with various AI / LLM models and architectures.
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Quality Engineer - AI?

    Sign up to receive alerts about other jobs on the Quality Engineer - AI career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $83,806 - $99,902
    Income Estimation: 
    $101,442 - $121,314
    Income Estimation: 
    $63,871 - $78,758
    Income Estimation: 
    $83,431 - $103,091
    Income Estimation: 
    $49,118 - $61,709
    Income Estimation: 
    $54,807 - $71,603
    Income Estimation: 
    $83,431 - $103,091
    Income Estimation: 
    $106,113 - $127,991
    Income Estimation: 
    $106,113 - $127,991
    Income Estimation: 
    $127,094 - $153,876
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Millennium Management

    Millennium Management
    Hired Organization Address Miami, FL Full Time
    Software Engineer The role will be part of a global team that is responsible for the development of a real-time trade ca...
    Millennium Management
    Hired Organization Address New York, NY Full Time
    Senior Quantitative Developer Senior Quantitative Developer Millennium is a top tier global hedge fund with a strong com...
    Millennium Management
    Hired Organization Address New York, NY Full Time
    Operations Control SpecialistJob Function Summary Primary responsibilities will be around daily risk evaluation and cont...
    Millennium Management
    Hired Organization Address New York, NY Full Time
    Technology Asset Manager Millennium is seeking a talented and experienced Technology Asset Manager to join our team. As ...

    Not the job you're looking for? Here are some other Quality Engineer - AI jobs in the Miami, FL area that may be a better fit.

    Quality Engineer - AI

    Millennium, Miami, FL

    Generative AI Engineer

    GENIE AI, Miami, FL

    AI Assistant is available now!

    Feel free to start your new journey!