What are the responsibilities and job description for the QA Lead-Chat bot - Gen AI position at ConglomerateIT LLC?
Job Title: QA Lead Chatbot & Gen AI
Tax Term: 1099 , W2 Only
Location: Costa Mesa CA
Employment Type: Contract
About us
Conglomerate IT is a certified and a pioneer in providing premium end-to-end Global Workforce Solutions and IT Services to diverse clients across various domains. Visit us at http://www.conglomerateit.com
Our mission is to establish global cross culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of global network to connect business with the right people without bias. We provide Global Workforce Solutions with affability.
Job Summary:We are looking for a QA Lead with expertise in Generative AI (GenAI) and Chatbot Testing to lead quality assurance efforts for AI-driven applications. The ideal candidate will have a strong background in Functional, UI, API Testing, and preferably Automation Testing. Prior experience in a client-facing role and leadership in test management is highly desirable. Key Responsibilities:
- Lead and manage the end-to-end testing strategy for Chatbot and GenAI applications.
- Perform Functional, UI, and API testing to ensure optimal chatbot performance and user experience.
- Validate Large Language Model (LLM) behavior, accuracy, response quality, and contextual relevance.
- Collaborate with cross-functional teams, including developers, data scientists, and product managers, to define quality standards.
- Design and execute test cases, track defects, and drive continuous improvements in AI model testing.
- Implement automation testing frameworks (if applicable) to optimize testing efforts.
- Provide detailed test reports, insights, and recommendations to stakeholders.
- Ensure compliance with AI ethics, security, and data privacy best practices.
- Guide and mentor the QA team while managing project timelines and deliverables.
- Strong expertise in Functional, UI, and API testing.
- Good understanding of GenAI, Chatbot Testing, and LLM evaluation methodologies.
- Experience in client-facing roles with excellent communication and stakeholder management skills.
- Knowledge of test automation (preferred but not mandatory).
- Familiarity with tools like Postman, Selenium, JIRA, TestRail, or similar.
- Ability to work in agile environments and lead testing efforts across multiple teams.
Founded in 2014, ConglomerateIT is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry.
ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively.
As a strategic extension of ConglomerateIT, Conglomerate Healthcare specializes in international healthcare recruitment. Leveraging our global reach and deep industry expertise, we connect healthcare organizations with top-tier talent, including Physicians, Nurses, and Medical Technicians. Our carefully curated talent pool includes Western-qualified Physicians, licensed Nurses, and highly skilled Medical Technicians who bring excellence and expertise to healthcare facilities worldwide.
Key Healthcare Services- Physicians Recruitment: We connect healthcare facilities with Western-qualified physicians who deliver exceptional expertise and care.
- Nurses Recruitment: We identify and place highly qualified licensed nurses who meet the highest standards of care.
- Medical Technician Recruitment: We provide healthcare institutions with access to certified and skilled medical technicians who support critical healthcare operations.
Conglomerate Healthcare operates as an integral part of ConglomerateIT's mission to deliver excellence across multiple sectors, further solidifying our position as a global leader in recruitment and IT solutions.
