What are the responsibilities and job description for the LLM Specialist (Generative AI) position at ConglomerateIT?
Job Title: LLM Specialist (Generative AI)
Location: Remote
Employment Type: Full-Time Contract (W2/1099)
About Us
Conglomerate IT is a certified and a pioneer in providing premium end-to-end Global Workforce Solutions and IT Services to diverse clients across various domains. Visit us at http://www.conglomerateit.com
Our mission is to establish global cross culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of global network to connect business with the right people without bias. We provide Global Workforce Solutions with affability.
Job Summary
Key Responsibilities:
Lead end-to-end technical assessments of GenAI products-focusing on safety, neutrality & fairness
Design and implement LLM evaluation frameworks for performance and accuracy
Analyze model outputs (accuracy, coherence, ethical considerations, etc.)
Develop automated testing pipelines for efficient model evaluation
Generate data-driven insights to guide product iterations
Collaborate with ML engineers, data scientists, and product managers
Identify model performance gaps and recommend improvements
Stay updated on the latest in NLP, LLMs, and evaluation methodologies
Present findings through detailed reports and presentations
Ensure ethical AI practices: fairness, bias detection, compliance
Qualifications
Bachelor's or Master's in Computer Science, ML, Data Science, or related field (PhD preferred)
Strong NLP and ML foundation
Hands-on experience with LLMs (GPT, BERT, LLaMA, etc.)
Proficiency in Python and ML libraries (PyTorch, TensorFlow, Hugging Face)
Experience designing LLM evaluation metrics (BLEU, ROUGE, perplexity, etc.)
Familiarity with AI ethics and responsible AI practices
Strong analytical and data interpretation skills
Excellent written and verbal communication
Preferred Skills
Experience working with LLM APIs and fine-tuning models
Knowledge of A/B testing and user feedback loops
Prompt engineering and evaluation techniques
Data visualization skills for presenting evaluation results
Founded in 2014, ConglomerateIT is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry.
ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively.
As a strategic extension of ConglomerateIT, Conglomerate Healthcare specializes in international healthcare recruitment. Leveraging our global reach and deep industry expertise, we connect healthcare organizations with top-tier talent, including Physicians, Nurses, and Medical Technicians. Our carefully curated talent pool includes Western-qualified Physicians, licensed Nurses, and highly skilled Medical Technicians who bring excellence and expertise to healthcare facilities worldwide.
Key Healthcare Services
Location: Remote
Employment Type: Full-Time Contract (W2/1099)
About Us
Conglomerate IT is a certified and a pioneer in providing premium end-to-end Global Workforce Solutions and IT Services to diverse clients across various domains. Visit us at http://www.conglomerateit.com
Our mission is to establish global cross culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of global network to connect business with the right people without bias. We provide Global Workforce Solutions with affability.
Job Summary
Key Responsibilities:
Lead end-to-end technical assessments of GenAI products-focusing on safety, neutrality & fairness
Design and implement LLM evaluation frameworks for performance and accuracy
Analyze model outputs (accuracy, coherence, ethical considerations, etc.)
Develop automated testing pipelines for efficient model evaluation
Generate data-driven insights to guide product iterations
Collaborate with ML engineers, data scientists, and product managers
Identify model performance gaps and recommend improvements
Stay updated on the latest in NLP, LLMs, and evaluation methodologies
Present findings through detailed reports and presentations
Ensure ethical AI practices: fairness, bias detection, compliance
Qualifications
Bachelor's or Master's in Computer Science, ML, Data Science, or related field (PhD preferred)
Strong NLP and ML foundation
Hands-on experience with LLMs (GPT, BERT, LLaMA, etc.)
Proficiency in Python and ML libraries (PyTorch, TensorFlow, Hugging Face)
Experience designing LLM evaluation metrics (BLEU, ROUGE, perplexity, etc.)
Familiarity with AI ethics and responsible AI practices
Strong analytical and data interpretation skills
Excellent written and verbal communication
Preferred Skills
Experience working with LLM APIs and fine-tuning models
Knowledge of A/B testing and user feedback loops
Prompt engineering and evaluation techniques
Data visualization skills for presenting evaluation results
Founded in 2014, ConglomerateIT is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry.
ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively.
As a strategic extension of ConglomerateIT, Conglomerate Healthcare specializes in international healthcare recruitment. Leveraging our global reach and deep industry expertise, we connect healthcare organizations with top-tier talent, including Physicians, Nurses, and Medical Technicians. Our carefully curated talent pool includes Western-qualified Physicians, licensed Nurses, and highly skilled Medical Technicians who bring excellence and expertise to healthcare facilities worldwide.
Key Healthcare Services
- Physicians Recruitment: We connect healthcare facilities with Western-qualified physicians who deliver exceptional expertise and care.
- Nurses Recruitment: We identify and place highly qualified licensed nurses who meet the highest standards of care.
- Medical Technician Recruitment: We provide healthcare institutions with access to certified and skilled medical technicians who support critical healthcare operations.
