LLMOps Engineer - Cloud/Gen AI

Manifest Solutions is currently seeking an LLMOps Engineer - Cloud / Gen AI for an onsite position in Westerville, OH.

• Conceptualize, develop, and execute Machine Learning (ML) / LLM pipelines specifically for Large Language Models, including data acquisition, pre-processing, model training / tuning, deployment, and monitoring.
• Utilize automation tools such as GitOps, CI / CD pipelines, and containerization technologies (Docker, Kubernetes) to streamline ML / LLM tasks across the Large Language Model lifecycle.
• Establish robust monitoring and alerting systems to track Large Language Model performance, data drift, and other key metrics, proactively identifying and resolving issues.
• Perform truth analysis to assess the accuracy and effectiveness of Large Language Model outputs, comparing them to known, accurate data.
• Collaborate closely with infrastructure, DevOps teams, and Generative AI Architects to optimize model performance and resource utilization.
• Oversee and maintain cloud infrastructure (e.g., AWS, Azure) specifically for Large Language Model workloads, ensuring cost-efficiency and scalability.
• Stay current with the latest advancements in ML / LLM Ops, integrating these developments into generative AI platforms and processes.
• Communicate effectively with both technical and non-technical stakeholders, providing updates on the performance and status of Large Language Models.

Requirements :

Preferred Requirements :