Senior Machine Learning Engineer - GenAI

Senior Machine Learning Engineer - GenAI

San Mateo or San Diego, CA (Hybrid)

The Role :

We are seeking a highly skilled and experienced Senior Machine Learning Engineer with a strong focus on large language models (LLMs), Retrieval-Augmented Generation (RAG), Fine-Tuning, and a general software development background. This role is pivotal in supporting the development and enhancement of our AI-powered solutions, particularly in cloud environments and with technologies such as Kubernetes, AWS Sagemaker, and Langchain / Llamaindex.

Our ideal candidate will have a proven track record of building and leveraging Gen-AI solutions to solve complex enterprise use cases while demonstrating both expertise and a deep passion for innovation in the field.

What you will do :

• RAG and Agent Optimization : Design, develop, and optimize standard RAG (via Corrective-RAG or Graph-Rag) and Agentic solutions (e.g., Langgraph) to solve enterprise use cases and enhance our existing products with Gen-AI.
• Model Deployment and Inference : Leverage ML-specific kubernetes workloads (e.g. kubeflow) or cloud managed solutions (e.g. AWS Sagemaker) to manage LLM deployment and serving workloads. Strive to continually optimize the LLM infrastructure and inference engine to keep improving inference quality and speed.
• Model Fine-Tuning : Lead data preparation and fine-tuning of LLMs via one or more of the following techniques - Supervised Fine-Tuning (SFT), Reinforced Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO).
• Prompt Engineering : Develop and fine-tune prompts to optimize the performance and accuracy of LLM integrations in various applications.
• Monitoring and Logging : Set up robust monitoring and logging for LLM inference and training infrastructure to ensure performance and reliability.
• LLM and RAG Evaluation : Design and wire up appropriate evaluation frameworks to compare and evaluate different LLMs, Embedding Models and RAG configurations.
• Security : Implement best practices for security in LLM and Embedding Model deployments and infrastructure management.
• Productize and Iterate : Work closely with Developer-Experience Engineers to test, iterate and productize new LLM capabilities to power different products and capabilities (e.g., chat, search, recommendation, agentic workflows and so on).
• Research and Innovation : Stay ahead of latest advancements in LLM and RAG space and continually explore opportunities to enhance our products and services.

What you will bring :

Good-to-have :

E-Verify : United States Employment Opportunities Only

E-Verify is an internet-based system operated by the Department of Homeland Security and the Social Security Administration and allows employers to confirm an individual's employment eligibility to work in the United States. Under the E-Verify rules, effective September 8, 2009, federal agencies subject to the Federal Acquisition Regulation are required to modify, and include in new contracts, a provision that requires federal contractors and subcontractors to use E-Verify. ITCO Solutions is required to adhere to these requirements.

ITCO Overview

Performance. Excellence, Value. Founded in 1997, our success is built on our relationships with our clients and our ability to deliver real value. ITCO Solutions is a technology services organization specializing in Workforce Solutions, Consulting Services, and Software Licensing.

At ITCO Solutions, our goal is to create a long-term relationship by providing quality service and delivering real value to our consultants and clients. We are not a staffing firm that will just submit resumes with little value. The ITCO team works directly with the hiring manager to understand requirements so we can deliver a consultant that fits.

Workforce Solutions Providing qualified IT talent to fill client resource needs, augment staff, and deliver projects on time. Engage ITCO Workforce Solutions to bolster the capacity of your IT staff and / or extend your capabilities beyond your existing skill sets.

Consulting Services Streamline your adoption of technology and ensure optimal investment with ITCO Consultants.

SmartSoft Licensing Solutions has set a new standard of value in helping companies maximize their purchasing power across the software spectrum.