Software Engineer, LLM Platform

Lamini enables every enterprise to safely, quickly, and cost-effectively build their own Expert AI. Our customers own their own models, trained on their data. Lamini optimizes for Expert AI workloads with minimal hallucination, enterprise-grade security, and enterprise flexibility, running on any infrastructure. Our team is made up of highly committed engineers, researchers, and tech industry veterans excited by mission and technology. We’re backed by leading VCs as well as computing and technology companies.

• Design and implement core LLMs tuning and inference on Kubernetes: Design, build, and maintain an LLM platform on Kubernetes to support large language model tuning and inference, and other emerging LLM technologies. 
• Deep understanding of complex distributed systems: Debug complex distributed system bugs. Dive deep into complex distributed system problems on Kubernetes outside your direct access, for example, debugging on a customer’s own Kubernetes cluster without kubectl.
• Build complex system features to solve customer problems: Synthesize complex and diverse customer demands into core features that solve a category of problems. Keep close watch on technology development in the open source ecosystem, and provide forward thinking and roadmap.
• Collaborate with ML & app engineers and product managers on platform features: Work closely with machine learning engineers, application engineers, and product managers to understand requirements and implement solutions.

• Education: Bachelor’s degree in Computer Science or comparable fields.
• Communication: Excellent written and verbal communication. Effective information sharing to audiences with vastly different backgrounds.
• Experience: 4 years of professional software engineering experience. Built and shipped software in production environments. Demonstrated experience in building complex systems using open-source tools & systems on the Kubernetes platform; and evolving these systems to accommodate fast changing customer requirements.
• Broad understanding of the Kubernetes ecosystem. ML systems, data pipeline, workload management, CI/CD, observability; and hands-on experience in building micro-service systems on K8s using operators and other system components.
• Programming Languages: Proficient in Go/Python, or other comparable languages. Familiarity with multiple languages. Can work with multiple languages.
• Maintain good engineering quality: Clear and readable coding style in Python or comparable programming languages, ensure thorough and effective testing, comprehensive and straightforward documentation, holistic thinking of the long-term impact of the system.
• Team spirit: A collaborative mindset and desire to achieve top-tier results. To an inclusive team environment. Be serious, sharp focus, and be a solid team player.

• Experience in building LLM platforms or similar systems.
• Experience in training/tuning LLMs (pre-training, post-training, fine-tuning)
• Understand RAG, Agents, and other LLM application paradigms.
• Experience in delivering software products to enterprise customers.

At Lamini AI, we are committed to providing an environment of mutual respect where equal employment opportunities are available to all applicants without regard to race, color, religion, sex, pregnancy (including childbirth, lactation and related medical conditions), national origin, age, physical and mental disability, marital status, sexual orientation, gender identity, gender expression, genetic information (including characteristics and testing), military and veteran status, and any other characteristic protected by applicable law. Lamini AI believes that diversity and inclusion among our employees is critical to our success as a company, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. Selection for employment is decided on the basis of qualifications, merit, and business need.

Salary : $150,000 - $200,000