Backend Engineer Focused on LLMs

Backend LLM Engineer at XILO

XILO, a fast-growing Vertical AI company recently backed by a Series A financing round, is seeking an experienced and innovative Backend LLM Engineer to join our team and lead advancements in Large Language Model (LLM) integration and performance.

About XILO

Founded in 2019 by two best friends, Jon and Eli, XILO set out to revolutionize the insurance industry by solving its biggest challenges. Eli, a brokerage owner, brought invaluable industry expertise, while Jon, an experienced software engineer, saw an opportunity to innovate using technology. Initially launched as a vertical SaaS solution addressing core quoting challenges, XILO has since evolved into a trailblazing Vertical AI company leveraging the latest AI technology to transform the industry. By layering cutting-edge AI solutions onto its SaaS platform, XILO is driving innovation far beyond its original vision. Having recently closed our Series A funding round, XILO is growing rapidly and seeking talented individuals who want to do career-defining work in a mission-driven startup that’s at the forefront of AI innovation.

About the Role

As a Backend LLM Engineer at XILO, you will be instrumental in optimizing the integration and performance of Large Language Models across our platform. You’ll lead efforts to enhance architecture, scalability, and security for LLM-based features while mentoring engineers to expand the capabilities of our AI-driven solutions. This is a hands-on role for someone passionate about cutting-edge AI technology and solving complex challenges.

Key Responsibilities:

• Design and optimize architecture for LLM-based features and services.
• Enhance database performance to support large-scale LLM operations.
• Implement industry-standard security measures for LLM data and interactions.
• Lead the LLM engineering team on key initiatives to improve AI features.
• Increase the efficiency, scalability, and accuracy of LLM-based models and services.
• Refine data feedback loops to enhance LLM model training and performance.

What We’re Looking For:

• Expertise in Large Language Models (LLMs) and their applications.
• Passionate coder who writes code daily.
• Proven ability to mentor junior engineers to mid-level and mid-level engineers to senior-level.
• Highly organized and capable of managing a wide array of tasks simultaneously.
• Strong communicator who engages with customers on multiple calls per month.
• Builds collaborative relationships with Product Management and Design teams.
• Team player with no ego and a mindset of continuous improvement.
• Relentless work ethic: doesn’t stop until the job is done and done right.
• Builds genuine relationships and motivates others positively.
• Balances leadership with hands-on contributions (player-coach mentality).
• Passionate about AI and the transformative potential of LLMs.

Why Join XILO?

Be part of a mission-driven team at the forefront of AI innovation. As a Backend LLM Engineer at XILO, you’ll have the opportunity to lead technical advancements in LLMs, mentor a talented team, and create impactful solutions in the insurance industry. At XILO, we don’t stop until the job is done. If you’re ready to roll up your sleeves, embrace challenges, and make a meaningful impact, we’d love to hear from you. Apply only if you’re ready to invest in your success and build a lasting career.