What are the responsibilities and job description for the Software Engineer position at SourceOwls?
Back-End Engineer – Systems & AI Optimization
We’re building a cutting-edge, open-source platform to optimize large language model (LLM) applications, transforming real-world production data into smarter, faster, and more cost-effective models.
What We’re Building
Our platform creates a continuous learning loop for LLMs by integrating:
- A Unified Model Gateway – One API to access any LLM with near-zero overhead.
- Real-Time Feedback & Metrics – Seamless data collection for continuous improvement.
- Optimization Tools – Enhance prompts, models, and inference strategies.
- Built-In Experimentation Frameworks – A/B testing, routing, and fallback strategies.
- Observability & Optimization Pipelines – Insights that drive better model performance.
How We Got Here
We started development in early 2024, successfully piloted our technology by mid-year, and launched our open-source project in the fall. Backed by top-tier investors with deep expertise in AI and infrastructure, we have the resources and vision to define the future of LLM optimization.
The Role: Back-End Engineer (Rust & Systems Focus)
We’re looking for a Founding Member of Technical Staff with deep experience in systems engineering, particularly in Rust. This role isn’t just about engineering—it’s about building. We need someone who can bridge research and production, infrastructure and experimentation to push the boundaries of LLM optimization.
What You’ll Work On
- High-Performance Inference Optimization – Enhance inference efficiency at scale.
- Advanced Experimentation Frameworks – Enable routing, fallbacks, and testing strategies.
- Core Infrastructure Development – Build and refine our Rust-based architecture.
What We Offer
- Competitive Compensation – Salary, equity, and benefits.
- High-Impact, Open-Source Work – Your contributions will be widely visible.
- Fast-Growth Learning Environment – Expand your expertise across systems and AI.
- Collaborative, Hands-On Team – Work on-site in NYC with a tight-knit, ambitious group.
- Backed by Leading Investors – Strong funding and long-term vision.
Who You Are
- Systems Expert – Strong background in backend infrastructure (especially Rust).
- End-to-End Builder – Ability to drive large projects from concept to execution.
- Growth-Oriented – Eager to push boundaries and develop new skills.
- In-Person Team Player – Willing to work on-site in NYC with a highly focused team.
- If you’re excited to shape the future of LLM optimization and work at the intersection of AI, systems, and open-source innovation, we’d love to hear from you.
