Demo

Senior AI Engineer

observeinc.com
San Mateo, CA Full Time
POSTED ON 3/18/2025
AVAILABLE BEFORE 4/17/2025

Observe is a SaaS Observability product that enables businesses to investigate modern distributed applications 10x faster. Observe ingests anything with a timestamp (e.g. system and application logs, metrics, and traces), and then structures that data so that it is correlated and easy to navigate. We enable engineers to spend more time coding features and less time investigating incidents. Finally, because of Observe’s unique elastic architecture, it is priced based on usage, making it cost 10x less than incumbents.

Traditional approaches to this problem have resulted in fragmented tooling and fragile dashboards which, in turn, have resulted in exploding costs and complexity. At Observe, we believe that the core challenge lies in organizing and relating telemetry data emitted by those applications, despite the fact it is constantly changing. Solving this data problem makes observability an order of magnitude easier, faster, and less expensive. At Observe, we didn’t set out to build another monitoring tool company, we set out to build a data company. Observe is founded by top enterprise VC Sutter Hill Ventures and has a founding team from leading Enterprise SaaS companies Snowflake, Splunk, and Wavefront.

The AI team is a small team within Observe that is responsible for leveraging generative AI to help our customers understand their incidents faster. In order to make sense of huge quantities of unstructured data by extracting, summarizing, and retrieving information that is relevant to engineers investigating incidents, we have incorporated recent advances in generative AI into our product.

These use cases include :

  • A chatbot with hallucination guardrails that allows users to easily, and reliably, ask questions about our product, powered by an in-house RAG solution searching over our documentation.
  • An AI-powered extraction tool that makes it easy to automatically add structure to unstructured machine data with the click of a button.
  • Finetuning 7B LLMs to power our OPAL copilot (OPAL is our SQL-like temporal query language).
  • Automatic and efficient incident summarization.

We value collaboration, willingness to learn, and the ability to solve immediate problems quickly while building towards a long-term vision.

The Role :

  • Design, improve, and maintain AI features at Observe.
  • Finetune and serve LLMs in production.
  • Build AI agentic workflows to improve the observability of users’ systems.
  • Requirements :

  • 3 years of experience working in generative AI.
  • Master’s in Computer Science or related field.
  • Experience with RAG.
  • Experience evaluating LLMs and RAG systems.
  • Experience with Huggingface Transformers.
  • Worked on a model that’s been deployed in production.
  • Python expertise.
  • Great written and spoken English communication skills about technical topics.
  • Knowledge of the Python data science stack : (Scikit-Learn, Numpy, Pandas).
  • Preferred :

  • Experience building AI agents.
  • Experience pre-training and / or fine-tuning LLMs at the 1b scale.
  • Experience building scalable applications with LLMs, using frameworks such as LangChain, LlamaIndex, etc.
  • Experience working with adapters, e.g. LoRA.
  • Experience with Pytorch.
  • Experience with FastAPI or Flask.
  • Experience with LLM-powered synthetic data labelling and evaluation.
  • Experience in the observability domain.
  • Experience with data processing tools like Apache Spark, Huggingface Datasets, or similar.
  • Experience with Go.
  • Feel free to apply even if you don’t meet 100% of the requirements!

    J-18808-Ljbffr

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Senior AI Engineer?

    Sign up to receive alerts about other jobs on the Senior AI Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $149,493 - $192,976
    Income Estimation: 
    $112,672 - $149,113
    Income Estimation: 
    $115,719 - $153,093
    Income Estimation: 
    $137,343 - $165,639
    Income Estimation: 
    $135,811 - $184,429
    Income Estimation: 
    $120,390 - $162,969
    Income Estimation: 
    $67,172 - $106,823
    Income Estimation: 
    $87,954 - $124,905
    Income Estimation: 
    $54,658 - $80,222
    Income Estimation: 
    $85,711 - $119,978
    Income Estimation: 
    $116,765 - $144,626
    Income Estimation: 
    $142,836 - $179,016
    Income Estimation: 
    $65,674 - $90,812
    Income Estimation: 
    $74,161 - $98,561
    Income Estimation: 
    $92,249 - $117,370
    Income Estimation: 
    $88,359 - $121,264
    Income Estimation: 
    $113,076 - $148,099
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Not the job you're looking for? Here are some other Senior AI Engineer jobs in the San Mateo, CA area that may be a better fit.

    Senior Solution Engineer (AI)

    Relevance AI, San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!