Demo

Staff Data Engineer

Obsidian Security
Palo Alto, CA Full Time
POSTED ON 4/12/2025
AVAILABLE BEFORE 5/2/2025

Job Description

Job Description

Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization.

Obsidian proudly offers the industry's most comprehensive and powerful SaaS defense solution. We are committed to solving the challenge of SaaS Security for our customers as efficiently and effectively as possible.

We're a passionate team optimizing for impact by solving some of the biggest challenges in cybersecurity today. We listen closely to our customers, iterate quickly, and (over) deliver to delight them. Working at Obsidian means contributing to an industry-leading cybersecurity product in an environment where customer satisfaction, privacy, and data ethics are paramount.

Obsidian is seeking an experienced Staff Data Engineer to build and extend our highly flexible, modern data stack built on dbt, DuckDB, Dagster, and Databricks. Our security engineers and researchers continuously ship new insights based on thousands of data sources and complex transformations with minimal friction.

This expert engineer is expected to have deep technical knowledge in data architecture, data semantics and software library design.

Who You Are :

  • You're a software engineer who is experienced in solving data problems with rigorous data semantics.
  • You enjoy building and architecting frameworks that are extensible and scalable.
  • You pride yourself in building highly performant data pipelines.

What You'll Do :

  • Architect and build computational frameworks exposing a new generation of data processing primitives, tackling :
  • customer-facing problems involving time travel, change detection, change attribution, and graph analysis.
  • incremental workloads enabling efficient processing of data-heavy security analyses.
  • Develop and maintain data pipelines for the acquisition, storage, and processing of heterogeneous data types, generating new features and feeding real-time machine learning models.
  • Work with security engineers and researchers to help solve cybersecurity questions.
  • Required skills / experience :

  • Expert level knowledge of Python and SQL.
  • Extensive knowledge of data engineering fundamentals; stream / batch processing, functional techniques, dimensional modeling, feature engineering.
  • Experience with data transformation frameworks such as dbt or SQLMesh is a strong plus.
  • Excellent knowledge of open table formats such as Delta Lake and Iceberg, and compute frameworks such as Spark.
  • Extensive experience with relational databases. Experience with graph processing or graph databases is a plus.
  • Experience with orchestrators such as Dagster, Prefect, or Airflow. Familiarity with Kubernetes is a strong plus.
  • Pay Transparancy

    Please note that the base pay range is a guideline and for candidates who receive an offer, the base pay will vary based on factors such as work location, as well as the knowledge, skills and experience of the candidate. In addition to a competitive base salary, this position is eligible for equity awards and may be eligible for incentive compensation based on factors such as experience, skills, and location.

    At Obsidian, we are proud to be an equal-opportunity employer. We value diversity and hire for talent, passion, and compassion. In compliance with federal law, all persons hired will be required to submit satisfactory proof of identity and legal authorization. If you have a need that requires accommodation, please contact accommodations@obsidiansecurity.com

    Information collected and processed as part of any job applications you choose to submit is subject to Obsidian's Applicant Privacy Policy.

    Pay Range

    179,000—$228,000 USD

    Employee Benefits :

    Our competitive benefits packages are designed to support our employees' well-being, both at work and at home.

  • Competitive compensation with equity and 401k
  • Comprehensive healthcare with dental and vision coverage
  • Flexible paid time off and paid holiday time off
  • 12 weeks of new parent or family leave
  • Personal and professional development resources
  • Salary : $179,000 - $228,000

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Staff Data Engineer?

    Sign up to receive alerts about other jobs on the Staff Data Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Obsidian Security

    Obsidian Security
    Hired Organization Address Stanford, CA Full Time
    Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the...
    Obsidian Security
    Hired Organization Address Stanford, CA Full Time
    Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the...
    Obsidian Security
    Hired Organization Address Boston, MA Full Time
    Job Description Job Description Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Securit...
    Obsidian Security
    Hired Organization Address Palo Alto, CA Full Time
    Job Description Job Description Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Securit...

    Not the job you're looking for? Here are some other Staff Data Engineer jobs in the Palo Alto, CA area that may be a better fit.

    Coders Data | Software Engineer

    Coders Data, Santa Clara, CA

    Coders Data | Software Engineer

    Coders Data, Sunnyvale, CA

    AI Assistant is available now!

    Feel free to start your new journey!