Demo

Lead Data Engineer

Windfall
San Francisco, CA Full Time
POSTED ON 1/23/2025
AVAILABLE BEFORE 4/21/2025

Windfall is seeking a Lead Data Engineer to join our core data team. As a Lead Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering teams. You will personally design and build the pipelines for massive datasets, taking them all the way from inception to exploration to production and customer use.

We're on a mission to change how organizations perceive and use people data. And we hold true to our core values of : (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Make a difference every day; and (5) Act with integrity and trust.

Responsibilities :

  • Construct data pipelines to ingest and merge billions of individual entities into Windfall's core data asset
  • Work closely with our data science team to run ML models on top of billions of data points
  • Build supporting data services and applications to orchestrate and monitor our data systems

Some technology you will use :

  • Cloud platform - GCP
  • Programming languages - Java, Python, and Kotlin
  • Data warehouse & databases - BigQuery, Postgres, Scylla / Cassandra
  • Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
  • Orchestration - Airflow
  • Requirements :

  • 8 years of professional data engineering experience
  • Significant experience working with Apache Beam / Spark / Flink or MapReduce
  • Strong Object-oriented programming ability in a JVM language
  • Expert knowledge of distributed data processing
  • Familiarity with different datastores, their differences, and appropriate usages
  • Experience at a sub-200 person company
  • You communicate as well as you code
  • You can simplify complex problems into simple solutions
  • You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
  • You are comfortable making trade-offs between quality, complexity, and speed-of-delivery
  • Preferred Qualifications :

  • Previous experience in a player-coach role
  • Proven experience taking a large project from ideation to production
  • Experience leading greenfield projects
  • Working knowledge of cloud-native data engineering infrastructure
  • Additional Information :

    The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across California and Colorado. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. We also offer a comprehensive benefits package, which you can explore on our careers site.

    California : Salary range is $170k - $240k

    Colorado : Salary range is $150k - $220k

    About Windfall

    Windfall is a people intelligence and AI company that gives go-to-market teams actionable insights. By democratizing access to people data, organizations can intelligently prioritize go-to-market resources to drive greater business outcomes. Powered by best-in-class machine learning and propensity modeling, Windfall activates insights into workflows that engage the right people for each respective organization. More than 850 data-driven organizations use Windfall to power their business.

    We comply with CCPA. For more information on how we comply, review our privacy notice.

    Salary : $150,000 - $220,000

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Lead Data Engineer?

    Sign up to receive alerts about other jobs on the Lead Data Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Windfall

    Windfall
    Hired Organization Address Missoula, MT Full Time
    The ideal candidate will have strong creative skills and a portfolio of work which demonstrates their passion for illust...
    Windfall
    Hired Organization Address San Francisco, CA Intern
    As an Intern on the Product team, you will partner closely with fellow leaders in engineering, marketing, sales, and cus...
    Windfall
    Hired Organization Address San Francisco, CA Full Time
    As a Sr. Product Manager on the core data team, you will partner closely with fellow leaders in engineering, marketing, ...
    Windfall
    Hired Organization Address Missoula, MT Full Time
    Windfall, Inc. is a full-service creative agency that aims to tell stories and spread messages that inspire change. We l...

    Not the job you're looking for? Here are some other Lead Data Engineer jobs in the San Francisco, CA area that may be a better fit.

    Software Engineer III

    Lead Bank, San Francisco, CA

    Data Engineer

    Entertainment Data Oracle (EDO), San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!