Demo

Lead Data Engineer – Big Data

S&P Global
Dayton, NV Full Time
POSTED ON 3/10/2025
AVAILABLE BEFORE 6/10/2025

Salary : 118,094 - 237,100 USD per year

Requirements :

  • We require candidates to hold a BE, MCA, or MS degree in Computer Science or Information Technology, along with at least 10 years of experience as a Data Engineer in an innovative organization. A minimum of 5 years of hands-on experience in implementing data lake systems utilizing AWS / Azure cloud technologies such as S3, Databricks, Hive, and large-scale data analytics tools is essential. Candidates should have at least 3 years of expertise in building applications using data stream processing tools for ingestion pipelines for bulk and incremental data loads.
  • Experience in the Software Development Life Cycle (SDLC), including stakeholder management, risk management, and strategic management, is necessary, along with the ability to resolve issues and guide teams both technically and functionally. Proficiency in development frameworks, data integration technologies like Python and Scala, microservices, and API design and implementation is expected.
  • Candidates should possess hands-on experience in developing scalable data pipelines, with a focus on ETL and ELT concepts, and have deep experience with technologies such as Java / J2EE, C#, and cloud-native orchestration tools. Strong understanding of cloud-native architectures, best practices, Agile methodologies, and the ability to articulate and translate requirements into solutions are important. Excellent analytical thinking, along with strong interpersonal and communication skills, is also required.

Responsibilities :

  • As part of our team, I will design and build ingestion pipelines using ELT and schema-on-read in Databricks delta lake. I will develop "Transformations" aspects using the ELT framework to modernize our ingestion pipelines and build data transformations at scale. Providing technical expertise in the design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud technologies will be a core aspect of my role.
  • I will work closely with other data teams, including the Data Science team, to participate in the development of ingestion pipelines. Implementing data governance principles, conducting data quality checks, and ensuring data lineage throughout each data process will be my responsibility. I will stay informed on emerging trends in Big Data and cloud technologies and evaluate new technologies as needed. I will ensure compliance with enterprise standards and promote best practices that align with organizational standards.
  • Technologies :
  • Azure
  • Big Data
  • Cloud
  • Hive
  • Support
  • Java
  • Python
  • Scala
  • microservices
  • Java EE
  • Angular
  • DevOps
  • HTTP
  • Informatica
  • Jenkins
  • Linux
  • Machine Learning
  • SOAP
  • TensorFlow
  • Unix
  • More :

    At S&P Global Ratings, our analyst-driven approach provides critical insights necessary for translating complexity into clarity. Our ratings, research, and sustainable finance opinions empower market participants to uncover opportunities and make confident decisions. We are proud to support a diverse team of over 35,000 individuals globally, committed to fostering a collaborative environment where innovation thrives.

    Our purpose is to unlock possibilities and drive progress in a world that is increasingly complex. We prioritize integrity, discovery, and partnership in everything we do, ensuring that we support one another and our clients in achieving shared goals.

    We offer competitive compensation, extensive benefits covering health and wellness, flexible time off, continuous learning, and family-friendly perks. Our commitment to diversity, equity, and inclusion ensures that our workforce reflects the communities we serve, empowering everyone to bring their full selves to work. Join us in transforming data into Essential Intelligence and making a significant impact on the world.

    Salary : $118,094 - $237,100

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Lead Data Engineer – Big Data?

    Sign up to receive alerts about other jobs on the Lead Data Engineer – Big Data career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $184,796 - $233,226
    Income Estimation: 
    $179,606 - $233,815
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at S&P Global

    S&P Global
    Hired Organization Address Washington, DC Full Time
    About the Role : Grade Level (for internal use) : 09The Team : Commodity Insights seeks a US government-fluent reporter ...
    S&P Global
    Hired Organization Address MI Full Time
    About the Role : Grade Level (for internal use) : 15 Position Overview : The Head of APAC, Account Management will be re...
    S&P Global
    Hired Organization Address Princeton, NJ Full Time
    About the Role : Grade Level (for internal use) : The Role : Lead Java Engineer . The Team : Core Services is a global t...
    S&P Global
    Hired Organization Address Raleigh, NC Full Time
    About the Role : Grade Level (for internal use) : Please note : Proficient in Python, with experience using libraries li...

    Not the job you're looking for? Here are some other Lead Data Engineer – Big Data jobs in the Dayton, NV area that may be a better fit.

    Data Engineer

    Telligen Tech, Inc, South Lake Tahoe, CA

    Lead Data Analyst

    Lumen Inc, Carson, NV

    AI Assistant is available now!

    Feel free to start your new journey!