Demo

Senior Big Data Engineer – Databricks

TALENT Software Services
Chicago, IL Full Time
POSTED ON 2/27/2025
AVAILABLE BEFORE 5/23/2025

Are you an experienced Senior Big Data Engineer – Databricks with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Senior Big Data Engineer – Databricks to work at their company 100% remotely.

Position Summary : This job takes the lead in providing complex application development services in the client's Google Cloud Platform environment, typically as part of a project team or in an application support role. Databricks Engineers analyze, design, code, test, and implement more complex systematic solutions to meet customer requirements that adhere to client's IT standards and policies. They also provide general support to maintain more complex applications that meet the service levels, system availability, performance, and quality levels required by their customers. Able to guide and mentor less experienced team members.

Primary Responsibilities / Accountabilities :

  • Takes a lead role in analyzing, designing, coding, testing, and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates, and budgets with minimal or no defects.
  • Utilizes and participates in the more complex full system development life cycle, per current client SDLC standards.
  • Takes a lead role in collaborating with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions. Concentrates on providing innovative solutions to more complex business needs.
  • Performs work in compliance with all client and client's IT standards, policies, and procedures.
  • Actively takes a leading role and participates on project teams in various project roles, including, but not limited to, Developer, Technical Lead, and Project Manager, based upon level of experience.
  • Effectively communicates with team members, customers, partners, and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions, and providing accurate and concise documentation.
  • Other duties as assigned or requested.

Qualifications :

  • Bachelor's degree in Information Technology, Computer Science or a closely related field
  • 5 years of experience as a developer
  • 3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows.
  • Deep understanding of Spark and its core concepts. They should be proficient in Spark programming Python, Pyspark
  • Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation. They should be familiar with ETL and have hands-on experience with data pipelines and data orchestration tools.
  • Expertise with GCP, including services like Google Cloud Storage, BigQuery, Pub / Sub, and Dataflow.
  • Problem-solving, root cause analysis, and issue resolution
  • Demonstrated leadership skills
  • Experience in Healthcare or Health Insurance Industry
  • Experience with Databricks, GCP, application development tools, business processes, software development life cycle used by client's enterprise
  • Preferred :

  • Master's degree in Information Technology, Computer Science, or a closely related field
  • 5 years of experience as a developer with demonstrated skills in : Databricks and Python / Pyspark
  • GCP : Big Query and PostgreSQL
  • Certifications such as Python, Databricks, GCP
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Senior Big Data Engineer – Databricks?

    Sign up to receive alerts about other jobs on the Senior Big Data Engineer – Databricks career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at TALENT Software Services

    TALENT Software Services
    Hired Organization Address Billings, MT Full Time
    GROUP/PROJECT INFO: Responsible for performing title release processes per the SOP guidelines Responsible for participat...
    TALENT Software Services
    Hired Organization Address Washington, DC Full Time
    MRI Technologist - Days (5x8s, No On-Call, Rotating Weekends, No Floating) 📌 Job Details: Start Date: ASAP Shift: 5x8s,...
    TALENT Software Services
    Hired Organization Address Baltimore, MD Full Time
    Job Details Shift: 3x12 Nights – 1830-0700 On Call/Weekend Requirement: No on call requirement, every other weekend requ...
    TALENT Software Services
    Hired Organization Address Clinton, MD Full Time
    1E MS/TELE FLOAT - Nights (36HRS, 12N, Every Other Weekend & Holidays as Needed) 📌 Job Details: Start Date: 3/24 Shift:...

    Not the job you're looking for? Here are some other Senior Big Data Engineer – Databricks jobs in the Chicago, IL area that may be a better fit.

    Data Engineer - Databricks - Senior

    Lumenalta, Chicago, IL

    Senior big data engineer

    Automation & Robotic Technologies, Chicago, IL

    AI Assistant is available now!

    Feel free to start your new journey!