Demo

Tech Lead - Databricks Data Engineer

Derex Technologies Inc
Erie, PA Full Time
POSTED ON 1/17/2025
AVAILABLE BEFORE 4/15/2025

Job Description

Job Description

Company Description

Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients throughout North America.

With over two decades of unparalleled experience, Derex provides supports to its clientele, across such industries as Systems Integration, Banking and Finance, Telecommunications, Pharmaceutical and Life Sciences, Energy, Healthcare, Technology, Transportation, and local and federal Government agencies.

Job Description

Job Title : Tech Lead – Databricks Data Engineer

Location : PA (Onsite)

Primary skills : Advanced SQL, Azure Databricks, PySpark Azure Data Factory, Azure Datalake.

Secondary skills : Azure SQL, Azure Synapse.

About the job

We are seeking a Tech Lead – Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves managing large volumes of data, building complex ETL solutions, and working closely with business teams to deliver robust data transformations and analytics solutions.

Responsibilities :

  • Design and develop ETL pipelines using ADF for data ingestion and transformation.
  • Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.
  • Write SQL, Python, and PySpark code for efficient data processing and transformation.
  • Understand and translate business requirements into technical designs.
  • Develop mapping documents and transformation rules as per project scope.
  • Communicate project status with stakeholders, ensuring smooth project execution.

Requirements Must have :

  • 10-12 years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases.
  • Hands-on experience with Azure services : ADLS, Azure Databricks, Data Factory, Synapse, Azure SQL DB.
  • Experience in SQL, Python, and PySpark for data transformation and processing.
  • Familiarity with DevOps and CI / CD deployments.
  • Strong communication skills and attention to detail in high-pressure situations.
  • Experience in the insurance or financial industry is preferred.
  • Additional Information

    All your information will be kept confidential according to EEO guidelines.

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Tech Lead - Databricks Data Engineer?

    Sign up to receive alerts about other jobs on the Tech Lead - Databricks Data Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Derex Technologies Inc

    Derex Technologies Inc
    Hired Organization Address Illinois, IL Full Time
    Company Description Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software servi...
    Derex Technologies Inc
    Hired Organization Address Cincinnati, OH Full Time
    Company Description Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software servi...
    Derex Technologies Inc
    Hired Organization Address Jersey, NJ Full Time
    Job Description Job Description Company Description Derex Technologies Inc specializes in providing IT consulting, staff...
    Derex Technologies Inc
    Hired Organization Address Jefferson, MO Full Time
    Company Description Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software servi...

    Not the job you're looking for? Here are some other Tech Lead - Databricks Data Engineer jobs in the Erie, PA area that may be a better fit.

    AI Assistant is available now!

    Feel free to start your new journey!