Demo

Azure Data Engineer - Exp. w/ Databricks & Data Factory

AmeriHealth Caritas
Newtown, PA Full Time
POSTED ON 2/17/2025
AVAILABLE BEFORE 5/14/2025

Responsibilities

  • Build and maintain scalable automated data pipelines. Support critical data pipelines with a highly scalable distributed architecture - including data ingestion (streaming, events and batch), data integration, data curation.
  • Strong experience as an Azure Data Engineer and must have Azure Databricks and Azure Data Factory experience.
  • Demonstrated experience of turning business use cases and requirements into technical solutions.
  • Expert level understanding on Azure Data Factory, SQL, ADLS, Azure Databricks, PySpark, Azure DevOps, Kafka, Python is required.
  • Experience in business processing mapping of data and analytics solutions.
  • Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
  • The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
  • HVR, Snowflake, Azure Synapse, SQL Server, Collibra Governance tools is a plus.
  • Experience preparing data for Data Science and Machine Learning.
  • Experience preparing data for use in Azure Databricks.
  • Demonstrated experience preparing data and building data pipelines reusable components and frameworks.
  • Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data needs.
  • Identify and tackle issues concerning data management to improve data quality.
  • Understand and implement best practices in management of data, including master data, reference data, metadata, data quality and lineage.
  • Strong knowledge of Dev-Ops processes (including CI / CD) and Infrastructure as code is essential.
  • Strong team collaboration and experience working with remote teams.
  • Experience with Git / TFS / VSTS is a must.

Qualifications / Education :

  • At least five (5) years of experience with Azure Data Engineering.
  • At least four (4) years of hands-on experience in Azure Databricks and Azure Data Factory.
  • At least five (5) years of experience programming in Python, PySpark, Scala, Shell, T-SQL etc.
  • Experience as Data Engineer in Azure Big Data Environment.
  • Expertise in ETL tools i.e. (SSIS, Data Stage).
  • Expertise in Implementing Data Warehousing and Data Lake Solutions.
  • Experience with working in Agile environment as part of a scrum team.
  • Hands-on experience in Azure stack and hands-on experience on HVR, Kafka and Snowflake.
  • Good understanding of Azure Databricks platform and ability to build data analytics solutions to support the required performance & scale.
  • Good understanding and experience working on Deltalake using Apache Delta and Unity Catalog in Azure Databricks.
  • Experienced working on performance tuning and optimizing long running jobs.
  • Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment.
  • Solid understanding of Modern Data Warehouse and Data Warehousing concepts.
  • Proficient in a source code control system.
  • Bachelor’s degree in technology, related field or equivalent combination of education and relevant work experience.
  • Diversity, Equity, and Inclusion

    At AmeriHealth Caritas, everyone can feel valued, supported, and comfortable to be themselves. Our commitment to equity means that all associates have a fair opportunity to achieve their full potential. We put these principles into action every day by acting with integrity and respect. We stand together to speak out against injustice and to break down barriers to support a more inclusive and equitable workplace. Celebrating and embracing the diverse thoughts and perspectives that make up our workforce means our company is more vibrant, innovative, and better able to support the people and communities we serve.

    We keep our associates happy so they can focus on keeping our members healthy.

    Our Comprehensive Benefits Package

    Flexible work solutions including remote options, hybrid work schedules, Competitive pay, Paid time off including holidays and volunteer events, Health insurance coverage for you and your dependents on Day 1, 401(k) Tuition reimbursement and more.

    Generous paid time off and paid volunteer time off.

    Employer-matched 401(k) and additional non-elective contributions, starting on day one.

    Medical, dental, and vision plans — with coverage starting on day one.

    Employee assistance programs, fitness reimbursements, nutrition counseling, and more.

    Employer-paid life insurance, with opportunities to purchase additional coverage.

    Employer-paid short-term disability coverage and long-term disability coverage.

    Tuition assistance, including reduced tuition at certain schools.

    Financial assistance with adoption, including paid time off.

    Flexible spending and health savings accounts to pay for qualified expenses.

    Discount programs on entertainment, travel, and more.

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Azure Data Engineer - Exp. w/ Databricks & Data Factory?

    Sign up to receive alerts about other jobs on the Azure Data Engineer - Exp. w/ Databricks & Data Factory career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at AmeriHealth Caritas

    AmeriHealth Caritas
    Hired Organization Address Remote, OR Full Time
    Responsibilities The position of Medical Economics Consultant reports to the Manager of Medical Economics & Business Pro...
    AmeriHealth Caritas
    Hired Organization Address Southfield, MI Full Time
    Your career starts now. We’re looking for the next generation of healthcare leaders. At AmeriHealth Caritas, we’re passi...
    AmeriHealth Caritas
    Hired Organization Address Remote, OR Full Time
    Responsibilities Partner with corporate sourcing, provider network management, legal and business leaders in the organiz...
    AmeriHealth Caritas
    Hired Organization Address Effingham, SC Full Time
    Remote to qualified candidates living in South Carolina with a preference of York, Florence, Williamsburg,; Darlington a...

    Not the job you're looking for? Here are some other Azure Data Engineer - Exp. w/ Databricks & Data Factory jobs in the Newtown, PA area that may be a better fit.

    Azure Databricks Architect Sr Data Engineer with Healthcare Background

    Artifact Global Corporation, Philadelphia, PA

    AI Assistant is available now!

    Feel free to start your new journey!