What are the responsibilities and job description for the Azure Data Engineer - Exp. w/ Databricks & Data Factory position at AmeriHealth Caritas?
Responsibilities
- Build and maintain scalable automated data pipelines. Support critical data pipelines with a highly scalable distributed architecture - including data ingestion (streaming, events and batch), data integration, data curation.
- Strong experience as an Azure Data Engineer and must have Azure Databricks and Azure Data Factory experience.
- Demonstrated experience of turning business use cases and requirements into technical solutions.
- Expert level understanding on Azure Data Factory, SQL, ADLS, Azure Databricks, PySpark, Azure DevOps, Kafka, Python is required.
- Experience in business processing mapping of data and analytics solutions.
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
- The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
- HVR, Snowflake, Azure Synapse, SQL Server, Collibra Governance tools is a plus.
- Experience preparing data for Data Science and Machine Learning.
- Experience preparing data for use in Azure Databricks.
- Demonstrated experience preparing data and building data pipelines reusable components and frameworks.
- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data needs.
- Identify and tackle issues concerning data management to improve data quality.
- Understand and implement best practices in management of data, including master data, reference data, metadata, data quality and lineage.
- Strong knowledge of Dev-Ops processes (including CI / CD) and Infrastructure as code is essential.
- Strong team collaboration and experience working with remote teams.
- Experience with Git / TFS / VSTS is a must.
Qualifications / Education :
Diversity, Equity, and Inclusion
At AmeriHealth Caritas, everyone can feel valued, supported, and comfortable to be themselves. Our commitment to equity means that all associates have a fair opportunity to achieve their full potential. We put these principles into action every day by acting with integrity and respect. We stand together to speak out against injustice and to break down barriers to support a more inclusive and equitable workplace. Celebrating and embracing the diverse thoughts and perspectives that make up our workforce means our company is more vibrant, innovative, and better able to support the people and communities we serve.
We keep our associates happy so they can focus on keeping our members healthy.
Our Comprehensive Benefits Package
Flexible work solutions including remote options, hybrid work schedules, Competitive pay, Paid time off including holidays and volunteer events, Health insurance coverage for you and your dependents on Day 1, 401(k) Tuition reimbursement and more.
Generous paid time off and paid volunteer time off.
Employer-matched 401(k) and additional non-elective contributions, starting on day one.
Medical, dental, and vision plans — with coverage starting on day one.
Employee assistance programs, fitness reimbursements, nutrition counseling, and more.
Employer-paid life insurance, with opportunities to purchase additional coverage.
Employer-paid short-term disability coverage and long-term disability coverage.
Tuition assistance, including reduced tuition at certain schools.
Financial assistance with adoption, including paid time off.
Flexible spending and health savings accounts to pay for qualified expenses.
Discount programs on entertainment, travel, and more.