Demo

Azure Data Engineer Databricks expert

Accord Technologies Inc
Iselin, NJ Contractor
POSTED ON 1/25/2025
AVAILABLE BEFORE 7/21/2025
Title – Azure Data Engineer – Databricks Expertise

Location – Iselin, NJ / NYC. (Locals to NJ, NYC preferred)

Job Summary

We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize large-scale data pipeline, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions.

Key Responsibilities

  • Data Pipeline Development:
  • Data Pipeline Development:
  • Build and maintain scalable ETL/ELT pipelines using Databricks.
  • Leverage PySpark/Spark and SQL to transform and process large datasets.
  • Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
  • Collaboration & Analysis:
  • Work Closely with multiple teams to prepare data for dashboard and BI Tools.
  • Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.

Performance & Optimization

  • Optimize Databricks workloads for cost efficiency and performance.
  • Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
  • Governance & Security:
  • Implement and manage data security, access controls and governance standards using Unity Catalog.
  • Ensure compliance with organizational and regulatory data policies.

Deployment

Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.

  • Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.

Technical Skills

  • Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
  • Proficiency in Azure Cloud Services.
  • Solid Understanding of Spark and PySpark for big data processing.
  • Experience in relational databases.
  • Knowledge on Databricks Asset Bundles and GitLab.

Preferred Experience

  • Familiarity with Databricks Runtimes and advanced configurations.
  • Knowledge of streaming frameworks like Spark Streaming.
  • Experience in developing real-time data solutions.

Certifications

  • Azure Data Engineer Associate or Databricks certified Data Engineer Associate certification. (Optional)

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Azure Data Engineer Databricks expert?

Sign up to receive alerts about other jobs on the Azure Data Engineer Databricks expert career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$168,522 - $211,152
Income Estimation: 
$189,259 - $248,928
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$71,122 - $96,652
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$143,391 - $179,890
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Accord Technologies Inc

Accord Technologies Inc
Hired Organization Address Las Vegas, NV Full Time
Java Lead / Java Developer Location -Las Vegas, NV Onsite) Experience 12 years Partner with business and marketing to Im...
Accord Technologies Inc
Hired Organization Address Las Vegas, NV Full Time
Role - Technical Project manager Location - Las Vegas, NV (Onsite) Duration : long term Position : W2 contract must be a...
Accord Technologies Inc
Hired Organization Address Piney, AR Full Time
Title : Avionics Tech PF Location : Piney Flats TN Duration : 6 months Shift : 4 X 10 MTh schedule Start time 6 : 00 am ...
Accord Technologies Inc
Hired Organization Address Las Vegas, NV Full Time
Title : Power Automate Engineer - Power Automate Duration : Long term, Type : Full time / C2C Location : Las Vegas, NV (...

Not the job you're looking for? Here are some other Azure Data Engineer Databricks expert jobs in the Iselin, NJ area that may be a better fit.

Azure Data Engineer with Databricks

OmegaHires, Iselin, NJ

AI Assistant is available now!

Feel free to start your new journey!