We are seeking a Data Engineer with expertise in Scala, Java, Python, and Big Data technologies to support a healthcare industry project in NYC. The role requires designing and developing scalable Azure-based data solutions.
Key Responsibilities
Develop and maintain Azure solutions using Data Factory and Databricks.
Work with Big Data tools like Hadoop and Hive to manage large-scale data processing.
Ensure data is cleansed, mapped, transformed, and optimized for business and technical requirements.
Automate tasks and deploy production-standard code (unit testing, CI / CD, versioning).
Load transformed data into data warehouses, real-time reporting systems, and analytics platforms.
Build scalable data pipelines to extract, transform, and analyze large datasets.
Troubleshoot and maintain data warehouse performance and integrity.
Qualifications
11 years of experience in data engineering, specifically with Azure Big Data ecosystem.
Proficiency in Scala, Java, Python, and PySpark for data transformation and processing.
Strong knowledge of Azure Data Factory and Databricks.
Familiarity with Hadoop, Hive, and related data processing tools.
Experience with data pipeline automation and deploying production-standard code.
Proficiency in Python and C# is required.
English fluency (native / bilingual proficiency).
Why Join?
Work with cutting-edge Big Data and Azure technologies.
Opportunity to impact healthcare data solutions at scale.
Competitive compensation with a long-term contract (12 months).
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Data Engineer with Scala Experience?
Sign up to receive alerts about other jobs on the Data Engineer with Scala Experience career path by checking the boxes next to the positions that interest you.
