What are the responsibilities and job description for the Data Engineer with Databricks position at Dia Software Solutions?
Job Details
Hi,
Greetings from DIA SOFTWARE SOLUTIONS LLC!
We reaching out about an exciting Direct client opportunity with one of our clients. Please review the requirements and let me know if you are interested in this position?
Direct client Req:: Need Data Engineer with Databricks MI, Hybrid
PLEASE SEND THE RESUMES TO SKUMAR AT DIASOFTWARESOLUTIONS DOT COM !
Job Description:
Position Justification
- The position is responsible for providing ongoing maintenance and support of the Michigan Disease Surveillance System (MDSS).
- MDSS is a complex application that supports communicable disease surveillance, registries, and case management systems that are
- critical to supporting effective responses to public health emergencies and reducing the burden of communicable diseases. MDSS is
- going through modernization to enhance stability and functionality of the system. With phase 1 already completed. The resource is
- integral to developing and maintaining and enhancing MDHHS MDSS phase 1. Making sure automated processes are funtioning,
- streamlining critical business processes, data integrity, SEM/SUITE compliance, and securing the application. The resource also
- performs as a technical lead and provides technical guidance to the other developers in the department. As a technical lead, the
- resource participates in a variety of analytical assignments that provide for the enhancement, integration, maintenance, and
- implementation of projects. The resource will also provides technical oversight to other developers in the team that support other
- critical applications . Not having a resource on staff will lead to MDHSS failing to maintain, enhance, and support the modernized
- MDSS that can lead to errors causing application outages, data integrity issues and can eventually lead to incorrect information being
- processed and reporting of the patient information.
Position Summary
- Lead the design and development of scalable and high-performance solutions using AWS services.
- Experience with Databricks, Elastic search, Kibanna, S3.
- Experience with Extract, Transform, and Load (ETL) processes and data pipelines.
- Write clean, maintainable, and efficient code in Python/Scala.
- Experience with AWS Cloud-based Application Development
- Experience in Electronic Health Records (EHR) HL7 solutions.
- Implement and manage Elastic Search engine for efficient data retrieval and analysis.
- Experience with data warehousing, data visualization Tools, data integrity
- Execute full software development life cycle (SDLC) including experience in gathering requirements and writing
- functional/technical specifications for complex projects.
- Excellent knowledge in designing both logical and physical database model
- Develop database objects including stored procedures, functions,
- Extensive knowledge on source control tools such as GIT
- Develop software design documents and work with stakeholders for review and approval.
- Exposure to flowcharts, screen layouts and documentation to ensure logical flow of the system requirements
- Experience working on large agile projects.
- Experience or Knowledge on creating CI/CD pipelines using Azure Devops
Skill Descriptions
Skill | Amount of Experience | Experience |
developing complex database systems. | 12 Years |
|
Databricks. | 8 Years |
|
using Elastic search, Kibanna. | 8 Years |
|
using Python/Scala. | 8 Years |
|
Oracle. | 8 Years |
|
experience with Extract, Transform, and Load (ETL) processes and developing Data Pipelines. | 5 Years |
|
experience with AWS. | 5 Years |
|
experience with data warehousing, data visualization Tools, data integrity . | 5 Years |
|
using CMM/CMMI Level 3 methods and practices. | 5 Years |
|
implemented agile development processes including test driven development. | 5 Years |
|
Experience or Knowledge on creating CI/CD pipelines using Azure Devops- Nice to have | 3 Years |
|
