What are the responsibilities and job description for the Data Engineer position at RICEFW Technologies Inc?
Need Local candidate only
Job Title: Data Engineer
Location: State of Michigan - Department of Health and Human Services (DHHS)
Duration: Long-Term Contract
Work Mode: Hybrid
Job Summary:
The State of Michigan - DHHS is seeking an experienced Data Engineer to support data initiatives, modernize data platforms, and ensure high-quality data delivery across critical systems. The ideal candidate will have deep expertise in Azure Cloud technologies, Databricks, Big Data solutions, Snowflake, ETL pipelines, and SQL-based data manipulation. The Data Engineer will work closely with cross-functional teams, including Data Analysts, Data Scientists, and Business Stakeholders, to enable data-driven decision-making.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines to support data ingestion, transformation, and delivery for analytical and operational use cases.
- Leverage Azure services (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse) for data engineering workflows.
- Develop and optimize ETL processes to extract, transform, and load data from multiple data sources into Snowflake and other target platforms.
- Utilize Databricks for advanced data processing, analytics, and data quality management.
- Implement Big Data solutions, including processing large datasets from structured and unstructured sources.
- Write and optimize complex SQL queries to manipulate and transform data across different platforms.
- Collaborate with business stakeholders to understand data requirements and develop data models to support analytical reporting.
- Monitor and enhance data quality, performance, and reliability across pipelines and data stores.
- Maintain technical documentation, including data flow diagrams, system architecture, and process documentation.
- Ensure data solutions comply with State of Michigan security, privacy, and compliance requirements.
Required Skills & Qualifications:
- 5 years of experience in Data Engineering roles.
- Strong hands-on experience with Azure Data Platform tools:
- Azure Data Factory
- Azure Data Lake Storage
- Azure Databricks
- Azure Synapse Analytics
- Experience working with Snowflake for data warehousing and analytics.
- Expertise in developing ETL/ELT pipelines using modern data tools and frameworks.
- Strong proficiency in SQL programming (query writing, performance tuning, stored procedures).
- Experience handling Big Data technologies (Databricks, Spark, Hadoop, etc.).
- Experience integrating and transforming data from multiple structured/unstructured sources.
- Understanding of data governance practices, including data quality, lineage, and security.
- Experience with version control tools (e.g., Git) and CI/CD pipelines for data processes.
- Strong analytical and problem-solving skills, with attention to detail.
- Experience working in Agile environments and with JIRA or similar tools.
Preferred Qualifications:
- Experience working in public sector projects, especially in health and human services.
- Knowledge of Python and PySpark for data engineering.
- Familiarity with Power BI or other visualization tools.
- Understanding of healthcare data standards such as HL7, FHIR, or HIPAA compliance.
- Experience building real-time data pipelines and working with streaming data technologies (Kafka, Event Hub).
Education:
- Bachelor’s degree in Computer Science, Information Systems, Data Science, or a related field.
- Relevant certifications (Azure Data Engineer, Snowflake SnowPro, etc.) are a plus.