What are the responsibilities and job description for the ETL Engineer - HYBRID position at Sierra Solutions?
Job Summary
ETL Engineer -- In this role, you will be responsible for designing, developing, and implementing data integration solutions using Azure Data Factory (ADF), ensuring seamless ETL/ELT pipeline orchestration, and helping to streamline data workflows within the cloud ecosystem. You will collaborate closely with cross-functional teams to manage large volumes of data and implement robust data pipelines that support business intelligence, analytics, and reporting.
Primary Responsibilities
- Travel up to 25%
- Create, implement, and manage efficient data integration workflows using Azure Data Factory (ADF), ensuring smooth ETL/ELT pipeline orchestration.
- Work closely with business intelligence, analytics, and reporting teams to ensure the seamless integration of data solutions into the cloud ecosystem.
- Develop, deploy, and monitor robust data pipelines to support various business processes, ensuring data flows efficiently through systems like Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
- Handle large datasets, optimizing data processing for performance, and ensuring quick and accurate data retrieval.
- Utilize Azure services, including Azure Synapse Analytics and Azure SQL Database, to design scalable, cloud-based data solutions.
- Use Azure DevOps for version control and continuous integration/continuous deployment (CI/CD) pipeline management to ensure efficient and error-free data solution deployment.
- Identify and resolve issues with complex data flows and integration problems, ensuring high reliability and data integrity.
- Adhere to cloud security best practices and compliance standards to safeguard data and maintain regulatory compliance within a Health Plan environment.
- Experience working with Azure Data Factory, including pipeline design, development, deployment, and monitoring.
- Strong understanding of data integration, ETL/ELT processes, and cloud-based data workflows. Should have strong Provider Data experience within a Health Plan environment
- Experience working with other Azure services like Azure SQL Database, Azure Data Lake, Azure Blob Storage, and Azure Synapse Analytics.
- Proficiency with SQL and data modeling concepts.
- Familiarity with Azure DevOps for version control and CI/CD pipeline management.
- Ability to work with large datasets and optimize data processing for performance.
- Experience with cloud security best practices and compliance standards.
- Excellent troubleshooting skills and experience with debugging complex data flows and integration issues.
