What are the responsibilities and job description for the Cloud platform Engineer position at Sophus IT Solutions?
Role: Cloud Platform Engineer- Azure
Is this an onsite role? N/A – work can be done remotely with occasional travel (probably twice for the duration of the project).
Location: 500 5th Ave N, Seattle WA 98109
Is a credit check required? No
Is a drug screen required: No
Please submit only candidates who have lived in the US continuously for 5 years.
Responsibilities:
Primary skill:
• DBT Labs
• Snowflake
Secondary skill:
• Databricks
• Databricks Unity Catalog
Data Engineer
• Develop, optimize, and maintain data pipelines using Azure Data Factory (ADF), DBT Labs, Snowflake, and Databricks.
• Develop reusable jobs and configuration-based integration framework to optimize development and scalability.
• Manage data ingestion for structured and unstructured data ( landing/ lake house: ADLS, Sources: ADLS, Salesforce, Sharepoint Documents Libraries, Partner Data: DHS, IHME, WASDE etc. ).
• Implement and optimize ELT processes, source-to-target mapping, and transformation logic in DBT Labs, Azure Data Factory, Databricks Notebook, Snow SQL etc.
• Collaborate with data scientists, analysts, data engineers, report developers and infrastructure engineers for end-to-end support.
• Co-develop CI/CD best practices, automation, and pipelines with Infrastructure engineers for code deployments using GitHub Actions.
• Bring in automation from source-to-target mappings to data pipelines and data lineage in Collibra.
Required Experience
• Hands-on experience building pipelines with ADF, Snowflake, Databricks, and DBT Labs.
• Expertise in Azure Cloud with Databricks, Snowflake, and ADLS Gen2 integration.
• Data Warehousing and Lakehouse Knowledge: Proficient with ELT processes, Delta Tables, and External Tables for structured/unstructured data.
• Experience with Databricks Unity Catalog and data sharing technologies.
• Strong skills in CI/CD (Azure DevOps, GitHub Actions) and version control (GitHub).
Strong cross-functional collaboration and technical support experience for data scientists, report developers and analysts.
