Azure Architect/Lead Azure Data Engineer

Job Description:

On behalf of our retail client, we are looking to hire Azure Architect/Lead Azure Data Engineer who has expert level knowledge in Azure Data Factory & SQL, and is willing to serve in an individual contributor role.

Knowledge of Snowflake is highly desirable. In the absence of Snowflake, knowledge of any Cloud Datawarehouse would work too

Client is only considering people based out of Seattle/Vancouver region or willing to relocate to Seattle/Vancouver region.

A successful candidate will be a problem solver and an expert in ETL programming/scripting, data modelling, data integration, SQL and have exemplary communication skills. The candidate will need to be comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail. The candidate will know, and love working with Azure technologies, can model multidimensional datasets, and can partner with cross functional business teams to answer key business questions. Apart from building data pipelines, you will be an advocate for automation, performance tuning and cost optimization. Be ready to question the status quo and bring forth intelligent solutions and proof of concepts.

Key Responsibilities

Interface with cross functional business teams, gather requirements and take ownership of the end-to-end delivery of the data product/pipelines.

Build robust and scalable data pipelines using SQL, Azure Data Factory, Snowflake Supported Procedure languages and PySpark.

Embrace automation, reduce cost, and human dependencies wherever possible.

Design and implement data products and data governance strategies.

Build frameworks and reusable components.

Bring a product development mindset to every aspect of data engineering development activities.

Qualifications

10 years of experience as a Data Engineer or in a similar role.

Experience working with large volume data; retail experience strongly desired.

Experience with Azure Cloud services like Azure Data Factory, Azure Functions, AKS, Docker.

Strong experience using Azure Data Factory and Azure Functions

Expert level experience in SQL.

Proficiency in one or more programming language like Python

Experience with data modeling, data warehousing, and building ETL pipelines

Knowledge of data management fundamentals, data storage principles, ETL, Data Modeling, and Data Architecture.

Excellent problem-solving skills, combined with the ability to present your findings/insights clearly and compellingly in both verbal and written form.

Desired Qualifications:

Experience with Snowflake platform.

Experience with Databricks and PySpark.