What are the responsibilities and job description for the Azure lead data engineer position at Samay Consulting?
Job Details
On behalf of our retail client, we are looking to hire Azure Architect/Lead Azure Data Engineer who has expert level knowledge in Azure Data Factory & SQL, and is willing to serve in an individual contributor role.
Knowledge of Snowflake is highly desirable. In the absence of Snowflake, knowledge of any Cloud Datawarehouse would work too
Client is only considering people based out of Seattle/Vancouver region or willing to relocate to Seattle/Vancouver region.
A successful candidate will be a problem solver and an expert in ETL programming/scripting, data modelling, data integration, SQL and have exemplary communication skills. The candidate will need to be comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail. The candidate will know, and love working with Azure technologies, can model multidimensional datasets, and can partner with cross functional business teams to answer key business questions. Apart from building data pipelines, you will be an advocate for automation, performance tuning and cost optimization. Be ready to question the status quo and bring forth intelligent solutions and proof of concepts.
Key Responsibilities
Interface with cross functional business teams, gather requirements and take ownership of the end-to-end delivery of the data product/pipelines.
Build robust and scalable data pipelines using SQL, Azure Data Factory, Snowflake Supported Procedure languages and PySpark.
Embrace automation, reduce cost, and human dependencies wherever possible.
Design and implement data products and data governance strategies.
Build frameworks and reusable components.
Bring a product development mindset to every aspect of data engineering development activities.
Qualifications
10 years of experience as a Data Engineer or in a similar role.
Experience working with large volume data; retail experience strongly desired.
Experience with Azure Cloud services like Azure Data Factory, Azure Functions, AKS, Docker.
Strong experience using Azure Data Factory and Azure Functions
Expert level experience in SQL.
Proficiency in one or more programming language like Python
Experience with data modeling, data warehousing, and building ETL pipelines
Knowledge of data management fundamentals, data storage principles, ETL, Data Modeling, and Data Architecture.
Excellent problem-solving skills, combined with the ability to present your findings/insights clearly and compellingly in both verbal and written form.
Desired Qualifications:
Experience with Snowflake platform.
Experience with Databricks and PySpark.
