What are the responsibilities and job description for the Azure Lead Data Engineer position at SSV Technologies Inc?
Job Details
Azure Lead Data Engineer
About the job
SSV Technologies is seeking a Azure Lead Data Engineer and in this role, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to implementation, transition and warranty. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Required Qualifications:
- Bachelor's degree or foreign equivalent required from an accredited institution
- 10 years of experience in Information Technology
- 5 years of Azure Datafactory, Azure Datalake, Azure Blob, Azure KeyVault & Azure Eventhubs experience
- 5 years of experience in data transformation using Databricks
- 10 years of experience in SQL, pyspark, Spark, Big Data and Python
- 10 years of experience in designing, engineering, and operationalizing data pipelines for large and complex datasets.
- 5 years of hands-on experience working with unstructured data, including JSON.
- Strong expertise in batch and stream processing methodologies.
- Extensive proficiency in Advanced SQL for data transformation and analysis
- Good experience in end-to-end implementation of data warehouse and data marts
- Experience with ETL data pipelines
- Must be proficient in complex SQL, Unix Shell Scripting, performance tuning and troubleshooting
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
Preferred Qualifications:
- Good understanding of data integration, data quality and data architecture
- Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data
- Good understanding of Agile software development frameworks
- Experience in Airline domain
- Strong communication and Analytical skills
- Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
- Experience and desire to work in a global delivery environment
