What are the responsibilities and job description for the Azure Data Engineer - 10+ Years Exp Only position at AQUA Information Systems, Inc.?
Job Details
Responsibilities:
Design, develop, and maintain scalable and efficient data solutions leveraging Azure cloud technologies, ADF, Databricks, Spark, and SQL.
Implement and optimize Delta Lake architecture and other Big Data solutions to enhance performance and scalability.
Work collaboratively with cross-functional teams to comprehend and address business needs related to Equities trading data.
Apply AI/ML methodologies to improve data processing and analytical capabilities.
Participate in the development and implementation of Data Mesh architecture to enhance data accessibility and usability.
Requirements:
You are:
Minimum of 10 years of hands-on development experience in Azure cloud, ADF, Databricks, Spark, and SQL.
Strong understanding of Delta Lake architecture and Big Data solutions.
Familiarity with Equities trading data is essential.
Knowledge of AI/ML practices and Data Mesh concepts is a plus.
Excellent problem-solving skills with the ability to work independently and collaboratively in a team environment.
Strong verbal and written communication skills to interact effectively with stakeholders.
It would be great if you also had:
Familiarity with modern software development practices, tools, and methodologies.
Ability to mentor and guide junior team members, fostering knowledge sharing and skill development.
