Data Engineer

Sr. Azure Data Engineer

Remote

Long term Contract!

Need folks with Azure Event hub/Streaming services and Data Modelling experience?For Azure - Key Responsibilities:

Design and develop scalable and efficient data pipelines for data ingestion, transformation, and storage using Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure services.

Collaborate with data scientists, analysts, and business teams to gather data requirements and ensure seamless integration with reporting and analytics solutions.

Implement ETL/ELT processes to move, clean, and optimize large volumes of structured and unstructured data across cloud and on-premise systems.

Optimize the performance, security, and reliability of data pipelines and Azure data infrastructure, ensuring compliance with data governance and security policies.

Use Azure Storage (Blob Storage, Data Lake) for managing data lakes and building out data storage layers.

Develop and manage data models, both logical and physical, for effective querying and reporting.

Ensure proper monitoring, alerting, and automation of pipelines to provide consistent, reliable data to the end-users.

Manage and orchestrate workflows using Azure Data Factory and Azure Logic Apps.

Assist in building and maintaining CI/CD pipelines for data-related tasks, leveraging tools like Azure DevOps.

Work with Azure SQL Database, Cosmos DB, and other database services to store and retrieve data efficiently.

Perform troubleshooting of data-related issues and provide solutions to ensure smooth operations of the data infrastructure.

Required Skills

- Strong programming skills in Python , Azure Durable functions with Typescript V4 prog model and SQL for building data solutions.

Experience with ETL/ELT tools and processes, data wrangling, and handling large datasets.

Knowledge of Azure SQL Database, Cosmos DB, or other database management systems.

Familiarity with Azure DevOps for building and deploying data pipelines.

Strong understanding of data modeling and working with data warehouses.

Proficiency in data governance, data security, and compliance best practices within Azure.

Problem-solving mindset, with a focus on automation and continuous improvement.

Excellent communication and collaboration skills.

Preferred Qualifications:

Certifications like Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect are highly preferred.

Experience working in Agile/Scrum teams and familiarity with project management tools.

Knowledge of Power BI or other BI tools for building visual reports and dashboards.

Experience with real-time data processing technologies such as Azure Stream Analytics, Event Hubs, or Azure IoT Hub.

Regards,

Uma Mahesh Nandigama

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.