Senior Engineer

Job Description: Azure Data Specialist

Overview

We are seeking a highly skilled and experienced Azure Data Specialist to join our dynamic team. The ideal candidate will be proficient in a range of Azure services, including Azure Data Lake (Gen1 and Gen2), Azure Data Factory, Azure Databricks, Azure Data Warehouse, Azure Synapse, and more. This role requires a deep understanding of data architecture, analytics, and security within the Azure environment. The successful candidate will be pivotal in driving our data strategies and ensuring optimal data processing and security measures.

Key Responsibilities

• Data Management and Architecture:
• Design and implement complex data storage solutions using Azure Data Lake Storage Gen1 and Gen2.
• Utilize Azure Data Factory to orchestrate and automate data movement and data transformation processes.
• Develop and maintain scalable data models and pipelines using Azure Databricks and Azure Data Warehouse.
• Leverage Azure Synapse Analytics to integrate complex data analytics and data exploration solutions.
• Security and Compliance:
• Manage sensitive data securely by implementing Azure Key Vault and Azure Active Directory for comprehensive access and encryption key management.
• Ensure compliance with data security and privacy standards across all Azure data services.
• Data Processing and Analytics:
• Implement Databricks services for processing streaming data using Spark clusters to handle real-time data processing needs.
• Manage and utilize Blob containers, ensuring efficient data storage and accessibility.
• Integrate and manage Enterprise Service Bus (ESB), Event Grid, and Azure Functions to streamline data flows and event management across various platforms.
• Database Management:
• Oversee the deployment and maintenance of Azure SQL Server and Cosmos DB for high-performance and scalable database solutions.
• Analytics and Reporting:
• Develop and deploy analytics solutions using Power BI, providing actionable insights through rich visualizations and reports.
• Collaborate with business stakeholders to translate business requirements into robust analytical solutions that support decision-making.
  

Required Skills And Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field.
• Proven expertise in managing Azure environments, specifically with Azure Data Lake, Azure Data Factory, Azure Databricks, and Azure Synapse.
• Strong experience in implementing security measures using Azure Key Vault and Azure Active Directory.
• Expertise in SQL, Python, or Scala for data manipulation and processing.
• Strong analytical skills with experience in Power BI or other analytics tools.
• Excellent problem-solving abilities and a strong sense of ownership.
• Effective communication skills, capable of working collaboratively across diverse teams.
  
  

Additional Information

• Relocation Assistance: No
• Visa Sponsorship Eligibility: No
  
  

Skills: communication skills,azure data bricks,azure active directory,azure data lake,azure key vault,quality assurance,agile methodologies,azure data lake gen1/gen2,azure databricks,team leadership,key vault,scala,power bi,sql,system design,azure synapse,project management,azure data factory,data analysis,azure data warehouse,process improvement,python,azure dwh,problem solving