What are the responsibilities and job description for the Azure Cloud Engineer position at Cynet Systems?
Job Description:
Requirement:
Requirement:
- Develop and maintain data pipelines to ingest, transform, and load data from various sources.
- Design and manage scalable data lakes to support comprehensive data storage and analysis needs.
- Design retention, lifecycle, and archival policies for datasets.
- Work with Azure Data Lake Storage to efficiently store and manage large datasets.
- Create and manage data models and data warehouses to support business intelligence and analytics needs.
- Set up and manage external tables and integrate with various data sources.
- Utilize Delta Lake for optimized data storage and real-time analytics capabilities.
- Develop and deploy interactive and visually compelling reports and dashboards using Power BI.
- Utilize Azure Databricks for advanced data processing.
- Optimize and manage Azure SQL databases to ensure high performance and availability.
- Implement CI/CD pipelines using Azure DevOps to streamline development and deployment processes.
- Ensure data security and compliance with relevant regulations and best practices (eg: NIST).
- Setup Azure Purview for data governance.
- Experience with data integration and migration from on-premises to cloud environments.
- Proficiency in Python and experience with Python Notebooks.
- Proficiency in scripting and automation (Power Shell, Client templates, Terraform.
- Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus.
