Lead Data DevOps Engineer

Job Title: Lead Data DevOps Engineer
Location: Atlanta, GA
Employment Type: C2H
Must have: Managing and Automating the Data Infrastructure to Install, Configure, Automate via CI-CD, Troubleshoot, establish monitoring and alerting data infrastructure on Azure cloud and off cloud resources

Job Summary:
We are seeking a skilled Lead Data DevOps Engineer to manage and automate our data infrastructure across Azure Cloud and on-premises resources. The ideal candidate will be proficient in installing, configuring, automating, and maintaining robust data environments. They will implement CI/CD pipelines, troubleshoot issues, and establish reliable monitoring and alerting systems to ensure the seamless operation of our data infrastructure.

Key Responsibilities:

• Data Infrastructure Management: Install, configure, and maintain data infrastructure on Azure Cloud and off-cloud environments.
• Automation and CI/CD: Design and implement automation processes, including CI/CD pipelines, to streamline deployments and updates across the infrastructure.
• Troubleshooting: Diagnose and resolve issues within the data infrastructure, ensuring minimal downtime and optimal performance.
• Monitoring and Alerting: Develop and manage monitoring systems to proactively identify potential problems and set up alerting mechanisms to notify relevant teams.
• Collaboration: Work closely with data engineers, developers, and IT teams to align infrastructure capabilities with organizational goals.
• Security and Compliance: Ensure the infrastructure complies with security standards and best practices for data protection.

Required Skills and Qualifications:

• Proven experience managing data infrastructure on Azure Cloud and hybrid environments.
• Proficiency in automation tools and scripting languages (e.g., Python, Bash, PowerShell).
• Hands-on experience with CI/CD tools such as Jenkins, Azure DevOps, or similar.
• Strong understanding of monitoring tools like Prometheus, Grafana, or Azure Monitor.
• Expertise in troubleshooting complex system issues.
• Familiarity with containerization and orchestration tools such as Docker and Kubernetes.
• Knowledge of database systems (e.g., SQL, NoSQL) and data pipelines is a plus.
• Strong problem-solving skills and a proactive mindset.

Preferred Qualifications:

• Certifications in Azure (e.g., Azure Solutions Architect, Azure DevOps Engineer).
• Experience with Infrastructure as Code (IaC) tools like Terraform or Ansible.
• Familiarity with data governance and compliance standards.

What We Offer:

• Competitive salary and benefits package.
• Opportunities for professional growth and development.
• A collaborative and inclusive work environment.
• The chance to work on cutting-edge technologies and impactful projects.