Description

Purpose

The Data Engineering Manager brings strong expertise in ETL methodologies, data transformation, and cloud-based data platforms to lead a data engineering team in optimizing data handling and workflows. This role’s focus on leveraging AI-driven automation techniques will enhance data processing efficiency over time. The ideal candidate for this position has a blend of hands-on technical ability, leadership skills specific to data engineering, and strategic vision for data processing.

Responsibilities

The responsibilities for this position include the following:

• Provide general Leadership, Management, and Accountability (LMA) for ETL developers and data engineers, ensuring best practices in data processing.
• Develop and maintain ETL pipelines for structured and unstructured data processing.
• Implement AI-driven automation techniques to improve ETL efficiency over time.
• Ensure data quality, security, and compliance in all processes and foster a culture of continuous improvement.
• Establish and track KPIs for ETL performance, AI-driven automation, data integrity, and team productivity.

Qualifications

Competencies and Qualities

Qualified candidates must have the following competencies and qualities:

• Excellent problem-solving, project management, and stakeholder communication skills
• Interest in AI/ML techniques for data processing, with a willingness to apply AI-driven automation over time
• Able to lead a team to achieve high-level goals by initiating detailed, actionable plans
• Attentive to the skill level and performance of direct reports
• Resourceful and creative problem solver

Education Experience and Certifications

Required

• 5 years of experience in ETL development, data engineering, or a related field
• 3 years of leadership experience in a software development or data engineering role
• Experience working with unstructured data and data transformation techniques
• Hands-on experience with ETL tools and data processing frameworks
• Proficiency in Microsoft development tools, including Visual Studio, using C#
• Experience with cloud-based data platforms (AWS Glue, Redshift, etc.)
• Strong knowledge of database systems, data lakes, and data warehouse solutions

Preferred

• Hands-on experience or familiarity with AI/ML techniques for data transformation and anomaly detection
• Experience with DevOps practices, CI/CD pipelines, and containerization (Docker, Kubernetes)
• Experience with S3, EC2, Secrets Manager, CloudWatch, RDS
• Experience building complicated Regular Expressions
• Knowledge of data governance and regulatory compliance frameworks

Supervisory Responsibility

This position provides direct oversight and direction to a team of ETL developers/ data engineers, to include assigning work, hiring for open positions, and conducting performance reviews.

Work Environment

This is a remote position with regular meetings and critical team discussions at the main HC3 office in Irondale, Alabama.

Travel

This position requires little to no travel. This role may be required to occasionally travel to an HC3 office for team meetings.

Physical Demand

This role will require using a computer for long periods of time while either sitting or standing.

Position Type and Expected Hours

This is a full-time position for five, eight-hour days (at least 40 hours) per week.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities. Activities, duties, and responsibilities may change at any time with or without notice.