What are the responsibilities and job description for the Senior Data Engineer position at Sibitalent Corp?
Job Title: Data Engineer Lead/Manager
Location - Irondale, AL(Remote)
Job Description
- The Data Engineering Manager brings strong expertise in ETL methodologies, data transformation, and cloud-based data platforms to lead a data engineering team in optimizing data handling and workflows. This roles focus on leveraging AI-driven automation techniques will enhance data processing efficiency over time. The ideal candidate for this position has a blend of hands-on technical ability, leadership skills specific to data engineering, and strategic vision for data processing.
Responsibilities
- The responsibilities for this position include the following:
- Provide general Leadership, Management, and Accountability (LMA) for ETL developers and data engineers, ensuring best practices in data processing.
- Develop and maintain ETL pipelines for structured and unstructured data processing.
- Implement AI-driven automation techniques to improve ETL efficiency over time.
- Ensure data quality, security, and compliance in all processes and foster a culture of continuous improvement.
- Establish and track KPIs for ETL performance, AI-driven automation, data integrity, and team productivity.
Must Have Skills:
- Excellent problem-solving, project management, and stakeholder communication skills
- Interest in AI/ML techniques for data processing, with a willingness to apply AI-driven automation over time
- Able to lead a team to achieve high-level goals by initiating detailed, actionable plans
- Attentive to the skill level and performance of direct reports
- Resourceful and creative problem solver
Education Experience and Certifications
- 5 years of experience in ETL development, data engineering, or a related field
- 3 years of leadership experience in a software development or data engineering role
- Experience working with unstructured data and data transformation techniques
- Hands-on experience with ETL tools and data processing frameworks
- Proficiency in Microsoft development tools, including Visual Studio, using C#
- Experience with cloud-based data platforms (AWS Glue, Redshift, etc).
- Strong knowledge of database systems, data lakes, and data warehouse solutions
Preferred
- Hands-on experience or familiarity with AI/ML techniques for data transformation and anomaly detection
- Experience with DevOps practices, CI/CD pipelines, and containerization (Docker, Kubernetes)
- Experience with S3, EC2, Secrets Manager, CloudWatch, RDS
- Experience building complicated Regular Expressions
- Knowledge of data governance and regulatory compliance frameworks
