ETL Developer

We are seeking a skilled and motivated ETL Developer with a strong background in data engineering. The ideal candidate should have hands-on experience with Kafka, SQL Programming, MySQL, Linux scripting, data modeling, and some Java programming for writing Kafka connectors. In addition, the candidate should be familiar with Airflow or other orchestration tools, Azure DevOps, and CI/CD pipeline implementation. This role will involve collaborating with cross-functional teams to deliver robust data solutions and efficient data pipelines that support our business needs.

Scope of Work & Key Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines using Kafka to support large-scale data processing needs.
• Write SQL queries and manage MySQL databases to ensure data accuracy, integrity, and availability.
• Develop and maintain Linux scripts for automating data processing and ETL operations.
• Create and maintain data models that align with business requirements and optimize performance.
• Develop and maintain Kafka connectors using Java to integrate various data sources and ensure seamless data flow.
• Implement and manage data workflows using Airflow or other orchestration tools to automate data processing pipelines.
• Set up and manage CI/CD pipelines using Azure DevOps to ensure efficient code deployment and automated testing.
• Collaborate closely with cross-functional teams (Data Scientists, Analysts, and Business Stakeholders) to understand data requirements and deliver tailored solutions.

Key Qualifications/Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a relevant discipline.
• 3 to 5 years of hands-on development experience, with a strong understanding of the design, coding, and testing of information systems.
• Strong background in ETL development, particularly using Kafka, SQL, and MySQL.
• Proficiency in Linux scripting and data modeling to support efficient data processing and analysis.
• Experience with Airflow or other orchestration tools for managing complex workflows and data pipelines.
• Knowledge of Java programming for writing and maintaining Kafka connectors.
• Experience with Azure DevOps and CI/CD pipelines for streamlined deployment and automation.
• Strong understanding in the context of ETL/SSIR/SSIS products. Experience with integration technologies and DevOps is an added advantage.
• Demonstrated ability to independently design, develop, and implement high-quality software solutions.
• Familiarity with version control systems such as Azure DevOps and GIT for managing source code and collaboration.

To apply, simply click the "Apply" button or send your updated profile to recruit@percept-solutions.com

EA Licence No.:18S9405 / EA Reg. No.:R1330864

Percept Solutions is expanding and actively seeking talented individuals. We encourage applicants to follow Percept Solutions on LinkedIn at https://www.linkedin.com/company/percept-solutions/to stay informed about new opportunities and events.