What are the responsibilities and job description for the Integration (Data) Engineer position at Saviance?
Job Title : Integration (Data) Engineer
Location : Mexico
Duration : 3 months
About Job :
We are seeking a talented Integration Engineer with a strong background in data integration, ETL (Extract, Transform, Load) processes, and data pipelines. The Integration Engineer will play a crucial role in ensuring the seamless flow of data between various systems, applications, and databases within our organization. The ideal candidate is detail-oriented, technically skilled, and possesses excellent problem-solving abilities.
Key Responsibilities :
- Design, develop, and maintain data integration solutions that facilitate the transfer of data between different systems and platforms.
- Collaborate with cross-functional teams to gather integration requirements and implement solutions that meet business needs.
- Develop ETL processes to extract, transform, and load data from source systems to target databases or data warehouses.
- Implement data cleansing, validation, and enrichment procedures to ensure data accuracy and quality.
- Build and manage data pipelines for ingesting, processing, and delivering data to various downstream applications or analytics platforms.
- Monitor pipeline performance, troubleshoot issues, and optimize pipeline efficiency.
- Perform data transformations and manipulations to ensure data compatibility, consistency, and adherence to data standards.
- Implement data mapping, data conversion, and data enrichment as required.
- Integrate with external APIs and third-party data sources to retrieve and synchronize data in real-time or batch modes.
- Handle API authentication, error handling, and data synchronization challenges.
- Work with various database technologies to retrieve, update, and manipulate data as needed for integration processes.
- Optimize database queries and operations for performance and scalability.
- Maintain comprehensive documentation of integration processes, data flows, and ETL workflows.
- Provide clear documentation for troubleshooting, maintenance, and knowledge sharing.
- Perform thorough testing of data integration solutions to identify and resolve errors, inconsistencies, and issues.
- Collaborate with QA teams to ensure data accuracy and quality throughout the integration process.
- Collaborate with software developers, data analysts, and business stakeholders to understand integration requirements and priorities.
- Communicate project status, challenges, and solutions effectively to both technical and non-technical team members.
Qualifications and Skills :
