What are the responsibilities and job description for the Data Engineer position at Viterra US?
Job Summary:
We are looking for a skilled and detail-oriented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data architecture and infrastructure. The ideal candidate should have a strong understanding of data management, ETL processes, and data modeling, along with proficiency in relevant programming languages and tools.
Responsibilities:
- ETL/ELT Development:
- Design, develop, and maintain ETL/ELT processes using Informatica PowerCenter or relevant tools.
- Utilize Informatica for data integration, transformation, and loading tasks from various sources.
- Data Architecture and Design:
- Collaborate with stakeholders to understand data requirements and design scalable and efficient data architectures using Informatica.
- Implement and maintain data models, database schemas, and structures within the Informatica environment.
- ETL Optimization:
- Optimize and troubleshoot Informatica workflows and mappings for performance and reliability.
- Implement best practices for Informatica development to ensure efficiency and scalability.
- Database Management:
- Experience with database systems (MS SQL, Oracle, Snowflake, etc.)
- Develop and manage large-scale databases within the Informatica environment, ensuring data integrity and security.
- Implement and maintain database solutions, including indexing, partitioning, and optimization, using Informatica tools.
- Data Quality and Testing:
- Implement data quality standards and best practices within the context of Informatica development.
- Conduct testing procedures using Informatica tools to validate data accuracy, completeness, and consistency.
- Collaboration:
- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data needs and deliver effective Informatica solutions.
- Work closely with the IT team to integrate Informatica data solutions into existing systems
- Documentation:
- Create and maintain technical documentation for Informatica data architectures, ETL processes, and data models.
- Document data flows, transformations, and dependencies within the Informatica environment.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Data Science, Management Information Systems, or a related field.
- Proven experience as a Data Engineer with a focus on Informatica development.
- Strong understanding of data management concepts, ETL/ELT processes, and data modeling.
- Proficiency in Informatica PowerCenter and other Informatica tools.
- Experience with database systems (MS SQL, Oracle, Snowflake) and database design principles.
Preferred Skills:
- Experience with Informatica PowerCenter, Python, SQL, and Snowflake.
- Experience with Tableau and other data visualization tools and concepts.
- Understanding of data governance and compliance standards related to Informatica development.
- Familiarity with version control systems.
- Strong problem-solving and critical-thinking skills.
- Excellent communication and interpersonal skills.
- Ability to drive technical discussions and decisions.
- Experience with RESTful APIs and integration.
- Understanding of agile development methodologies.
- Ability to learn and adapt to new technologies quickly.
