Senior Data Engineer

Job Description:

• End client is seeking a Senior Data Engineer to join their team.
• End client is responsible for financial data and financial reporting.
• Day to day you will lead all aspects of the design, development, and delivery of database, business intelligence, data warehouse, and data integration solutions.

Key Accountabilities:

A Senior data engineer will be responsible for designing, developing, and maintaining ETL processes to extract, transform, and load data from various sources into our data warehouse. The ideal candidate should have hands-on experience with ETL tools, strong data analysis skills, and the ability to work with large datasets.

• Lead the design, development, and maintenance of large-scale data systems, including data warehouses, data lakes, and data pipelines.
• Design, develop, and maintain ETL processes using tools like Matillion.
• Design, Develop and maintain optimal data flows in tools like Matillion.
• Develop and Maintain Datawarehouse objects like tables, views and security roles in snowflake database.
• Extract data from various sources, such as databases, flat files, and APIs
• Transform and cleanse data to ensure data quality and integrity
• Load data into the data warehouse, ensuring data consistency and accuracy
• Optimize ETL processes for performance, scalability, and reliability
• Work closely with data architects, analysts, and developers to support data integration initiatives.
• Implement data validation, data quality checks, and data security measures
• Troubleshoot and resolve data issues, performance bottlenecks, and ETL failures.
• Implement best practices for data warehousing, data modeling, and ETL development.
• Document ETL processes, data mappings, and configurations.

Requirements:

• A minimum of 6 years of experience with relational databases, ETL, and data warehouse required.
• Expert level knowledge of industry leading ETL/ELT tools such as ODI, Informatica, Matillion or SSIS.
• Experience in designing and developing complex near real-time and/or batch data integration solutions using cloud based ETL and integration tools
• Experience with traditional and non-traditional forms of analytical data design (Kimbal, Inmon etc)
• Proficiency in SQL programming and relational database concepts.
• Experience with loading and maintaining a data warehouse.
• Bachelor's degree in Computer Science or a related field with 6 years of related experience, or Master's degree in Computer Science or a related field with at least 4 years of related experience required.

Nice to Have:

• Experience with cloud-based data platforms, such as Snowflake.
• Domain knowledge in the area of finance data is preferred.
• Experience with SAP Systems and Databases
• Knowledge of data visualization tools, such as PowerBI or Tableau.