Junior Data Engineer

Data Engineer ACH

Title: Junior Data Engineer

Job Description:

A junior data engineer is an entry-level data professional who is responsible for designing, building, and maintaining data pipelines and systems. They work closely with Product Owners and Analysts to ensure that data is easily accessible and of high quality. Junior data engineers typically have less experience than data engineers and are expected to work under the guidance of experienced engineers.

Job Summary

We are seeking a highly motivated and detail-oriented Entry Level Data Engineer to join our dynamic team. The successful candidate will assist in gathering requirements, curating data elements and documenting data lineage in specified data repositories within the bank. This entry-level position offers an excellent opportunity to gain hands-on experience in the field of data engineering and work closely with experienced professionals.

Core Skills

1. Programming Languages

Proficiency in programming languages such as Python, SQL.

2. Big Data Technologies

Experience with big data technologies such as Hadoop, Spark, Kafka, and Flink.

Familiarity with data warehousing solutions like Amazon Redshift, Google BigQuery, and Snowflake

3. Database Management

Strong understanding of relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Skills in database design, indexing, and query optimization

4. Data Modeling

Ability to design and build data models to support business requirements.

Experience with data modeling tools and techniques

5. ETL Processes

Expertise in Extract and Load (EL) processes and transform tool DBT

Ability to develop and maintain ETL workflows

6. Cloud Platforms

Knowledge of cloud platforms such as Snowflake

Experience with cloud-based data services and infrastructure

7. Data Governance

Understanding of data governance principles and best practices.

Ability to implement data governance frameworks to ensure data quality and compliance

8. Problem-Solving

Strong analytical and problem-solving skills.

Ability to troubleshoot and resolve data-related issues

9. Communication

Excellent communication skills to collaborate with technical and non-technical stakeholders.

Ability to translate complex technical concepts into understandable terms

10. Continuous Learning

Commitment to staying updated with the latest trends and technologies in data engineering.

Willingness to continuously improve skills and knowledge

Duties and Responsibilities

• Curating data elements and documenting data lineage

• Managing data storage and ensuring data quality

• Building and maintaining data pipelines and ETL processes – moving data between different cloud-based platforms and on-premises data sources

• Developing and maintaining databases and data warehouses

• Working with Product Owners and Analysts to understand business requirements and provide data solutions

• Writing scripts and code to automate data processes

Requirements and Qualifications

• Strong problem-solving and communication skills

• Proficiency in at least one programming language (Python, Java, etc.)

• Proficiency in DB2 and/or DataStage

• Knowledge of SQL and relational databases

• Understanding of big data technologies (Curation, Data Lineage, Data Mesh, etc.)

• Experience with cloud platforms (AWS, Snowflake, etc.)