What are the responsibilities and job description for the Junior Data Engineer position at Encore Talent Solutions?
Data Engineer ACH
Title: Junior Data Engineer
Job Description:
A junior data engineer is an entry-level data professional who is responsible for designing, building, and maintaining data pipelines and systems. They work closely with Product Owners and Analysts to ensure that data is easily accessible and of high quality. Junior data engineers typically have less experience than data engineers and are expected to work under the guidance of experienced engineers.
Job Summary
We are seeking a highly motivated and detail-oriented Entry Level Data Engineer to join our dynamic team. The successful candidate will assist in gathering requirements, curating data elements and documenting data lineage in specified data repositories within the bank. This entry-level position offers an excellent opportunity to gain hands-on experience in the field of data engineering and work closely with experienced professionals.
Core Skills
1. Programming Languages
Proficiency in programming languages such as Python, SQL.
2. Big Data Technologies
Experience with big data technologies such as Hadoop, Spark, Kafka, and Flink.
Familiarity with data warehousing solutions like Amazon Redshift, Google BigQuery, and Snowflake
3. Database Management
Strong understanding of relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
Skills in database design, indexing, and query optimization
4. Data Modeling
Ability to design and build data models to support business requirements.
Experience with data modeling tools and techniques
5. ETL Processes
Expertise in Extract and Load (EL) processes and transform tool DBT
Ability to develop and maintain ETL workflows
6. Cloud Platforms
Knowledge of cloud platforms such as Snowflake
Experience with cloud-based data services and infrastructure
7. Data Governance
Understanding of data governance principles and best practices.
Ability to implement data governance frameworks to ensure data quality and compliance
8. Problem-Solving
Strong analytical and problem-solving skills.
Ability to troubleshoot and resolve data-related issues
9. Communication
Excellent communication skills to collaborate with technical and non-technical stakeholders.
Ability to translate complex technical concepts into understandable terms
10. Continuous Learning
Commitment to staying updated with the latest trends and technologies in data engineering.
Willingness to continuously improve skills and knowledge
Duties and Responsibilities
• Curating data elements and documenting data lineage
• Managing data storage and ensuring data quality
• Building and maintaining data pipelines and ETL processes – moving data between different cloud-based platforms and on-premises data sources
• Developing and maintaining databases and data warehouses
• Working with Product Owners and Analysts to understand business requirements and provide data solutions
• Writing scripts and code to automate data processes
Requirements and Qualifications
• Strong problem-solving and communication skills
• Proficiency in at least one programming language (Python, Java, etc.)
• Proficiency in DB2 and/or DataStage
• Knowledge of SQL and relational databases
• Understanding of big data technologies (Curation, Data Lineage, Data Mesh, etc.)
• Experience with cloud platforms (AWS, Snowflake, etc.)
