What are the responsibilities and job description for the Senior Data Engineer position at Agility Partners?
Agility Partners is seeking a qualified Sr. Data Engineer to fill an open position with one of our clients. This is an exciting opportunity to work on a Financial Crimes IT team, where you will play a key role in modernizing data processes. You will collaborate with business analysts, data engineers, and upstream teams to enhance data ingestion and processing. This role requires strong expertise in ETL development using DataStage and DBT, ensuring data quality and accuracy for Financial Crimes applications.
Responsibilities:
- Design, construct, install, test, and maintain data management systems.
- Develop and update ETL pipelines using DataStage and DBT for data ingestion.
- Ensure data quality, reliability, and adherence to business and industry standards.
- Collaborate with cross-functional teams to integrate new data management technologies.
The Ideal Candidate:
- Has at least 5 years of experience in data engineering.
- Holds a technical degree or has equivalent work experience.
- Experienced in both relational and non-relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.).
- Proficient in programming and/or architecting backend systems using Java, J2EE, or similar technologies.
- Skilled in building high-performance algorithms, predictive models, and data prototypes.
- Knowledgeable in data mining, data modeling, and data integration techniques.
- Strong problem-solving skills with the ability to work in a collaborative environment.
Reasons to Love It:
- Opportunity to work on impactful projects in the financial crimes sector.
- Collaborate with a skilled and supportive team.
- Gain hands-on experience with modern data engineering tools and technologies.