What are the responsibilities and job description for the Senior Data Engineer position at DATAECONOMY?
We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.
Key Responsibilities :
- Model Development : Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks.
- Cloud Infrastructure : Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience.
- ETL Pipeline Development : Create, manage, and optimize ETL pipelines using PySpark for large-scale data processing.
- CI / CD Implementation : Build and maintain CI / CD pipelines for deploying and maintaining cloud-based applications.
- Data Analysis : Perform detailed data analysis and deliver actionable insights to stakeholders.
- Collaboration : Work closely with cross-functional teams to understand requirements, present solutions, and ensure alignment with business goals.
- Agile Methodology : Operate effectively in agile or hybrid agile environments, delivering high-quality results within tight deadlines.
- Framework Development : Enhance and expand existing frameworks and capabilities to support evolving business needs.
- Documentation and Communication : Create clear documentation and present technical solutions to both technical and non-technical audiences.
Requirements
Soft Skills :
Preferred Qualifications :
Benefits
