What are the responsibilities and job description for the Data Engineer position at Drum Associates?
We're looking for a Data Engineer to join a Fortune 100, mission-driven team in Boston, MA who has a passion for building reliable and scalable systems. In this role, you will be part of an innovative technology group who's focused on creating their next generation of leaders.
In addition to this full-time opportunity, you will also be enrolled in a program at DRUM that provides you with on-demand, paid for training in our partners niche technologies. This is an exciting opportunity to advance your career while simultaneously upskilling and continuing to make an impact in the world of technology.
Responsibilities :
- Assist in the development of large-scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs
- Write ETL processes, design database systems and develop tools for real-time and offline analytic processing
- Collaborates with client team to transform data and integrate algorithms and models into automated processes
- Uses programming skills in Python, Java or any of the major languages to build robust data pipelines and dynamic systems
- Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards
- Understand and transform technical specifications into a data model, and database deliverables for the build out of our compliance trade data warehouse and metrics data warehouse
- Apply strong knowledge in Python and Shell Scripting required for file processing and database connections
Experience :
