What are the responsibilities and job description for the Data Engineer position at Addison Group?
Salary 140 -165k bonus
Chicago Metro Hybrid
No Visa Transfers at this time
Our client and large financial services organization has a newly created role for a Data Engineer to join a team focused on a highly visible initative for Data Transformation and the use of Gen AI. This role requires strong skills with Azure Data Bricks, ETL Python .
- Participate in design and architecture of software solutions with focus on ETL data management
- Design, develop, and optimize complex queries to support data discovery, analysis, and reporting. Leverage databases to ensure accurate data staging and transformation processes that align with business requirements
- Develop and implement data staging strategies to prepare data for analysis and reporting
- Conduct thorough data discovery to identify and address data quality issues (including handling of structured or unstructured data in data lakes, data warehouses or other data repository types), ensuring that the data is accurate, complete, and accessible for business needs
- Partnering with our business, business process group and key stakeholder teams to create effective solutions
- Optimize data models for query performance and scalability
- Data Repositories, Warehousing, and Data Lakes :
- Manage and maintain data repositories, data warehouses and data lakes, including structured and unstructured data, data loading, indexing, and partitioning
- Implement data security and privacy measures to protect sensitive information
- Cloud Technologies :
- Leverage cloud platforms (e.g., Azure) to build scalable and cost-effective data solutions
- Utilize cloud-native data services (e.g., data repositories, data warehouses, data lakes, data pipelines) to accelerate data processing and analysis
Minimum Qualifications