What are the responsibilities and job description for the Data Engineer II position at Lakeshore Recycling Systems?
As a Data Engineer II, you will be responsible for designing, developing, and maintaining robust data pipelines and warehouse solutions. You will work with modern data stack technologies to ensure efficient data integration, transformation, and delivery for analytics and reporting needs. This position requires hands-on development experience, mentorship of junior engineers, and close collaboration with analytics and business teams.
- Design and implement scalable data pipelines using Azure Data Factory and other modern tools
- Develop and optimize ETL / ELT processes for various data sources
- Implement data quality frameworks and monitoring solutions
- Build robust error handling and pipeline monitoring systems
- Design and implement efficient data models for warehousing
- Write complex SQL queries and stored procedures
- Optimize database performance and query execution
- Implement data governance and security measures
- Develop solutions using Azure Fabric and other modern data platforms
- Implement real-time data integration patterns when needed
- Design and maintain data marts for specific business domains
- Create and maintain data documentation and lineage
- Develop automated testing frameworks for data pipelines
- Implement data quality rules and monitoring systems
- Perform code reviews and mentor junior engineers
- Ensure compliance with data governance standards
- Mentor Data Engineer I team members
- Collaborate with business analysts and data scientists
- Participate in architecture discussions and design reviews
- Help define and implement best practices
- Bachelor's degree in Computer Science, Information Systems, or a related fieldor an equivalent combination of education, certifications, and proven hands-on experience.
- 2-5 years of hands-on data engineering experience
- Strong experience with SQL and database optimization
- Proficiency with Azure data services or similar cloud platforms
- Experience with modern data warehouse architecture
- Knowledge of data modeling and dimensional design
- Understanding of data governance and security principles
