Senior Data Engineer

Schupan began as a scrap metal recycling company in 1968, with the purpose of creating a culture of stewardship, excellence in customer service, and industry-focused solutions. Today, it operates across multiple divisions with diverse specializations and is known for its commitment to sustainability, innovative recycling solutions, and exceptional customer service. Schupan takes pride in its dedication to environmental responsibility and in creating value through quality, integrity, and customer-centered practices. Join a dynamic team where you can contribute to meaningful work in a growing, impactful industry.

We are seeking a skilled Senior Data Engineer to enhance our IT team's capabilities in integration, analytics, and automation. This role is pivotal in designing and implementing systems integrations and data solutions that directly support our company's growth objectives. The ideal candidate will have substantial experience and the ability to work both independently and collaboratively in small teams. We are looking for someone who is hands-on, adaptable, and focused on delivering practical results that drive business impact. Key responsibilities include developing our integrations and data infrastructure, optimizing data processes, data pipelines, and translating complex data into actionable insights for decision-making. This position requires strong technical expertise in data engineering and the ability to align technical solutions with business needs.

Key Responsibilities:

• Integration Architecture: Actively participate in designing, building, and maintaining integration architecture principles, standards and best practices.
• Participate in the technical evaluation and recommendation and deployment of integration platforms and tools.
• Systems Integration Operations: Monitor, support, troubleshot and enhance existing systems integrations. Use Transact-SQL (T-SQL) to optimize, and maintain complex database operations, improve performance, and enable analytics needs.
• APIs Development and Maintenance: Design, build, and maintain APIs to enable data integration, and access across multiple systems and applications.
• Data Pipelines: Design, set up and maintain data pipelines; monitor and ensure its performance and health.
• Data Management: Design and manage relational databases; implement and maintain validation techniques to ensure data accessibility, integrity, accuracy, and consistency; and support analytics initiatives to drive business insights and decision-making.
• Security Compliance: Ensure security practices are followed and comply with regulatory standards and policies.
• Collaboration: Collaborate with data leaders and multi-discipline teams to design, develop and ensure critical data and integration solutions.

Skills:

• Proficiency in T-SQL skills, including performance tuning.
• Extensive experience with APIs (REST and GraphQL) management, and market leading iPaaS.
• Proven success with Microsoft SQL Server, MS Integration Services. Azure Data Factory, Data Lake and Data Bricks are a plus.
• Strong experience with integration of cloud services with on-premises technologies.
• Strong Python scripting experience.
• Proven experience in developing/maintaining robust and scalable big data solutions, as well as with various data infrastructures, from relational databases to column-oriented databases, and unstructured data sources.
• Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior-level management.
• Proven track record of leading and mentoring data teams.
• Strong change manager. Comfortable with change, especially that which arises through company growth. Able to lead a team effectively through times of change.
• Ability to understand and translate business requirements into data and technical requirements.

Qualifications:

• Education: Bachelor's degree in Computer Science, Information Systems, Data Engineering, Applied Mathematics, or a technical field.
• Experience: 5 years of experience as a Data Engineer, API Developer, or similar role.
• Preferred:
• Certifications: Relevant Azure Data Engineer and SQL Server are desirable.
• Big Data Tools: Familiarity with tools like Azure Data Explorer and Azure Synapse
• Experience with Reporting Tools: Knowledge of reporting tools like Power BI or Tableau.
• CDATA tools Experience: Proficiency with CDATA tools for data integration, connectivity, and transformation across various data sources.