What are the responsibilities and job description for the Lead Data Engineer position at Silverchair?
About Silverchair
Silverchair is the premier independent platform partner for scholarly and professional publishers, dedicated to expanding the reach of the world’s most valuable knowledge. By connecting creators, publishers, and users, we amplify the impact of scholarship and enhance the accessibility of critical information. Our global teams develop, build, and host websites, online products, and digital libraries for prestigious publishers, including the American Medical Association, MIT Press, and Oxford University Press.
DEI Statement
At Silverchair, we celebrate and embrace diversity in all its forms. We are committed to fostering an inclusive environment from the moment you consider joining our team. We actively encourage candidates from diverse backgrounds to apply, believing that a variety of perspectives and experiences enriches our community, drives innovation, and strengthens our impact.
Equity and inclusion are at the core of our hiring practices, and we strive to build a team that reflects a broad spectrum of cultures, experiences, and viewpoints. We are particularly committed to increasing representation from groups historically underrepresented in technology careers. Your unique experiences and perspectives are not just welcomed but are integral to our collective success. Join us in our mission to create a culture that unites and brings out the best in all of us.
Learn more about our commitment to diversity, equity, and inclusion at Silverchair.
Overview
Silverchair seeks a seasoned Lead Data Engineer with deep expertise in Microsoft Azure to play a pivotal role in advancing our analytic capabilities. With a demonstrated history of success in developing, deploying, and managing Azure data engineering projects, this hands-on leader will bring a robust background in data engineering, cloud computing, and analytics, coupled with the capacity to spearhead projects and provide guidance to team members.
As Lead Data Engineer, you will have the opportunity to advance offerings in scholarly publishing analytics, serving world-renowned client organizations. You'll be joining Silverchair, a company that combines long-established industry presence with the agility of a nimble software organization. Our analytics team operates with a startup-like ethos offering high autonomy and robust support from leadership within a growing company. Your strategic vision and technical expertise will be key in shaping the future of our data platform as you deliver innovative data solutions to the scholarly publishing industry.
Essential Functions
- Data Platform Leadership
Take an ownership mindset to fully understand the existing data estate and partner with the Technical Director in planning the short- and long-term development path to achieve data platform enhancement goals.
Create transformations that ensure robust and reliable data flow from source data to report delivery. Acquire existing data transformations and evolve them to improve client reporting standards and exceed client reporting expectations.
Design, construct, and maintain robust data pipelines using Microsoft ETL tools like Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric, ensuring optimal data flow for analytics.
Implement and manage Azure-based solutions (Data Lakes, Synapse SQL servers, Fabric Data Warehouses and Lakehouses), maintaining data integrity and accessibility.
Ensure efficient, reliable data handling and retrieval by monitoring and optimizing the performance of data lakes, Synapse SQL Servers and Fabric assets.
Document data engineering projects, including architecture and established processes, using industry standard visualization tools like Lucid or Visio, DBML diagrams, and written Standard Operating Procedures.
Required Skills
Experience with Change Data Capture for data ingestion, as well as strategies for data movement optimization, including incremental ingestion and preservation of historical data.
Desired Experience
Experience building Power BI semantic models and reporting with demonstrated capability to define dimensional models to produce effective semantic models.
Experience with Azure DevOps, Git, and Agile Scrum environments.
Familiarity with Pentaho is a significant plus, given existing legacy systems.
Experience integrating data solutions with machine learning models.
Location and Remote Work
Open for remote candidates with the ability to work within the Eastern Time Zone. Candidates based in or around Charlottesville, Virginia, are a plus.
Disclosures
