What are the responsibilities and job description for the Data Engineer Lead position at Private Company?
Job Description
Job Description
Data Engineering Lead
We are seeking a highly skilled Data Engineering Lead with extensive experience in designing and implementing data architectures across multiple platforms, including Snowflake and MS SQL Server . This critical role will focus on building scalable, high-performance data solutions and supporting data-driven initiatives within our organization. The ideal candidate will be a strategic problem solver, with a deep understanding of data engineering best practices, and will work in close collaboration with cross-functional teams.
Responsibilities :
Data Architecture & Design :
Design and implement scalable data architectures across Snowflake and other platforms to support analytics, reporting, and operational systems.
Optimize database schemas and data models to enhance performance, scalability, and long-term maintainability.
Data Engineering :
Develop, test, and maintain efficient ETL / ELT pipelines to process and load data from diverse sources.
Build real-time and batch data pipelines that ensure robust data flows.
Database Expertise :
Apply advanced expertise in MS SQL Server and other database platforms, ensuring efficient storage, query optimization, and performance tuning.
Leverage knowledge of NoSQL , columnar , and relational databases to support a variety of data use cases.
Collaboration & Cross-Functional Support :
Partner with data scientists, analysts, and software engineers to understand and meet data requirements.
Collaborate with business stakeholders to align data structures and ensure organizational goals are supported.
Data Quality & Governance :
Enforce and maintain data quality, security, and governance standards to ensure data accuracy, integrity, and compliance.
Continuously monitor data systems to ensure consistency and reliability.
Performance Optimization :
Continuously optimize query performance, storage efficiency, and processing speed across multiple platforms.
Mentorship & Leadership :
Provide technical mentorship and leadership to junior data engineers and analysts, fostering their growth and promoting best practices.
Guide the team in problem-solving and troubleshooting complex data issues to ensure long-term solutions.
Skills & Experience Required :
Education : Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
Experience : 6 years in data engineering, with hands-on expertise in Snowflake and MS SQL Server .
Snowflake : Proficient in Snowflake data architecture, warehouse optimization, and advanced features like time travel and zero-copy cloning.
MS SQL Server : Extensive experience with database design, query optimization, and performance tuning.
Data Pipeline Development : Hands-on experience with modern ETL / ELT tools (e.g., Apache Airflow, Talend, DBT, Fivetran) or custom Python / Scala pipelines.
Data Warehousing : Expertise in designing and managing data warehouses, particularly with Snowflake .
Programming & Scripting : Proficiency in programming languages such as Python and SQL .
Cloud Platforms : Experience working with cloud technologies such as AWS , Azure , or Google Cloud and their respective data services.
Data Quality & Governance : Strong ability to enforce data integrity, quality checks, and governance practices.
Performance Tuning : Proven track record in query optimization and database tuning in large-scale environments.
Analytical & Problem-Solving Skills : Excellent analytical skills with a strong problem-solving approach.
Communication Skills : Ability to clearly communicate technical concepts to both technical and non-technical stakeholders.
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Data Engineer Lead?
Sign up to receive alerts about other jobs on the Data Engineer Lead career path by checking the boxes next to the positions that interest you.
