What are the responsibilities and job description for the Data Engineering Lead position at Vydia?

Job Type

Full-time

Description

About Vydia :

Vydia is an end-to-end music technology platform and services company that provides labels with the infrastructure and tools to power their business. The company's innovative solutions in rights management, automated royalty accounting, advanced payments, and daily performance analytics provide leaders in music and culture with the unfettered ability to publish, distribute, and monetize their audio-visual content on a global scale. Vydia is a wholly-owned division of gamma., the artist-first multimedia platform providing creative and business services across all artistic and commercial formats founded by CEO Larry Jackson and President Ike Youssef. To learn more, please visit vydia.com

Description :

As the Data Engineering Lead, you will play a critical role in leading and contributing to our data engineering competency to ensure the highest quality, integrity, efficiency, and scalability of our data services and infrastructure. This position requires a hands-on leader with a passion for data excellence, a deep technical understanding, and the ability to guide and mentor a team to provide data as a platform service to the broader organization and to customers.

Responsibilities :

Data Architecture : Lead the design, implementation and operation of robust data architecture, ETL / ELT pipelines, and data warehousing strategies using Airflow and AWS cloud services.
Team Management and Leadership : Manage a small team of Data and Business Intelligence engineers, fostering a collaborative and results-driven environment. Provide mentorship and encourage growth. Manage data expenses. Develop and report KPIs.
Technical Expertise and Contribution : Be an individual contributor for our data projects. Provide hands-on guidance and expertise to the team in Python, SQL, and AWS cloud services, ensuring high-quality code and software engineering best practices. Help manage and pay off tech debt.
Data and BI Services and Integration : Collaborate with product engineers and internal data stakeholders to make application data available for product features and work closely with business analysts to orchestrate Business Intelligence reporting using Looker.
Quality Standards : Uphold and refine data quality standards, engineering best practices, and KPIs while optimizing data pipelines for performance, scalability, and data quality.
Innovation : Challenge existing structures and thought processes, staying updated with the latest developments in technology and recommending innovative solutions.
Communication : Clearly and concisely communicate ideas to both technical and non-technical stakeholders, sharing knowledge and expertise both upstream and downstream.
Cloud Infrastructure Optimization : Work closely with DevOps to optimize cloud infrastructure performance and scalability and help to save costs.
Code Reviews : Participate in code reviews to ensure code quality and knowledge sharing among team members.
Documentation : Maintain comprehensive documentation for data processes and systems. Establish and enforce documentation best practices.
Testing : Implement robust testing frameworks for data pipelines and quality assurance. Increase test coverage across all data engineering projects. Develop automated testing scripts for data integrity and performance.
Monitoring : Design and implement logging and monitoring systems for data workflows. Set up real-time alerting mechanisms for data pipeline issues.
Data Governance, Compliance, and Security : Manage and maintain internal and external security best practices. Ensure compliance with Data Usage-license agreements.

Qualifications :

Experience : 6 years of experience as a Data Engineer with increasing responsibility and a strong track record of technical leadership.

Technical Skills : Advanced skills in Python 3 (5 years recent), SQL (5 years recent), and data cloud services (AWS preferred, 3 years). Extensive experience with data pipeline development (batch processing), management, data warehousing (Redshift, Postgres), and orchestration (Airflow) is a must. Experience working heavily with analytics and BI reports.

Leadership : 2 years of experience in a team leadership role

Passion : Passionate about the latest developments in technology, with a commitment to data quality and high personal code / development standards.

Team Player : A friendly, collaborative, and passionate team player who can adapt to a fast-paced environment and is experienced with Scrum / Agile methodologies. Can both give and receive respectful constructive feedback. Committed to prioritizing team success over personal gain.

Leveraging Partnerships : Experienced in evaluating and executing strategic outsourcing opportunities as a complement to in-house capabilities, ensuring optimal resource utilization without compromising team integrity or project quality.

Continuous Learning : A commitment to staying updated with industry trends and emerging technologies.

Communication : Excellent communication skills, with the ability to articulate ideas and solutions effectively.

Nice to Haves :

Working knowledge of Kubernetes and Docker

Experience with AWS Athena & AWS GLUE

Experience with AWS RDS Aurora

Experience with Snowflake or GCP BigQuery

The Vydia Development Experience :

Join an environment where there is an emphasis on individual growth, experimentation, and ownership. You'll find a team that is focused on creating a great experience for our clients, partners, and coworkers alike. From technical education to career growth, you will be given the resources needed to excel.

Reasons to work with us :

Vydia is certified as a Great Place to Work™ company and has been named Best Place to Work in NJ by NJBIZ 6x (2024 most recent) due to its collaborative, fast-paced, and fun, thriving environment. Additionally, Vydia has been named a 2023 Fortune Best Workplaces in New York.

Vydia was honored with the 2023 TechUnited Catalyst of Technology Award for our cutting edge technology and scalable platform that provides global music entrepreneurs and their labels the ability to stay independent. Vydia was also named the 2022 winner of the NJBIZ Business Of The Year award (51-100 employees) which recognizes the state's most dynamic businesses and business leaders who share a commitment to professional excellence, business growth and the community.

Major growth opportunities alongside the growth of the company; Vydia has been identified as an Inc 500 Fastest Growing Company in America and by Entrepreneur Magazine as one of the most Entrepreneurial companies in America

Join a mission-based culture that enjoys giving back to the community through a variety of initiatives that are meaningful to our team members

Full medical / dental / vision package, 401k retirement with employer matching, and financial wellness plans

We invest in your growth and development, providing a professional development stipend for continued education and mentorship to support your career goals

Hybrid / Remote flexibility to work from home

Generous vacation policy including paid parental leave

Vydia provides equal employment opportunities to all applicants and employees and strictly prohibits any type of harassment or discrimination in regards to race, religion, age, color, sex, disability status, national origin, genetics, sexual orientation, protected veteran status, gender expression, gender identity, or any other characteristic protected under federal, state, and / or local laws.

Consistent with the Americans with Disabilities Act (ADA), it is the policy of Vydia to provide reasonable accommodation when requested by a qualified applicant or employee with a disability, unless such accommodation would cause an undue hardship. The policy regarding requests for reasonable accommodation applies to all aspects of employment, including the application process. If reasonable accommodation is needed, please contact HR@Vydia.com

Your employment with Vydia is on an at-will basis, meaning either you or the Company can terminate the employment relationship, at any time, for any or no reason, and with or without cause or notice. As an at-will employee, your employment with Vydia is not guaranteed for any length of time.

For all California residents, to learn more about how Vydia processes your personal information when you apply for a job, please visit our California Job Applicant Privacy Policy at

Salary Description

170,000 - $200,000

Salary : $170,000 - $200,000

Apply for this job

Receive alerts for other Data Engineering Lead job openings

Data Engineering Lead

What are the responsibilities and job description for the Data Engineering Lead position at Vydia?

What is the career path for a Data Engineering Lead?

Not the job you're looking for? Here are some other Data Engineering Lead jobs in the Holmdel, NJ area that may be a better fit.

We don't have any other Data Engineering Lead jobs in the Holmdel, NJ area right now.

AI Assistant is available now!