Oversee the design, development, and maintenance of data infrastructure.
Ensure scalable data design and reliable data pipelines
Responsibilities and Duties:
Lead our team of data engineers and database administrators with a strong focus on high-quality solution delivery and team culture.
Design, implement and maintain scalable and reliable data pipelines, ETL processes, and databases to support a variety of data and analytics needs.
Lead the development and maintenance of a comprehensive and up-to-date data dictionary by overseeing the capture of end-to-end data flows and the creation of source-to-target documentation, ensuring a detailed and accessible repository that enhances data understanding and transparency across the organization.
Provide technical leadership and strategic direction to align data engineering initiatives with business objectives.
Build cross-functional relationships with software engineers, solutions engineers. and other business stakeholders to collaboratively build solutions, standards, and processes.
Provide strategic leadership to the data engineering team, guiding the effective and appropriate utilization of tools, including but not limited to BigQuery, SQLDBM, Airflow, and Great Expectations.
Foster a culture of excellence in performant data transformations and clear schema design, ensuring alignment with operational and analytical business requirements.
Manage and optimize data storage and processing systems to enhance performance, improve reliability and optimize cost.
Manage alerting, on-call, triage, and response procedures to ensure timely resolution of issues.
Ensure our data architecture is secure and compliant per company policies and industry standards.
Qualifications:
5 years experience managing and leading data engineering and database administration teams
In-depth knowledge of database systems, data warehousing concepts and data modeling techniques.
6 years of hands-on experience in data management activities such as building data pipelines and database administration.
Strong proficiency in programming languages such as Python and data processing framework such as Airflow
Proficiency in one or more of the following technologies, languages, and databases: Python, SQL, MySQL database, BigQuery, Airflow, Google Cloud