What are the responsibilities and job description for the Data Engineer position at Art of Problem Solving?
Job Description
Job Description
As a Data Engineer at AoPS, you will be the backbone of our data operations, enabling scalable and reliable access to data that drives mission-critical decisions across the organization. You will take ownership of our data pipeline infrastructure to ensure that data flows without error from sources to our end users. You will work closely with our Analytics Engineers to maintain the ELT pipeline, ensuring they have the data they need to design meaningful transformations. We deeply care about efficient orchestration and designing with observability in mind. Our pipeline is currently built on a combination of Fivetran, Airbyte, Redshift, dbt Cloud, and Lightdash using SQL, Python, and Go.
The Data Engineer will :
- Takes ownership of the data pipeline, from source ingestion to warehouse.
- Implements a pipeline orchestration solution with scheduling, monitoring, and error alerting for all pipeline exposures.
- Develops a deep understanding of AoPS data sources and business problems to inform choices about structuring and monitoring the data pipeline.
- Builds new data connections as needed with an appropriate tool for the use case (Fivetran, Airbyte, AWS Glue, AWS Lambda, etc.).
- Identifies opportunities to optimize the current data stack to produce more effective analytical solutions.
- Establishes processes as needed to ensure an error-free pipeline.
- Builds and maintains platforms that facilitate data exploration, machine learning model training, and experimentation for data analysts and data scientists.
The ideal candidate has :
Why Join AoPS :
This is a hybrid full-time position based at our headquarters in San Diego, CA. The full salary range for this position is 116k-135k with a 6% year-end bonus. Here are some things you can look forward to :
Background Check :
Please note that employment is contingent on the successful completion of a background check.
Work Authorization :
Please note that in order to be considered for this position you must be legally authorized to work in the US. We are unable to offer sponsorship, including STEM-OPT and H-1B.
About AoPS :
Art of Problem Solving (AoPS) is on a mission to discover, inspire, and train the great problem solvers of the next generation. Since 2003, we have trained hundreds of thousands of the country's top students, including nearly all the members of the US International Math Olympiad team, through our online school, in-person academies, textbooks, and online learning systems. While our primary focus has been math for most of our history, through the years we have expanded our unique problem solving curriculum into more subjects, such as language arts, science, and computer science.
By clicking submit application you agree that we may contact you regarding your application via email, phone or SMS and to the terms of our data privacy policy.
