Job Description
Job Description
Sr Data Engineer
Experience : 7 - 25 Years
Location : & Glendale, CA – Onsite 3-4 days a week W2
Contract Role Duration 18 months W2
Experience on the below skills Mandatory :
- Airflow
- Apache Spark
- Snowflake OR Databricks
- Data Modeling
- Candidates should have a depth of experience in PySpark and data bricks
The Company
Headquartered in Los Angeles, this leader in the Entertainment Media space is focused on delivering world-class stories and experiences to it's global audience. To offer the best entertainment experiences, their technology teams focus on continued innovation and utilization of cutting edge technology.
Platform / Stack
You will work with technologies that include Python, AWS, Snowflake, Databricks, and Airflow.
What You'll Do As a Sr Data Engineer :
Contribute to maintaining, updating, and expanding existing Core Data platform data pipelinesBuild and maintain APIs to expose data to downstream applicationsDevelop real-time streaming data pipelinesTech stack includes Airflow, Spark, Databricks, Delta Lake, and SnowflakeCollaborate with product managers, architects, and other engineers to drive the success of the Core Data platformContribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and moreEnsure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)Qualifications :
You could be a great fit if you have :
7 years of data engineering experience developing large data pipelinesProficiency in at least one major programming language (e.g. Python, Java, Scala)Hands-on production environment experience with distributed processing systems such as SparkHands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelinesExperience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query).Experience in developing APIs with GraphQLAdvance understanding of OLTP vs OLAP environmentsGraph Database experience a plusRealtime Event Streaming experience a plus
