Data Engineer/Senior Engineer

Job Description:

As a data engineer, you are responsible for designing, developing, testing, and maintaining ETL (extract-transform-load) programs. We are using these programs every day to handle a large amount of data coming from our products worldwide. Your work will influence users of our products as well as internal staffs from other departments. You will work collaboratively with other colleagues to make decisions on technologies and product features.

• Collect data from various date sources, clean and ingest them into data warehouse
• Design data warehouse models and ETL pipelines. Develop, delivery and maintain data jobs using various technologies
• Deep dive into data jobs with performance issue, figure out the root cause, and optimize them accordingly
• Collaborate with data analysts and external users, understand and normalize their use cases on each data service, build and maintain development frameworks accordingly
• Collaborate with data platform engineers, build and maintain data engine of platform features
• Manage data, scripts and documentation in accordance with compliance rules
  
  
  

Requirements:

• Bachelor's degree or higher in Computer Science, Business Analytics, Mathematics, or related disciplines
• Self-learner with a strong sense of ownership
• Familiar with one of the following programming languages: Python, Scala, Java
• Experience with one or more of the following: PySpark, Hadoop, Flink
• Experience with Linux and Shell scripting
• Experience with Git will be an added advantage
• Passionate about programming and new technologies in the field
• Strong written and verbal communication skills
• Strong interpersonal skills and team player