What are the responsibilities and job description for the Data Engineer position at HPTech Inc.?
Job Details
Job Functions / Responsibilities
- Build and document automated data pipelines from a wide range of data sources, with a strong focus on automation and scalability for our Connected Vehicle Platform.
- Develop highly available data services to support near-real-time integrations with our Connected Vehicle Platform using a multi-cloud-based technology stack.
- Ensure product and technical features are delivered to spec and on-time in a DevOps fashion through Github/Github Actions.
- Contribute to overall architecture, framework, and design patterns to store and process highdatavolumes of connected vehicle data.
- Develop solutions to measure, improve, and monitordataquality based on business requirements from connected vehicle data.
- Collaborate with product owners, reporting analysts, data analysts, and business partners within an Agile/Scrum methodology to design and implement reporting and analytics features specifically tailored to the Connected Vehicle Platform.
- Proactively support product health by building automated, scalable, and sustainable solutions, with a relentless focus on minimizing defects and technical.
- Provide post-implementation production support for data pipelines, with a deep understanding of the unique challenges and requirements of the Connected Vehicle Platform.
Qualifications
- Bachelors' degree in Computer Science, Informatics, or a related field required.
- Masters degree in Computer Science preferred.
- 3 years of experience in adataengineering role.
- 2 years of experience with AWS and related services (e.g., EC2, S3, SNS, Lambda, IAM,etc.).
- Hands-on experience with ETL tools and techniques (Desirable).
- Basic proficiency with a dialect of ANSI SQL and Python.
- Knowledge of and experience with RDBMS platforms, such as MS SQL Server, MySQL, Postgres. NoSQL databases experience is a plus.
- Experience with Snowflake Data Warehouses.
- Experience in Data design and advanced Data Modeling in the Automotive industry.
- Experience with creating Kafka Topics, connectors, consumers and processors.
- Experience with participating in time sensitive projects in a highly collaborative, multi-disciplinary team environment.
- AWS or Google Cloud Platform Certification is plus.
Education
- Bachelor's degree in Computer Science, Informatics, Business Administration or related field required
- Master s Degree in Computer Science, Business Administration or related field preferred
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
