What are the responsibilities and job description for the Data Engineer position at ARK Infotech Spectrum?
Job Details
Role : Data Engineer
Location : Mountainview , CA
NOTE : Previous experience working with Google is Plus
Required Technical Skills :
- More than 10 years experience implementing data solutions
- Strong proficiency in Java, Python and kotlin with an emphasis in building data pipelines
- Experience in big data technologies like HDFS, YARN, Map-Reduce, Kafka, Spark, Airflow, etc.
- Experience in working with Google Internal tools like PLX, CiderV, Buganizer etc.
- Experience with Apache Airflow, Google Composer and dataflow
- Experience with Cloud platforms such as Google Cloud Platform, Azure
- Ability to write complex SQL to perform common types of analysis and aggregations
- Experience with Data Visualization Applications. Looker is a plus
- Collaborate with cross-functional teams such as developers, analysts, and operations to execute deliverables
- Detail-oriented and document all the work
- 5 years professional experience as a data or software engineer
- BS in Computer Science; MS in Computer Science preferred
- Google Cloud Platform solution architect - certified, is a plus
Responsibility of / Expectations from the Role
- Data modeling/Data warehouse modernization/Cloud based data lakes
- Create and maintain optimal data pipeline architecture
- Define technical roadmap for data platform modernization and analysis and assessment of the existing data platforms
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
