What are the responsibilities and job description for the Google Cloud Platform Data Engineer @ Raritan, NJ position at Hecta Data LLC DBA Vilwaa?
Job Details
Job Title: Google Cloud Platform Data Engineer
Job Type: Contract
Location: Raritan, NJ
Duration: 6 Months
Start Date: Immediate
About US
At Vilwaa (), we are focused towards delivering IT services and solutions in Data Engineering, Cloud Infrastructure solutions, Digital Application Development, (IoT) - Internet of Things.
We are seeking an experienced Google Cloud Platform Data Engineer with deep expertise in building the data pipelines to fetch the data from various source system patterns such as batch, streaming & relational.
Skills Required:
- Google Cloud Platform Dataflow
- Cloud Composer (Airflow)
- Big Query
- Functions
- Strong SQL
- Python knowledge (Required to create Airflow, Dataflow).
- Knowledge on reading from API, File
JD: Python Google Cloud Platform
- Hands-on experience in building the data pipelines to fetch the data from various source system patterns such as batch, streaming & relational.
- Hands-on experience in Google services such as BigQuery, DataFlow, DataProc, Cloud scheduler, Cloud Storage, Pub/Sub, Cloud Composer, Cloud Function.
- Hands-on experience in using cloud data ingestion tools such as Apache NiFi & Qlik Replicate/Golden Gate.
- How to optimize the data engineer pipelines.
- Exposure towards leveraging Python in cloud services.
- Hands-on experience in tuning Big Query SQL.
- Understand the DWH, Snowflake & STAR schema designs, normalization forms & slowly changing dimensions.
- 6 or more years of experience in performance tuning SQL queries on OLAP databases
- Python (>3 years)
- CI/CD (>2 years)
- Data analysis (>2 years)
- Work with multiple geographic teams
- Need a strong team collaborator that can work and lead independently.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
