What are the responsibilities and job description for the GCP Data Engineer position at Devfi?
GCP Data Engineer
Location : Iselin NJ
Employment Type : Hybrid / W2 (H1b's preferred)
Experience Level : Minimum10 years of experience
Roles :
- Create and manage data storage solutions using GCP services such as BigQuery, Cloud Storage, and Cloud SQL
- Develop efficient ETL / ELT pipelines and orchestration using Data Prep, Google Cloud Composer
- Develop and Maintain Data Ingestion and transformation process using Apache PySpark, Dataflow
- Build data systems and pipelines on GCP Cloud using Data proc, Data Flow, Data Fusion, Big query and Pub / Sub
- Implement schedules / workflows and tasks for Cloud Composer / Apache Airflow.
Required Experience :
Benefits :