What are the responsibilities and job description for the GCP Data Engineer (W2 Position) position at Megan Soft Inc?
We have a job opportunity of a Role GCP Data Engineer with given job description on W2 .Please forward related profiles to praveen@megansoft.com or 1(248) 266-0910.
Position Title: GCP Data Engineer (W2 Position)
Location: Dearborn, MI (Hybrid)
Duration: 12 Months
Experience: 8 Years
Jd
Skills Required:
Praveen
Megan Soft, Inc.
Direct No: 1(248) 266-0910
E Mail: praveen@megansoft.com
Linked In ID : https://www.linkedin.com/in/praveen-kanthri-160275167/
Position Title: GCP Data Engineer (W2 Position)
Location: Dearborn, MI (Hybrid)
Duration: 12 Months
Experience: 8 Years
Jd
Skills Required:
- Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment. Implement methods for automation of all parts of the pipeline to minimize labor in development and production
- Experience in analyzing complex data, organizing raw data and integrating massive datasets from multiple data sources to build subject areas and reusable data products
- Experience in working with architects to evaluate and productionalize appropriate GCP tools for data ingestion, integration, presentation, and reporting
- Experience in working with all stakeholders to formulate business problems as technical data requirement, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management
- In-depth understanding of Google’s product technology (or other cloud platform) and underlying architectures
- 5 years of analytics application development experience required
- 5 years of SQL development experience
- 3 years of Cloud experience (GCP preferred) with solution designed and implemented at production scale
- Experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Terraform, Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Airflow, etc.
- 2 years professional development experience in Java or Python, and Apache Beam
- Extracting, Loading, Transforming, cleaning, and validating data
- Designing pipelines and architectures for data processing
- 1 year of designing and building CI/CD pipelines
Praveen
Megan Soft, Inc.
Direct No: 1(248) 266-0910
E Mail: praveen@megansoft.com
Linked In ID : https://www.linkedin.com/in/praveen-kanthri-160275167/