What are the responsibilities and job description for the Google Cloud Platform ETL Tester position at Pinnacle Software Solutions?
Job Details
Job Title: Google Cloud Platform ETL Tester - AAA MWG
Location:
- Preference for Phoenix, AZ (can sit in Walnut Creek, CA)
- Onsite two days a week Duration: 6 Months
Job Description:
We are looking for an experienced Google Cloud Platform ETL Tester with strong expertise in BigQuery, ETL Testing, and hands-on experience with Google Cloud Platform (Google Cloud Platform) services. This role is ideal for someone with a solid background in SQL debugging and data validation between systems, as well as experience in working with cloud-based ETL tools and services. The successful candidate will work closely with a cross-functional team of data engineers, data scientists, and business intelligence teams to deliver efficient data solutions.
Required Skills and Qualifications:
- Deep knowledge of SQL, particularly for debugging BigQuery Stored Procedures and working on medium to complex SQL queries to perform data validation between systems.
- Strong experience in ETL testing, specifically with Cloud Composer (Apache Airflow) and BigQuery Transfer Service.
- Hands-on experience with key Google Cloud Platform services, including Cloud Storage, Pub/Sub, Cloud Functions, and IAM.
- Good understanding of Google Cloud Platform logging services to monitor and troubleshoot data pipelines.
- Extensive experience with Salesforce, particularly in Salesforce Data Cloud testing.
- Working knowledge of version control tools like GitHub.
- Strong proficiency in API testing and ETL validation processes.
Additional Requirements for Sr. Data Engineer:
- 5-10 years of experience in data engineering and testing.
- Expertise in complex SQL queries for data validation, debugging, and querying across platforms.
- Experience validating data migration with Google Cloud Platform, BigQuery, and cloud services.
- Strong understanding of API integrations and ETL processes.
- Proven ability to perform database testing.
- Familiarity with Postman for API testing.
- Salesforce Data Cloud experience is a plus, but not required.
Responsibilities:
- Conduct testing for ETL processes using Cloud Composer and BigQuery.
- Validate data migration and ensure data integrity between various systems within the Google Cloud Platform.
- Work with Salesforce data, ensuring accuracy and consistency, especially with Salesforce Data Cloud.
- Write and execute complex SQL queries for data validation and troubleshooting.
- Collaborate with data engineers, data scientists, and business intelligence teams to understand data requirements and provide efficient solutions.
- Utilize version control tools like GitHub for code and test management.
- Perform comprehensive testing using Postman for API testing.
- Review Google Cloud Platform logs and troubleshoot issues related to ETL workflows and data transfers
