What are the responsibilities and job description for the Google Cloud Platform Data Tester w/ ETL position at Pinnacle Software Solutions?
Job Details
Job Title: Google Cloud Platform Data Tester w/ ETL
Location: Preference for Phoenix, AZ (Open to Walnut Creek, CA), must be onsite two days a week
Duration: 6-month Contract to Hire (CTH)
Job Overview:
We are seeking an experienced Google Cloud Platform Data Tester w/ ETL to validate and test data migration solutions on Google Cloud Platform (Google Cloud Platform). The ideal candidate will have a strong background in BigQuery, ETL testing, and complex SQL queries. As a Google Cloud Platform Data Tester, you will work closely with Data Engineers, Data Scientists, and Business Intelligence teams to ensure data accuracy, integrity, and consistency throughout the testing and migration process.
Key Responsibilities:
- Data Validation and Testing: Validate data migration and perform data validation using Google Cloud Platform, BigQuery, and ETL processes to ensure the accuracy and integrity of data.
- ETL Testing: Execute comprehensive ETL testing across multiple systems and platforms, focusing on data extraction, transformation, and loading accuracy.
- SQL Query Writing: Write and execute complex SQL queries to validate data and troubleshoot issues in BigQuery stored procedures.
- BigQuery Expertise: Perform validation and testing specifically on BigQuery, utilizing advanced features to ensure that all data is migrated and integrated correctly across systems.
- API Testing: Conduct API testing using tools like Postman to validate data integration and migration flows.
- Collaborate with Teams: Work closely with Data Engineers, Data Scientists, and Business Intelligence teams to understand data requirements and ensure successful execution of data solutions.
- Cloud Services Testing: Use Cloud Composer (Apache Airflow) and BigQuery Transfer Service to test data pipelines and integrations within Google Cloud Platform.
- Google Cloud Platform Expertise: Hands-on experience with various Google Cloud Platform services such as Cloud Storage, Pub/Sub, Cloud Functions, and IAM.
- Salesforce Data Cloud Testing: Experience working with Salesforce Data Cloud and conducting testing to ensure data flows seamlessly across Salesforce and other integrated systems.
- Version Control: Use version control tools like GitHub to manage and track code changes in the testing process.
Mandatory Skills and Qualifications:
- 5-10 years of overall experience in data testing, ETL, and database management.
- Advanced SQL Knowledge: Strong proficiency in writing complex SQL queries to debug and validate data, specifically within BigQuery stored procedures.
- BigQuery Expertise: Extensive experience working with BigQuery for data validation and integration testing.
- ETL Testing: Significant experience with ETL testing in cloud-based environments, including validating transformations and data loads.
- API Testing: Hands-on experience with Postman or similar tools to validate API data flows.
- Google Cloud Platform Services Knowledge: Practical experience with Google Cloud Platform services, including Cloud Storage, Pub/Sub, Cloud Functions, and IAM.
- Cloud Composer (Apache Airflow): Experience with Cloud Composer (or Apache Airflow) for ETL orchestration and testing.
- Salesforce Data Cloud (Nice to Have): Familiarity with Salesforce Data Cloud and its integration and testing.
- Version Control Tools: Experience using version control tools like GitHub.
- Collaborative Skills: Ability to collaborate with cross-functional teams, including Data Engineers, Data Scientists, and Business Intelligence teams, to understand requirements and deliver testing solutions.
Preferred Skills (Nice to Have):
- Experience with Salesforce Data Cloud testing.
- Experience in programming languages (e.g., Python, Java) for scripting or automation in testing.
- Familiarity with Google Cloud Platform logging services for monitoring and troubleshooting.