What are the responsibilities and job description for the Data Integration Engineer position at O'Reilly Media?
A company is looking for a Data Integration Engineer to develop and expand systems and tools focused on ETL processes.Key ResponsibilitiesArchitect and build complex ETL pipelines using Talend Data IntegrationManage and optimize BigQuery datasets and implement advanced SQL queriesImplement and optimize real-time data pipelines using Google Pub / Sub and DataflowRequired Qualifications6 years of professional data engineering experienceStrong experience with Talend Data Integration and ETL pipeline optimizationExperience with JSON and ARRAY data structures in BigQueryProficient in building real-time data pipelines with Google Cloud technologiesSolid understanding of PostgreSQL and query optimization techniques
