Data Operations Engineer

Position Summary

DataOps Engineers help to build and manage our data pipeline operations, ensuring smooth, efficient, and high-quality data flow across our platforms. This role emphasizes data pipeline management, data quality testing, and the optimization of data delivery. As part of our growing data team, you’ll play a pivotal role in ensuring data is processed, validated, and made available efficiently and reliably for business and analytical use.

Responsibilities

Data Pipeline Management: Oversee the development, maintenance, and continuous improvement of data pipelines to ensure timely and reliable delivery of data across systems.

Data Quality Testing: Implement and maintain automated data validation and quality testing frameworks to ensure accuracy, consistency, and reliability of data.

Pipeline Monitoring & Optimization: Monitor and track pipeline performance, proactively identifying and resolving bottlenecks or failures to maintain optimal data flow.

Data Integration: Collaborate with data and software engineers to integrate new data sources and pipelines, ensuring they meet business and technical requirements.

Data Validation & Profiling: Implement data profiling tools and techniques to continuously assess data quality, detect anomalies, and ensure data adheres to predefined quality standards.

Pipeline Automation: Automate routine tasks related to data ingestion, transformation, and delivery using appropriate tools and technologies, minimizing manual intervention.

Collaboration: Partner with data engineers, analysts, and business teams to ensure that data is accessible, accurate, and up to date for decision-making and reporting needs.

Documentation: Maintain thorough documentation for data pipelines, data flows, data quality checks, and operational processes.

Data Governance: Ensure data governance policies are enforced across data pipelines, including data lineage tracking, auditability, and access control.

Continuous Improvement: Evaluate and recommend tools and practices to improve the reliability, scalability, and performance of data operations.

Qualifications

Experience: 3 years of experience in DataOps, Data Engineering, or Data Management roles, with a strong focus on data pipeline management and data quality.

Data Pipeline Tools: Proficiency with data orchestration and ETL/ELT tools such as Apache Airflow, Azure Data Factory, dbt, Fivetran, or similar to manage complex data pipelines.

Data Quality Tools: Experience with data quality testing and monitoring tools (e.g., Great Expectations, dbt tests, or custom validation frameworks).

Data Transformation: Knowledge of ETL/ELT processes and the ability to implement scalable data transformation pipelines.

SQL & Scripting: Strong proficiency in SQL for querying and transforming data, as well as scripting languages like Python for automating data operations.

Cloud Platforms: Familiarity with cloud platforms (AWS, Azure, or Google Cloud) for managing cloud-based data infrastructure and pipelines.

Data Governance: Experience implementing data governance frameworks, including data lineage, metadata management, and compliance with regulatory standards.

Data Management: Knowledge of managing data in cloud-based data warehouses such as Snowflake, Redshift, or BigQuery.

Preferred Qualifications

Automation: Experience in automating data validation, pipeline management, and delivery processes to ensure efficient and error-free operations.

Big Data & Streaming: Familiarity with big data technologies (e.g., Spark, Kafka) and real-time data streaming tools.

Data Integration: Experience integrating a variety of data sources (APIs, databases, flat files) into data systems.

Company Overview

Vista is a leading global investment firm that exclusively invests in enterprise software, data and technology-enabled organizations across private equity, permanent capital, credit and public equity strategies, bringing an approach that prioritizes creating enduring market value for the benefit of its global ecosystem of investors, companies, customers and employees. Vista’s investments are anchored by a sizable long-term capital base, experience in structuring technology-oriented transactions and proven, flexible management techniques that drive sustainable growth. Vista believes the transformative power of technology is the key to an even better future – a healthier planet, a smarter economy, a diverse and inclusive community and a broader path to prosperity. Further information is available at vistaequitypartners.com. Follow Vista on LinkedIn, @Vista Equity Partners, and on X, @Vista_Equity.