107 Principal Data Engineer Jobs in Houston, TX
SORT BY
S
A
D
E
Q
V
J
E
B
B
B
D
D
e
B
H
S
R
G
F
W
A
W
A
Ascend Performance Materials Operations LLC
Houston, TX | Part Time
$110k-137k (estimate)
1 Month Ago
C
C
C
V
Principal Data Engineer
$146k-177k (estimate)
Full Time | Business Services
1 Week Ago
Search Services, LLC is Hiring a Principal Data Engineer Near Houston, TX
Position Summary:Our client, a hyper growth PE firm based in Houston is seeking a Principal Data Engineer who embodies strategic leadership and a practical, application-oriented mindset. This role is perfect for someone eager to make a substantial business impact utilizing modern cloud-based data processing technologies to ingest, curate and deliver clean datasets to business-critical processes and applications used across the business.
In this position, you will play the lead role implementing our data management strategy. You will focus on advancing our existing data platform, implementing the tools to increase security and governance, and manage the implementation and maintenance of our data processing pipelines. Your ability to translate complex technical subjects into clear business language will empower stakeholders to make informed decisions. You will ensure that our data platform can always support our immediate business objectives and that the future roadmap is closely aligned with our strategic and sustainable business goals. Your role goes beyond traditional data engineering; it's about harnessing the power of data to create tangible business outcomes. Collaborating with a larger offshore team, you will implement an industry leading data management solution that is designed to scale our business and deliver real-world results. Reporting to the Head of Engineering, you will establish yourself as a key figure in shaping data-driven future, with a clear focus on practical applications and business impact.
DESCRIPTION:Able to lead projects and work collaboratively with cross-functional teams, including data engineers, data analysts, subject matter experts and internal IT stakeholders.
Lead a team of onshore and offshore data engineers.
Define the to-be status of our data platform and lead implementation of the change process.
Responsible for ensuring that our data platform complies with our data governance policies.
Responsible for generating and reporting KPIs relating to service quality, ingestion, and consumption.
Responsible for delivering a self-service data access concept for key stakeholders, by implementing a secure but easy to use data consumption layer.
Manage the development and maintenance of new and existing data pipelines.
Conduct regular code reviews on bespoke pipeline code and notebook code.
Experience and Abilities:
10 years' experience
Proven track record of implementing modern big data platform solutions, either Azure Data Bricks or Azure Synapse.
Terraform - Infrastructure as a Code
Prior experience with MDM and governance tools such as Unity Catalog or Microsoft Purview
Expert with Azure Data Lake, Avro, Parquet and Delta tables
Solid experience with Structured and Semi-Structured datasets
Solid understanding of ELT/ETL and the application using data pipelines
Ability to develop, implement and integrate notebooks within data pipelines.
Ability to setup and control data ingestion pipelines using Azure Data Factory or Data Bricks.
Prior experience ingesting public data sources such as Enverus, IHS, TGS
Extensive experience in common data engineering programming languages such as Python, R, SQL.
Extensive experience consuming and processing data from secure REST APIs
Comfortable integration data with data visualization applications using PowerBI, Spotfire, Plotly.
Familiar with Azure Dev Ops and CI/CD processes.
Strong communication skills and the ability to effectively propose and discuss solutions with data engineers as well as business partners at the appropriate level of technical detail.
BS, MS / PhD in Computer Science, or related disciplines, or a Petroleum Industry technical expert cross-trained through extensive work experience within the data engineering domain.
Energy domain expertise in Exploration & Production and/or Energy Transition & Decarbonization a plus.
In this position, you will play the lead role implementing our data management strategy. You will focus on advancing our existing data platform, implementing the tools to increase security and governance, and manage the implementation and maintenance of our data processing pipelines. Your ability to translate complex technical subjects into clear business language will empower stakeholders to make informed decisions. You will ensure that our data platform can always support our immediate business objectives and that the future roadmap is closely aligned with our strategic and sustainable business goals. Your role goes beyond traditional data engineering; it's about harnessing the power of data to create tangible business outcomes. Collaborating with a larger offshore team, you will implement an industry leading data management solution that is designed to scale our business and deliver real-world results. Reporting to the Head of Engineering, you will establish yourself as a key figure in shaping data-driven future, with a clear focus on practical applications and business impact.
DESCRIPTION:Able to lead projects and work collaboratively with cross-functional teams, including data engineers, data analysts, subject matter experts and internal IT stakeholders.
Lead a team of onshore and offshore data engineers.
Define the to-be status of our data platform and lead implementation of the change process.
Responsible for ensuring that our data platform complies with our data governance policies.
Responsible for generating and reporting KPIs relating to service quality, ingestion, and consumption.
Responsible for delivering a self-service data access concept for key stakeholders, by implementing a secure but easy to use data consumption layer.
Manage the development and maintenance of new and existing data pipelines.
Conduct regular code reviews on bespoke pipeline code and notebook code.
Experience and Abilities:
10 years' experience
Proven track record of implementing modern big data platform solutions, either Azure Data Bricks or Azure Synapse.
Terraform - Infrastructure as a Code
Prior experience with MDM and governance tools such as Unity Catalog or Microsoft Purview
Expert with Azure Data Lake, Avro, Parquet and Delta tables
Solid experience with Structured and Semi-Structured datasets
Solid understanding of ELT/ETL and the application using data pipelines
Ability to develop, implement and integrate notebooks within data pipelines.
Ability to setup and control data ingestion pipelines using Azure Data Factory or Data Bricks.
Prior experience ingesting public data sources such as Enverus, IHS, TGS
Extensive experience in common data engineering programming languages such as Python, R, SQL.
Extensive experience consuming and processing data from secure REST APIs
Comfortable integration data with data visualization applications using PowerBI, Spotfire, Plotly.
Familiar with Azure Dev Ops and CI/CD processes.
Strong communication skills and the ability to effectively propose and discuss solutions with data engineers as well as business partners at the appropriate level of technical detail.
BS, MS / PhD in Computer Science, or related disciplines, or a Petroleum Industry technical expert cross-trained through extensive work experience within the data engineering domain.
Energy domain expertise in Exploration & Production and/or Energy Transition & Decarbonization a plus.
Job Summary
JOB TYPE
Full Time
INDUSTRY
Business Services
SALARY
$146k-177k (estimate)
POST DATE
06/15/2024
EXPIRATION DATE
07/13/2024
WEBSITE
searchsvc.com
HEADQUARTERS
Bellaire, TX
SIZE
25 - 50
INDUSTRY
Business Services
Related Companies
Show more
The job skills required for Principal Data Engineer include Python, Big Data, Programming Language, Data Engineering, Leadership, Computer Science, etc. Having related job skills and expertise will give you an advantage when applying to be a Principal Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Principal Data Engineer. Select any job title you are interested in and start to search job requirements.
For the skill of Programming Language
People, Technology & Processes
Full Time
$88k-106k (estimate)
8 Months Ago
Show more
Similar Jobs
Popular Articles
Top 10 Things to Avoid Putting on a Job Application
Read Article
How to Describe Your Education in a Resume
Read Article
How to Write a Memorable Cover Letter in 5 Ways
Read Article
4 Personal Finance Tips to Make During Job Transition
Read Article
4 Best Camera Setups for Interview
Read Article
Keeping a Job Search Journal: 9 Types of Journaling You Can Do
Read Article
