What are the responsibilities and job description for the Python Data Engineer position at Clearpoint?
TITLE : Python Data Engineer
CLIENT : Oil & Gas
LOCATION : Downtown Houston
TYPE : Contract
RATE : DOE
URGENCY : Open to interview and hire
WORK SCHEDULE : 5 days a week on-site-location-downtown Houston area (LOCAL HOUSTON CANDIDATES PLEASE)
SUMMARY :
Excellent opportunity to work for an organization that has continuously been voted as one of the best companies to work for in the Houston area.
We are seeking a skilled Python Data Engineer to join our team in Houston, TX. As a Python Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines to support our data-driven business. You will also be responsible for developing and maintaining their APIs using the FASTAPI framework and SQL Alchemy ORM. Experience working with LLMs is a plus!
The ideal candidate will have 5 years of experience in data engineering with a focus on Python, C# and Azure and will work closely with our Data Scientists and Business Analysts to ensure that data is properly collected, processed, and analyzed to generate insights and drive business decisions. You must have a good understand of SQL. Experience with Postgres is a plus, although not a requirement. The candidate will be required to work on-site Downtown Houston.
Responsibilities :
- Design, develop and maintain RESTful APIs using Python and FASTAPI framework.
- Extensive experience building APIs and integrating them with various systems and platforms.
- Work closely with our database team to ensure seamless integration with Postgres.
- Write efficient and reusable code using best practices.
- Ensure code quality, including automated tests and code reviews
- Collaborate with Data Scientists and Business Analysts to ensure data quality and accuracy.
- Develop and maintain data models and data schema.
- Deploy and manage applications in Azure using Docker
- Set up monitoring and metrics using Grafana
- Create and maintain documentation for data pipelines and processes.
- Monitor data pipelines to identify and address issues in a timely manner.
- Work with cross-functional teams to ensure data is properly integrated across systems.
Requirements :
