What are the responsibilities and job description for the Sr. Data Engineer position at Corporate Solutions General, Inc.?
Job Details
Role: Data Information Architect/Data Engineer
Location: Houston, TX Onsite
Job Description
Data Engineering is the practice of making the appropriate data accessible and available to various data consumers and systems. (including data scientists, business analysis, software developers and business users). Data engineers focus on the applications and harvesting of data.
A Data Engineering II works with complex data sources to extract data and automates data integration flows to create efficient processes. This role will learn through executing on behalf of the SMEs and many of the responsibilities are as part of project or larger initiative.
Following skills are all required:
1. Python
2. PySpark
3. GitHub CI/CD
4. SQL
5. Databricks