What are the responsibilities and job description for the Senior Data Engineer position at Zenith Services Inc.?
Job Title: Senior Data Engineer
W2/FTC/FTE
Exp: 09 Years
Location: Spring, TX (Onsite)
Visa: USC/GC/H4/GCEAD Only
Reach Me: Maheshp@zenithcad.com
Summary JD
Python programming required test framework nice to have
GitHub source control required
Github Actions for CICD nice to have
SQL required
Snowflake basic nice to have
Databricks experienced required
oDelta table required
oJob creation management by configurations dbx or Asset Bundle nice to have
Please share relevant P4P5 level profiles as this is immediate
DataBricks Skills and experience
Proficiency in Python and SQL
Experience with big data technologies data lakes and data warehouses
Knowledge of data integration and ETL processes
Experience with cloud platforms especially Microsoft Azure
Relevant certifications in PySpark Azure or related areas
GitHub Skill and Experience
Exposure to GitHub Workflows Actions Events Jobs Steps Secrets and Environment Variables
Hands on in Pull Request integrating and triggering Deployment pipelines across environment
Handling Error Debugging and Resolution
Version Upgrades and Enlivenment Setup
Proficiency in CI CD process in GITHUB
Configuring YAML fie for setting up
Python Skill and Experience
Develop and maintain scalable data pipelines
Perform data quality checks
Understanding of Python Libraries
Develop analytical tools and programs
Skills
Mandatory Skills : Apache Spark, Databricks, Python, SparkSQ
Good to Have Skills: Java, Scala
