What are the responsibilities and job description for the Data Engineer - II position at Custom Group Companies?
Job Summary :
We are seeking a skilled and motivated Data Engineer II to join a dynamic team in the banking sector. In this role, you will be responsible for designing, developing, and maintaining data infrastructure, pipelines, and systems to support data analytics, reporting, and decision-making processes. You will work closely with data scientists, analysts, and business stakeholders to ensure that data is accurate, accessible, and optimized for analytical and operational use.
Qualifications :
- Development of Data Pipelines using Python, Pyspark, JSON, Databricks.
Gitlab experience Pipeline function experience needed.
Delta Lake, Unified Catalog, Lake house architecture experience requiredComputer Science or similar background.
Python, Pyspark, JSON, Databricks experience
AWS resource experience like AWS GLUE, Step Functions, Postgres, Redshift
Starburst / Trini is a plus.
Preferred Qualifications :
