Senior Data Engineer / ETL Designer 6 Months Contract

Company Description

Belmont Lavan is a bespoke consultancy specializing in System Integration and Solution-building services for businesses looking to establish or scale their capabilities in EAM, ERP, CRM, AI, and IoT. Our mission is to help organizations streamline their operations, build successful technology practices, and navigate complex compliance landscapes.

You will be responsible for optimizing data workflows, writing efficient scripting code e.g. bash, python and SQL, and manage both on prem and cloud-based hybrid infrastructure.

Key Responsibilities:

• Design, build and maintain scalable ELT pipeline
• Develop and optimize PLSQL queries and database objects for high performance data storage in Oracle
• Write python-based data engineering scripts to process data.
• Implement CI/CD pipelines for data infrastructure and workflow automation
• Understand and have experience of database change management
• Work one or more of the major cloud vendor
• Integrate and manage modern data stack.
• Monitor, debug and optimize data workflows and infrastructure performance.
• Ensure data quality, governance, and compliance with good practices

Fundamental Skills:

• Proficient in designing OLAP system and using techniques like STAR schema or denormalization.
• Python & PLSQL Proficiency
• ELT/ETL development using GUI-based tool e.g. IBM Datastage, ADF, Stitch, Matillion
• Database Management, Oracle, MSSQL, Snowflake
• DevOps & CI/CD understanding of Git, Docker, Kubernetes, Terraform, CI/CD pipeline development tool e.g. Jenkins, Bamboo, Azure DevOps
• Experience with test automation e.g. Robot, Selenium and understand the different test scenarios.
• Understanding version control technique Git, GitHub, GitLab
• Workflow Orchestration e.g. Airflow & Prefect.

Advanced Skills:

• Streaming & Batch processing knowledge involving Kafka,
• Distributed and parallel Computing solution e.g. Spark, Flink or Dask.
• Data governance & security implementation RBAC, GDPR, HIPAA compliance