What are the responsibilities and job description for the Data Engineer position at Oxenham Group?
Data Engineer
About the Role :
We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have a proven track record in data migration, particularly from Teradata to Hadoop or from on-premises systems to the cloud. This role requires expertise in advanced data engineering tools and platforms, as well as a solid understanding of modern cloud-based architectures. Experience in the finance domain is a strong plus.
Key Responsibilities :
- Lead data migration initiatives, focusing on transitioning large-scale datasets from Teradata to Hadoop / GCP or other on-premises systems to cloud-based platforms.
- Develop and maintain scalable data pipelines and ETL processes using technologies like Spark, Hadoop, and Dataproc.
- Design, build, and manage data integration workflows and orchestration using Kubernetes.
- Collaborate with cross-functional teams to ensure efficient data architecture that meets business needs.
- Monitor and optimize performance of big data systems, ensuring scalability and reliability.
- Provide technical guidance on best practices for data processing and migration strategies.
Qualifications :
