What are the responsibilities and job description for the Java Software Engineer - Kafka / Spark position at QUANTEAM - North America (RAINBOW PARTNERS Group)?
Department : Global Banking Technology & Operations
Role Summary
As a Senior Big Data Java Engineer, you will contribute to the development of our client's data lake streaming platform on Azure. Working independently within a Feature Team, your primary responsibilities include :
- Development & Architecture : Architect, design, and build Java applications using Kafka Stream and Spark in Azure; develop scalable, resilient data pipelines.
- Quality Coding : Write and maintain high-quality Java code, ensuring adherence to best practices.
- System Design : Focus on scalability and resiliency when designing systems; troubleshoot performance issues in distributed systems managing large data volumes.
- Code Reviews & Team Collaboration : Conduct code reviews, provide feedback, and support team improvements.
- Customer-Focused Solutions : Break down customer requirements with the Product Owner, ensuring alignment with project goals.
- Testing & Deployment : Manage testing, deployment, and production activities, adhering to chapter guidelines for stability.
- Continuous Improvement : Participate in pair programming, write unit and BDD-style tests (JUnit, Mockito, Cucumber), and engage in backlog refinement.
Key Skills & Competencies
Experience & Education