What are the responsibilities and job description for the Big Data Developer position at VLink Inc?
Job Title: Kafka Developer
Location: Jersey City, NJ - Hybrid
Employment Type: Contract
Position Description:
Join Our High-Performing Investment Banking Capital Markets IT Team
We are seeking a talented Kafka Developer with Java to be part of our dynamic Investment Banking Capital Markets IT team. In this role, you will work with cutting-edge technology to address complex business challenges. Our team operates within an Agile framework, promoting a fast-paced environment that is ready to deliver impactful solutions.
This position is based in Jersey City and follows a hybrid model, requiring you to be in the office three days a week (please note, fully remote options are not available).
Your future duties and responsibilities:
• Develop backend Big Data services architecture using Kafka Framework(Kafka Connect/Kafka streams)
• Develop Kafka consumers to read and process messages from Kafka topics for downstream systems or applications.
• Optimize the performance of Kafka producers, consumers, and clusters, tuning configurations for memory, throughput, and latency.
• Develop the underlying framework to rewrite the enterprise services using the newly developed architecture
• Plan for Kafka's scalability, ensuring the infrastructure can handle increased message throughput as the system grow
• Work with client engineering and DevOps teams to develop the required technical environments to implement the new architecture
• Create detailed forward-looking technical roadmaps and architectural designs.
• Drive the delivery of new and innovative technology solutions.
• Partner with product managers to ensure the product meets customer expectations.
• Mentor and train other developers on coding practices and standards.
• Maintain a process-oriented culture leading the team in developing software products using agile methodologies.
Required qualifications to be successful in this role:
• Consultants with 8-10 years of experience in Big Data development environment.
• Expert working knowledge in Kafka messaging stream processing technology framework.
• Experience in design and building high performance, high availability, scalable, distributed applications capable of supporting straight through processing of large amount of data.
• Deep knowledge of Microservices architecture, REST APIs. Produce Microservice designs and develop them into fully working systems.
• Experience with web services development using SpringBoot/Container/Batch framework.
• Working knowledge of architectures using Distributed caching using EhCache / Gigaspaces or similar engines.
• Development experience using Java and Python
• Experience in PL-SQL/StoredProc with database like Oracle, Sybase, etc.
• Working Knowledge of in memory data stores: Ignite or Redis and distributed processing frameworks like Apache Flink
• Worked in projects with Investment Banking Financial Services Capital Markets domain
Agile development experience is valuable.
Skills:
- Banking
- Capital Markets
- Investment Management
- Java
- Java Enterprise Editions JEE
- Spring Boot
- RESTful (Rest-APIs)
