What are the responsibilities and job description for the Kafka Developer position at Helix Tech?
Job Details
Job Title: Kafka Developer
Location: Hybrid Pittsburgh PA , Birmingham AL , Phoenix AZ , Cleveland OH , Dallas TX , Philadelphia PA , Jacksonville FL , Miamisburg OH , Rocky Mount NC ( Hybrid Role )
Employment Type: Full-Time
Compensation: $120,000/year
Job Description:
We are seeking an experienced Kafka Developer to join our team supporting PNC Bank. The ideal candidate will have deep expertise in Kafka architecture, real-time data streaming, and distributed systems. You will be instrumental in building, optimizing, and maintaining scalable, real-time data pipelines using Apache Kafka.
Key Responsibilities:
- Design and implement robust Kafka-based data streaming solutions.
- Develop producers, consumers, and related components to manage real-time data pipelines.
- Optimize Kafka performance and troubleshoot issues related to message delivery and throughput.
- Integrate Kafka with various data sources and sinks using custom applications written in Java, Python, or Scala.
- Implement and manage schema versions using Confluent Schema Registry or equivalent tools.
- Collaborate with cross-functional teams including DevOps, data engineers, and architects.
Required Skills:
- Strong understanding of Kafka architecture, especially producers, consumers, and message formats.
- Proficiency in Java, Python, or Scala for Kafka development.
- Experience with distributed systems and real-time data streaming.
- Familiarity with schema management tools like Confluent Schema Registry.
- Solid grasp of data serialization formats such as Avro, JSON, or Protobuf.
- Strong problem-solving skills to address real-time data publishing challenges.
- Good understanding of networking and messaging concepts (e.g., publish-subscribe models, latency optimization).
Additional Details:
- Hybrid Work Environment Candidate must be local to one of the listed cities and available for a hybrid onsite schedule.
- Strong communication and collaboration skills required.
Salary : $100,000 - $120,000