What are the responsibilities and job description for the Data Engineer with Kafka position at Techstra Solutions?
Techstra is seeking an experienced Data Engineer with strong experience in Apache Kafka to join our growing data team. You’ll help build and scale our real-time data pipelines, ensuring high availability, reliability, and performance across systems. This role is crucial in transforming how we ingest, process, and distribute data across the organization.
From the day you join, you will hit the ground running surrounded by amazing people. Here is a look of some of the expectations and responsibilities for this position:
Responsibilities
Design, implement, and maintain robust data pipelines using Apache Kafka and related streaming technologies.
Work with Kafka producers and consumers to enable real-time data ingestion and processing.
Optimize Kafka topics, partitions, and consumer groups for performance and scalability.
Integrate data from multiple sources (databases, APIs, cloud services) into the data platform.
Collaborate with software engineers, data scientists, and analysts to build streaming solutions.
Monitor and troubleshoot Kafka cluster performance, ensuring data integrity and reliability.
Document architecture, workflows, and best practices.
Requirements
3 years of experience in data engineering or backend development.
Strong hands-on experience with Apache Kafka (e.g., Kafka Streams, Kafka Connect, ksqlDB).
Proficiency in Python, Java, or Scala for integrating Kafka producers/consumers.
Experience with stream processing tools like Apache Flink or Spark Streaming
Solid understanding of data structures, distributed systems, and event-driven architecture.
Familiarity with cloud platforms (AWS, GCP, or Azure) and managed Kafka services (like Confluent Cloud or MSK).
Experience with schema management
At Techstra Solutions, we help top companies and brands achieve the business value of Digital and Talent Transformation. We believe there are three components in successful business transformation: Business Strategy, Technology and Talent. It is the coming together of these three disciplines that enable companies to take full advantage of opportunities. It differentiates us. Our approach is holistic and all encompassing. We consider the full picture as we guide our clients on this journey.
We are experts in transformation, business strategy, technology, innovation, and human capital management. We deliver our expertise through client consulting, innovative staffing solutions and software development. From strategy through implementation, we are dedicated to bringing our clients world-class business and talent solutions that fit strategic requirements and most importantly, deliver results.
Equal Employment Opportunity Statement
Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender,, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.
