What are the responsibilities and job description for the Kafka Engineer position at MARSHALL TECHNOLOGIES INC?
Job Title: Senior Kafka Engineer (Confluent Kafka, AWS, Kubernetes)
Location: Baltimore, MD
Job Type: Contract
ONLY W2 Profiles
Job Overview
We are seeking an experienced Senior Kafka Engineer who will be responsible for designing, implementing, and managing Kafka solutions from the ground up within large organizations. The ideal candidate will have hands-on experience with Confluent Kafka and Confluent Cloud, along with expertise in AWS and Kubernetes environments. This role requires someone who can build, monitor, troubleshoot, and optimize Kafka event-driven and data streaming platforms.
Key Responsibilities
Location: Baltimore, MD
Job Type: Contract
ONLY W2 Profiles
Job Overview
We are seeking an experienced Senior Kafka Engineer who will be responsible for designing, implementing, and managing Kafka solutions from the ground up within large organizations. The ideal candidate will have hands-on experience with Confluent Kafka and Confluent Cloud, along with expertise in AWS and Kubernetes environments. This role requires someone who can build, monitor, troubleshoot, and optimize Kafka event-driven and data streaming platforms.
Key Responsibilities
- Kafka Implementation: Lead the design, development, and deployment of Kafka solutions from scratch, both event-driven and data streaming, for large-scale organizations.
- Confluent Kafka & Cloud: Work with Confluent Kafka and Confluent Cloud to ensure efficient integration and management of streaming data.
- AWS Expertise: Deploy and manage Kafka in AWS environments, ensuring optimal performance and reliability.
- Monitoring & Troubleshooting: Monitor, troubleshoot, and optimize Kafka clusters for performance and reliability, handling high availability and low-latency configurations.
- Automation: Develop and implement strong automation practices using tools like Ansible and Python to streamline Kafka operations.
- Kubernetes Management: Utilize Kubernetes to manage containerized Kafka services and ensure scalability and resilience.
- CI/CD & DevOps: Leverage CI/CD tools such as Jenkins and Git for continuous integration and delivery pipelines.
- Linux Proficiency: Manage Kafka environments running on Linux systems.
- Collaboration: Work closely with data engineers, DevOps, and other cross-functional teams to ensure smooth integration and operation of Kafka services.
- 5 years of experience in designing, implementing, and managing Kafka platforms, with experience in large-scale event-driven and data streaming solutions.
- Expertise in Confluent Kafka and Confluent Cloud.
- Strong experience in AWS, including Kafka deployment and management.
- Proven experience with Kubernetes for container orchestration.
- Proficiency in Ansible and Python for automation tasks.
- Experience with CI/CD tools such as Jenkins, Git, etc.
- Solid understanding of Linux environments and managing Kafka on Linux.
- Strong troubleshooting and problem-solving skills.
- Kafka SME with deep knowledge of Kafka architecture, optimization, and best practices.
- Experience with Kafka Streams and Kafka Connect.
- Familiarity with AWS CloudFormation and Terraform for infrastructure automation.
- Understanding of messaging patterns, data replication, and real-time data streaming best practices.
