Confluent Kafka Administrator

Job title: Confluent Kafka Administrator

Location: Dallas, TX, USA / Tampa, FL / Jersey City, NJ (onsite)

Duration: Long term Contract

Job Description:

Job Summary:

We are seeking an experienced Confluent Kafka Administrator to manage and maintain our Kafka infrastructure. The ideal candidate will have a minimum of 5 years of experience with Confluent Kafka and a strong background in data streaming and real-time data processing.

Key Responsibilities:

Kafka Cluster Management: Install, configure, and manage Kafka clusters, including Confluent Kafka components.

Monitoring and Performance Tuning: Monitor Kafka clusters for performance, reliability, and capacity planning. Optimize Kafka performance and troubleshoot issues.

Security: Implement and manage security measures for Kafka clusters, including encryption, authentication, and authorization.

Data Integration: Work with development teams to integrate Kafka with various data sources and sinks.

Upgrades and Patching: Plan and execute upgrades and patches for Kafka clusters to ensure they are up to date with the latest features and security fixes.

Disaster Recovery: Develop and maintain disaster recovery plans for Kafka clusters.

Documentation: Create and maintain documentation for Kafka configurations, processes, and procedures.

Support: Provide support for Kafka-related issues and work closely with other teams to resolve any problems.

Topic Management: Manage Kafka topics, including adding and removing topic configurations, setting cleanup policies, and configuring retention times. Required Skills and Qualifications: Experience: Minimum of 5 years of experience with Confluent Kafka.

Technical Skills: Strong knowledge of Kafka architecture, Kraft mode (Kafka Raft), Kafka Connect, Kafka Streams, and KSQL.

Scripting and Automation: Proficiency in scripting languages (e.g., Python, Bash) and automation tools (e.g., Ansible, Terraform).

Monitoring Tools: Experience with monitoring tools like Prometheus, Grafana, Dynatrace, and Splunk ITSI.

Security: Knowledge of security best practices for Kafka, including SSL/TLS, Kerberos, and RBAC.

Problem-Solving: Strong analytical and problem-solving skills.

Communication: Excellent communication and collaboration skills. Preferred Qualifications: Certifications: Confluent Certified Administrator or Developer.

Cloud Experience: Experience with cloud platforms (e.g., AWS) and managing Kafka in cloud environments.

DevOps: Familiarity with DevOps practices and tools.

Database Knowledge: Experience with databases.