What are the responsibilities and job description for the Lead Engineer - Kafka position at Request Technology, LLC?
Lead Software Engineer – Kafka
Salary: Open Bonus
Location: Chicago, IL or Dallas, TX
Hybrid: 3 days onsite, 2 days remote
*We are unable to provide sponsorship for this role*
Qualifications
- Bachelor’s degree
- 10 years of experience in infrastructure middleware administration and engineering
- In-depth expertise in Kafka administration, including cluster management, performance tuning, and security.
- Strong proficiency in IaC tools, specifically Ansible, Terraform and bash scripting.
- Extensive experience with cloud automation and provisioning on AWS and Azure.
- Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins.
- Strong scripting skills in languages like Python and Bash.
Responsibilities
- Design, implement and manage highly available and scalable Kafka clusters.
- Monitor Kafka performance, troubleshoot issues and optimize configurations.
- Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration Management.
- Create and maintain reusable IaC modules.
- Design and implement cloud-based infrastructure solutions on AWS and Azure.
- Automate cloud resource provisioning, scaling and management using cloud-native tools and services.
- Deploy and Manage containerized applications using Kubernetes and Rancher
- Troubleshoot container-related issues and optimize container performance.
- Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins.