What are the responsibilities and job description for the Kafka Engineer position at AIT Global inc.?
Job Title: Kafka Engineer
Location: Newark, NJ
Location: Newark, NJ
We are seeking a Kafka Engineer with skills in AWS, Terraform, Chef and Confluent Kafka. The role is exciting and challenging is looking to drive the modernization efforts across the enterprise. As Kafka Engineer, you will be responsible for the installation, configuration, maintenance, and support of Confluent Kafka software in an organization. You will ensure the reliability and performance of the platform, as well as manage user access and security.
JOB RESPONSIBILITIES:
- Ability to architect and create reference architecture for Kafka Implementations
- Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center.
- Ensure optimum performance, high availability and stability of solutions.
- Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices.
- Create producers, consumers and consumer groups for helping onboard applications from different languages/platforms.
- Provide administration and operations support of the Kafka platform like provisioning, access lists Kerberos and SSL configurations.
- Use automation tools like provisioning using BladeLogic, Ansible, Chef, Jenkins and GitLab.
- Ability to perform performance benchmarking, analysis and tuning.
- Involve in design and capacity review meetings to provide suggestion in Kafka usage.
- Strong knowledge of monitoring tools and fine tuning alerts on Splunk, Datadog, and APM.
- Strong understating on secure deployment of Kafka solutions
- Providing Backup & Recovery and problem determination strategies for the projects.
- Monitor, troubleshoot Kafka related issues.
- Provide strategic vision in engineering solutions that support event driven architecture deployment
QUALIFICATIONS:
- 5 years demonstrated proficiency and experience in design, implementation, monitoring, and troubleshooting Kafka messaging infrastructure.
- Hands on experience on recovery in Kafka.
- 2 or more years of experience in developing/customizing messaging related monitoring tools/utilities.
- Good programming knowledge/experience with one or more languages (ex. Java, python)
- Considerable experience in implementing Kerberos Security.
- Support 24*7 Model and be available to support rotational on-call work
- Competent working in one or more environments highly integrated with an operating system.
- Experience implementing and administering/managing technical solutions in major, large-scale system implementations.
- High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy.
- Ability to manage tasks independently and take ownership of responsibilities
- Ability to learn from mistakes and apply constructive feedback to improve performance
- Ability to adapt to a rapidly changing environment.
- Proven leadership abilities including effective knowledge sharing, conflict resolution, facilitation of open discussions, fairness and displaying appropriate levels of assertiveness.
- Ability to communicate highly complex technical information clearly and articulately for all levels and audiences.
- Willingness to learn new technologies/tool and train your peers.
- Proven track record to automate.
