What are the responsibilities and job description for the Kafka Lead Engineer position at i4DM?
Description
About the Company
At our core, we believe in the transformative power of technology, innovation, and collaboration. Guided by our values of People Matter, Integrity, and a Commitment to Excellence, we've created a vibrant, inclusive environment where creativity thrives and boundaries are pushed.
By joining our team, you'll become part of a dynamic group of trailblazers-individuals who are not only passionate about solving business challenges but also dedicated to making a lasting impact. We use the latest technologies to craft tailored solutions that deliver extraordinary value to our clients.
If you're ready to work in an ego-free, fast-paced culture and solve real-world problems in a creative and empowering environment, we want you on our team.
Overview :
We are seeking a highly skilled Kafka Lead Engineer to join our team and work closely with the Army on mission-critical data stream engineering projects. In this role, you will play a key part in delivering essential data solutions in an artificial intelligence (AI) and low code no code (LCNC) architecture, helping the Army transform and optimize their data infrastructure. The ideal candidate will have a deep technical background in Kafka development and a strong focus on customer engagement, especially in adapting solutions to fit the Army's unique needs and working in an agile environment.
As the Kafka Lead, you will design, develop, and implement data pipelines, streams, and connectors that organize and correlate disparate data, enabling real-time access for business consumers. Your ability to integrate Kafka technology with the Army's mission and operational requirements is critical to the success of the project.
Key Responsibilities :
- Kafka Architecture and Engineering : Lead the design and development of Kafka-based data pipelines and streaming solutions, ensuring they meet the high availability, scalability, disconnected operations, and performance needs of the Army's mission-critical systems.
- Data Integration : Develop connectors, transformations, and integration patterns that make disparate data accessible in real-time for business consumers, ensuring consistency, reliability, and speed.
- Agile Collaboration : Work closely with cross-functional teams, including project managers, architects, data engineers, and Army stakeholders, to deliver solutions that align with their goals and are adaptable in an agile environment.
- Customer-Focused Solutions : Engage with Army personnel to understand their workflows, operational needs, and mission goals. Tailor Kafka-based solutions to meet specific Army requirements, ensuring that the data infrastructure aligns with their unique operational context.
- Mentorship and Leadership : Lead and mentor associate Kafka developers, guiding them through best practices, code reviews, and technical challenges. Provide direction to ensure all Kafka solutions are implemented efficiently and effectively.
- Optimization and Troubleshooting : Monitor Kafka systems for performance, troubleshoot issues, and optimize pipeline efficiency, ensuring minimal downtime and continuous data flow.
- Documentation and Best Practices : Create clear, detailed documentation of Kafka architectures, processes, and solutions. Ensure adherence to best practices, coding standards, and operational processes.
Required Skills and Qualifications :
Preferred Qualifications :
TAG : INDMJC
TAG : #LI-I4DM
