What are the responsibilities and job description for the Data Engineer (IIDR) position at A R Systems Inc.,?
Job Title : Data Engineer (IIDR)
Duration : 12 Months (Possible Extension)
Location : Charlotte, NC
Job Description :
- Kafka Cluster Management : Deploying, configuring, and maintaining Kafka clusters on OpenShift, including topic creation, partition management, and scaling operations.
- Data Pipeline Design : Architecting and implementing data pipelines using Kafka streams, connectors, and other related technologies to process and route data in real-time.
- IDDR Implementation : Applying data ingestion, transformation, and distribution techniques to ensure data quality and reliability within the Kafka pipelines.
- OpenShift Integration : Leveraging OpenShift features like deployments, services, and monitoring to manage Kafka applications within the containerized environment.
