What are the responsibilities and job description for the Senior DevOps Engineer (Kafka/Cloud/Data) position at Tech Mahindra (Americas) Inc.?
Job Details
Job Title: Senior DevOps Engineer (Kafka/Cloud/Data)
Location: SCV, CA / Austin, TX
Key skills:
- Should be a bit of Program and Release Management experience apart from just being a CI/CD DevOps engineer. He should be able to coordinate well with the team.
- Should have good exposure of deploying in distributed Cloud/Cluster environment with the following Technology Stack:
- Kafka Nodes,
- AWS, Kubernetes
- Apache Spark, Snowflake
- Java/Python, React, Bare Metal Cube Continuous Deployment.
- He should have experience working on load management to scale out and scale in the Microservices/Server needed.
Job Summary:
As a DevOps Engineer you will be responsible for building and maintaining our infrastructure and deployment pipelines, ensuring the reliability, scalability, and performance of our distributed data and microservices systems. You will leverage your deployment expertise in AWS, Kubernetes, Bare Metal Cube, Apache Kafka, Apache Spark, Snowflake, Java/Python, React to automate and optimize our development and operations workflows. A core responsibility will be easy scaling of microservices, servers and alerts needed based on real-time load.
Responsibilities:
- Design, build, and maintain robust and scalable infrastructure for distributed systems on AWS using Kubernetes (EKS) & Bare Metal Cube.
- Implement and manage continuous integration and continuous deployment (CI/CD) pipelines.
- Deployment and management of Apache Kafka, Apache Spark, and Snowflake clusters.
- Monitoring and logging solutions using tools like Prometheus, Grafana, and the ELK stack.
- Troubleshoot and resolve infrastructure and deployment issues.
- Collaborate with development teams to ensure smooth and efficient deployments.
- Optimize system performance and reliability.
- Design and implement systems with alerts for scaling of microservices and servers based on load.
- Manage and maintain the deployment of microservices developed in Java or Python, including React front ends.
- Ensure security best practices are implemented throughout the infrastructure and deployment process.
- Manage the Bare Metal Cube continuous deployment environment.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Extensive experience in DevOps engineering.
- Strong expertise in AWS cloud services, particularly Kubernetes (EKS).
- Proven experience with Apache Kafka, Apache Spark, and Snowflake.
- Experience with CI/CD tools, specifically Bare Metal Cube.
- Strong scripting skills in Python or Bash.
- Experience with containerization and orchestration technologies (Docker, Kubernetes).
- Experience with monitoring and logging tools (Prometheus, Grafana, ELK stack).
- Experience with Java/Python deployment.
- Experience with React deployment.
Education:
- Bachelor s or master s degree in computer science, Engineering, or a related field.