Hybrid Contract Role of Hadoop Administrator with Cloud Native Automation|| NYC,NY

Position: Hadoop Administrator with Cloud Native Automation

Location: NYC,NY(Hybrid-2 Days Onsite 3 Days Remote)

Duration: 12 months Contract C2C

Who are you?

You are a dedicated and motivated engineer interested in building and managing large-scale distributed systems.

You are an innovative problem solver who likes building tools and orchestration frameworks to relentlessly automate away toil.

You want to make a significant impact and contribute to open-source software.

We'll trust you to:

Build and develop tools to operate and support a massive data and compute infrastructure (10s of PB) through aggressive process automation.

Provide tenants with self-serve tools to provision Hadoop resources and environments.

Understand and improve the usability, reliability, and scalability of open-source Apache Hadoop services to optimize for the needs of application teams.

You'll need to have:

3 years experience Infrastructure as Code (IaC) practices and technologies like Ansible, Chef, or Terraform.

Systems programming experience in Python, Go or Java.

A degree in Computer Science, Engineering or similar field of study or equivalent work experience.

Experience with Chaos Engineering or testing strategies for infrastructure and platform operations.

Solid understanding of Linux Operating system, Shell scripting, OS troubleshooting

Strong problem-solving and communication skills.

We'd love to see:

Experience with workflow automation tools like Airflow, Argo, etc.

CI/CD experience like Jenkins, TeamCity, etc. to manage SDLC of infrastructure and platform automation tooling.

Experience in automating deployments of technologies in the Hadoop ecosystem (HDFS, HBase, Hive, Spark, Oozie, etc.)

Experience with Cloud Native computing technologies like Kubernetes, and Containers.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.