What are the responsibilities and job description for the Senior Hadoop Administrator - Associate position at Software Guidance & Assistance, Inc. (SGA, Inc.)?
Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Hadoop Administrator - Associate for a CONTRACT assignment with one of our premier Financial Services clients in Alpharetta, GA.
Responsibilities:
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.
Responsibilities:
- Commissioning and decommissioning of the nodes to/from Hadoop cluster.
- Implementing, managing, and administering the overall Hadoop infrastructure.
- Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
- Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
- Replicating huge amount data from one Hadoop cluster to another.
- Applying encryption to secure the data in the Hadoop cluster.
- Applying the configuration changes and testing the cluster in collaboration with the application teams and business users.
- Expert in setting up Hadoop cluster from scratch and server maintenance.
- Sound knowledge of Hadoop services - HDFS, Hive, HBase, Impala, Hue, Ranger etc.
- Experience with Cloudera CDP Hadoop upgrade.
- Experience with access management and setting up user roles in Hadoop.
- Able to create and debug complex Unix shell scripts.
- Good verbal and written communication skills.
- Good analytical and problem-solving skills.
- Good team player.
- Analyzing and troubleshooting the issues with the clusters.
- Set up and maintain appropriate infrastructure to maintain performance and data integrity.
- Experience with ELK Stack: Elasticsearch, Logstash, Kibana, Apache Hadoop
- Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
- Expert in networking and security settings to support network related pipelines.
- Good to have Ruby and/or Python, Unix and GIT Knowledge.
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.