What are the responsibilities and job description for the Hadoop Admin position at Info Way Solutions?
Hi Professionals,
Hope you are doing good
This is Jayaraman from Info Way Solutions, LLC We have job opening for Hadoop Admin and the detailed Job description is given below :
Kindly check the JD and share your views
Role : Hadoop Admin
Location : Mountain View, CA
Job Description :
Responsible for implementation and ongoing administration of Hadoop infrastructure.
Responsible for Cluster maintenance, trouble shooting, Monitoring and followed proper backup & Recovery strategies.
Provisioning and managing the life cycle of multiple clusters like EMR & EKS.
Infrastructure monitoring, logging & alerting with Prometheus / Grafana / Splunk.
Performance tuning of Hadoop clusters and Hadoop workloads and capacity planning at application / queue level. Responsible for Memory management, Queue allocation, distribution experience in Hadoop / Cloud era environments.
Should be able to scale clusters in production and have experience with 18 / 5 or 24 / 5 production environments. Monitor Hadoop cluster connectivity and security, File system (HDFS) management and monitoring.
Investigates and analyzes new technical possibilities, tools, and techniques that reduce complexity, create a more efficient and productive delivery process, or create better technical solutions that increase business value. Involved in fixing issues, RCA, suggesting solutions for infrastructure / service components.
Responsible for meeting Service Level Agreement (SLA) targets, and collaboratively ensuring team targets are met.
Ensure all changes to the Production systems are planned and approved in accordance with the Change Management process.
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
Maintain central dashboards for all System, Data, Utilization, and availability metrics.
What an Ideal candidate will look like?
8-12 years of Total experience with at least 5 years of work experience in developing, maintaining, optimization, issue resolution of Hadoop clusters, supporting Business users. Experience in Linux / Unix OS Services, Administration, Shell, awk scripting
- Strong knowledge of anyone programming language Python / Scala / Java / R with Debugging skills.
Experience in Hadoop (Map Reduce, Hive, Pig, Spark, Kafka, HBase, HDFS, H-catalog, Zookeeper and Oozie / Airflow) Experience in Hadoop security (Kerberos, Knox, TLS). Hands-on Experience in SQL and No SQL Databases (HBASE) with performance optimization.
Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
Thanks & Regards,
Jayaraman
Email : jayaraman@infowaygroup.com
Direct : (925)-241-5719
Work : (925)-592-6160 Ext 105
Info Way Solutions LLC | 46520 Fremont Blvd, Suite 614 | Fremont, CA - 94538
