What are the responsibilities and job description for the Sr. Cloudera Big Data administrator position at KMM Technologies, Inc.?
Job Description
Job Description
Reach me on : E-Mail : sanjay@kmmtechnologies.com | (240) 800-0048
Position : Sr. Cloudera Big Data administrator
Location : Reston, VA #HYBRID
Duration : Long Term Contract
Job Description :
Experience with building Cloudera cluster CDP public cloud and AMI upgrade, setting up NiFi, SOLR, HBase, Kafka, Knox in Cloud using CDP Public Cloud v7.2.17 or higher.
Be able to write the shell scripts to monitor the health check of services and respond accordingly to any warning or failure conditions.
Monitoring the health of all the services running in the production cluster using the Cloudera Manager. Performing / Accessing the databases, metastore tables and writing Hive, Impala queries using HUE.
Responsible for monitoring the health of the Services on top of all clusters.
Working closely with different teams like Application development team, Security team, Platform Support to identify and implement the Configurational changes that are needed on top of the cluster for better performance of the services.
Rectify resource intensive & long running SOLR queries
Additional Must Have Skills includes :
Proficient with handling AWS EC2, S3, EBS, EFS
Ensure Cloudera installation and configuration is at optimal specifications (CDP, CDSW, Hive, Spark, NiFi).
Design and implement big data pipelines and automated data flows using Python / R and NiFi.
Assist and provide expertise as it pertains to automating the entire project lifecycle.
Perform incremental updates and upgrades to the Cloudera environment with newer version.
Assist with new use cases (i.e., analytics / ML, data science, data ingest and processing), Infrastructure (including new cluster deployments, cluster migration, expansion, major upgrades, COOP / DR, and security).
Assist in testing, governance, data quality, training, and documentation efforts.
Move data and use YARN to allocate resources and schedule jobs.
Manage job workflows with Hue.
Implement comprehensive security policies across the Hadoop cluster using Ranger.
Troubleshoot potential issues with Kerberos, TLS / SSL, Models, and Experiments, as well as other workload issues that data scientists might encounter once the application is running.
Supporting the Big Data / Hadoop databases throughout the development and production lifecycle.
Troubleshooting and resolving database integrity issues, performance issues, blocking and deadlocking issues, replication issues, log shipping issues, connectivity issues, security issues, performance tuning, query optimization, using monitoring and troubleshooting tools.
Create, test, and implement scripting for automation support.
Experience in working with Kafka ecosystem (Kafka Brokers, Connect, Zookeeper) in production is ideal.
Implement and support streaming technologies such as Kafka, Spark & Kudu
Thanks & Regards,
LAXMAN
KMM Technologies, Inc.
CMMI Level 2 | ISO 9001 | ISO 20000 | ISO 27000 Certified
Tel : (240) 800-0039 |Email : lax@kmmtechnologies.com
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Sr. Cloudera Big Data administrator?
Sign up to receive alerts about other jobs on the Sr. Cloudera Big Data administrator career path by checking the boxes next to the positions that interest you.
