What are the responsibilities and job description for the Cloudera Big Data Administrator position at Cynet Systems?
Job Details
We are looking for Cloudera Big Data Administrator for our client in Reston, VA
Job Title: Cloudera Big Data Administrator
Job Type: Contract
Job Description:
Job Description:
- This is a Cloudera Big Data administrator position and not a developer position.
- Experience with building Cloudera cluster CDP public cloud and AMI upgrade, setting up NiFi, SOLR, HBase, Kafka, Knox in Cloud using CDP Public Cloud v7.2.17 or higher.
- Be able to write the shell scripts to monitor the health check of services and respond accordingly to any warning or failure conditions.
- Monitoring the health of all the services running in the production cluster using the Cloudera Manager.
- Performing/Accessing the databases, metastore tables and writing Hive, Impala queries using HUE.
- Responsible for monitoring the health of the Services on top of all clusters.
- Working closely with different teams like Application development team, Security team, Platform Support to identify and implement the Configurational changes that are needed on top of the cluster for better performance of the services.
- Cloudera CDP Public Cloud v7.2.17 or higher.
- Apache Kafka - strong Administration & troubleshooting skills.
- Kafka Streams API stream processing with KStreams & Ktables.
- Kafka integration with IBM MQ.
- Kafka broker management.
- Topic/ offset management.
- Apache Nifi - Administration.
- Flow management.
- registry server management.
- controller service management.
- NiFi to Kafka /HBase /SOLR integration.
- Hbase - administration.
- database management.
- troubleshooting.
- SOLR - administration.
- managing Logging level.
- managing shards & high availability.
- Collection management.
- Rectify resource intensive & long running SOLR queries.
- Proficient with handling AWS EC2, S3, EBS, EFS.
- Ensure Cloudera installation and configuration is at optimal specifications (CDP, CDSW, Hive, Spark, NiFi).
- Design and implement big data pipelines and automated data flows using Python/R and NiFi.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
