Hadoop Administrator - Laurel Springs, NJ

Job Title: Hadoop Administrator

Location: Laurel Springs, NJ

Duration: Full Time role

Position Responsibilities:

• Design a data lake model to configure the jobs.
• Create a Hadoop cluster from scratch with 65 nodes on premise environment.
• Migrate the on-prem platform to cloud environment using data lake models and deploy the job using the tool Talentd R Studio.
• Work on MapR platform for performance tuning of hive and spark jobs for all users. Use Hive TEZ engine to increase the performance of the applications.
• Create 50 Hadoop nodes in production cluster to scale up the cluster storage capacity and performance.
• Install and configure Applications like Data Stage, Rstudio, Tableau, Talentd, and Alation on Hadoop Cluster.
• Install and Configure Monitoring tools like Collectd, Elastic Search, OpenTSDB, and Fluentd.
• Architecture the Hadoop clusters for application development and Hadoop.
• Work on Tools, such as Hive, Spark, Kafka, Flume, MapReduce, HBase, and Zookeeper.
• Install, Configure and Maintain Apache Hadoop clusters for application development and utilize Hadoop tools like Hive, Hue, Spark, HBase, CLDB, NFS, YARN, Node Manager, Resource Manager and Zookeeper.
• Work with tier 1 application teams on fine-tuning code to get better performance from HBase during reads and writes in order to meet Business SLA's.
• Domestic travel required approximately 5% of time to various unanticipated client sites.
• Travel and relocation required to unanticipated client locations throughout the U.S.

Required Skills & Experience:

• Master's or foreign equivalent degree in Computer Science, or Computer Engineering, and 6 months of experience in the job offered or 6 months of experience in the related occupation of Software Engineer or equivalent with experience in designing and implementing geo spatial application using core software development practices using Scala, Java, SQL Server, as well as 6 months of experience to include using tools such as Apache Spark, Spark SQL, Spark Core, Spark Streaming, Structured Streaming, Scala, Impala, Kafka, HBase and Spark MLlib.
• Domestic travel required approximately 5% of time to various unanticipated client sites.
• Travel and relocation required to unanticipated client locations throughout the U.S.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.