Hadoop Spark SparkSQL - Scala

Job description

"Skill Big Data Spark SQL Java

Mandatory Certification any one

Cloudera CCA Spark and Hadoop Developer CCA175

Databricks Certified Developer Apache Spark 2 X

Hortonworks HDP Certified Apache Spark Developer

Job Description

Experience in Core Advanced Java programming language Spring framework

Experience in Big Data technologies including Spark HDFS Hive

You have a good understanding of organizational strategy architecture patterns Aspect Oriented Programming and technology choices and coaching the team in execution in alignment to these guidelines

You can apply organizational technology patterns effectively in projects and make recommendations on alternate options

You have hands on experience working with large volumes of data including different patterns of data ingestion processing batch real time movement storage and access for both internal and external to BU and ability to make independent decisions within scope of project

You have a good understanding of data structures and algorithms

You can unit test Junit debug and fix issues within established SLAs

You can design software that is easily testable and observable

You understand how team's goals fit a business need

You can identify business problems at the project level and provide solutions

You understand data access patterns streaming technology data validation data performance cost optimization

Strong SQL skills Oracle Sybase

CI CD tools Git Autosys Jenkins

ETL Spark Hive Sqoop Bash script

Experience with Linux OS user level

Python programming skills good to have but not mandatory"

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.