What are the responsibilities and job description for the Spark 3 developer//Only W2 position at System Edge (USA) L.L.C.?
Job Details
Columbus based client
Preferred to Columbus OH 3 days office is must for this role
We are ok with candidate who are open to relocate
Duration -9-10 months
Skills needed
This is migration project and client is moving to MapReduce to Spark 3
opportunity for a skilled consultant in conversion of Cascading/MapReduce to Spark
The Sr Software Engineer will be responsible for migrating Big Data workloads to Kubernetes/Spark 3.
Will lead the conversion of Cascading/MapReduce to Spark 3.
Will be touching the code daily within the IntelliJ IDE...doing Scala code reviews, making coding changes needed for the Scala/Spark upgrade, designing the new Kubernetes environment, etc.