What are the responsibilities and job description for the Spark 3 developer position at Urpan Technologies, Inc.?
Job Details
Skills needed
This is migration project and client is moving to MapReduce to Spark 3
opportunity for a skilled consultant in conversion of Cascading/MapReduce to Spark
The Sr Software Engineer will be responsible for migrating Big Data workloads to Kubernetes/Spark 3.
Will lead the conversion of Cascading/MapReduce to Spark 3.
Will be touching the code daily within the IntelliJ IDE...doing Scala code reviews, making coding changes needed for the Scala/Spark upgrade, designing the new Kubernetes environment, etc.