What are the responsibilities and job description for the Lead Big Data Developer position at Karwell Technologies Inc?
Job Details
#W2 Requirement
Job Title: Senior/Lead Spark3 Developer
Location: Columbus, Ohio (Hybrid Onsite - 3 Days/Week)
Duration: 6-12 Months Plus
Description:
We are looking for a Sr Software Engineer skilled in conversion of Cascading/MapReduce to Spark. This individual will be responsible for migrating Big Data workloads to Kubernetes/Spark 3. This individual will lead the conversion of Cascading/MapReduce to Spark 3. Will be touching the code daily within the IntelliJ IDE...doing Scala code reviews, making coding changes needed for the Scala/Spark upgrade, designing the new Kubernetes environment, etc.
Key Skills: Application Migration, Hadoop, Spark 3, SCALA, YAMAL, JIRA, Docker, Linux, GitHub, GitLab