What are the responsibilities and job description for the Spark Engineer position at Omega Solutions Inc?
Interview Process : 3 Rounds of Zoom Video
- Need 8 Yrs experience and strong experience in Big Data Hadoop, Spark, PySpark
- Hands on Programming - Java, Scala, Python
- WS Cloud -S3, EFS, MSK, ECS, EMR, Lambdas
- Containerized and Microservices
- Distributed Computing constructs - Joins, MapReduce, Good at Memory management
- RDBMS - MySQL, Aurora and No-SQL
- Kafka Streaming
- Data Storage Architecture
- Solid in Scala programming
- Familiar with data transfer
- WS experience is needed