Job Requirements: Responsible for designing, developing, and supporting realtime streaming application using Spark & Scala.
Design and develop batch data ingestion and processing application using spark and scala Able to consume and process different file types like json, csv, text. Able to integrate spark with different datasources like kafka, oracle, couchbase, mongo etc., Able to create junit test cases and integrate java APIs into scala-spark Basic knowledge in shell scripting to manage deployment and test application in servers