Key responsibilities
- Develop and maintain Spark applications using Scala for high-volume data processing.
- Build and optimise batch and streaming data pipelines, including performance tuning and troubleshooting.
- Work with data engineers, architects and product teams to deliver robust data solutions in an agile environment.
- Support testing, deployment and operational readiness using CI/CD, version control and engineering best practices.
- Contribute to documentation, knowledge transfer and handover to permanent engineering teams.
Essential skills and experience
- Strong hands-on experience developing with java, Apache Spark and Scala.
- Good understanding of distributed data processing, data pipelines,
- ETL/ELT and performance optimisation.
- Experience with Hadoop, Cloudera, AWS or GCP data platforms is desirable.
- Familiarity with Kafka, SQL, Python, Git, Jenkins or similar CI/CD tooling would be beneficial.
- Ability to work independently as a contractor, integrate quickly with an existing team and deliver against agreed outcomes.
Location - Kolkata, Hyderabad, Bangalore, Chennai, Delhi / NCR