Role: Azure Databricks Developer
Industry Type: IT Services & Consulting
Department: Consulting
Employment Type: Full Time, Permanent
Role Category: IT Consulting
UG: Any Graduate
PG: Any Postgraduate
Role: Azure Databricks/ Pyspark Developers
Exp: 9-12 Years
Location: Vishakapatnam
Essentials:
- PySpark and Spark SQL
- Working with Dataframes using different APIs
- Spark Functions
- Advanced Data transformations
- Good knowledge in SQL
- Applying UDFS
- Error handling, logging and monitoring
- Unix, Scheduling Tool
- Performance Tuning & Generic process development
- Banking Domain Knowledge
- ò Develop and maintain ETL pipelines using Azure Databricks (PySpark / Spark SQL)
- ò Process and transform large financial datasets (transactions, customer data)
- ò Implement data pipelines for AML, KYC, risk, and regulatory reporting
- ò Ensure data quality, governance, and lineage tracking
- ò Integrate data from banking systems (core banking, payments, trading)
- ò Optimize Spark jobs for performance and cost
- ò Collaborate with business and compliance teams
- ò Support audit and regulatory requirements