Role: Lead Data Engineer
Industry Type: IT Services & Consulting
Department: Engineering - Software & QA
Employment Type: Full Time, Permanent
Role Category: Software Development
UG: Any Graduate
PG: Any Postgraduate
EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India.
Location: Gurgaon/Pune/Hyderabad/Bengaluru/Chennai/Coimbatore
Work Mode: Hybrid (2-3 days office in a week) Full time
Job Description:
- 5-14 Years of experience in Big Data & Data related technology experience
- Expert level knowledge and experience in Apache Spark (Core Concepts e.g., RDDs, DataFrames, fault tolerance, Spark internals, Catalyst optimiser, and AQE)
- Hands on programming with Python OR Scala.
- Understands exception handling and its practical applications.
- Experience with building stream-processing systems, using technologies such as Spark-Streaming
- Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
- Good understanding of SQL queries, joins, stored procedures, relational schemas
- Knowledge of ETL techniques and frameworks
- Performance tuning of Spark Jobs
- Experience with native Cloud data services AWS
- Ability to lead a team efficiently
- Experience with designing and implementing Big data solutions
- Practitioner of AGILE methodology
WE OFFER
- Opportunity to work on technical challenges that may impact across geographies
- Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
- Opportunity to share your ideas on international platforms
- Sponsored Tech Talks & Hackathons
- Possibility to relocate to any EPAM office for short and long-term projects
- Focused individual development
- Benefit package:
ò Health benefits, Medical Benefitsò Retirement benefitsò Paid time offò Flexible benefits
- Forums to explore beyond work passion (CSR, photography, painting, sports, etc.
About EPAM: https://vimeo.com/729865941