Role: Senior Data Engineer
Industry Type: IT Services & Consulting
Department: Engineering - Software & QA
Employment Type: Full Time, Permanent
Role Category: Software Development
UG: Any Graduate
PG: Any Postgraduate
Senior Data EngineerJob Description
We are seeking Python Application Developers with strong experience in building applications from scratch. The ideal candidate will have a proven track record in Python application development, infrastructure as code, and cloud components (AWS preferred). In addition, experience in full-stack web applications or API development is essential. This role requires hands-on expertise, problem-solving ability, and a passion for building scalable, maintainable solutions.
Key Responsibilities - Design, develop, and deploy Python applications from the ground up.
- Build and maintain APIs and full-stack web applications.
- Implement Infrastructure as Code IaC solutions for scalable deployments.
- Work with cloud services AWS preferred to integrate and optimize applications.
- Collaborate with cross functional teams product data QA to deliver high quality features.
- Ensure code quality, maintainability, and adherence to best practices.
- Participate in code reviews, testing, and continuous integration/continuous deployment CI/CD.
- Strong experience in Python application development (building applications from scratch).
- Expertise in Infrastructure as Code (Terraform, CloudFormation, or similar).
- Hands on experience with AWS cloud components (EC2, Lambda, S3, RDS, etc.).
- Solid background in API development and full-stack web applications.
- Proficiency in CI/CD pipelines, containerization Docker, Kubernetes, and version control Git.
- Strong problem solving skills and ability to work in agile product teams.
- Experience in data engineering projects (ETL pipelines, data modeling, data integration).
- Working knowledge of front-end technologies and understanding of how websites are built and function.
- Familiarity with streaming and batch processing frameworks Kafka, Spark, Flink.
- Understanding of Change Data Capture CDC and micro-batch processing.
- Big Data - Big Data - Pyspark
- Data AI - ETL OTHERS - Snowflake
- Data Science and Machine Learning - Data Science and Machine Learning - Databricks
- Data AI - Data Engineering - Apache Kafka
- Programming Language - Python - Apache Airflow
- Data Science and Machine Learning - Data Science and Machine Learning - Python
- Database - Database Programming - SQL
- Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark
- Data AI - Data Engineering - Data Quality Validation
- Data AI - Data Engineering - Stream Processing
- Beh - Communication and collaboration