Role: Software Development - Other
Industry Type: IT Services & Consulting
Department: Engineering - Software & QA
Employment Type: Full Time, Permanent
Role Category: Software Development
UG: Any Graduate
Kafka Platform Engineer / DevOps Engineer
Job Summary
Responsible for building, automating, and managing real-time data streaming platforms using Kafka, along with CI/CD pipelines and infrastructure automation tools to ensure scalable, resilient, and secure systems.
Key Responsibilities
Design, deploy, and manage Apache Kafka clusters (on-prem / cloud) Monitor Kafka performance, throughput, and latency Manage topics, partitions, brokers, and replication strategies Troubleshoot Kafka issues (lag, broker failures, consumer performance) Build and maintain CI/CD pipelines using GitLab Automate deployments for infrastructure and applications Integrate testing, security checks, and release workflows Develop and manage infrastructure using Terraform / Ansible Automate provisioning (VMs, networks, storage, cloud services) Maintain Infrastructure-as-Code (IaC) best practices Ensure high availability, scalability, and disaster recovery Collaborate with data engineers and application teams Maintain documentation and operational runbooks
Required Skills
Core Technical Skills Apache Kafka (brokers, topics, partitions, consumer groups) Kafka ecosystem (Kafka Connect, Schema Registry nice-to-have) Performance tuning & monitoring DevOps Skills GitLab CI/CD pipelines (build, test, deploy automation) Version control using Git Containerization (Docker)