Role & responsibilities
Key Responsibilities
Design, build, and operate Kafka-based streaming platforms for logs, metrics, and traces.
Configure and optimize Kafka clusters including brokers, topics, partitions, replication, and consumer groups.
Implement and manage Kafka security using SSL/TLS and SASL mechanisms.
Design and operate OpenTelemetry pipelines and collectors for metrics, logs, and distributed tracing.
Integrate telemetry data across logs, metrics, and traces for end-to-end observability.
Perform performance tuning, capacity planning, and reliability improvements for Kafka and OTel pipelines.
Troubleshoot complex production issues across Kafka, OpenTelemetry collectors, and downstream systems.
Manage and operate data/telemetry platforms ensuring stability, scalability, and compliance.
Collaborate with platform, SRE, and application teams to support enterprise observability use cases.
Mandatory Skills (Must-Have)
5+ years of hands-on experience with Apache Kafka in production environments.
Strong knowledge of Kafka architecture: brokers, partitions, replication, consumer groups, offsets.
Hands-on experience with Kafka security (SSL/TLS, SASL).
Strong hands-on experience with OpenTelemetry pipelines and collectors.
Experience integrating logs, metrics, and traces into a unified observability platform.
Proven expertise in performance tuning and production troubleshooting.
Experience managing enterprise-scale data or observability platforms.