Principal Consultant_ Kafka Admin
Infosys Technologies
In this role, you will lead the administration of Kafka and Confluent ecosystems to support scalable, reliable data streaming. You will work within a broader cloud/digital transformation effort to ensure high availability, security, and governance across multi-region deployments. You will drive upgrades, backup workflows, and performance tuning to meet latency and throughput targets. You will partner with cross-functional teams to implement secure connectivity, auditability, and cost-aware architecture. This opportunity combines deep platform expertise with strategic impact on data infrastructure at scale.
Responsibilities- Provision, configure, and manage Kafka clusters (Apache Kafka KRaft or ZooKeeper-backed) and Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, REST Proxy, Control Center) and Confluent Cloud resources.
- Ensure high availability and resilience across multi-AZ/region deployments; manage replication, ISR, and rack awareness.
- Implement and maintain quotas, throttling, and back-pressure strategies; plan zero-downtime upgrades/patching.
- Own backup/restore workflows for metadata, Schema Registry, and Connect configs; enforce security (authentication/authorization) and encryption.
- Govern topic naming conventions, retention policies, and schema evolution rules; manage PII handling and auditing for compliance.
- Coordinate vulnerability management and hardening baselines; align with CIS/STIG as applicable.
- Deploy and maintain observability pipelines (Prometheus/Grafana, JMX exporters, ELK/OpenSearch) and tracing (OpenTelemetry).
- Define and monitor SLOs/SLIs; analyze broker hotspots, partition skew, and JVM tuning for throughput.
- Automate lifecycle of clusters and topics using Terraform, Helm, and GitOps; manage distributed connectors (JDBC, Debezium, S3/ADLS/GCS, Elasticsearch).
- Operate Schema Registry, ksqlDB, and/or Flink for streaming SQL; enforce resource limits and multi-tenant governance.
- 5–10 years in platform/SRE/DevOps; 3+ years Kafka/Confluent admin in production
- Strong hands-on knowledge of Apache Kafka internals (brokers, controllers, partitions, log segments, retention)
- Proficiency with Kafka CLI tools and AdminClient; deep ACLs, quotas, transactions, exactly-once semantics
- Experience with Confluent Platform or Confluent Cloud administration (RBAC, audit logs, networking)
- Proficiency with observability and alerting (Prometheus/Grafana, Alertmanager, JMX exporters)
- JVM tuning, Linux performance, and network tuning; Docker/Kubernetes administration
- Cloud networking and multi-region architectures (VPC/VNET, PrivateLink)
- Preferrable: Confluent Certified Administrator for Kafka, Terraform/CNK, major cloud certs; CFK knowledge
- strong problem-solving and situational awareness
- excellent cross-functional collaboration
- attention to detail and problem ownership
- Apache Kafka (KRaft and legacy ZooKeeper-backed)
- Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, Control Center)
- Confluent Cloud administration
Reference: WJ-747_31230759 · Posted 06 Nov 2026, 02:16 AM