IT & Software

Principal Consultant_ Kafka Admin

Infosys Technologies

London · Greater London · United Kingdom

Share this job: X Facebook WhatsApp Save job : Principal Consultant_ Kafka Admin
Overview

In this role, you will lead the administration of Kafka and Confluent ecosystems to support scalable, reliable data streaming. You will work within a broader cloud/digital transformation effort to ensure high availability, security, and governance across multi-region deployments. You will drive upgrades, backup workflows, and performance tuning to meet latency and throughput targets. You will partner with cross-functional teams to implement secure connectivity, auditability, and cost-aware architecture. This opportunity combines deep platform expertise with strategic impact on data infrastructure at scale.

Responsibilities
  • Provision, configure, and manage Kafka clusters (Apache Kafka KRaft or ZooKeeper-backed) and Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, REST Proxy, Control Center) and Confluent Cloud resources.
  • Ensure high availability and resilience across multi-AZ/region deployments; manage replication, ISR, and rack awareness.
  • Implement and maintain quotas, throttling, and back-pressure strategies; plan zero-downtime upgrades/patching.
  • Own backup/restore workflows for metadata, Schema Registry, and Connect configs; enforce security (authentication/authorization) and encryption.
  • Govern topic naming conventions, retention policies, and schema evolution rules; manage PII handling and auditing for compliance.
  • Coordinate vulnerability management and hardening baselines; align with CIS/STIG as applicable.
  • Deploy and maintain observability pipelines (Prometheus/Grafana, JMX exporters, ELK/OpenSearch) and tracing (OpenTelemetry).
  • Define and monitor SLOs/SLIs; analyze broker hotspots, partition skew, and JVM tuning for throughput.
  • Automate lifecycle of clusters and topics using Terraform, Helm, and GitOps; manage distributed connectors (JDBC, Debezium, S3/ADLS/GCS, Elasticsearch).
  • Operate Schema Registry, ksqlDB, and/or Flink for streaming SQL; enforce resource limits and multi-tenant governance.
Key requirements
  • 5–10 years in platform/SRE/DevOps; 3+ years Kafka/Confluent admin in production
  • Strong hands-on knowledge of Apache Kafka internals (brokers, controllers, partitions, log segments, retention)
  • Proficiency with Kafka CLI tools and AdminClient; deep ACLs, quotas, transactions, exactly-once semantics
  • Experience with Confluent Platform or Confluent Cloud administration (RBAC, audit logs, networking)
  • Proficiency with observability and alerting (Prometheus/Grafana, Alertmanager, JMX exporters)
  • JVM tuning, Linux performance, and network tuning; Docker/Kubernetes administration
  • Cloud networking and multi-region architectures (VPC/VNET, PrivateLink)
  • Preferrable: Confluent Certified Administrator for Kafka, Terraform/CNK, major cloud certs; CFK knowledge
  • strong problem-solving and situational awareness
  • excellent cross-functional collaboration
  • attention to detail and problem ownership
  • Apache Kafka (KRaft and legacy ZooKeeper-backed)
  • Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, Control Center)
  • Confluent Cloud administration

Reference: WJ-747_31230759 · Posted 06 Nov 2026, 02:16 AM

Find more on GigBlow

This role is listed on GigBlow for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.

Browse jobs