This role is responsible for the management and operational excellence of the Kafka clusters running in a Kubernetes environment.

What you’ll do:

• Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control Centre.
• Provide expertise and hands-on experience working on Kafka connect using schema registry at a very high volume.
• Provide administration and operations of the Kafka platform - provisioning, access lists, Kerberos and SSL configurations. Provide expertise and hands-on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connectors, JMS source connectors, Tasks, Workers, converters, Transforms.
• Provide expertise and hands-on experience on custom connectors using the Kafka core concepts and API.
• Create topics, set up redundancy clusters, deploy monitoring tools, configure appropriate alerts and create stubs for producers, consumers, and consumer groups to help onboard applications from different languages/platforms.
• As a Kafka SRE, you will conduct root cause analysis of production incidents, document for reference and put into place proactive measures to enhance system reliability.
• Automate routine tasks using scripts or automation tools and perform data-related benchmarking, performance analysis and tuning.
• Conduct root cause analysis of production incidents, documenting for reference and initiating proactive measures to enhance system reliability.

What you'll need to succeed