Finding a Work-Load Balance: Cruise Control for Kafka on Kubernetes

Guest Speakers: Paolo Patierno and Kyle Liberti (Red Hat)

OpenShift Commons Briefing
2021-06-21
https://commons.openshift.org/events.htm

Abstract:
Over time, the load on the brokers of an Apache Kafka cluster can easily become unbalanced causing the topics to receive an unhealthy distribution of traffic.

In situations like these, some brokers may become overloaded leading to Kafka cluster performance issues due to poor utilization of cluster resources such as CPU, network, and storage.

To make matters worse, rebalancing the cluster manually with the provided command-line tools is one of the most complicated and time-consuming Kafka operations.

Luckily using open source tools like Cruise Control for automated cluster balancing and Strimzi for cloud-native Kafka Kubernetes, we can maintain healthy Kafka clusters with significantly less effort. During this session, you will learn how to easily balance your under-performing cluster using the Kubernetes native Cruise Control resources provided by Strimzi.

hosted by Diane Mueller (Red Hat)

#kubernetes #kafka