Rebalance Storm Survival Guide: Strategies for Seamless Kafka Data Pipelines
April 4, 2024
12:05
11:40
Hall A
Intermediate | English | Libraries & Frameworks

Every day, our data ingest pipeline handles petabytes of malicious internet traffic events. This high-volume pipeline heavily relies on Kafka, with hundreds of producers and consumers running on Kubernetes pods and performing thousands of read and write operations per second. Consequently, Kafka rebalance has become a familiar challenge we face. Join us for this session focused on valuable insights into mitigating the disruptions caused by rebalance storms.

During this session, you'll discover effective techniques for optimizing consumer group configurations, minimizing unnecessary rebalances, and ensuring uninterrupted data processing. Gain practical strategies to maintain pipeline stability and enhance the overall performance of your Kafka-driven pipelines, even in the face of dynamic scaling and restarts.

Yulia Antokovsy_500_500_home (1)
LinkedIn_Orange-JavaSummit website icon
Yulia Antonovsky
Principal Software Engineer - Tech Lead
_500_250 Akamai

Yulia Antonovsky is a Senior Software Engineer II at Akamai

With more than 15 years of experience in the tech industry, Yulia has been focusing on Data Engineering for the past 6 years.

She holds a BSc in Computer and Information Sciences from the Technion (Israel Institute of Technology).

Cancellation Policy

Sponsor Cancellation:

In case of cancellation of the event, we will offer a full refund to all attendees and sponsors.

Attendee cancellations:

Up to 30 days prior to the event – 100% Refund 30-14 days prior to the event – 50% Refund No refund will be offered later than that.

Cancellation Policy

Sponsor Cancellation:

In case of cancellation of the event, we will offer a full refund to all attendees and sponsors.

Attendee cancellations:

Up to 30 days prior to the event – 100% Refund.
30-14 days prior to the event – 50% Refund.
No refund will be offered later than that.