Skip to main content
Question

Bulk warning in kafka

  • Jul 3, 2023 7:22 AM UTC
  • 3 replies
  • 20 views

name_tanwar

Hi #kafka-streams, I have one question regarding warning message in kafka logs "WARN Received a PartitionLeaderEpoch assignment for an epoch < latestEpoch. This implies messages have arrived out of order. New: {epoch:1, offset:5684029657}, Current: {epoch:9, offset5670020569} for Partition:-0 (kafka.server.epoch.LeaderEpochFileCache)". I have cleared kafka consumer logs and which stopped these warnings. How can i resolve this issue permanently?

3 replies

mosheg
Forum|alt.badge.img+2
  • Participating Frequently
  • Jul 4, 2023 1:53 PM UTC

You might have hit a bug mentioned here https://issues.apache.org/jira/browse/KAFKA-7415
After an upgrade to 2.0.1 it was mentioned that the leader-epoch-checkpoint for each topic updated to the correct values.

You can also open a support case.


SergeB
Forum|alt.badge.img
  • Participating Frequently
  • Jul 5, 2023 12:49 AM UTC

This seems to be a Kafka server related warning. Does it impact the Vertica integration ?


name_tanwar
  • Author
  • New Participant
  • Jul 5, 2023 5:14 AM UTC

We are using kafka version 2.12-0.11.0.1, we haven't upgraded the kafka version, also it doesn't impacting vertica integration.