Skip to main content

Kafka not consuming messages

  • August 19, 2016
  • 2 replies
  • 16 views

skunkwerk
Forum|alt.badge.img

I've run the following steps, but there is no data in my target table, or error in the log:

 

/opt/vertica/packages/kafka/bin/vkconfig scheduler --add —-username dbadmin —-password pass

CREATE FLEX TABLE public.kafka_tgt();

/opt/vertica/packages/kafka/bin/vkconfig topic --add --target public.kafka_tgt --rejection-table public.kafka_rej --topic testiaTest --num-partitions 1 --username dbadmin --password pass

/opt/vertica/packages/kafka/bin/vkconfig kafka-cluster --add --brokers (IP HERE):9092 --cluster K_cluster_1 --username dbadmin --password pass

/opt/vertica/packages/kafka/bin/vkconfig launch --conf /home/dbadmin/config.properties

 

Any ideas how to debug this?

 

thanks

2 replies

skunkwerk
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • August 19, 2016

I've been able to consume messages from that endpoint and topic from another system, so I know that's working.  Do I need to tell Vertica to start from the beginning of the topic?


thien
  • New Participant
  • August 15, 2017

We've just encountered the same problem with Vertica 8.0.1 against Kafka 0.8 and we've tried against Kafka 0.9 and it seems to be working.