Skip to main content

increase performance when using kafka with vertica

  • July 11, 2017
  • 0 replies
  • 6 views

hoseiney
Forum|alt.badge.img

I have a Kafka cluster and use Vertica scheduler for sync Vertica with Kafka ...

when I monitor Copy commands I get this :

COPY my_table SOURCE KafkaSource(stream='kafka_topic|0|1, executionparallelism=1,
message_max_bytes=1048576 )

this command take too long and I want to increase performance of that.

I Know kafka_default_pool is the pool when Vertica runs copy commands and I want to increase executionparallelism

I run this commands to change that:
ALTER RESOURCE POOL kafka_default_pool executionparallelism 5

but when I Monitor Copy commands, executionparallelism is still 1.

how can I increase perfomance Of this type of commands ?