Skip to main content

Is Vertica Clustering Increase Performance?

  • June 6, 2017
  • 4 replies
  • 14 views

hoseiney
Forum|alt.badge.img

Hi, we have a system with high volume bulk load, for now we load 10 k data per second
and retain data for 10 days...

But in future we need scale our system and should handle 50 k data per second
and we should retain data for 20 days.

For now, we use Vertica in single Node, and after 5 or 6 TB, simple queries like count(*) take long time.
I know clustering is good for high availability, but we need performance optimization in 2 phase:
bulk loading and query execution.
Is Clustering increase performance in bulk loading and query execution?

4 replies

Forum|alt.badge.img+2
  • Participating Frequently
  • June 6, 2017

Yes definately cluster would give you better query performance and load performance than a single node cluser as volumn of data increase. highly recommended that you plan for it .


hoseiney
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • June 7, 2017

@skamat
does Vertica have linear scalability?


ckotsidimos
Forum|alt.badge.img+1
  • Participating Frequently
  • June 8, 2017

Bulk loading data can also be done in a stand by node that will not affect the cluster query performance.

Vertica scales very well as you add nodes. keep in mind to optimize projections


RaghavA
Forum|alt.badge.img
  • Participating Frequently
  • June 9, 2017

@hoseiney ,

As we have experienced, clustering really helpful when you target to have 50k rows per sec. Just remember to have your cluster to have well balanced projections and do run performance scripts, vioperf, vcpuperf and vnetperf.
Intercluster connectivity is very important as during your Trickle loads and bulk loads, inter-node communication and their speed is a very important factor.

Regards,
Raghav Agrawal