Skip to main content

Mergeout and CPU usage

  • Oct 10, 2017 6:51 PM UTC
  • 4 replies
  • 13 views

Izayda
Forum|alt.badge.img
  • Participating Frequently

We have a lot of direct inserts in our database. So, we have a lot of mergeout operations.

But sometimes we observe strange behaviour of that operations.
Some mergeout operations consume CPU on one node for couple of hours. LA of that node increase and sometimes this node have a huge delay in Global Catalog operations with this node (transactions lock GC at this node with ~20 second delay). So, sometimes we have GCL timeout problem. This mergeout sessions can be seen in system_sessions table, but doesn't appear in tuple_mover_operations table. We can grep it in vertica.log

This looks like this:

Average ROS containers count for our projections is about 300-400.

Recently, we had similar problem, but it was solved by proper TM configuration: https://forum.vertica.com/discussion/238751/high-cpu-usage

So, is this normal behaviour? Has somebody such problems in mergeouts?

4 replies

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • Oct 11, 2017 12:04 PM UTC

What version of Vertica ?


Izayda
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • Oct 11, 2017 12:05 PM UTC

8.1.1-4


TomM
Forum|alt.badge.img
  • Participating Frequently
  • Oct 11, 2017 12:13 PM UTC

Do your customers/users perform updates or deletes?

If yes, I'd recommend you review:

https://my.vertica.com/kb/Deletes-in-Vertica-The-FAQs/Content/FAQs/Deletes-in-Vertica-The-FAQs.htm?Highlight=replay


Izayda
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • Oct 11, 2017 12:15 PM UTC

Sometimes we delete or update data.Then we purge delete vectors. When this CPU anomaly occurs, delete_vectors table is empty