Skip to main content
Question

Error (Sort Buffer failed)

  • September 2, 2019
  • 1 reply
  • 9 views

andre_silva
Forum|alt.badge.img

Hi,
When i executed transformations pdi, vertica returns this error:
**2019/09/02 12:16:16 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2019/09/02 12:16:16 - Table output.0 - Error inserting/updating row
2019/09/02 12:16:16 - Table output.0 - [Vertica]VJDBC ERROR: Malloc of 399458304 bytes for Sort Buffer failed
**
It's necessary up the pool parameters in vertica?

Thanks.

1 reply

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • September 3, 2019

Check out the "Vertica Integration with Pentaho Data Integration (PDI): Tips and Techniques" guide here:
https://www.vertica.com/kb/PentahoPDI_Tips/Content/Partner/PentahoPDI_Tips.htm

In particular, if you are doing a large data load:

  1. When using the Standard Output Table component, add the DirectBatchInsert parameter to the connection and set it to true
  2. To specify that the Vertica Bulk Loader write data directly to the ROS, select Insert direct to ROS.