Skip to main content

How to unload One BIG table (containing 200 - 300 Million records) into multiple files

  • May 21, 2019
  • 1 reply
  • 3 views

gkaushik

We have requirement to unload One BIG table in Vertica (containing 200 - 300 Million records) into multiple files using one command.

What's the utility I should use to achieve this functionality like in Teradata there is TPT script which creates multiple parallel connection to export data in parallel. Is there something like that in Vertica?

1 reply

chaima
Forum|alt.badge.img+2
  • Participating Frequently
  • May 22, 2019

Hi,

There used to be a user defined function - ParallelExport - on the market place (unsupported) not sure if it's still available...
But, you can use export to parquet, it's quite fast: https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/SQLReferenceManual/Statements/EXPORTTOPARQUET.htm?zoom_highlight=export to parquet

Chaima