Skip to main content

What is the fastest way to load a file from S3 into Vertica?

  • December 26, 2013
  • 1 reply
  • 9 views

Nicholas_Chamma
Forum|alt.badge.img+1
A critical but also slow part of our data pipeline involves loading large files from S3 into Vertica.

What is the fastest way to do that?

Does Vertica offer some way to automatically break input files into pieces and load them in parallel (a la distcp/s3distcp)?

1 reply

Nicholas_Chamma_1
Forum|alt.badge.img
Any ideas?