Skip to main content
Question

Copy data *.csv from S3 bucket into Vertica Table

  • February 12, 2019
  • 2 replies
  • 19 views

scottysak

Any ideas on why the Copy Command below is failing? The S3 bucket contains 2500+ .csv files that totals about 750GB. The table test_master_tmp2 was created beforehand. The AWS cluster is sized with 8-300GB drives totaling almost 2.4TB per node (3 node cluster), just wondering how there could be insufficient disk space.

Failed Load Details


For query with sessionId: v_verticadb_node0003-13318:0x13b, transactionId: 54043195528445989, statementId: 1.
Copy Command copy test_master_tmp2 from 's3://bridge-datapartners/count_system/count_system_20190115/*.csv' delimiter '|' NULL '' ENCLOSED BY '"' REJECTMAX 10000 DIRECT
Error Time 11 Feb 2019 21:38:23
Error Code 2927
Error Details Could not write to [/vertica/data/VerticaDB/v_verticadb_node0001_data]: Volume [/vertica/data/VerticaDB/v_verticadb_node0001_data] has insufficient space.

2 replies

mkheir
Forum|alt.badge.img+1
  • Participating Frequently
  • February 12, 2019

From the error :
""Error Details Could not write to [/vertica/data/VerticaDB/v_verticadb_node0001_data]: Volume [/vertica/data/VerticaDB/v_verticadb_node0001_data] has insufficient space.""
it seems that you don't have enough free disk space under /vertica/data/VerticaDB/v_verticadb_node0001_data ?

what is the output of 'df -h' command on your node0001?


scottysak
  • Author
  • New Participant
  • February 15, 2019

Thanks for your response, unfortunately the cluster has been shutdown by the customer and we no longer have the ability to troubleshoot, will have to keep an eye out for this to happen again. Thanks mkheir.