Skip to main content

number of ROS containers using COPY DIRECT

  • March 5, 2015
  • 1 reply
  • 11 views
eychih

Hi,

 

From my understanding, the Vertica COPY DIRECT command is designed for many small files.  If data of these files belong to one table, I would like to know if each of these files will create a ROS container, using COPY DIRECT.  If this is the case, will the number of ROS containers exceed limitation quickly?  How to avoid it (copy a large file)?  Thanks.    

    1 reply

    Rahul_Choudhary
    Forum|alt.badge.img
    • Rahul_Choudhary
    • Participating Frequently
    • March 9, 2015

    Hi 

     

    Copy with direct is ideally designed for loading large amounts of data (100MB or more) at a time & not for smaller loads.

     

    Using the DIRECT keyword in the COPY statement results in bypassing  loading data into WOS, and instead, load data directly into ROS containers.

     

    So if you try to load data with no. of small files it can lead to "too many ros container" issue that is the reason why Vertica always suggest to load into WOS if you have smaller loads to avoid this situation.

     

    Regards

    Rahul Choudhary

    Still scrolling?
    Ask a question
    Terms & ConditionsAccessibility statement