Skip to main content

Hadoop for Archiving

  • December 12, 2017
  • 2 replies
  • 17 views
Vertica_User
Forum|alt.badge.img+1

Hi,
We have 36 node vertica cluster with 10% free disk space. We would like to keep 6 months data in vertica and archive rest to other locations and restore when required.
Can you suggest if hadoop is fine or any other storage locations is preferable?

    2 replies

    kguan
    Forum|alt.badge.img
    • kguan
    • Participating Frequently
    • December 15, 2017

    Yes, Hadoop if fine. Using HDFS storage locations to store lower-priority data is suggested by Vertica:
    https://my.vertica.com/docs/9.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/StorageLocations/HPVerticaStorageLocationForHDFS.htm

    Jim_Knicely
    Forum|alt.badge.img+2
    • Jim_Knicely
    • Participating Frequently
    • December 19, 2017

    @Vertica_User:

    Fyi ...

    "If you use any HDFS storage locations, the HDFS data must be available at the time you start Vertica. Your HDFS cluster must be operational, and the ROS files must be present. If you have moved data files, or if they have become corrupted, or if your HDFS cluster is not responsive, Vertica cannot start."

    See:
    https://my.vertica.com/docs/9.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/StorageLocations/HPVerticaStorageLocationForHDFS.htm

    Still scrolling?
    Ask a question
    Terms & ConditionsAccessibility statement