Skip to main content

load from hadoop

  • August 28, 2014
  • 2 replies
  • 14 views
Navneet_1
Forum|alt.badge.img+1
Hi,

I have a requirement to copy data from Hadoop to Vertica 6.1. Data is certainly quite large. What is the best way out (by performance) - 

- Using copy command ? - Can I use on any node feature with Copy from hdfs and where can I find details of the copy from hdfs
- Using connectors and then mapred or streaming ?
- Any other way out ...

Thanks
NJ

    2 replies

    eli_revach
    Forum|alt.badge.img+2
    • eli_revach
    • Participating Frequently
    • August 28, 2014
    Hi 
    You can use HCatLoader and HCatStorer interfaces   with Pig scripts to read data from Hive  HCatalog-managed tables and dumped it into Vertica .

    Attach is good example to start with -> http://www.research.janahang.com/load-hive-tables-into-vertica/

    Thanks 

    Daniel_Leybovic
    Forum|alt.badge.img+1
    • Daniel_Leybovic
    • Participating Frequently
    • August 28, 2014
    Thanks!
    Still scrolling?
    Ask a question
    Terms & ConditionsAccessibility statement