Skip to main content

Mysql ETL into Vertica

  • June 12, 2013
  • 2 replies
  • 20 views
David_Chen
Forum|alt.badge.img+1
What is the best way to do direct table data transfers from a source mysql table to an equivalent (almost identical) target Vertica table? So far, we have been getting by with a shell script that does "mysqldump --where...", substitutes some values in the output, and then does a vsql COPY into our Vertica table. It works, but it is quite a hack. Is there a better way? Thanks, David

    2 replies

    Hugo_Sheng
    • Hugo_Sheng
    • New Participant
    • June 12, 2013
    There are many graphical ETL tools out there that you can leverage to do this - many have free versions you can download and use on your desktop. One in particular you can try is QlikView Expressor ( http://www.qlikview.com/us/explore/products/expressor ) - full disclosure, I work for QlikTech. You'll need the ODBC driver for Vertica installed. If you are using the community edition of MySQL, you'll need their ODBC driver as well. We do include the MySQL enterprise ODBC driver.
    Tibor_Mozes
    Forum|alt.badge.img+1
    • Tibor_Mozes
    • Participating Frequently
    • July 11, 2014
    HI David,

    Would you mind sharing the script that substitute the values in the mysqldump? I ran into the same problem with RDS, where you cannot export out data with mysqldump in TSV format.

    Thanks for any suggestions,
    Tibor
    Still scrolling?
    Ask a question
    Terms & ConditionsAccessibility statement