Skip to main content

Does DataStage works well with Vertica?

  • Sep 16, 2014 3:26 AM UTC
  • 7 replies
  • 23 views

Oleg_Savkin
Forum|alt.badge.img
Does anyone use DataStage to load data in Vertica? What connection has been used? How fast is the load comparing with Vertica's COPY?
What other ETL tool would you suggest to use with Vertica?

7 replies

Navin_C
Forum|alt.badge.img+2
  • Participating Frequently
  • Sep 16, 2014 1:43 PM UTC
Hi Oleg,


>>Does anyone use DataStage to load data in Vertica
DataStage works good with Vertica.
Any ETL works good with Vertica.

>>What connection has been used?
Connections that can be used are JDBC or ODBC.
I prefer JDBC over ODBC when it comes to ETL talking with databases.

>> How fast is the load comparing with Vertica's COPY?
In any case, Vertica's COPY command is the fastest way to load data.
COPY is meant for bulk loading and it is file to db loading, whereas ETL can help you with Source to Target Loading.
But for sure in both case COPY will be ahead in terms of time.


>>What other ETL tool would you suggest to use with Vertica?
Two good options.
1. Informatica :
Vertica provides a native connector for informatica tool.
A native connector means special support for the ETL tool which is always above the ODBC or JDBC connection and is faster.
2. Syncsort: (Don't get surprised)
Syncsort holds a world record for loading maximum data with Vertica.
Syncsort and Vertica

Hope this helps.
NC







Oleg_Savkin
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • Sep 17, 2014 6:29 AM UTC
Thanks Navin. Will check Syncsort, never knew before

Arun_s
  • New Participant
  • May 23, 2016 1:25 AM UTC

Hi ,

 

I used Datastage to insert and select data from vertica using ODBC driver and connector. But when i started performing update / delete for 100 records its taking 2 minutes. The same is taking seconds in VSQL. Please help.


FiliN
Forum|alt.badge.img
  • Participating Frequently
  • May 29, 2016 11:28 AM UTC

Data Stage is the ETL tool not ELT.

Sometime it is better to use ELT instead of ETL.

If you age going to use batch loading try to use Vertica COPY DIRECT not Data Stage insert


siddyash
Forum|alt.badge.img
  • Participating Frequently
  • Aug 17, 2017 8:25 PM UTC

We have published Datastage document in the community.
https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm


Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • Aug 21, 2017 4:29 PM UTC

Take away ... Vertica understands ODBC, JDBC, OLEDB, ADO.NET, etc

See:

https://my.vertica.com/docs/8.1.x/HTML/index.htm#Authoring/ConnectingToVertica/ClientDriverMisc/HPVerticaClientLibraryOverview.htm

We offer the best platform.


Forum|alt.badge.img+2
  • Participating Frequently
  • Sep 21, 2017 4:07 PM UTC

Here's an article on our Knowledge Base about connecting to DataStage:

https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm