Skip to main content

Does DataStage works well with Vertica?

  • September 16, 2014
  • 7 replies
  • 16 views

Oleg_Savkin
Forum|alt.badge.img
Does anyone use DataStage to load data in Vertica? What connection has been used? How fast is the load comparing with Vertica's COPY?
What other ETL tool would you suggest to use with Vertica?

7 replies

Navin_C
Forum|alt.badge.img+2
  • Participating Frequently
  • September 16, 2014
Hi Oleg,


>>Does anyone use DataStage to load data in Vertica
DataStage works good with Vertica.
Any ETL works good with Vertica.

>>What connection has been used?
Connections that can be used are JDBC or ODBC.
I prefer JDBC over ODBC when it comes to ETL talking with databases.

>> How fast is the load comparing with Vertica's COPY?
In any case, Vertica's COPY command is the fastest way to load data.
COPY is meant for bulk loading and it is file to db loading, whereas ETL can help you with Source to Target Loading.
But for sure in both case COPY will be ahead in terms of time.


>>What other ETL tool would you suggest to use with Vertica?
Two good options.
1. Informatica :
Vertica provides a native connector for informatica tool.
A native connector means special support for the ETL tool which is always above the ODBC or JDBC connection and is faster.
2. Syncsort: (Don't get surprised)
Syncsort holds a world record for loading maximum data with Vertica.
Syncsort and Vertica

Hope this helps.
NC







Oleg_Savkin
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • September 17, 2014
Thanks Navin. Will check Syncsort, never knew before

Arun_s
  • New Participant
  • May 23, 2016

Hi ,

 

I used Datastage to insert and select data from vertica using ODBC driver and connector. But when i started performing update / delete for 100 records its taking 2 minutes. The same is taking seconds in VSQL. Please help.


FiliN
Forum|alt.badge.img
  • Participating Frequently
  • May 29, 2016

Data Stage is the ETL tool not ELT.

Sometime it is better to use ELT instead of ETL.

If you age going to use batch loading try to use Vertica COPY DIRECT not Data Stage insert


siddyash
Forum|alt.badge.img
  • Participating Frequently
  • August 17, 2017

We have published Datastage document in the community.
https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm


Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • August 21, 2017

Take away ... Vertica understands ODBC, JDBC, OLEDB, ADO.NET, etc

See:

https://my.vertica.com/docs/8.1.x/HTML/index.htm#Authoring/ConnectingToVertica/ClientDriverMisc/HPVerticaClientLibraryOverview.htm

We offer the best platform.


Forum|alt.badge.img+2
  • Participating Frequently
  • September 21, 2017

Here's an article on our Knowledge Base about connecting to DataStage:

https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm