Skip to main content
Question

Getting only delta from the Vertica DB using Spark (Java)

  • Sep 25, 2018 11:01 PM UTC
  • 0 replies
  • 8 views

bala_8383

Hi,

Am currenlty working on ingesting the data from vertica DB to couchbase. Am using Spark(Java) for this purpose.
I found the way to get data(Dump) out of Vertica. However am interested only in the delta. Delta i meant is, we plan to run the job every day once.
Its should be able to retrieve only the data for the current day based on a filed called lastSeenDate.

Any help on this would help me lot.