Skip to main content
Question

Ingestion from azure event hub to Vertica ?

  • July 6, 2020
  • 1 reply
  • 4 views

mosheg
Forum|alt.badge.img+2
  • Participating Frequently

Is there any experience or existing client doing ingestion from azure event hub to Vertica ?
Are there any recommended practices?
Theoretically, it should work since event hub can expose an interface that is completely Kafka compatible.
https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-for-kafka-ecosystem-
The difficulties Customer expect is to do the authentication and the SSL.
Please advise.

1 reply

Bryan_H
Forum|alt.badge.img+2
  • Participating Frequently
  • July 14, 2020

While not out of the box, they could write a C# or Java class that reads the message queue and writes out to Vertica. I had to do this for a customer with ActiveMQ and posted some example code at https://github.com/bryanherger/vertica-activemq but beyond that, it sounds like a PS project or maybe something we could build if there is other demand.
Chris Daly does a fair amount of Azure work so he may be more aware of demand for Event Hub integration or any existing solutions.