I have data generated by monitoring devices and I want to load the data every 5 min. Basically, it is a trickle feed which I want to load on near real time basis.
I am looking a best design approach to load and store the data. Pls let me know if you have done any real time implementations/any white paper/case study.
Near Real Time load into Vertica
+1
Our customer, Visible Measures, gave a great talk at our Big Data Conference 2013 on how they load >500 million events per day into a Vertica database with a 2 second latency between the event arriving at their data center and it being queryable in Vertica. They use a number of tools, including Storm and Kestrel to stage the data into Vertica. I dug around looking for a reference and couldn't find one.
+1Thanks for the information. I at least now know that it was implemented at a large volume.
Sign up
Already have an account? Login
Welcome to the Rocket Forum!
Please log in or register:
Employee Login | Registration Member Login | RegistrationEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.
77 4th Avenue
Waltham, MA 02451 USA
