Hi All,
I'm tasked with migrating our MongoDB database into Vertica for our website analytics.
Presently we have one table (collection in Mongo parlance) per site, around 40,000 sites and approx 3 billion rows. The largest site has about 300 million rows. Total rows is growing at about 10% per month. We store a timestamp (int), timeslice (rounded timestamp, int) and 7 fields for each record (document).
Is it optimal to stick with the one table per site setup ?
Is there a more optimal way to set this up ?
(Just thinking about 40,000 tables with the same RLE data in them .. 5 of the fields have a cardinality of 200, the other two have a cardinality of 20,000 and 65,000).
I'm not looking for hard and fast advice that i can take to the bank (if you've got it that's excellent), more "I'd take route {x} for reason {y} and set things up like {z}" .. :-)
Primary use case : Customers querying their own data (on a per site basis).
Secondary use case : On occasion we query across the whole dataset for trends and stats.
Thanks.
Cheers
Richard
Sign up
Already have an account? Login
Welcome to the Rocket Forum!
Please log in or register:
Employee Login | Registration Member Login | RegistrationEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.