Skip to main content

Uber's Big Data Platform: 100+ Petabytes with Minute Latency | Uber Engineering Blog

  • November 15, 2018
  • 3 replies
  • 7 views

Yassine
Must read for everyone:

https://eng.uber.com/uber-big-data-platform/

Please share your thoughts on the article and architecture, specifically the role of Vertica in the two phases.

-Yassine

3 replies

RonaldRong
Forum|alt.badge.img+1
  • Participating Frequently
  • November 15, 2018

Interesting reading but what I find disconcerting is that the step to 100's of PB's does NOT involve Vertica - the third generation. (At least I can't discover it in the diagrams for the third generation). Have we missed the boat? How do we get back on the diagram?


marcothesane
Forum|alt.badge.img+1
  • Participating Frequently
  • November 15, 2018
Agree .... All the more when we have so much to offer for their newest endeavours..

And I don't support their keenness on nested structures at all ....not a reason to not be a fit for Vertica . Especially as they boast their use of SQL, which can't deal with nested structures, either...

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • November 15, 2018

I attended (i.e. booth duty) the Tableau conference in New Orleans last month. While there a gentleman came up to the booth to discuss Vertica. One of his questions was about that engineering blog post! He wanted to know why Uber wasn't going to use Vertica in its "Generation 3" solution! I was caught off guard by that and assured him that Uber is still using Vertica extensively. Anyway, point is, looks like we are going to be asked about this in the field, so is the best reply simply "Uber is still using Vertica extensively!"? Maybe we need to come up with a better unified response to that question, and to @RonaldRong's point, how to we get back on that diagram???