Skip to main content
Question

S3 Bucket Size for EON

  • November 21, 2019
  • 2 replies
  • 14 views

Mujeef
Forum|alt.badge.img+1
  • Participating Frequently

Hello All,

I need little guidance about S3 Bucket size for the EON.
I have 1 one EON database with S3 bucket size about 256TB.
We have requirement to add data in S3 for EON database approx 400TB.
May I know ,
Can we increase size of S3 bucket ?
Is there any limit for S3 bucket Size.

I see S3 bucket size 256TB added to my database.

Can you please suggest how I can manage 400TB data ?

Thanks in advance.

Mujeef

2 replies

Bryan_H
Forum|alt.badge.img+2
  • Participating Frequently
  • November 21, 2019

It's not really the bucket size that will be an issue if this is AWS S3. If it's an on-prem or non-AWS service, then network bandwidth may become an issue.
The greater issue is division of data on the S3 bucket, and amount of compute resources to process up to ~700TB. How many nodes will be running on the data, and how many shards?
Please also review the latest sizing guidelines at https://www.vertica.com/docs/9.3.x/HTML/Content/Authoring/Eon/SizingEonCluster.htm


LenoyJ
Forum|alt.badge.img+1
  • Participating Frequently
  • November 21, 2019

AWS S3 has unlimited data storage. According to AWS's FAQ [emphasis mine]:

Q: How much data can I store in Amazon S3?
The total volume of data and number of objects you can store are unlimited. Individual Amazon S3 objects can range in size from a minimum of 0 bytes to a maximum of 5 terabytes.