Skip to main content

Does Vertica support S3-compatible solutions?

  • July 2, 2018
  • 1 reply
  • 3 views

mosheg
Forum|alt.badge.img+2
  • Participating Frequently

Does Vertica support RED HAT Ceph storage cluster?
Ceph supports a range of storage methods. The RADOS gateway
(RADOSGW) is an object storage gateway service that provides S3-compatible and OpenStack Swift compatible RESTful interfaces.
Main benefit for customers are as follows:
• decouple the data compute workloads from the storage monolithic Architecture give far grater flexibility and elasticity
• since same objects can be addressed via multiple compute engines i.e vertica, Hive, spark, impala via the same S3A connector no need to spin up different clusters per workload as in HDFS
• leverage the efficient of Erasure codding in order to decrease hardware overhead when compared to HDFS
• ceph is the new unified SDS system offering POSIX Parallel FS, S3/Swift Obj store and block storage via RBD/SCSI under the same cluster
• when used under RHEL 7.5 it can also leverage the VDO capabilities of inline compression and deduplication (dedup is currently not supported with ceph ver 3.0 aka luminous.. future support will be made available with ceph 5.x aka nautilus dist)

Follow this link to gain better understanding on the solution.
https://www.redhat.com/cms/managed-files/st-ceph-storage-qct-object-storage-reference-architecture-f7901-201706-v2-en.pdf

1 reply

Bryan_H
Forum|alt.badge.img+2
  • Participating Frequently
  • July 14, 2018

Hi, I've tested Vertica with Minio in a non-production scenario and I'm aware of field testing using PureStorage S3. These are documented on Confluence. We expect it to work with Ceph and it's rumored that SUSE was testing using their Enterprise Storage solution built on Ceph.