Skip to main content
Question

How to use mounted FTP as backup location

  • May 4, 2020
  • 6 replies
  • 19 views

vishakha_lall

I am running full backups from Vertica cluster every day.

The backup is currently taken on the nodes itself and specified in the mapping as

[]:/vertica/backups

While this works, the backup size grows incrementally (~7GB) and consumes the disk space. I wanted to know if there's a way I can specify a mounted FTP location instead?

Any help would be appreciated.

6 replies

Bryan_H
Forum|alt.badge.img+2
  • Participating Frequently
  • May 6, 2020

How is the FTP location mounted? If you're using a FUSE driver so the FTP site looks like a regular mount point, my guess is probably yes, though we've not tested this and can't guarantee performance and expected behavior.


mosheg
Forum|alt.badge.img+2
  • Participating Frequently
  • May 6, 2020

In addition, consider hardLinkLocal option to create a full- or object-level backup with hard file links on a local database host.
One of the advantages is that it uses significantly less disk space than a backup with copies of database data files.
However it cannot protect you from file system or node failures because data and backups are on the same nodes.
See: https://www.vertica.com/docs/9.3.x/HTML/Content/Authoring/AdministratorsGuide/BackupRestore/CreatingHardLinkLocalBackups.htm


vishakha_lall
  • Author
  • Participating Frequently
  • May 7, 2020

@mosheg Thank you for your response. Indeed, I sync the backup folder to an external S3 like storage. So the backup is maintained elsewhere for node failures. I will explore the hardLinkLocal option. Would that be useful if I take a full backup with the hardLinkLocal option and sync this folder externally for node failure situations?


mosheg
Forum|alt.badge.img+2
  • Participating Frequently
  • May 7, 2020

Hard link is fast and save disk space because it create two file names that both point to the same physical location on a hard disk.
However, when transferring hard-link local backups to other storage media it copies the data files associated with the hard file links,
which will consume the same space on the target media as the original source files.
Transferring Backups to and from Remote Storage is described here:
https://www.vertica.com/docs/9.3.x/HTML/Content/Authoring/AdministratorsGuide/BackupRestore/RestoringHardLinkLocalBackups.htm


vishakha_lall
  • Author
  • Participating Frequently
  • May 7, 2020

@mosheg Thanks for your response. Your suggestions looks like something I could try. However, I did not see any reduction in disk space after setting the hardLinkLocal = True in the [Transmission] section of the .ini file. Some thing I 'm doing wrong or have missed?


baron42bba
Forum|alt.badge.img
  • Participating Frequently
  • May 12, 2020

For hardlink to work properly the backup folder must be on the same partition as the data folder.