How to Backup Data When You Have Over 1TB’s Worth of Files

JFrog Support
2023-01-22 11:09

When dealing with very large repositories, filestores, and databases, it may take Artifactory’s built-in backup service a significant amount of time to complete running backup jobs. For better control and performance, we suggest using a third-party IT backup solution with snapshot or copying capabilities, which should point to the $ARTIFACTORY_HOME location of your filesystem. To round out your backup regime, you should take periodic snapshots of your external database. These two procedures should be executed as near to the same time as possible, with your database snapshot coming first.

When restoring your data, you'll need to be able to do this to a desired point in time by applying your HDD/filestore together with your database snapshots to restore your important Artifactory data. You'll generally want to use the most recent backups/snapshots available so that your backed-up information will be kept in sync.

Should you ever need to rely on data backups, the recommended solutions above will get you back up and running in the shortest time possible. And be aware that you can execute these backup solutions in addition to maintaining a separate backup of your Artifactory server(s), or using the snapshot capabilities of an object store (e.g., Amazon S3) to back up your binaries. Maintaining such redundancies is smart, failsafe planning and should be a part of your overall backup strategy.