Backups¶
Danger
All NERSC users should back up important files to HPSS on a regular basis. You should also have at least one copy of critical data stored outside of NERSC. Ultimately, it is your responsibility to protect yourself from data loss.
Snapshots¶
Global Homes and Community use a snapshot capability to provide users a seven-day history of their directories. Snapshots on Global Homes are in /global/homes/.snapshots/<date of last snapshot>
and for CFS they are in /global/cfs/.snapshots/<date of last snapshot>
. For either of these directories, you can choose the date you'd like to view and then navigate to your desired directory.
.snapshots
is invisible tols
,ls -a
,find
and similar commands- Contents are visible through
ls -F .snapshots
- Can be browsed normally after
cd .snapshots
- Files cannot be created, deleted or edited in snapshots
- Files can only be copied out of a snapshot
Backup/Restore¶
Global homes are periodically backed up to HPSS. The timing of backups depends on the size and number of files (NERSC filesystems are large, and a single backup can take many days to complete). We typically complete a backup of all home directories 1-2 times per month.
Note
Sparse files can appear to be much larger than your space quota (as the "missing" blocks are not stored), but these are not supported by our backup system. Sparse files may be more difficult to recover, and sparse files whose extent is large may not be backed up.
These backups are retained for at least 6 months, after which they may be removed to make space for newer backups.
Extracting files from backup can take several days. We recommend first searching the snapshots, and if the files you need are no longer available there, contact NERSC Consulting with pathnames and timestamps of the missing data.
Warning
These backups make it possible to recover accidentally-deleted data, but are not architected to provide disaster protection - we do not have multiple or off-site copies of backups. For this reason you should ensure you have other copies, in other locations, of all critical data.
Purging¶
Note
See Filesystem Quotas and Purging for detailed information about inode, space quotas, and file system purge policies.
Warning
$SCRATCH
directories are not backed up