Backup Central

Hi,

Does anyone use rsnapshot to backup filesystems in the 100 gig range (or anything with a LOT of files)?

I the past, I have tried many rsync-over-ssh type backups and run into problems when I use them on larger filesystems.
It can take a very long time to generate the intial list of files. This can either mean crash due to high memory requirments/load
or simply a backup that takes so long one cannot run them on a regular schedule.

Does anyone have any experience with this? Usually what I do is something really lame like :

backup.sh /home/a*
backup.sh /home/b*
.
.
.
backup.sh /home/z*

which is really not the best method at all but works.


I would love to hear that rsnapshot can give me an elegant way to do larger backups. The design looks great so far (I've not had a chance to
give it a test on a large filesystem yet).

So, does anyone use it for big backups. I suppose the real issue is the number of files and not the size.

Thanks!

hbeaumont hbeaumont wrote:

Does anyone use rsnapshot to backup filesystems in the 100 gig range (or
anything with a LOT of files)?

Yes, I back up about a TB.

I the past, I have tried many rsync-over-ssh type backups and run into
problems when I use them on larger filesystems.
It can take a very long time to generate the intial list of files. This
can either mean crash due to high memory requirments/load
or simply a backup that takes so long one cannot run them on a regular
schedule.

The initial snapshot took days, most of which was just the time needed
to read and write all that data. The subsequent incrementals take a
couple of hours, most of which is spent in comparing the source and
target directories and seeing what changes need to be sent.

Unless your machine is running out of both memory *and* swap space,
rsync (and hence rsnapshot) shouldn't crash. Check your system logs and
see if that's what's happening.

--
David Cantrell | Official London Perl Mongers Bad Influence

"IMO, the primary historical significance of Unix is that it marks the
time in computer history where CPUs became so cheap that it was possible
to build an operating system without adult supervision."
-- Russ Holsclaw in a.f.c


-------------------------------------------------------
SF.Net email is Sponsored by the Better Software Conference & EXPO
September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices
Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA
Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss