SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
multi terabyte backups
Author Message
Post multi terabyte backups 
Seems like a lot of you use rsnapshot for local backups. Does anybody
use rsnapshot for sort-of-large to very-large servers?

I've got a 144 terabyte storage server that backs up to a 288tb
rsnapshot server, which then runs a monthly to a 288tb offsite system.
Everything works fine, and I have no problems with the time it takes
to run them rm's or cp's, which can routinely last 3 or 4 days.

I was just curious if anybody else has large volumes they're backing up.

(we mainly have 16p/m^2 lidar and aerial imagery, along with the
processing of the raw data...)

------------------------------------------------------------------------------
Learn Windows Azure Live! Tuesday, Dec 13, 2011
Microsoft is holding a special Learn Windows Azure training event for
developers. It will provide a great way to learn Windows Azure and what it
provides. You can attend the event by watching it streamed LIVE online.
Learn more at http://p.sf.net/sfu/ms-windowsazure
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post multi terabyte backups 
rsnapshot for sort-of-large to very-large servers?

I use rsnapshot on several smaller 2TB-6TB servers. No real problems with the latest rsync installed.

One client has older, low-end hardware on a GigE network with an iSCSI SAN. The ~5TB of data takes about 72 hours for the initial run and 4 hours for an incremental snapshot. If that same hardware runs over SSH to an encrypted disk, it takes about 12 hours for an incremental snapshot due to the weak CPU and low SSH I/O transfer speeds. (Modern server hardware is 2x to 3x faster.)

144 terabyte storage [...] monthly to a 288tb offsite system.

How is the "offsite" system connected? Even with a dedicated GigE connection to the offsite server, 144TB of data would a couple of weeks just for a simple copy transfer. You must be using fiber...?

Also, what file system and SAN (or NAS) protocol do you use?


--Derek

On 12/10/2011 01:37 AM, Ken Woods wrote: Seems like a lot of you use rsnapshot for local backups. Does anybody
use rsnapshot for sort-of-large to very-large servers?

I've got a 144 terabyte storage server that backs up to a 288tb
rsnapshot server, which then runs a monthly to a 288tb offsite system.
Everything works fine, and I have no problems with the time it takes
to run them rm's or cp's, which can routinely last 3 or 4 days.

I was just curious if anybody else has large volumes they're backing up.

(we mainly have 16p/m^2 lidar and aerial imagery, along with the
processing of the raw data...)

------------------------------------------------------------------------------
Learn Windows Azure Live! Tuesday, Dec 13, 2011
Microsoft is holding a special Learn Windows Azure training event for
developers. It will provide a great way to learn Windows Azure and what it
provides. You can attend the event by watching it streamed LIVE online.
Learn more at http://p.sf.net/sfu/ms-windowsazure
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net ([email]rsnapshot-discuss < at > lists.sourceforge.net[/email])
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss


Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB