Backup Central

shorvath <backuppc-forum < at > backupcentral.com> wrote:

Hi Timothy,

Thanks for your comments, unfortunately however I think you're missing
my point.
I very much like the way Backuppc handles backup, dedupe etc. and to
use this on the local site to handle the backups of each individual
client would be preferred, plus it gives the client an interface to
browse backups and do restores. (One of the main reasons I want to use
it)
However for remote backups (eg offsite) I want to be able to have and
rsync style "snapshot" of the most recent backup.
I do not want to have to pull backups from my remote site to each
individual server for this purpose because
A) I'm already backing them up from the local site backup server and I
don't want to back them up twice (more io/cpu and it'll take longer)
These servers are production and heavily used with a lot of daily
changes.
Keep in mind that the backup server is used just for backups so it can
spend the whole day getting thrashed for all I care.
and to be honest that just seems silly and more than a solution.
B) I don't like having multiple entry points ..... actually no other
points are needed. Point A is enough reason not to do it.
I already achieve my needs currently by simply using rsync for both
local and remote but as mentioned earlier I want a more elegant
solution and I like backuppc and how it handles the local backups.
If there is no way of exposing the latest backup of each host from the
backuppc server either via a fuse module (that works) or other means
then my solution to either stick to my current solution. eg rsync but
spend some time refining it.
or
use something like rdiff-backup or rsnapshot.
rdiff-backup will allow me to see the most recent "snapshot" but has
it's caveats/pitfalls/complexities.
Rsnapshot will do everything I need but maybe not the most efficient on
space.
Of course there are other...
Bandwidth, not a problem, I can limit/shape that several ways.


I think the best solution that fits your currently stated requirements has already been given to you ... (for free).

Simply setup a new "host" (this is the remote host where the offsite backup will live), configure it as rsync or rsyncd etc, and then use a cron job to trigger a restore of the most recent backup to this virtual host, in the path /some/path/hostname

If you absolutely must pull this archive rather than pushing it, then setup this host as a virtual local host, it just means you end up with one additional copy of the locally backed up machines.

Regards,
Adam



------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

----- Original Message -----
From: "shorvath" <backuppc-forum < at > backupcentral.com>
To: backuppc-users < at > lists.sourceforge.net
Sent: Tuesday, June 26, 2012 6:02:57 PM
Subject: [BackupPC-users] Offsite copy

Hi Timothy,

Thanks for your comments, unfortunately however I think you're
missing my point.
I very much like the way Backuppc handles backup, dedupe etc. and to
use this on the local site to handle the backups of each individual
client would be preferred, plus it gives the client an interface to
browse backups and do restores. (One of the main reasons I want to
use it)
However for remote backups (eg offsite) I want to be able to have and
rsync style "snapshot" of the most recent backup.
I do not want to have to pull backups from my remote site to each
individual server for this purpose because
A) I'm already backing them up from the local site backup server and
I don't want to back them up twice (more io/cpu and it'll take
longer) These servers are production and heavily used with a lot of
daily changes.
Keep in mind that the backup server is used just for backups so it
can spend the whole day getting thrashed for all I care.
and to be honest that just seems silly and more than a solution.
B) I don't like having multiple entry points ..... actually no other
points are needed. Point A is enough reason not to do it.
I already achieve my needs currently by simply using rsync for both
local and remote but as mentioned earlier I want a more elegant
solution and I like backuppc and how it handles the local backups.
If there is no way of exposing the latest backup of each host from
the backuppc server either via a fuse module (that works) or other
means then my solution to either stick to my current solution. eg
rsync but spend some time refining it.
or
use something like rdiff-backup or rsnapshot.
rdiff-backup will allow me to see the most recent "snapshot" but has
it's caveats/pitfalls/complexities.
Rsnapshot will do everything I need but maybe not the most efficient
on space.
Of course there are other...
Bandwidth, not a problem, I can limit/shape that several ways.


Why doesn't the archive function work for you? I use it to rotate my offsite backups to USB drives. It could very easily copy the archive files offsite as well, if we had the bandwidth.

Gerald

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Surely this means sending a complete copy with every archive which can't be rsync'd with what's already there no?

On Wed, Jun 27, 2012 at 11:56 AM, Gerald Brandt <gbr < at > majentis.com ([email]gbr < at > majentis.com[/email])> wrote:


----- Original Message -----
From: "shorvath" <backuppc-forum < at > backupcentral.com ([email]backuppc-forum < at > backupcentral.com[/email])>
To: backuppc-users < at > lists.sourceforge.net ([email]backuppc-users < at > lists.sourceforge.net[/email])
Sent: Tuesday, June 26, 2012 6:02:57 PM
Subject: [BackupPC-users]  Offsite copy

Hi Timothy,

Thanks for your comments, unfortunately however I think you're
missing my point.
I very much like the way Backuppc handles backup, dedupe etc. and to
use this on the local site to handle the backups of each individual
client would be preferred,  plus it gives the client an interface to
browse backups and do restores. (One of the main reasons I want to
use it)
However for remote backups (eg offsite) I want to be able to have and
rsync style "snapshot" of the most recent backup.
I do not want to have to pull backups from my remote site to each
individual server for this purpose because
A) I'm already backing them up from the local site backup server and
I don't want to back them up twice (more io/cpu and it'll take
longer) These servers are production and heavily used with a lot of
daily changes.
Keep in mind that the backup server is used just for backups so it
can spend the whole day getting thrashed for all I care.
and to be honest that just seems silly and more  than a solution.
B) I don't like having multiple entry points .....  actually no other
points are needed. Point A is enough reason not to do it.
I already achieve my needs currently by simply using rsync for both
local and remote but as mentioned earlier I want a more elegant
solution and I like backuppc and how it handles the local backups.
If there is no way of exposing the latest  backup of each host from
the backuppc server either via a fuse module (that works) or other
means then my solution to either stick to my current solution. eg
rsync but spend some time refining it.
or
use something like rdiff-backup or rsnapshot.
rdiff-backup will allow me to see the most recent "snapshot" but has
it's caveats/pitfalls/complexities.
Rsnapshot will do everything I need but maybe not the most efficient
on space.
Of course there are other...
Bandwidth, not a problem, I can limit/shape that several ways.




Why doesn't the archive function work for you?  I use it to rotate my offsite backups to USB drives.  It could very easily copy the archive files offsite as well, if we had the bandwidth.

Gerald

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net ([email]BackupPC-users < at > lists.sourceforge.net[/email])
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Hi,

rsync will only send the bits that changed. gzip normally ruins all that, but there is an rsync friendly gzip out there (or try gzip -rsyncable). Or don't compress your archives.

Gerald


----- Original Message -----
From: "Member Horvath" <member < at > thehorvaths.co.uk>
To: "General list for user discussion, questions and support" <backuppc-users < at > lists.sourceforge.net>
Sent: Wednesday, June 27, 2012 9:51:47 AM
Subject: Re: [BackupPC-users] Offsite copy


Surely this means sending a complete copy with every archive which
can't be rsync'd with what's already there no?


On Wed, Jun 27, 2012 at 11:56 AM, Gerald Brandt < gbr < at > majentis.com >
wrote:






----- Original Message -----
From: "shorvath" < backuppc-forum < at > backupcentral.com >
To: backuppc-users < at > lists.sourceforge.net
Sent: Tuesday, June 26, 2012 6:02:57 PM
Subject: [BackupPC-users] Offsite copy

Hi Timothy,

Thanks for your comments, unfortunately however I think you're
missing my point.
I very much like the way Backuppc handles backup, dedupe etc. and
to
use this on the local site to handle the backups of each individual
client would be preferred, plus it gives the client an interface to
browse backups and do restores. (One of the main reasons I want to
use it)
However for remote backups (eg offsite) I want to be able to have
and
rsync style "snapshot" of the most recent backup.
I do not want to have to pull backups from my remote site to each
individual server for this purpose because
A) I'm already backing them up from the local site backup server
and
I don't want to back them up twice (more io/cpu and it'll take
longer) These servers are production and heavily used with a lot of
daily changes.
Keep in mind that the backup server is used just for backups so it
can spend the whole day getting thrashed for all I care.
and to be honest that just seems silly and more than a solution.
B) I don't like having multiple entry points ..... actually no
other
points are needed. Point A is enough reason not to do it.
I already achieve my needs currently by simply using rsync for both
local and remote but as mentioned earlier I want a more elegant
solution and I like backuppc and how it handles the local backups.
If there is no way of exposing the latest backup of each host from
the backuppc server either via a fuse module (that works) or other
means then my solution to either stick to my current solution. eg
rsync but spend some time refining it.
or
use something like rdiff-backup or rsnapshot.
rdiff-backup will allow me to see the most recent "snapshot" but
has
it's caveats/pitfalls/complexities.
Rsnapshot will do everything I need but maybe not the most
efficient
on space.
Of course there are other...
Bandwidth, not a problem, I can limit/shape that several ways.


Why doesn't the archive function work for you? I use it to rotate my
offsite backups to USB drives. It could very easily copy the archive
files offsite as well, if we had the bandwidth.

Gerald



------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond.
Discussions
will include endpoint security, mobile security and the latest in
malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond.
Discussions
will include endpoint security, mobile security and the latest in
malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On 27/06/12 00:02, shorvath wrote:
Hi Timothy,

Thanks for your comments, unfortunately however I think you're missing my point.
I very much like the way Backuppc handles backup, dedupe etc. and to use this on the local site to handle the backups of each individual client would be preferred, plus it gives the client an interface to browse backups and do restores. (One of the main reasons I want to use it)
However for remote backups (eg offsite) I want to be able to have and rsync style "snapshot" of the most recent backup.
I do not want to have to pull backups from my remote site to each individual server for this purpose because
A) I'm already backing them up from the local site backup server and I don't want to back them up twice (more io/cpu and it'll take longer) These servers are production and heavily used with a lot of daily changes.
Keep in mind that the backup server is used just for backups so it can spend the whole day getting thrashed for all I care.
and to be honest that just seems silly and more than a solution.
B) I don't like having multiple entry points ..... actually no other points are needed. Point A is enough reason not to do it.
I already achieve my needs currently by simply using rsync for both local and remote but as mentioned earlier I want a more elegant solution and I like backuppc and how it handles the local backups.
If there is no way of exposing the latest backup of each host from the backuppc server either via a fuse module (that works) or other means then my solution to either stick to my current solution. eg rsync but spend some time refining it.
or
use something like rdiff-backup or rsnapshot.
rdiff-backup will allow me to see the most recent "snapshot" but has it's caveats/pitfalls/complexities.
Rsnapshot will do everything I need but maybe not the most efficient on space.
Of course there are other...
Bandwidth, not a problem, I can limit/shape that several ways.

You options that I can see are:

1. Script up a recover of each server to the backup server and then
rsync that to the remote host. This means you lose a chunk of space on
the backup server but is bandwidth efficient.

Something like:

BackupPC_tarCreate -h <host> -n -1 -s "<share name>" / |\
tar -C /path/to/localbackups/host -x -f -

and then:

rsync -avz /path/to/localbackups/ remotehost:/path/to/remotebackups/

This will cost you disk space on the backup server and some disk
bandwidth during the recover.

2. If bandwidth truely isn't an issue then you can simply recover the
latest backup into an ssh pipe something like this:

BackupPC_tarCreate -h <host> -n -1 -s "<share name>" / |\
ssh -c arcfour -C remotehost tar -C /path/to/remotebackups/host -x -f -

This will transfer the most recent backup via tar and ssh to the remote
host but this will transfer a full backup everytime.

This will hammer the cpu on the backup server to compress and encrypt
the transfer and also hammer your bandwidth both remote disk and network.

--
Tim Fletcher <tim < at > night-shade.org.uk>