Backup Central

Hi,

I have a problem with the partial backup:

1) I make a full backup and this backup failed because broken link, this
backup is displayed as Partial (good)

2) I restart an other full backup that start from the previous partial
(good)

3) This full backup failed again, then this new partial backup lost all
files already backed up on the step 1 ???

Is it not possible to kept the files backed up until the full backup
succeeded even the backup failed more that once ?

Sam.





-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technology
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Le ven 30/07/2004 =E0 17:45, Sam Przyswa a =E9crit :
Hi,
=20
I have a problem with the partial backup:

With rsyncd to backup a Linux Debian machine over the Internet

1) I make a full backup and this backup failed because broken link, thi=
s
backup is displayed as Partial (good)
=20
2) I restart an other full backup that start from the previous partial
(good)
=20
3) This full backup failed again, then this new partial backup lost all
files already backed up on the step 1 ???

In fact in phase 2 rsync rescan files to see if they are already in the
partial, and if the rsync crash during this phase the previous partial
is truncated to the file where the crash occur.

Rsync don't really restart from the last backed up file but scan the
last partial
=20
Is it not possible to kept the files backed up until the full backup
succeeded even the backup failed more that once ?
=20
Sam.




-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technology
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

On Sat, 2004-07-31 at 17:29, Sam Przyswa wrote:
Le ven 30/07/2004 =E0 17:45, Sam Przyswa a =E9crit :
Hi,
=20
I have a problem with the partial backup:
=20
With rsyncd to backup a Linux Debian machine over the Internet
=20
1) I make a full backup and this backup failed because broken link, t=
his
backup is displayed as Partial (good)
=20
2) I restart an other full backup that start from the previous partia=
l
(good)
=20
3) This full backup failed again, then this new partial backup lost a=
ll
files already backed up on the step 1 ???
=20
In fact in phase 2 rsync rescan files to see if they are already in the
partial, and if the rsync crash during this phase the previous partial
is truncated to the file where the crash occur.
=20
Rsync don't really restart from the last backed up file but scan the
last partial
=20
Is it not possible to kept the files backed up until the full backup
succeeded even the backup failed more that once ?
=20

I have seen this problem in the past. I now use TAR instead of rsync.=20
rsync doesn't like you changing files while it is backing up your file
system. This is a problem when you are backing up data that is live or
when it is a large amount (only 2Gig+). It takes too long to perform
the compare. Someone always changes the data after rsync has made it's
compare. It then dies due to the change in data. Try TAR. You should
get fewer errors.

Q

Sam.
=20
=20
=20
=20
-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technolog=
y
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/



-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technology
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Le lun 02/08/2004 à 16:42, Quentin Arce a écrit :
On Sat, 2004-07-31 at 17:29, Sam Przyswa wrote:
Le ven 30/07/2004 à 17:45, Sam Przyswa a écrit :
Hi,

I have a problem with the partial backup:

With rsyncd to backup a Linux Debian machine over the Internet

1) I make a full backup and this backup failed because broken link, this
backup is displayed as Partial (good)

2) I restart an other full backup that start from the previous partial
(good)

3) This full backup failed again, then this new partial backup lost all
files already backed up on the step 1 ???

In fact in phase 2 rsync rescan files to see if they are already in the
partial, and if the rsync crash during this phase the previous partial
is truncated to the file where the crash occur.

Rsync don't really restart from the last backed up file but scan the
last partial

Is it not possible to kept the files backed up until the full backup
succeeded even the backup failed more that once ?


I have seen this problem in the past. I now use TAR instead of rsync.
rsync doesn't like you changing files while it is backing up your file
system. This is a problem when you are backing up data that is live or
when it is a large amount (only 2Gig+). It takes too long to perform
the compare. Someone always changes the data after rsync has made it's
compare. It then dies due to the change in data. Try TAR. You should
get fewer errors.

Ok, I got this problem on large rsyncd modules backup more than 2Gig, I
gonna try TAR and at least rsync + SSH just to see.

Thanks a lot for your help.

Sam.




-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technology
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Sam Przyswa writes:

I have a problem with the partial backup:

1) I make a full backup and this backup failed because broken link, this
backup is displayed as Partial (good)

2) I restart an other full backup that start from the previous partial
(good)

3) This full backup failed again, then this new partial backup lost all
files already backed up on the step 1 ???

Yes, that's right.

Is it not possible to kept the files backed up until the full backup
succeeded even the backup failed more that once ?

If a full starts from a partial (step 2), and no files are saved
(ie: the full fails before any files are received), then the original
partial is kept. If the full starts saving files, and then fails,
a new partial is saved and the old partial is lost.

I agree is would be better to only keep the newer partial if it
has saved more files than the original partial. I'll add that to
the wishlist.

Craig


-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technology
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Le lun 02/08/2004 à 20:07, Craig Barratt a écrit :
Sam Przyswa writes:

I have a problem with the partial backup:

1) I make a full backup and this backup failed because broken link, this
backup is displayed as Partial (good)

2) I restart an other full backup that start from the previous partial
(good)

3) This full backup failed again, then this new partial backup lost all
files already backed up on the step 1 ???

Yes, that's right.

Is it not possible to kept the files backed up until the full backup
succeeded even the backup failed more that once ?

If a full starts from a partial (step 2), and no files are saved
(ie: the full fails before any files are received), then the original
partial is kept. If the full starts saving files, and then fails,
a new partial is saved and the old partial is lost.

I agree is would be better to only keep the newer partial if it
has saved more files than the original partial. I'll add that to
the wishlist.

Yes thanks, but it seems that my problem come from a rsync bug with
large module size, more than 2Gig, see previous message in the list, I
will try TAR for large dirs.

Sam.

Sam Przyswa writes:

Yes thanks, but it seems that my problem come from a rsync bug with
large module size, more than 2Gig, see previous message in the list, I
will try TAR for large dirs.

Rsync used to work with large files, but it appears a bug crept into
rsync 2.6.2. Here's an email from the ssync mail list. Would you
mind trying this?

If it fixes your problem I should update the pre-packaged rsync
on the BackupPC SF site.

Craig

---------- Forwarded message ----------
To: Don Malloy <nixuser23 < at > hotmail.com>
From: Wayne Davison <wayned < at > samba.org>
Cc: rsync < at > lists.samba.org
Date: Thu, 15 Jul 2004 09:28:10 -0700
Subj: Re: HP-UX 11i and largefiles on rsync 2.6.2

On Wed, Jul 14, 2004 at 04:46:41PM -0400, Don Malloy wrote:
The rsync transfers always fail at the 2GB mark.

There is a bug in the large-file support of 2.6.2 that is fixed by the
attached patch. Either apply it using "patch" or manually edit the
size_t to OFF_T manually, recompile, and give the resulting rsync a try.

..wayne..

-------- Attachment (text/plain, large-files.patch):
--- generator.c 13 Jul 2004 01:45:51 -0000 1.95
+++ generator.c 14 Jul 2004 16:40:08 -0000 1.96
< at > < at > -205,7 +205,7 < at > < at >
*
* Generate approximately one checksum every block_len bytes.
*/
-static void generate_and_send_sums(struct map_struct *buf, size_t len, int f_out)
+static void generate_and_send_sums(struct map_struct *buf, OFF_T len, int f_out)
{
size_t i;
struct sum_struct sum;



-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technology
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Le lun 02/08/2004 à 20:36, Craig Barratt a écrit :
Sam Przyswa writes:

Yes thanks, but it seems that my problem come from a rsync bug with
large module size, more than 2Gig, see previous message in the list, I
will try TAR for large dirs.

Rsync used to work with large files, but it appears a bug crept into
rsync 2.6.2. Here's an email from the ssync mail list. Would you
mind trying this?

We use the 2.6.2-2 Debian

If it fixes your problem I should update the pre-packaged rsync
on the BackupPC SF site.

I patched the Debian source and recreate the .deb binary, I test it and
if that fix the problem I will send you the the binary and the .deb
package.

Thanks for your help.

Sam.

Le lun 02/08/2004 à 20:36, Craig Barratt a écrit :
Sam Przyswa writes:

Yes thanks, but it seems that my problem come from a rsync bug with
large module size, more than 2Gig, see previous message in the list, I
will try TAR for large dirs.

Rsync used to work with large files, but it appears a bug crept into
rsync 2.6.2. Here's an email from the ssync mail list. Would you
mind trying this?

If it fixes your problem I should update the pre-packaged rsync
on the BackupPC SF site.

I patched rsync 2.6.2 but with rsyncd no changes, there two weeks I try
to backup a directory from a remote machine I got 80% of files then
crash, next night backup from partial crash after 10 mn and I lost most
of files from the previous partial.

I tried rsync over SSH but it's don't work I got error message about
keys problem but the keys are good I connect by SSH without problem.

I only succeeded to backup locals machines or remote but with 10 Mbps.

How to backup remote machine on ADSL with large amount of data > 2Gig
???

I use BackupPC 2.1.0

Sam.

Le mar 03/08/2004 à 22:25, Sam Przyswa a écrit :
Le lun 02/08/2004 à 20:36, Craig Barratt a écrit :
Sam Przyswa writes:

Yes thanks, but it seems that my problem come from a rsync bug with
large module size, more than 2Gig, see previous message in the list, I
will try TAR for large dirs.

Rsync used to work with large files, but it appears a bug crept into
rsync 2.6.2. Here's an email from the ssync mail list. Would you
mind trying this?

If it fixes your problem I should update the pre-packaged rsync
on the BackupPC SF site.

I patched rsync 2.6.2 but with rsyncd no changes, there two weeks I try
to backup a directory from a remote machine I got 80% of files then
crash, next night backup from partial crash after 10 mn and I lost most
of files from the previous partial.

I tried rsync over SSH but it's don't work I got error message about
keys problem but the keys are good I connect by SSH without problem.

I only succeeded to backup locals machines or remote but with 10 Mbps.

How to backup remote machine on ADSL with large amount of data > 2Gig
???

I use BackupPC 2.1.0

I succeeded to backup a large directory, more than 2 Gig over Internet
at 128 Kbps with the patched rsync and ssh with -C option to compress
data before transfert.

Thanks to all of you for your help.

Sam.

Sam Przyswa writes:

I patched rsync 2.6.2 but with rsyncd no changes, there two weeks I try
to backup a directory from a remote machine I got 80% of files then
crash, next night backup from partial crash after 10 mn and I lost most
of files from the previous partial.

I tried rsync over SSH but it's don't work I got error message about
keys problem but the keys are good I connect by SSH without problem.

I only succeeded to backup locals machines or remote but with 10 Mbps.

How to backup remote machine on ADSL with large amount of data > 2Gig
???

I use BackupPC 2.1.0

I succeeded to backup a large directory, more than 2 Gig over Internet
at 128 Kbps with the patched rsync and ssh with -C option to compress
data before transfert.

Good. Unfortunately, as you discovered, broadband wide-area
connections are not always very stable. Any significant hiccup
causes ssh to terminate, and rsync needs to start over each time.

Craig


-------------------------------------------------------
This SF.Net email is sponsored by OSTG. Have you noticed the changes on
Linux.com, ITManagersJournal and NewsForge in the past few weeks? Now,
one more big change to announce. We are now OSTG- Open Source Technology
Group. Come see the changes on the new OSTG site. www.ostg.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/