Backup Central

Hello,

rsync seems to have trouble with jobs operating on millions of files:
http://lists.samba.org/archive/rsync/2003-October/007546.html

If that's the case, is it also automatically the case for rdiff-backup?
Does rdiff-backup create a complete list of files to be backed up before
working?

--
Greetings from Troels Arvin, Copenhagen, Denmark

On Thu, 28 Apr 2005, Troels Arvin wrote:

rsync seems to have trouble with jobs operating on millions of files:
http://lists.samba.org/archive/rsync/2003-October/007546.html

If that's the case, is it also automatically the case for rdiff-backup?
Does rdiff-backup create a complete list of files to be backed up before
working?

yeah rdiff-backup has the same problem.

fwiw i don't have troubles on a 1M+ inode fs (actually it has 2M inodes
but about 1M are excluded)... but that doesn't mean there isn't a problem.

there have been thoughts towards an improved rsync protocol... such as
<http://www.blorf.net/new-protocol.html>. and i think there's another
proposal along these lines, but i don't seem to be using the right search
terms to find it today.

-dean

dean gaudet <dean-list-rdiff-backup < at > arctic.org>
wrote the following on Thu, 28 Apr 2005 16:47:17 -0700 (PDT)

On Thu, 28 Apr 2005, Troels Arvin wrote:

rsync seems to have trouble with jobs operating on millions of files:
http://lists.samba.org/archive/rsync/2003-October/007546.html

If that's the case, is it also automatically the case for rdiff-backup?
Does rdiff-backup create a complete list of files to be backed up before
working?

yeah rdiff-backup has the same problem.

fwiw i don't have troubles on a 1M+ inode fs (actually it has 2M
inodes but about 1M are excluded)... but that doesn't mean there
isn't a problem.

No, rdiff-backup does not have this problem rdiff-backup only
makes one pass, so memory should not increase linearly with the number
of files.

rdiff-backup and rsync use completely different protocols, and they
don't really share any code.


--
Ben Escoto