Backup Central

Hi,
I am trying to backup to ncpfs (the novell netware filesystem)
I have tried it on 0.13.4 and 1.1.5 both give the same error.
here is 1.1.5 traceback....

Ben, if you want more tests to figure out more tests that might need
skipping or adjusting, let me know.... its a pretty exotic filesystem I
know, but I would love to be able to back up to it.

It doesn't pass the filesystem detection test:

rdiff-backup -v9 --print-statistics /tmp/ mnt/dcentrl/rsync/test/test2
Wed Jan 25 14:29:56 2006 Making directory mnt/dcentrl/rsync/test/test2
Wed Jan 25 14:29:56 2006 Making directory
mnt/dcentrl/rsync/test/test2/rdiff-backup-data
Wed Jan 25 14:29:56 2006 ACLs not supported by filesystem at /tmp
Wed Jan 25 14:29:56 2006
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
Access control lists Off
Extended attributes On
Case sensitivity On
Mac OS X style resource forks Off
Mac OS X Finder information Off
-----------------------------------------------------------------
Wed Jan 25 14:29:56 2006 Making directory
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Wed Jan 25 14:29:56 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/5-_ a.
Wed Jan 25 14:29:56 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/5-_ a.
Wed Jan 25 14:29:56 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/:\ ᄉ
Wed Jan 25 14:29:56 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/:\ ᄉ
Wed Jan 25 14:29:56 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/A
Wed Jan 25 14:29:56 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/A
Wed Jan 25 14:29:56 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/foo
Wed Jan 25 14:29:56 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/foo
Wed Jan 25 14:29:56 2006 Making directory
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hl
Wed Jan 25 14:29:56 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Wed Jan 25 14:29:56 2006 Hard linking
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
to
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Wed Jan 25 14:29:56 2006 Warning: hard linking not supported by
filesystem at mnt/dcentrl/rsync/test/test2/rdiff-backup-data
Wed Jan 25 14:29:56 2006 Directories on file system at
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0 are
not fsyncable.
Assuming it's unnecessary.
Wed Jan 25 14:29:56 2006 Extended attributes not supported by
filesystem at
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Wed Jan 25 14:29:56 2006 ACLs not supported by filesystem at
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Wed Jan 25 14:29:56 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Wed Jan 25 14:29:56 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Wed Jan 25 14:29:56 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Wed Jan 25 14:29:56 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Wed Jan 25 14:29:57 2006 Touching
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/high_perms
Wed Jan 25 14:29:57 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/high_perms
Wed Jan 25 14:29:57 2006 Deleting
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Wed Jan 25 14:29:57 2006 Removing directory
mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Wed Jan 25 14:29:57 2006 Exception '[Errno 16] Device or resource busy:
'mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0''
raised of class 'exceptions.OSError':
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
295, in error_check_Main
try: Main(arglist)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
315, in Main
take_action(rps)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
271, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
325, in Backup
rpout.conn.fs_abilities.backup_set_globals(rpin)
File "/usr/lib/python2.4/site-packages/rdiff_backup/fs_abilities.py",
line 602, in backup_set_globals
dest_fsa = FSAbilities('destination').init_readwrite(Globals.rbdir)
File "/usr/lib/python2.4/site-packages/rdiff_backup/fs_abilities.py",
line 149, in init_readwrite
subdir.delete()
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line
945, in delete
self.conn.shutil.rmtree(self.path)
File "/usr/lib/python2.4/shutil.py", line 168, in rmtree
onerror(os.rmdir, path, sys.exc_info())
File "/usr/lib/python2.4/shutil.py", line 166, in rmtree
os.rmdir(path)

Traceback (most recent call last):
File "/usr/bin/rdiff-backup", line 23, in ?
rdiff_backup.Main.error_check_Main(sys.argv[1:])
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
295, in error_check_Main
try: Main(arglist)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
315, in Main
take_action(rps)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
271, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
325, in Backup
rpout.conn.fs_abilities.backup_set_globals(rpin)
File "/usr/lib/python2.4/site-packages/rdiff_backup/fs_abilities.py",
line 602, in backup_set_globals
dest_fsa = FSAbilities('destination').init_readwrite(Globals.rbdir)
File "/usr/lib/python2.4/site-packages/rdiff_backup/fs_abilities.py",
line 149, in init_readwrite
subdir.delete()
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line
945, in delete
self.conn.shutil.rmtree(self.path)
File "/usr/lib/python2.4/shutil.py", line 168, in rmtree
onerror(os.rmdir, path, sys.exc_info())
File "/usr/lib/python2.4/shutil.py", line 166, in rmtree
os.rmdir(path)
OSError: [Errno 16] Device or resource busy:
'mnt/dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0'

Dave Kempe <dave < at > solutionsfirst.com.au>
wrote the following on Wed, 25 Jan 2006 14:34:59 +1100
I am trying to backup to ncpfs (the novell netware filesystem)
I have tried it on 0.13.4 and 1.1.5 both give the same error.
here is 1.1.5 traceback....

Ben, if you want more tests to figure out more tests that might need
skipping or adjusting, let me know.... its a pretty exotic filesystem I
know, but I would love to be able to back up to it.

Can you try this again with the CVS version? Cengiz Gunay reported some
errors recently, and one of the changes I made in response I think might
help.


--
Ben Escoto

Ben Escoto wrote:

Can you try this again with the CVS version? Cengiz Gunay reported some
errors recently, and one of the changes I made in response I think might
help.



I tried the CVS version, it did make a little difference, however I am
getting a strange OS error 13 on a certain section (pasted below). It
appears to be when rdiff-backup renames the file, you then get left with
a repo that has one or two files (that do work) then a file called
rdiff-backup.tmp.3 or whatever. it always seems to be the 3rd file....
strange. anyway, any hints on how to troubleshoot this better would be
appreciated.

rdiff-backup -v9 --print-statistics --force /tmp/ dcentrl/rsync/test/test2
Tue Feb 7 11:47:09 2006 Making directory
dcentrl/rsync/test/test2/rdiff-backup-data
Tue Feb 7 11:47:09 2006 ACLs not supported by filesystem at /tmp
Tue Feb 7 11:47:09 2006
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
Access control lists Off
Extended attributes On
Case sensitivity On
Mac OS X style resource forks Off
Mac OS X Finder information Off
-----------------------------------------------------------------
Tue Feb 7 11:47:09 2006 Making directory
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/:\ ᄉ
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/:\ ᄉ
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/A
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/A
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/foo
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/foo
Tue Feb 7 11:47:09 2006 Making directory
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hl
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Tue Feb 7 11:47:09 2006 Hard linking
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
to
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Tue Feb 7 11:47:09 2006 Warning: hard linking not supported by
filesystem at dcentrl/rsync/test/test2/rdiff-backup-data
Tue Feb 7 11:47:09 2006 Directories on file system at
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0 are not
fsyncable.
Assuming it's unnecessary.
Tue Feb 7 11:47:09 2006 Extended attributes not supported by filesystem
at dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Tue Feb 7 11:47:09 2006 ACLs not supported by filesystem at
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Tue Feb 7 11:47:09 2006 Touching
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/high_perms
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0/high_perms
Tue Feb 7 11:47:09 2006 Deleting
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Tue Feb 7 11:47:09 2006 Removing directory
dcentrl/rsync/test/test2/rdiff-backup-data/rdiff-backup.tmp.0
Tue Feb 7 11:47:10 2006
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
Ownership changing Off
Hard linking Off
fsync() directories Off
Directory inc permissions Off
High-bit permissions Off
Extended filenames On
Access control lists Off
Extended attributes Off
Case sensitivity On
Mac OS X style resource forks Off
Mac OS X Finder information Off
-----------------------------------------------------------------
Tue Feb 7 11:47:10 2006 Making directory
dcentrl/rsync/test/test2/rdiff-backup-data/increments
Tue Feb 7 11:47:10 2006 Starting mirror /tmp to dcentrl/rsync/test/test2
Tue Feb 7 11:47:10 2006 Processing changed file .
Tue Feb 7 11:47:10 2006 Processing changed file .ICE-unix
Tue Feb 7 11:47:10 2006 Getting signature of .ICE-unix/6847 with
blocksize 64
Tue Feb 7 11:47:10 2006 Processing changed file .ICE-unix/6847
Tue Feb 7 11:47:10 2006 Making directory path
dcentrl/rsync/test/test2/rdiff-backup-data/increments/.ICE-unix
Tue Feb 7 11:47:10 2006 Regular copying ('.ICE-unix', '6847') to
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.1
Tue Feb 7 11:47:10 2006 Exception 'Socket error: (1, 'Operation not
permitted')' raised of class 'rdiff_backup.rpath.SkipFileException':
File "/usr/lib/python2.4/site-packages/rdiff_backup/robust.py", line 32,
in check_common_error
try: return function(*args)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 111,
in copy
elif rpin.issock(): rpout.mksock()
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 900,
in mksock
self.conn.rpath.make_socket_local(self)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 263,
in make_socket_local
raise SkipFileException("Socket error: " + str(exc))

Tue Feb 7 11:47:10 2006 SpecialFileError .ICE-unix/6847 Socket error:
(1, 'Operation not permitted')
Tue Feb 7 11:47:10 2006 Touching
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.1
Tue Feb 7 11:47:10 2006 Copying attributes from ('.ICE-unix', '6847') to
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.1
Tue Feb 7 11:47:10 2006 Setting time of
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.1 to 1139270440
Tue Feb 7 11:47:10 2006 Renaming
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.1 to
dcentrl/rsync/test/test2/.ICE-unix/6847
Tue Feb 7 11:47:10 2006 Getting signature of
.ICE-unix/dcop6825-1139270423 with blocksize 64
Tue Feb 7 11:47:10 2006 Processing changed file
.ICE-unix/dcop6825-1139270423
Tue Feb 7 11:47:11 2006 Regular copying ('.ICE-unix',
'dcop6825-1139270423') to
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.2
Tue Feb 7 11:47:11 2006 Exception 'Socket error: (1, 'Operation not
permitted')' raised of class 'rdiff_backup.rpath.SkipFileException':
File "/usr/lib/python2.4/site-packages/rdiff_backup/robust.py", line 32,
in check_common_error
try: return function(*args)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 111,
in copy
elif rpin.issock(): rpout.mksock()
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 900,
in mksock
self.conn.rpath.make_socket_local(self)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 263,
in make_socket_local
raise SkipFileException("Socket error: " + str(exc))

Tue Feb 7 11:47:11 2006 SpecialFileError .ICE-unix/dcop6825-1139270423
Socket error: (1, 'Operation not permitted')
Tue Feb 7 11:47:11 2006 Touching
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.2
Tue Feb 7 11:47:11 2006 Copying attributes from ('.ICE-unix',
'dcop6825-1139270423') to
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.2
Tue Feb 7 11:47:11 2006 Setting time of
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.2 to 1139270423
Tue Feb 7 11:47:11 2006 Renaming
dcentrl/rsync/test/test2/.ICE-unix/rdiff-backup.tmp.2 to
dcentrl/rsync/test/test2/.ICE-unix/dcop6825-1139270423
Tue Feb 7 11:47:11 2006 Processing changed file .X0-lock
Tue Feb 7 11:47:11 2006 Copying attributes from ('.ICE-unix',) to
dcentrl/rsync/test/test2/.ICE-unix
Tue Feb 7 11:47:11 2006 Setting time of
dcentrl/rsync/test/test2/.ICE-unix to 1139270440
Tue Feb 7 11:47:11 2006 Regular copying ('.X0-lock',) to
dcentrl/rsync/test/test2/rdiff-backup.tmp.4
Tue Feb 7 11:47:11 2006 Writing file object to
dcentrl/rsync/test/test2/rdiff-backup.tmp.4
Tue Feb 7 11:47:11 2006 Copying attributes from ('.X0-lock',) to
dcentrl/rsync/test/test2/rdiff-backup.tmp.4
Tue Feb 7 11:47:11 2006 Setting time of
dcentrl/rsync/test/test2/rdiff-backup.tmp.4 to 1139269992
Tue Feb 7 11:47:11 2006 Renaming
dcentrl/rsync/test/test2/rdiff-backup.tmp.4 to
dcentrl/rsync/test/test2/.X0-lock
Tue Feb 7 11:47:11 2006 Exception '[Errno 13] Permission denied' raised
of class 'exceptions.OSError':
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 295,
in error_check_Main
try: Main(arglist)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 315,
in Main
take_action(rps)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 271,
in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 337,
in Backup
backup.Mirror(rpin, rpout)
File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line 38,
in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
218, in patch
ITR(diff.index, diff)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rorpiter.py", line
281, in __call__
last_branch.fast_process(*args)
File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
517, in fast_process
rpath.rename(tf, mirror_rp)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 237,
in rename
else: rp_source.conn.os.rename(rp_source.path, rp_dest.path)

Traceback (most recent call last):
File "/usr/bin/rdiff-backup", line 23, in ?
rdiff_backup.Main.error_check_Main(sys.argv[1:])
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 295,
in error_check_Main
try: Main(arglist)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 315,
in Main
take_action(rps)
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 271,
in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 337,
in Backup
backup.Mirror(rpin, rpout)
File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line 38,
in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
218, in patch
ITR(diff.index, diff)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rorpiter.py", line
281, in __call__
last_branch.fast_process(*args)
File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
517, in fast_process
rpath.rename(tf, mirror_rp)
File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line 237,
in rename
else: rp_source.conn.os.rename(rp_source.path, rp_dest.path)
OSError: [Errno 13] Permission denied

Charles Duffy wrote:
Can you explain why a syscall attempting to perform this rename
operation would fail with a permission denied error on ncpfs? Do you get
the same thing when you attempt doing that rename yourself with mv
(without the -f flag provided)? If so, please try to figure out why.

No I can't explain that. And I did try and create a file, mv it
successfully, edit it, save, mv again. It all worked.
Its particularly strange.
Maybe the syscall is different from mv in some subtle way that ncpfs
doesn't like. is that possible?

dave

David Kempe wrote:
Tue Feb 7 11:47:11 2006 Renaming
dcentrl/rsync/test/test2/rdiff-backup.tmp.4 to
dcentrl/rsync/test/test2/.X0-lock
Can you explain why a syscall attempting to perform this rename
operation would fail with a permission denied error on ncpfs? Do you get
the same thing when you attempt doing that rename yourself with mv
(without the -f flag provided)? If so, please try to figure out why.

dave kempe wrote:
Charles Duffy wrote:
Can you explain why a syscall attempting to perform this rename
operation would fail with a permission denied error on ncpfs? Do you
get the same thing when you attempt doing that rename yourself with
mv (without the -f flag provided)? If so, please try to figure out why.

No I can't explain that. And I did try and create a file, mv it
successfully, edit it, save, mv again. It all worked.
Well, the file in question isn't an arbitrary standard file -- if I
remember correctly (which I may not, so check), it's a named socket. Can
you move named sockets over each other?