Hi,
Trying out rdiff-backup for the first time. Looks like a great tool.
Have got a wierd crashing bug however.
Here's the situation: running it on a MacOS X machine, doing a simple
backup of a directory tree (actually the GNU hello source code) to an
NFS server running FreeBSD:
rdiff-backup hello-2.1.1/ /Network/home/alastair/tmp/hello-backup
Seems to work just fine. Now I realise that I should have excluded a
directory from the backup, so I'll add it as an --exclude argument:
rdiff-backup --exclude hello-2.1.1/src/ hello-2.1.1/ /Network/
home/alastair/tmp/hello-backup
The stack trace is a bit long, see below for the gory details.
However the error message complaining about a subdirectory of the
excluded directory not being empty:
OSError: [Errno 66] Directory not empty: '/Network/home/alastair/
tmp/hello-backup/src/.deps'
But it is empty:
tmp $ ll /Network/home/alastair/tmp/hello-backup/src/.deps/
total 1
drwxr-xr-x 2 alastair wheel 512 Oct 9 21:26 ./
drwxr-xr-x 3 alastair wheel 512 Sep 12 20:00 ../
tmp $
I have verified that this problem does not happen when backing up to
a local directory. Likewise, it does not happen when backing up to
the server through ssh. Something about the NFS mount...
Other details:
- MacOS X 10.4.2
- Python 2.4.1, built from DarwinPorts
- rdiff-backup 1.0.1 also from DarwinPorts
- NFS server is FreeBSD 5.4-RELEASE
Can't think of anything else relevant. Help appreciated.
Complete output follows:
tmp $ rdiff-backup -v9 --exclude hello-2.1.1/src/ hello-2.1.1/ /
Network/home/alastair/tmp/hello-backup
Sun Oct 9 22:05:22 2005 Unable to import module xattr.
Extended attributes not supported on filesystem at hello-2.1.1
Sun Oct 9 22:05:22 2005 Unable to import module posix1e from
pylibacl package.
ACLs not supported on filesystem at hello-2.1.1
Sun Oct 9 22:05:22 2005
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
Access control lists Off
Extended attributes Off
Mac OS X style resource forks On
Mac OS X Finder information On
-----------------------------------------------------------------
Sun Oct 9 22:05:22 2005 Making directory /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/rdiff-backup.tmp.0
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/foo
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/foo
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Sun Oct 9 22:05:22 2005 Hard linking /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file2
to /Network/home/alastair/tmp/hello-backup/rdiff-backup-data/rdiff-
backup.tmp.0/hardlinked_file1
Sun Oct 9 22:05:22 2005 Unable to import module xattr.
Extended attributes not supported on filesystem at /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/rdiff-backup.tmp.0
Sun Oct 9 22:05:22 2005 Unable to import module posix1e from
pylibacl package.
ACLs not supported on filesystem at /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/5-_ a.
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/5-_ a.
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/A
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/A
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/:
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/:
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/\
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/\
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/?
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0/?
Sun Oct 9 22:05:22 2005 Deleting /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/rdiff-backup.tmp.0
Sun Oct 9 22:05:22 2005 Removing directory /Network/home/alastair/
tmp/hello-backup/rdiff-backup-data/rdiff-backup.tmp.0
Sun Oct 9 22:05:22 2005
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
Characters needing quoting ''
Ownership changing Off
Hard linking On
fsync() directories On
Directory inc permissions Off
Access control lists Off
Extended attributes Off
Mac OS X style resource forks Off
Mac OS X Finder information On
-----------------------------------------------------------------
Sun Oct 9 22:05:22 2005 Writing mirror marker /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/current_mirror.
2005-10-09T22:05:22+10:00.data
Sun Oct 9 22:05:22 2005 Starting increment operation hello-2.1.1
to /Network/home/alastair/tmp/hello-backup
Sun Oct 9 22:05:22 2005 Processing changed file .
Sun Oct 9 22:05:22 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/increments.2005-10-09T22:03:21+10:00.dir
Sun Oct 9 22:05:22 2005 Copying inc attrs from () to /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/increments.
2005-10-09T22:03:21+10:00.dir
Sun Oct 9 22:05:22 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments.2005-10-09T22:03:21
+10:00.dir to 1126519246
Sun Oct 9 22:05:22 2005 Processing changed file src
Sun Oct 9 22:05:22 2005 Regular copying ('src',) to /Network/home/
alastair/tmp/hello-backup/rdiff-backup.tmp.1
Sun Oct 9 22:05:22 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup/src
Sun Oct 9 22:05:22 2005 Making directory /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src
Sun Oct 9 22:05:22 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/increments/src.2005-10-09T22:03:21+10:00.dir
Sun Oct 9 22:05:22 2005 Copying inc attrs from ('src',) to /Network/
home/alastair/tmp/hello-backup/rdiff-backup-data/increments/src.
2005-10-09T22:03:21+10:00.dir
Sun Oct 9 22:05:22 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src.2005-10-09T22:03:21
+10:00.dir to 1126519245
Sun Oct 9 22:05:22 2005 Processing changed file src/.deps
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps') to /
Network/home/alastair/tmp/hello-backup/src/rdiff-backup.tmp.2
Sun Oct 9 22:05:23 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup/src/.deps
Sun Oct 9 22:05:23 2005 Making directory /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src/.deps
Sun Oct 9 22:05:23 2005 Touching /Network/home/alastair/tmp/hello-
backup/rdiff-backup-data/increments/src/.deps.2005-10-09T22:03:21
+10:00.dir
Sun Oct 9 22:05:23 2005 Copying inc attrs from ('src', '.deps') to /
Network/home/alastair/tmp/hello-backup/rdiff-backup-data/increments/
src/.deps.2005-10-09T22:03:21+10:00.dir
Sun Oct 9 22:05:23 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src/.deps.
2005-10-09T22:03:21+10:00.dir to 1126519245
Sun Oct 9 22:05:23 2005 Getting signature of src/.deps/alloca.Po
with blocksize 64
Sun Oct 9 22:05:23 2005 Processing changed file src/.deps/alloca.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'alloca.Po') to /Network/home/alastair/tmp/hello-backup/src/.deps/
rdiff-backup.tmp.3
Sun Oct 9 22:05:23 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup/src/.deps/alloca.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'alloca.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/alloca.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing file object to /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/increments/src/.deps/
alloca.Po.2005-10-09T22:03:21+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Copying attributes from ('src', '.deps',
'alloca.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/alloca.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing carbon data to ('src', '.deps',
'alloca.Po.2005-10-09T22:03:21+10:00.snapshot.gz')
Sun Oct 9 22:05:23 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src/.deps/alloca.Po.
2005-10-09T22:03:21+10:00.snapshot.gz to 1126519245
Sun Oct 9 22:05:23 2005 Deleting /Network/home/alastair/tmp/hello-
backup/src/.deps/alloca.Po
Sun Oct 9 22:05:23 2005 Getting signature of src/.deps/getopt.Po
with blocksize 64
Sun Oct 9 22:05:23 2005 Processing changed file src/.deps/getopt.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'getopt.Po') to /Network/home/alastair/tmp/hello-backup/src/.deps/
rdiff-backup.tmp.4
Sun Oct 9 22:05:23 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup/src/.deps/getopt.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'getopt.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/getopt.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing file object to /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/increments/src/.deps/
getopt.Po.2005-10-09T22:03:21+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Copying attributes from ('src', '.deps',
'getopt.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/getopt.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing carbon data to ('src', '.deps',
'getopt.Po.2005-10-09T22:03:21+10:00.snapshot.gz')
Sun Oct 9 22:05:23 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src/.deps/getopt.Po.
2005-10-09T22:03:21+10:00.snapshot.gz to 1126519245
Sun Oct 9 22:05:23 2005 Deleting /Network/home/alastair/tmp/hello-
backup/src/.deps/getopt.Po
Sun Oct 9 22:05:23 2005 Getting signature of src/.deps/getopt1.Po
with blocksize 64
Sun Oct 9 22:05:23 2005 Processing changed file src/.deps/getopt1.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'getopt1.Po') to /Network/home/alastair/tmp/hello-backup/src/.deps/
rdiff-backup.tmp.5
Sun Oct 9 22:05:23 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup/src/.deps/getopt1.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'getopt1.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/getopt1.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing file object to /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/increments/src/.deps/
getopt1.Po.2005-10-09T22:03:21+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Copying attributes from ('src', '.deps',
'getopt1.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/getopt1.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing carbon data to ('src', '.deps',
'getopt1.Po.2005-10-09T22:03:21+10:00.snapshot.gz')
Sun Oct 9 22:05:23 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src/.deps/getopt1.Po.
2005-10-09T22:03:21+10:00.snapshot.gz to 1126519245
Sun Oct 9 22:05:23 2005 Deleting /Network/home/alastair/tmp/hello-
backup/src/.deps/getopt1.Po
Sun Oct 9 22:05:23 2005 Getting signature of src/.deps/hello.Po
with blocksize 64
Sun Oct 9 22:05:23 2005 Processing changed file src/.deps/hello.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'hello.Po') to /Network/home/alastair/tmp/hello-backup/src/.deps/
rdiff-backup.tmp.6
Sun Oct 9 22:05:23 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup/src/.deps/hello.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'hello.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/hello.Po.2005-10-09T22:03:21+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing file object to /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/increments/src/.deps/
hello.Po.2005-10-09T22:03:21+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Copying attributes from ('src', '.deps',
'hello.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/hello.Po.2005-10-09T22:03:21+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing carbon data to ('src', '.deps',
'hello.Po.2005-10-09T22:03:21+10:00.snapshot.gz')
Sun Oct 9 22:05:23 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src/.deps/hello.Po.
2005-10-09T22:03:21+10:00.snapshot.gz to 1126519245
Sun Oct 9 22:05:23 2005 Deleting /Network/home/alastair/tmp/hello-
backup/src/.deps/hello.Po
Sun Oct 9 22:05:23 2005 Getting signature of src/.deps/version.Po
with blocksize 64
Sun Oct 9 22:05:23 2005 Processing changed file src/.deps/version.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'version.Po') to /Network/home/alastair/tmp/hello-backup/src/.deps/
rdiff-backup.tmp.7
Sun Oct 9 22:05:23 2005 Incrementing mirror file /Network/home/
alastair/tmp/hello-backup/src/.deps/version.Po
Sun Oct 9 22:05:23 2005 Regular copying ('src', '.deps',
'version.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/version.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:23 2005 Writing file object to /Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/increments/src/.deps/
version.Po.2005-10-09T22:03:21+10:00.snapshot.gz
Sun Oct 9 22:05:24 2005 Copying attributes from ('src', '.deps',
'version.Po') to /Network/home/alastair/tmp/hello-backup/rdiff-backup-
data/increments/src/.deps/version.Po.2005-10-09T22:03:21
+10:00.snapshot.gz
Sun Oct 9 22:05:24 2005 Writing carbon data to ('src', '.deps',
'version.Po.2005-10-09T22:03:21+10:00.snapshot.gz')
Sun Oct 9 22:05:24 2005 Setting time of /Network/home/alastair/tmp/
hello-backup/rdiff-backup-data/increments/src/.deps/version.Po.
2005-10-09T22:03:21+10:00.snapshot.gz to 1126519245
Sun Oct 9 22:05:24 2005 Deleting /Network/home/alastair/tmp/hello-
backup/src/.deps/version.Po
Sun Oct 9 22:05:24 2005 Getting signature of src/ChangeLog with
blocksize 80
Sun Oct 9 22:05:24 2005 Processing changed file src/ChangeLog
Sun Oct 9 22:05:24 2005 Removing directory /Network/home/alastair/
tmp/hello-backup/src/.deps
Traceback (most recent call last):
File "/opt/local/bin/rdiff-backup", line 23, in ?
rdiff_backup.Main.Main(sys.argv[1:])
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
Main.py", line 283, in Main
take_action(rps)
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
Main.py", line 253, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
Main.py", line 303, in Backup
backup.Mirror_and_increment(rpin, rpout, incdir)
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
backup.py", line 51, in Mirror_and_increment
DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
backup.py", line 229, in patch_and_increment
ITR(diff.index, diff)
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
rorpiter.py", line 281, in __call__
if self.finish_branches(index) is None:
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
rorpiter.py", line 233, in finish_branches
to_be_finished.end_process()
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
backup.py", line 574, in end_process
self.base_rp.rmdir()
File "/opt/local/lib/python2.4/site-packages/rdiff_backup/
rpath.py", line 806, in rmdir
self.conn.os.rmdir(self.path)
OSError: [Errno 66] Directory not empty: '/Network/home/alastair/tmp/
hello-backup/src/.deps'
Exception exceptions.TypeError: "'NoneType' object is not callable"
in <bound method GzipFile.__del__ of <gzip open file '/Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/file_statistics.
2005-10-09T22:05:22+10:00.data.gz', mode 'wb' at 0x117f6e0
0x118fee0>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable"
in <bound method GzipFile.__del__ of <gzip open file '/Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/error_log.
2005-10-09T22:05:22+10:00.data.gz', mode 'wb' at 0x117f650
0x118fdc8>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable"
in <bound method GzipFile.__del__ of <gzip open file '/Network/home/
alastair/tmp/hello-backup/rdiff-backup-data/mirror_metadata.
2005-10-09T22:05:22+10:00.snapshot.gz', mode 'wb' at 0x117f770
0x118ffd0>> ignored
