Backup Central

Hello,

I use rdiff-backup 1.2.8 on a debian squeeze.
I would like to use rdiff-backup from an ext3 partition to a
fat partition. Although it is never said completly explicitly, it
seems that rdiff-backup should be able to handle the differences of
the filesystems automatically, for example according to this FAQ entry:
http://rdiff-backup.nongnu.org/FAQ.html#case_insensitive

Now, when I try to backup a simple directory with files in it
I get an error:

ls -lR test_rdiff2/
test_rdiff2/:
total 0
-rw-r--r-- 1 dumas dumas 0 Feb 14 11:30 BB
-rw-r--r-- 1 dumas dumas 0 Feb 14 11:29 bb

rdiff-backup test_rdiff2 /media/HD-PEU2/tttttr2
Warning: hard linking not supported by filesystem at /media/HD-PEU2/tttttr2/rdiff-backup-data
UpdateError rdiff-backup.tmp.2 [Errno 2] No such file or directory: '/media/HD-PEU2/tttttr2/bb'



And similar when they are directories, I get a bigger trace:
ls -lR test_rdiff
test_rdiff:
total 8
drwxr-xr-x 2 dumas dumas 4096 Feb 14 11:25 BB
drwxr-xr-x 2 dumas dumas 4096 Feb 14 11:25 bb

test_rdiff/BB:
total 0

test_rdiff/bb:
total 0

rdiff-backup test_rdiff /media/HD-PEU2/tttttr
Warning: hard linking not supported by filesystem at /media/HD-PEU2/tttttr/rdiff-backup-data
Exception '[Errno 17] File exists: '/media/HD-PEU2/tttttr/bb'' raised of class '<type 'exceptions.OSError'>':
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 304, in error_check_Main
try: Main(arglist)
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 324, in Main
take_action(rps)
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 280, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 346, in Backup
backup.Mirror(rpin, rpout)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 38, in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 232, in patch
ITR(diff.index, diff)
File "/usr/lib/pymodules/python2.5/rdiff_backup/rorpiter.py", line 284, in __call__
branch.start_process(*args)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 626, in start_process
if diff_rorp.isdir(): self.prepare_dir(diff_rorp, self.base_rp)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 654, in prepare_dir
base_rp.mkdir()
File "/usr/lib/pymodules/python2.5/rdiff_backup/rpath.py", line 983, in mkdir
self.conn.os.mkdir(self.path)

Traceback (most recent call last):
File "/usr/bin/rdiff-backup", line 30, in <module>
rdiff_backup.Main.error_check_Main(sys.argv[1:])
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 304, in error_check_Main
try: Main(arglist)
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 324, in Main
take_action(rps)
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 280, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/pymodules/python2.5/rdiff_backup/Main.py", line 346, in Backup
backup.Mirror(rpin, rpout)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 38, in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 232, in patch
ITR(diff.index, diff)
File "/usr/lib/pymodules/python2.5/rdiff_backup/rorpiter.py", line 284, in __call__
branch.start_process(*args)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 626, in start_process
if diff_rorp.isdir(): self.prepare_dir(diff_rorp, self.base_rp)
File "/usr/lib/pymodules/python2.5/rdiff_backup/backup.py", line 654, in prepare_dir
base_rp.mkdir()
File "/usr/lib/pymodules/python2.5/rdiff_backup/rpath.py", line 983, in mkdir
self.conn.os.mkdir(self.path)
OSError: [Errno 17] File exists: '/media/HD-PEU2/tttttr/bb'



The mout line for /media/HD-PEU2/ is:
/dev/sda1 on /media/HD-PEU2 type vfat (rw,nosuid,nodev,uhelper=hal,uid=500)

And for the source filesystem:
/dev/hda6 on /home type ext3 (rw)



I could have entered a bug directly, but I am a bit puzzled that I
am the only one encountering this issue, so I post here before filling
a bug.

I have checked the debian patches, there is one, although and it seems
unlikely to me that this is directly responsible for the issue, it could.

--
Pat


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Sunday 14 February 2010 3:43:15 am Patrice Dumas wrote:
Hello,

I use rdiff-backup 1.2.8 on a debian squeeze.
I would like to use rdiff-backup from an ext3 partition to a
fat partition. Although it is never said completly explicitly, it
seems that rdiff-backup should be able to handle the differences of
the filesystems automatically, for example according to this FAQ entry:
http://rdiff-backup.nongnu.org/FAQ.html#case_insensitive

Now, when I try to backup a simple directory with files in it
I get an error:

ls -lR test_rdiff2/
test_rdiff2/:
total 0
-rw-r--r-- 1 dumas dumas 0 Feb 14 11:30 BB
-rw-r--r-- 1 dumas dumas 0 Feb 14 11:29 bb

rdiff-backup test_rdiff2 /media/HD-PEU2/tttttr2
Warning: hard linking not supported by filesystem at
/media/HD-PEU2/tttttr2/rdiff-backup-data UpdateError rdiff-backup.tmp.2
[Errno 2] No such file or directory: '/media/HD-PEU2/tttttr2/bb'




"Warning: hard linking not supported by filesystem at"

Seems the issue is related to hard linking not case.

See here:
http://rdiff-backup.nongnu.org/rdiff-backup.1.html

--no-hard-links
Don't replicate hard links on destination side. If many hard-
linked files are present, this option can drastically decrease
memory usage. This option is enabled by default if the backup
source or restore destination is running on native Windows.

You might to try adding this switch to see if it helps.

--
Adrian Klaver
adrian.klaver < at > gmail.com


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Sun, Feb 14, 2010 at 11:53:48AM -0800, Adrian Klaver wrote:
On Sunday 14 February 2010 3:43:15 am Patrice Dumas wrote:

"Warning: hard linking not supported by filesystem at"

Seems the issue is related to hard linking not case.

See here:
http://rdiff-backup.nongnu.org/rdiff-backup.1.html

--no-hard-links
Don't replicate hard links on destination side. If many hard-
linked files are present, this option can drastically decrease
memory usage. This option is enabled by default if the backup
source or restore destination is running on native Windows.

You might to try adding this switch to see if it helps.

There is no warning in that case, but the result is exactly the same. In
fact, I understand the warning as setting --no-hard-links automatically
even if wasn't set on the command-line. Besides, none of the files or
directories are hard-linked.

--
Pat


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Sunday 14 February 2010 12:03:25 pm Patrice Dumas wrote:

There is no warning in that case, but the result is exactly the same. In
fact, I understand the warning as setting --no-hard-links automatically
even if wasn't set on the command-line. Besides, none of the files or
directories are hard-linked.

--
Pat


My mistake for not reading thoroughly enough. I saw the warning then the next
example with a link count of 2. I did not seem them as directories and assumed
hard links. The only thing I can think to do now is run the first example with
an increased -v to see if it provides more information. By default v=3 and I
have found anything above 5 overwhelming.

--
Adrian Klaver
adrian.klaver < at > gmail.com


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Sun, Feb 14, 2010 at 12:43:15PM +0100, Patrice Dumas wrote:
Hello,

The mout line for /media/HD-PEU2/ is:
/dev/sda1 on /media/HD-PEU2 type vfat (rw,nosuid,nodev,uhelper=hal,uid=500)

Maybe the problem is the detection of case insensitivity, with
verbose, as suggested by Adrian Klaver, I get, for this filesystem:


Extended attributes not supported by filesystem at /media/HD-PEU2/tttttr/rdiff-backup-data/rdiff-backup.tmp.0
POSIX ACLs not supported by filesystem at /media/HD-PEU2/tttttr/rdiff-backup-data/rdiff-backup.tmp.0
Unable to import win32security module. Windows ACLs
not supported by filesystem at /media/HD-PEU2/tttttr/rdiff-backup-data/rdiff-backup.tmp.0
escape_dos_devices not required by filesystem at /media/HD-PEU2/tttttr/rdiff-backup-data/rdiff-backup.tmp.0
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
Ownership changing Off
Hard linking N/A
fsync() directories On
Directory inc permissions Off
High-bit permissions Off
Symlink permissions Off
Extended filenames On
Windows reserved filenames On
Access control lists Off
Extended attributes Off
Windows access control lists Off
Case sensitivity On
Escape DOS devices Off
Escape trailing spaces Off
Mac OS X style resource forks Off
Mac OS X Finder information Off
-----------------------------------------------------------------
Backup: must_escape_dos_devices = 0


Where you can see:
Case sensitivity On

which is wrong. Maybe this is enough for a bug report?

--
Pat


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Sun, Feb 14, 2010 at 12:43:15PM +0100, Patrice Dumas wrote:
Hello,


Answering myself, I think I found the issue. In fs_abilities.py
in def set_case_sensitive_readwrite(self, subdir):
the code is
upper_a = subdir.append("A")
upper_a.touch()
lower_a = subdir.append("a")
if lower_a.lstat():
.... system is case insensitive

but it seems like a stat on a file on a case insensitive filesystem
may fail for a different case:

dumas < at > patoune:~$ rm -rf /media/HD-PEU2/td
dumas < at > patoune:~$ mkdir /media/HD-PEU2/td
dumas < at > patoune:~$ touch /media/HD-PEU2/td/A
dumas < at > patoune:~$ stat /media/HD-PEU2/td/a
stat: cannot stat `/media/HD-PEU2/td/a': No such file or directory

And then
dumas < at > patoune:~$ touch /media/HD-PEU2/td/a
touch: cannot touch `/media/HD-PEU2/td/a': File exists

Not sure if the bug is in my distribution, or if rdiff-backup should
test differently.

Also I can read python, but not really write it. Maybe the best
approach is trying to touch lower_a and catch the failure, but I
just can't code such complex task

--
Pat


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Sun, Feb 14, 2010 at 12:43:15PM +0100, Patrice Dumas wrote:
Hello,

I use rdiff-backup 1.2.8 on a debian squeeze.
I would like to use rdiff-backup from an ext3 partition to a
fat partition. Although it is never said completly explicitly, it
seems that rdiff-backup should be able to handle the differences of
the filesystems automatically, for example according to this FAQ entry:
http://rdiff-backup.nongnu.org/FAQ.html#case_insensitive

Ok, definitly an error in the distribution or my setup. The file system
is indeed mounted case sensitive for some reason, and so rdiff-backup
detects it rightly.

--
Pat


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki