Backup Central

Hi all, I know this problem is not new but I couldn't find the solution anywere.

Try simply to copy a file with capitalized letters in the file name
form windows to a linux rdiff-backup server.

I created the file àèìòù.txt in a test folder (windows), then I copied it by:

rdiff-backup.exe --print-statistics --override-chars-to-quote ''
--remote-schema "plink -i private.ppk %%s rdiff-backup --server"
"F:/test" root < at > 192.168.1.200::/mnt/dati/backup/f/test

I get no error from rdiff-backup but when I look at the backed up file
I see a question mark for each capitalized letter:

# ls -l test/
totale 4
drwx------ 3 root root 4096 4 ott 17.52 rdiff-backup-data
-rw-rw-rw- 1 root root 0 4 ott 17.46 ?????.txt



I'm using rdiff-backup 1.2.8 on both sides.
The linux server is running debian squeeze x86_64.
The windows server is running windows server 2008 64 bit.

I got the same problem in the past between debian lenny and windows 2003.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Tue, Oct 04, 2011 at 06:02:08PM +0200, Valerio Pachera wrote:

Try simply to copy a file with capitalized letters in the file name
form windows to a linux rdiff-backup server.

I created the file àèìòù.txt in a test folder (windows), then I
copied it by:

rdiff-backup.exe --print-statistics --override-chars-to-quote ''
--remote-schema "plink -i private.ppk %%s rdiff-backup --server"
"F:/test" root < at > 192.168.1.200::/mnt/dati/backup/f/test

I get no error from rdiff-backup but when I look at the backed up
file I see a question mark for each capitalized letter:

# ls -l test/
totale 4
drwx------ 3 root root 4096 4 ott 17.52 rdiff-backup-data
-rw-rw-rw- 1 root root 0 4 ott 17.46 ?????.txt


The originating filename may be in UTF-16 or Windows 1252 or some
other, depending your your file system and OS settings. rdiff does not
convert the file names, it just stores them and gives them back the
way it got them.

If you access your rdiff repo from the Unix prompt then you should
expect to see this since your terminal does not know what charset the
filename is in, and even if it did know and it may not have the fonts
available to render it. When you restore the file back to it's origin
it will look correct.

Best,

Chuck


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

2011/10/4 chuck odonnell <cao < at > bus.net>:
When you restore the file back to it's origin
it will look correct.

My main problem is that I have to create a mirror of the backup to a
ntfs external disk.

If I copy to an ext3 partition, no problem.
# cp -r test/ /tmp/
<no message>

If I copy to the ntfs partition I get "Impossible to create the file..."
# cp -r test/ /media/bkp_esterno1/
cp: impossibile creare il file regolare
"/media/bkp_esterno1/test/\340\350\354\362\371.txt": Invalid or
incomplete multibyte or wide character

These are the fstab options I use 'ntfs-3g rw,locale=it_IT.utf8 '.
mount with no arguments gives
/dev/sdc1 on /media/bkp_esterno1 type fuseblk (rw,allow_other,blksize=4096)

I didn't test to run rdiff-backup from windows to the linux server
directly to the ntfs partition.
It might fail.
When I find a little time, I test that too.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

2011/10/5 Valerio Pachera <sirio81 < at > gmail.com>:
I didn't test to run rdiff-backup from windows to the linux server
directly to the ntfs partition.

Ok, I tested it, and it fail like aspected:

From windows, bkp_test.bat:
rdiff-backup.exe --print-statistics --override-chars-to-quote ''
--remote-schema "plink -i private.ppk %%s rdiff-backup --server"
"F:/test" root < at > 192.168.1.200::/media/bkp_esterno1/test2

This is the error I read in the backup.log:
OSError while renaming /media/bkp_esterno1/test2/rdiff-backup.tmp.1 to
/media/bkp_esterno1/test2/<E0><E8><EC><F2><F9>.txt
UpdateError rdiff-backup.tmp.1 [Errno 84] Invalid or incomplete
multibyte or wide character

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

2011/10/4 chuck odonnell <cao < at > bus.net>:
When you restore the file back to it's origin
it will look correct.

It seems to not be workong:

From windows:
rdiff-backup.exe --restore-as-of now --remote-schema "plink -i
private.ppk %%s rdiff-backup --server"
root < at > 192.168.1.200::/mnt/dati/backup/test/àèìòù.txt
"C:/Windows/Temp/restore/miofile.txt"

I get nothing.
Only a warning message about hard links.

No file in the restore folder.

I tried also with the filename ':/mnt/dati/backup/test/?????.txt', off
course no success.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

This is the restore.log I get, with verbosity 4:

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Wed, Oct 05, 2011 at 10:24:19AM +0200, Valerio Pachera wrote:
2011/10/5 Valerio Pachera <sirio81 < at > gmail.com>:
I didn't test to run rdiff-backup from windows to the linux server
directly to the ntfs partition.

Ok, I tested it, and it fail like aspected:

From windows, bkp_test.bat:
rdiff-backup.exe --print-statistics --override-chars-to-quote ''
--remote-schema "plink -i private.ppk %%s rdiff-backup --server"
"F:/test" root < at > 192.168.1.200::/media/bkp_esterno1/test2

This is the error I read in the backup.log:
OSError while renaming /media/bkp_esterno1/test2/rdiff-backup.tmp.1 to
/media/bkp_esterno1/test2/<E0><E8><EC><F2><F9>.txt
UpdateError rdiff-backup.tmp.1 [Errno 84] Invalid or incomplete
multibyte or wide character


You are trying to back up from one platform and restore to another?

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

2011/10/5 chuck odonnell <cao < at > bus.net>:
This is the error I read in the backup.log:
OSError while renaming /media/bkp_esterno1/test2/rdiff-backup.tmp.1 to
/media/bkp_esterno1/test2/<E0><E8><EC><F2><F9>.txt
UpdateError rdiff-backup.tmp.1 [Errno 84] Invalid or incomplete
multibyte or wide character

You are trying to back up from one platform and restore to another?

No. This message is about backup, not about restore.
You get it if you rdiff-backup from windows and the destination is
linux on a ntfs partition.

If I do the same, but on a "normal" ext3 partition like destination, I
get no error but the '?' on the file names.

From windows (the same one I start the backup from), I tried to
restore a copy of file with the '?' charachters in the name.
I get not files.

In the previuos mail I attached the log. May you tell me if is there?

I write it here but is less clear than reading from file:

Starting restore of /mnt/dati/backup/test/<D3><DE><FD>=<A8>.txt to
C:/Windows/Temp/restore/myfile.txt as it was as of Wed Oct 05 10:29:55
2011.
Starting restore of /mnt/dati/backup/test/noncisono.txt to
C:/Windows/Temp/restore/myfile.txt as it was as of Wed Oct 05 10:33:07
2011.
Starting restore of /mnt/dati/backup/test/?????.txt to
C:/Windows/Temp/restore/myfile.txt as it was as of Wed Oct 05 10:33:39
2011.
Wed Oct 5 14:08:10 2011 Starting restore of
/mnt/dati/backup/test/<D3><DE><FD>=<A8>.txt to
C:/Windows/Temp/restore/myfile.txt as it was as of Wed Oct 05 14:02:53
2011.
Wed Oct 5 14:08:11 2011 Processing changed file .
Wed Oct 5 14:08:11 2011 Regular copying () to
C:/Windows/Temp/restore/rdiff-backup.tmp.1
Wed Oct 5 14:08:11 2011 Removing directory C:/Windows/Temp/restore/myfile.txt
Wed Oct 5 14:08:11 2011 Restore finished
Wed Oct 5 14:08:11 2011 Cleaning up
Starting restore of /mnt/dati/backup/test/<D3><DE><FD>=<A8>.txt to
C:/restore/myfile.txt as it was as of Wed Oct 05 14:08:46 2011.
Processing changed file .
Restore finished
Starting restore of /mnt/dati/backup/test/<D3><DE><FD>=<A8>.txt to
C:/restore/myfile.txt as it was as of Wed Oct 05 14:12:58 2011.
Restore finished

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Wed, Oct 05, 2011 at 04:17:09PM +0200, Valerio Pachera wrote:

No. This message is about backup, not about restore.
You get it if you rdiff-backup from windows and the destination is
linux on a ntfs partition.


Ah okay. Can't help you there. Not sure if rdiff-backup is the right
tool for backing up to NTFS. Someone please correct me.





_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

-----------------------------
From Valerio Pachera <sirio81 < at > gmail.com>
2011-10-04 18.02.08 [[rdiff-backup-users] Capitalized letters from windows to
linux]:
Hi all, I know this problem is not new but I couldn't find the solution
anywere.

Try simply to copy a file with capitalized letters in the file name
form windows to a linux rdiff-backup server.

I created the file àèìòù.txt in a test folder (windows), then I copied it
by:

rdiff-backup.exe --print-statistics --override-chars-to-quote ''
--remote-schema "plink -i private.ppk %%s rdiff-backup --server"
"F:/test" root < at > 192.168.1.200::/mnt/dati/backup/f/test

I get no error from rdiff-backup but when I look at the backed up file
I see a question mark for each capitalized letter:

# ls -l test/
totale 4
drwx------ 3 root root 4096 4 ott 17.52 rdiff-backup-data
-rw-rw-rw- 1 root root 0 4 ott 17.46 ?????.txt



I'm using rdiff-backup 1.2.8 on both sides.
The linux server is running debian squeeze x86_64.
The windows server is running windows server 2008 64 bit.

I got the same problem in the past between debian lenny and windows 2003.

I do not know how to resolve your things. However I can tell the story how I
use rdiff-backup in a special case with mixed file systems. Mybe this can help
at least as an inspiration for other cases?

I am backing up from ext3 (etc.) to fat32 using Kubuntu (Debian based). Having
experienced file name incompatibility frustration on several occasions
formerly, I use file names with ascii characters only (without spaces) and
preferrably lower case letters in order not to confuse the Windows file system
with unintended duplicates. If there are no latent duplicates even both-case
names may work.

Still (why?) I need to take precautions to avoid character errors related to
yours. I did use and modify advices found at a forum, please look at
http://ubuntuforums.org/showthread.php?t=652316

After some experiments I found my backups running without errors using

rdiff-backup --no-hard-links --override-chars-to-quote '"*/:<>?\\|;' $so $de

where $so is ext3 and $de is fat32. The --no-hard-links option has no
significance in this (if I remember right), but the --override-chars-to-quote
string is needed to remove character errors similar to yours.

Do not ask me to explain further since I cannot, can anybody, please?

Tore

P.S. Why copying from ext3 to fat32? A: Can use the files on my (duplicate)
backup disk directly with a Windows computer.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

On Oct 5, 2011, at 1:32 PM, Tore Ericsson wrote:
I created the file àèìòù.txt in a test folder (windows), then I copied it
by:

rdiff-backup.exe --print-statistics --override-chars-to-quote ''
--remote-schema "plink -i private.ppk %%s rdiff-backup --server"
"F:/test" root < at > 192.168.1.200 ([email]root < at > 192.168.1.200[/email])::/mnt/dati/backup/f/test

I get no error from rdiff-backup but when I look at the backed up file
I see a question mark for each capitalized letter:



I suspect that it has more to do with the non-ascii characters than the capital letters.