Backup Central

I looked through the archives to see if I could find
this issue, but I could not.

The problem I'm having is that if I backup a file,
delete it, and then make a new backup, I can't restore
the deleted file anymore. I've tried using the
restore function with 2D on the parent directory, but
this only restores the files that still exist. This
forces me to use the increment file restore method.

First problem: I have to hunt through the backups to
find the exact file I want. On os x, it looks like
30+% of my files get their filenames garbled
('quoting?') and it's really difficult to figure out
which is the exact file I want.

Next problem: lets say I actually deleted a whole
directory of hundreds of files by accident and now I
want to restore them. The increment method seems to
only allow specifying one unique file to restore at a
time as opposed to just restoring the parent
directory. I'm pretty new at the CLI and have never
written a shell script, so making a script to
one-by-one restore all the .missing files is way
beyond me. For now, I would have to manually restore
each file, and go through the problem of typing out
the full garbled name, which seems to have a huge
number of characters and tab-complete is not helpful
when there are hundreds of these similarly named
files.

Last problem: this is the most critical one, I guess.
Even if I manage to manually labor through the above
two issues, I'm having a problem (bug? ignorance on my
part?) restoring using the increment file method. The
files simply are not appearing after I run the
command. I created a directory on my desktop called
temp and tried restoring these deleted files into it.
Instead, temp vanishes without a trace and there's no
restored file. No matter how many different ways of
restoring one of these .missing files, I just can't do
it.

any help on any of these points would be greatly
appreciated!

thanks
chris

__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com

Chris Kausel wrote:
I created a directory on my desktop called
temp and tried restoring these deleted files into it.

Sorry I can't help with most of your post - I don't use Tiger (although
it would be nice, in a way, if my company did...). The normal mode of
operation is for rdiff-backup to create the directory that it will
restore into, so I suggest that you try your test restore without first
creating the target directory.

This doesn't explain why the directory disappears when you do the
restore as you have been, so the next thing I'd suggest is running the
restore command with -v9 to get more detail.

Given that you are "pretty new at the CLI", it might make sense to post
here the exact commands you are using.

Keith
--
Keith Edmunds

+---------------------------------------------------------------------+
| Tiger Computing Ltd | Helping businesses make the most of Linux |
| "The Linux Company" | http://www.tiger-computing.co.uk |
+---------------------------------------------------------------------+

Ok, here are my steps:

1) I wiped my entire backup directory clean, and ran a
fresh backup of all home dirs (/Users/ in os x). (done
in Terminal as rm -rf Users while in the rdiff-backup
directory).

2) I moved a file on _my_ desktop
(/Users/ckausel/Desktop/) to the trash. This file was
named stunningillusion.wmv. (done in the GUI by
dragging the file to the trash, which puts it inside
my .Trashes directory)

3) Since I had a dir vanish on me before, I figured I
should be safe and create temp on the desktop again to
avoid having my desktop vanish. (used the GUI to
create and name the new dir).

4) I ran another backup of all home dirs

5) I spelunked through the backed up data to this
directory (with corresponding listing):

nb-ckauselmm:/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data/increments/ckausel/;068esktop
root# ls -la
total 14648
drwx------ 6 unknown unknown 204 Dec 12 08:10
.
drwx------ 10 unknown unknown 340 Dec 12 08:13
..
-rw------- 1 unknown unknown 725 Dec 12 01:54
.;068;083_;083tore.2005-12-12;08402;05803;05803-08;05800.diff.gz
-rw-r--r-- 1 unknown unknown 7494196 Nov 1 10:22
stunningillusion.wmv.2005-12-12;08402;05803;05803-08;05800.snapshot
drwx------ 2 unknown unknown 68 Dec 12 08:10
temp
-rw------- 1 unknown unknown 0 Dec 12 08:10
temp.2005-12-12;08402;05803;05803-08;05800.missing

6) What I found interesting was there is no .missing
version of stunningillusion.wmv. But anyway,
according to the rdiff-backup documentation, any
increment file should work for restore, right? So I
went ahead and issued the following command:

root# /sw/bin/rdiff-backup
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/

7) the temp directory on my desktop instantly vanished
without a trace and no sign of a restored
stunningillusion.wmv anywhere.

So... am I doing something wrong?

Chris

--- Keith Edmunds <keith < at > midnighthax.com> wrote:

Given that you are "pretty new at the CLI", it might
make sense to post
here the exact commands you are using.

Keith


__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com

Chris Kausel wrote:
So... am I doing something wrong?

As I said before, rdiff-backup will create the restore directory so you
should not create temp by hand. I suggest you:

- remove the temp directory
- run the restore command again but this time with -v9, so:

/sw/bin/rdiff-backup -v9
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/

--
Keith Edmunds

+---------------------------------------------------------------------+
| Tiger Computing Ltd | Helping businesses make the most of Linux |
| "The Linux Company" | http://www.tiger-computing.co.uk |
+---------------------------------------------------------------------+

ok, you asked for it :)

Here it is:

by the way: I noticed some interesting stuff in this
log. First, its claim regarding which characters need
quoting doesn't look correct for os x, which would
explain why almost all of my files are quoted, I
guess. Is this something I can configure?

There's the repeated error of 'Unable to import module
xattr' along with 'Extended attributes not supported
on filesystem...' and 'ACLs not supported on
filesystem...' Maybe I'm off-base, but I could have
sworn OS X used ACLs. I don't know what qualifies as
an 'Extended attribute,' but if it's related to
meta-data, isn't os x heavy on meta data?
---
nb-ckauselmm:/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data/increments/ckausel/;068esktop
root# /sw/bin/rdiff-backup -v9
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/
Mon Dec 12 09:19:44 2005 Using mirror root directory
/Volumes/.Backup/.rdiff_daily/Users
Mon Dec 12 09:19:44 2005 Making directory
/Users/ckausel/Desktop/temp
Mon Dec 12 09:19:44 2005 Making directory
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/foo
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/foo
Mon Dec 12 09:19:44 2005 Making directory
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hl
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hardlinked_file1
Mon Dec 12 09:19:44 2005 Hard linking
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hl/hardlinked_file2
to
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hardlinked_file1
Mon Dec 12 09:19:44 2005 Unable to import module
xattr.
Extended attributes not supported on filesystem at
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005 Unable to import module
posix1e from pylibacl package.
ACLs not supported on filesystem at
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/dir_inc_check
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/dir_inc_check
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/regfile
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/regfile
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/high_perms
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/high_perms
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/5-_ a.
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/5-_ a.
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/A
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/a
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/:
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/:
Mon Dec 12 09:19:44 2005 Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/\
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/\
Mon Dec 12 09:19:44 2005 Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005 Removing directory
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005
-----------------------------------------------------------------
Detected abilities for destination (read/write) file
system:
Characters needing quoting
'^a-z0-9_ -.'
Ownership changing On
Hard linking On
fsync() directories On
Directory inc permissions On
High-bit permissions On
Access control lists Off
Extended attributes Off
Mac OS X style resource forks On
Mac OS X Finder information On
-----------------------------------------------------------------
Mon Dec 12 09:19:44 2005 Unable to import module
xattr.
Extended attributes not supported on filesystem at
/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data
Mon Dec 12 09:19:44 2005 Unable to import module
posix1e from pylibacl package.
ACLs not supported on filesystem at
/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data
Mon Dec 12 09:19:44 2005
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
Access control lists Off
Extended attributes Off
Mac OS X style resource forks On
Mac OS X Finder information On
-----------------------------------------------------------------
Mon Dec 12 09:19:44 2005 Starting restore of
stunningillusion.wmv.2005-12-12;08402;05803;05803-08;05800.snapshot
to /Users/ckausel/Desktop/temp as it was as of Mon Dec
12 02:03:03 2005.
Mon Dec 12 09:19:45 2005 Processing changed file .
Mon Dec 12 09:19:45 2005 Regular copying () to
/Users/ckausel/Desktop/rdiff-backup.tmp.1
Mon Dec 12 09:19:45 2005 Removing directory
/Users/ckausel/Desktop/temp
Mon Dec 12 09:19:45 2005 Restore finished
Mon Dec 12 09:19:45 2005 Cleaning up
nb-ckauselmm:/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data/increments/ckausel/;068esktop
root#


--
Thank you so much for your patience in this
chris

--- Keith Edmunds <keith < at > midnighthax.com> wrote:

Chris Kausel wrote:
So... am I doing something wrong?

As I said before, rdiff-backup will create the
restore directory so you
should not create temp by hand. I suggest you:

- remove the temp directory
- run the restore command again but this time with
-v9, so:

/sw/bin/rdiff-backup -v9

stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/

--
Keith Edmunds


+---------------------------------------------------------------------+
| Tiger Computing Ltd | Helping businesses make
the most of Linux |
| "The Linux Company" |
http://www.tiger-computing.co.uk |

+---------------------------------------------------------------------+


__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com

Chris Kausel <clkausel < at > yahoo.com>
wrote the following on Mon, 12 Dec 2005 08:55:11 -0800 (PST)

6) What I found interesting was there is no .missing
version of stunningillusion.wmv. But anyway,
according to the rdiff-backup documentation, any
increment file should work for restore, right? So I
went ahead and issued the following command:

The backup repository looks right---the increments go in reverse, so
you get a .missing when you make a new file, not when you delete a
file.

root# /sw/bin/rdiff-backup
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/

This should work...

7) the temp directory on my desktop instantly vanished
without a trace and no sign of a restored
stunningillusion.wmv anywhere.

Hmm, can you try it using the other restore syntax, as in:

/sw/bin/rdiff-backup -r 1M /Volumes/.Backup/.rdiff_daily/Users/ckausel/Desktop/stunningillusion.wmv stunningillusion.wmv

and see if it works then?

by the way: I noticed some interesting stuff in this log. First,
its claim regarding which characters need quoting doesn't look
correct for os x, which would explain why almost all of my files are
quoted, I guess. Is this something I can configure?

Yes, there's a bug which should be fixed in 1.1.4, which I'll release
soon (once I get this KeyError stuff fixed).

Mon Dec 12 09:19:45 2005 Regular copying () to
/Users/ckausel/Desktop/rdiff-backup.tmp.1
Mon Dec 12 09:19:45 2005 Removing directory
/Users/ckausel/Desktop/temp

Hmm, this looks like a time error, where rdiff-backup is "restoring"
the current (deleted) file.

BTW that
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
should just be a copy of the original stunningillusion file, so if you
want to restore that file before you get rdiff-backup working, you can
just copy that where you want it.


--
Ben Escoto

Keith Edmunds wrote:

Chris Kausel wrote:

So... am I doing something wrong?


As I said before, rdiff-backup will create the restore directory so
you should not create temp by hand. I suggest you:

- remove the temp directory
- run the restore command again but this time with -v9, so:

/sw/bin/rdiff-backup -v9
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/

I've done some restore tests myself on a debian system with the latest
backup ( -r now ) and also had a vanishing directory when i specify a
file as the source and a dir as the destination. Instead a file with
that name exists!
Specifying two filenames or two directories works fine.

Carsten