SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Hash doesnt match recorded hash
Author Message
Post Hash doesnt match recorded hash 
Hi there!

I need to restore an old VMware image, but I am getting LOTS of these
errors:

Error reading /backup/weird/home/wonko/os/vmware/xp/winXPPro-0.log,
substituting empty file.
Warning: Hash da39a3ee5e6b4b0d3255bfef95601890afd80709 of winXPPro-0.log
doesn't match recorded hash db9943d0284382131b553cef380aae99871b0f2e!

Any idea what has happened? rdiff-backup --check-destination-dir --force
says nothing has to be checked, and option --verify does not find
errors. The hard drive seems to be okay, no errors in the syslog, and a
long SMART selftest also does not find any errors. I can restore some
other directories I tried, but I need the backup of this VMware machine.

Wonko

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Post Hash doesnt match recorded hash 
On 15/11/2011 00:23, Alex Schuster wrote:
I need to restore an old VMware image, but I am getting LOTS of these
errors:

Error reading /backup/weird/home/wonko/os/vmware/xp/winXPPro-0.log,
substituting empty file.
Warning: Hash da39a3ee5e6b4b0d3255bfef95601890afd80709 of winXPPro-0.log
doesn't match recorded hash db9943d0284382131b553cef380aae99871b0f2e!

Any idea what has happened? rdiff-backup --check-destination-dir --force
says nothing has to be checked, and option --verify does not find
errors. The hard drive seems to be okay, no errors in the syslog, and a
long SMART selftest also does not find any errors. I can restore some
other directories I tried, but I need the backup of this VMware machine.

Vmware files for a running vm may change while being backed up by
rdiff-backup, in which case you don't have a consistent backup. Maybe
this is why you have this inconsistent hash warning.

Before using rdiff-backup on a VMware vm, my suggestion is to pause or
suspend or stop the vm (e.g. with vmrun). Alternatively use the VMware
snapshot facility and backup the snapshot rather than the running vm.

None of this is much help if you have already lost your vm and are
trying to recover it from backup. You might try recovering older
versions of the vm (from your rdiff-backup repository), maybe you will
find a consistent and usable vm there. Also the file you mention is only
a log file and not critical. The critical files I think are *.vmdk,
*.vmx and *.nvram.

Regards

Dominic

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Post Hash doesnt match recorded hash 
On Tue, 15 Nov 2011, Dominic Raferd wrote:

On 15/11/2011 00:23, Alex Schuster wrote:

Warning: Hash da39a3ee5e6b4b0d3255bfef95601890afd80709 of winXPPro-0.log
doesn't match recorded hash db9943d0284382131b553cef380aae99871b0f2e!

Any idea what has happened?

Vmware files for a running vm may change while being backed up by
rdiff-backup, in which case you don't have a consistent backup. Maybe this is
why you have this inconsistent hash warning.

If the contents changed during the rdiff-backup run, it bails out and
doesn't save the (inconsistent) increment. So that shouldn't happen.

My guess would be a RAM problem, which is more likely to cause corruption
in huge vmware disk images than it is for smaller regular files.

Another known cause for this type of corruption is a Via KT400a chipset
when running with DDR400. Memtest won't find any errors, but repeatedly
md5summing the same large file will result in wrong checksums every now
and then ( < 5% of the cases, so try some 100 times... )
But that kind of hardware should have been retired these days anyway.


--
Maarten

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Post Hash doesnt match recorded hash 
Maarten Bezemer writes:

On Tue, 15 Nov 2011, Dominic Raferd wrote:

On 15/11/2011 00:23, Alex Schuster wrote:

Warning: Hash da39a3ee5e6b4b0d3255bfef95601890afd80709 of winXPPro-0.log
doesn't match recorded hash db9943d0284382131b553cef380aae99871b0f2e!

Any idea what has happened?

Vmware files for a running vm may change while being backed up by
rdiff-backup, in which case you don't have a consistent backup. Maybe this is
why you have this inconsistent hash warning.

If the contents changed during the rdiff-backup run, it bails out and
doesn't save the (inconsistent) increment. So that shouldn't happen.

And I amusing a backup script which takes a LVM snapshot of my /home
partition before rdiff-backupping it. Sorry Dominic for not mentioning this.
Restoring other VMs seems to work, although I did not test many. But I
cannot restore ANY backup of this special VM I need, I tried about six
of my twenty backups.
Well, it would be really nice to be able to restore this VM, but if not,
I can (and have to) live with that. But I really would like to know why
this happened, and if I can trust other backups I do.
I successfully restored this VM in the past already, but that was an
earlier snapshot I have deleted meanwhile.

My guess would be a RAM problem, which is more likely to cause corruption
in huge vmware disk images than it is for smaller regular files.

Right. But the system is running stable otherwise. I am on Gentoo Linux,
where the whole system is compiled from source, and RAM errors tend to
show up as weird, unreproducible compilation errors there. Especialle
gcc is a good test for this, because it is compiled twice in the build
process, and the two results are compared bitwise. But I compiled gcc
for 24 times since I made that backup, without a problem.

Another known cause for this type of corruption is a Via KT400a chipset
when running with DDR400. Memtest won't find any errors, but repeatedly
md5summing the same large file will result in wrong checksums every now
and then ( < 5% of the cases, so try some 100 times... )
But that kind of hardware should have been retired these days anyway.

I don't have this hardware, but thanks for the hint. Oh, and I also
don't have one of those Samsung SpinPoint drives that write an empty
block whenever the drive's identification is checked with hdparm.

Wonko

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Post Hash doesnt match recorded hash 
On 11/14/2011 06:23 PM, Alex Schuster wrote:
Hi there!

I need to restore an old VMware image, but I am getting LOTS of these
errors:

Error reading /backup/weird/home/wonko/os/vmware/xp/winXPPro-0.log,
substituting empty file.
Warning: Hash da39a3ee5e6b4b0d3255bfef95601890afd80709 of winXPPro-0.log
doesn't match recorded hash db9943d0284382131b553cef380aae99871b0f2e!

Any idea what has happened? rdiff-backup --check-destination-dir --force
says nothing has to be checked, and option --verify does not find
errors. The hard drive seems to be okay, no errors in the syslog, and a
long SMART selftest also does not find any errors. I can restore some
other directories I tried, but I need the backup of this VMware machine.

When you restore, are you restoring the most recent backup? The "--verify"
option only checks the current mirror. You'd have to use "--verify-at-time"
to check earlier versions. I can't imagine why a restore would run into
checksum errors while a verify for that same version would be clean.

If you are trying to restore the most recent backup, you can just copy
files from the mirror. If you are trying to restore an earlier version,
an act of final desperation would be to edit the (probably compressed)
mirror_metadata file for that timestamp and remove all of the "SHA1Digest"
lines. The restore will then work, though obviously with no error check.
A "--verify-at-time" for that version would produce a ton of "Cannot find
SHA1 digest ..." warnings.

--
Bob Nichols "NOSPAM" is really part of my email address.
Do NOT delete it.


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Post Hash doesnt match recorded hash 
The only really important file is the vmdk which is the hard disk. You
can create a new virtual machine and point it at the existing vmdk to
get to the data.

Sarel

On 11/15/2011 5:22 AM, Dominic Raferd wrote:
On 15/11/2011 00:23, Alex Schuster wrote:
I need to restore an old VMware image, but I am getting LOTS of these
errors:

Error reading /backup/weird/home/wonko/os/vmware/xp/winXPPro-0.log,
substituting empty file.
Warning: Hash da39a3ee5e6b4b0d3255bfef95601890afd80709 of winXPPro-0.log
doesn't match recorded hash db9943d0284382131b553cef380aae99871b0f2e!

Any idea what has happened? rdiff-backup --check-destination-dir --force
says nothing has to be checked, and option --verify does not find
errors. The hard drive seems to be okay, no errors in the syslog, and a
long SMART selftest also does not find any errors. I can restore some
other directories I tried, but I need the backup of this VMware machine.

Vmware files for a running vm may change while being backed up by
rdiff-backup, in which case you don't have a consistent backup. Maybe
this is why you have this inconsistent hash warning.

Before using rdiff-backup on a VMware vm, my suggestion is to pause or
suspend or stop the vm (e.g. with vmrun). Alternatively use the VMware
snapshot facility and backup the snapshot rather than the running vm.

None of this is much help if you have already lost your vm and are
trying to recover it from backup. You might try recovering older
versions of the vm (from your rdiff-backup repository), maybe you will
find a consistent and usable vm there. Also the file you mention is
only a log file and not critical. The critical files I think are
*.vmdk, *.vmx and *.nvram.

Regards

Dominic

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL:
http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Post Hash doesnt match recorded hash 
I note there was a similar plea last March on this list, you can see it
here:
http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/rdiff-backup-23/restore-fails-110831/.
Unfortunately there was no published resolution.

I wonder if the problem relates to the temporary folder being used on
the server or (possibly) on the local machine? Try running the restore
with --remote-tempdir and --tempdir pointed at locations with bags of space.

Is it only this log file that gives the error message? What about the
vmdk file?

Dominic

On 15/11/2011 12:27, Alex Schuster wrote:
Maarten Bezemer writes:

On Tue, 15 Nov 2011, Dominic Raferd wrote:

On 15/11/2011 00:23, Alex Schuster wrote:
Warning: Hash da39a3ee5e6b4b0d3255bfef95601890afd80709 of winXPPro-0.log
doesn't match recorded hash db9943d0284382131b553cef380aae99871b0f2e!

Any idea what has happened?
Vmware files for a running vm may change while being backed up by
rdiff-backup, in which case you don't have a consistent backup. Maybe this is
why you have this inconsistent hash warning.
If the contents changed during the rdiff-backup run, it bails out and
doesn't save the (inconsistent) increment. So that shouldn't happen.

I didn't know that, but I wonder if it always works like that or whether
in extreme cases (such as huge vmdk files or corrupted source drive) it
can break down.

And I amusing a backup script which takes a LVM snapshot of my /home
partition before rdiff-backupping it.

Good thinking, but I doubt this guarantees that the vmdk file is consistent.

Restoring other VMs seems to work, although I did not test many. But I
cannot restore ANY backup of this special VM I need, I tried about six
of my twenty backups.
Well, it would be really nice to be able to restore this VM, but if not,
I can (and have to) live with that. But I really would like to know why
this happened, and if I can trust other backups I do.
I successfully restored this VM in the past already, but that was an
earlier snapshot I have deleted meanwhile.

Yes I think we would all like an explanation for your problem, and a
workaround. It could be our problem one day...

Dominic

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB