SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
missing a file during verification
Author Message
Post missing a file during verification 
Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server two weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir 5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd 7.4-RELEASE-p3
JobId: 8299
Job: cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine each Saturday.
The daily incremental backups appear to be fine. The machine 'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to upgrading to
5.2.3 on all Bacula devices, there were no errors reported on this
instance.

How do I turn on or increase logging to try to identify the reason for
the skip? Or at least identify the file being skipped?

~Doug



------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server two weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir 5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd 7.4-RELEASE-p3
JobId: 8299
Job: cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine each Saturday.
The daily incremental backups appear to be fine. The machine 'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to upgrading to
5.2.3 on all Bacula devices, there were no errors reported on this
instance.

How do I turn on or increase logging to try to identify the reason for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula should print

The following files are in the Catalog but not on the Volume(s):

followed by the list of them.

If not, what is your Message resource in the bacula-dir.conf?

__Martin

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server two
weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir 5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
JobId: 8299
Job: cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine each
Saturday.
The daily incremental backups appear to be fine. The machine
'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to upgrading
to
5.2.3 on all Bacula devices, there were no errors reported on this
instance.

How do I turn on or increase logging to try to identify the reason
for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula should print

The following files are in the Catalog but not on the Volume(s):

followed by the list of them.

If not, what is your Message resource in the bacula-dir.conf?


Whoops. I thought I had copied the entire message for JobId 8299. I'm
enclosing both JobId 8295 (the original backup job) and JobId 8299 (the
verify job) here:

28-Jan 00:05 pisces-dir JobId 8295: Start Backup JobId 8295,
Job=cepheus.2012-01-28_00.05.00_11
28-Jan 00:05 pisces-dir JobId 8295: There are no more Jobs associated
with Volume "Backup_cepheus-fd_2011-11-19_00.05.03". Marking it purged.
28-Jan 00:05 pisces-dir JobId 8295: All records pruned from Volume
"Backup_cepheus-fd_2011-11-19_00.05.03"; marking it "Purged"
28-Jan 00:05 pisces-dir JobId 8295: There are no more Jobs associated
with Volume "Backup_cepheus-fd_2011-11-26_00.05.02". Marking it purged.
28-Jan 00:05 pisces-dir JobId 8295: All records pruned from Volume
"Backup_cepheus-fd_2011-11-26_00.05.02"; marking it "Purged"
28-Jan 00:05 pisces-dir JobId 8295: Created new Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" in catalog.
28-Jan 00:05 pisces-dir JobId 8295: Using Device "FileStoragecepheus"
28-Jan 00:03 cepheus-fd JobId 8295: DIR and FD clocks differ by -92
seconds, FD automatically compensating.
28-Jan 00:03 cepheus-fd JobId 8295: shell command: run
ClientRunBeforeJob "start /w ntbackup backup systemstate /F
C:\SystemState.bkf"
28-Jan 00:06 pisces-sd JobId 8295: Labeled new Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" on device "FileStoragecepheus"
(/backup).
28-Jan 00:06 pisces-sd JobId 8295: Wrote label to prelabeled Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" on device "FileStoragecepheus"
(/backup)
28-Jan 00:06 pisces-dir JobId 8295: Max Volume jobs=1 exceeded. Marking
Volume "Backup_cepheus-fd_2012-01-28_00.05.01" as Used.
28-Jan 00:05 cepheus-fd JobId 8295: Generate VSS snapshots. Driver="VSS
Win 2003", Drive(s)="CD"
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "System
Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"SqlServerWriter", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"Removable Storage Manager", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"MSDEWriter", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "WMI
Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "BITS
Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"Registry Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "IIS
Metabase Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "Event
Log Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "COM+
REGDB Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:22 pisces-sd JobId 8295: Job write elapsed time = 00:16:16,
Transfer rate = 4.801 M Bytes/second
28-Jan 00:23 pisces-dir JobId 8295: Bacula pisces-dir 5.2.3 (16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd 7.4-RELEASE-p3
JobId: 8295
Job: cepheus.2012-01-28_00.05.00_11
Backup Level: Differential, since=2012-01-07 00:05:12
Client: "cepheus-fd" 5.2.3 (16Dec11) Microsoft Windows
Server 2003 R2 Enterprise Edit
ion Service Pack 2 (build 3790),Cross-compile,Win32
FileSet: "cepheus" 2010-02-05 16:54:38
Pool: "cepheus" (From Run pool override)
Catalog: "MyCatalog" (From Client resource)
Storage: "FileStoragecepheus" (From Job resource)
Scheduled time: 28-Jan-2012 00:05:00
Start time: 28-Jan-2012 00:06:41
End time: 28-Jan-2012 00:23:01
Elapsed time: 16 mins 20 secs
Priority: 10
FD Files Written: 989
SD Files Written: 989
FD Bytes Written: 4,685,749,010 (4.685 GB)
SD Bytes Written: 4,685,928,862 (4.685 GB)
Rate: 4781.4 KB/s
Software Compression: 76.5 %
VSS: yes
Encryption: no
Accurate: no
Volume name(s): Backup_cepheus-fd_2012-01-28_00.05.01
Volume Session Id: 9
Volume Session Time: 1327608090
Last Volume Bytes: 4,692,229,733 (4.692 GB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK

28-Jan 00:23 pisces-dir JobId 8295: Begin pruning Jobs older than 2
months .
28-Jan 00:23 pisces-dir JobId 8295: No Jobs found to prune.
28-Jan 00:23 pisces-dir JobId 8295: Begin pruning Files.
28-Jan 00:23 pisces-dir JobId 8295: No Files found to prune.
28-Jan 00:23 pisces-dir JobId 8295: End auto prune.



28-Jan 06:00 pisces-dir JobId 8299: Verifying against JobId=8295
Job=cepheus.2012-01-28_00.05.00_11
28-Jan 06:00 pisces-dir JobId 8299: Bootstrap records written to
/var/db/bacula/pisces-dir.restore.4.bsr
28-Jan 06:00 pisces-dir JobId 8299: Start Verify JobId=8299
Level=VolumeToCatalog Job=cepheusVerifyData.2012-01-28_06.00.00_15
28-Jan 06:00 pisces-dir JobId 8299: Using Device "FileStoragecepheus"
28-Jan 06:00 pisces-sd JobId 8299: Ready to read from volume
"Backup_cepheus-fd_2012-01-28_00.05.01" on device "FileStoragecepheus"
(/backup).
28-Jan 06:00 pisces-sd JobId 8299: Forward spacing Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" to file:block 0:237.
28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir 5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd 7.4-RELEASE-p3
JobId: 8299
Job: cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

28-Jan 06:08 pisces-dir JobId 8299: Begin pruning Jobs older than 2
months .
28-Jan 06:08 pisces-dir JobId 8299: No Jobs found to prune.
28-Jan 06:08 pisces-dir JobId 8299: Begin pruning Files.
28-Jan 06:08 pisces-dir JobId 8299: No Files found to prune.
28-Jan 06:08 pisces-dir JobId 8299: End auto prune.

As you can see Bacula does not print anything indicating which file is
not on the Volume. Message resource info below:

# Verify file consistency between data & data backup of cepheus-fd
Job {
Name = "cepheusVerifyData"
Type = Verify
Client = cepheus-fd
Level = VolumeToCatalog
FileSet = "cepheus"
Schedule = "cepheusVerifyWeeklyCycle"
Storage = FileStoragecepheus
Messages = Standard
<<<<<<<<<<<<<<<<<=====================
Pool = cepheus
Priority = 11 # run after main backup
Maximum Concurrent Jobs = 14
}


# Reasonable message delivery -- send most everything to email address
# and to the console
Messages {
Name = Standard
#
# NOTE! If you send to two email or more email addresses, you will need
# to replace the %r in the from field (-f part) with a single valid
# email address in both the mailcommand and the operatorcommand.
#
mailcommand = "/usr/local/sbin/bsmtp -h mailfilter.example.org -f
root < at > example.org -s \"Bacula: %t %e of %c %l\" %r"
operatorcommand = "/usr/local/sbin/bsmtp -h mailfilter.example.org -f
root < at > example.org -s \"Bacula: Intervention needed for %j\" %r"
mail = admin < at > example.org = all, !skipped
operator = admin < at > example.org, dsamp < at > example.org = mount # the
alias 'bacula' is defined in /etc/mail/aliases
console = all, !skipped, !saved
#
# WARNING! the following will create a file that you must cycle from
# time to time as it will grow indefinitely. However, it will
# also keep all your messages if they scroll off the console.
#
append = "/var/db/bacula/log" = all, !skipped
}

Does these help?

~Doug

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Tue, 31 Jan 2012 11:02:59 -0800, Doug Sampson said:

On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server two
weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir 5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
JobId: 8299
Job: cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine each
Saturday.
The daily incremental backups appear to be fine. The machine
'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to upgrading
to
5.2.3 on all Bacula devices, there were no errors reported on this
instance.

How do I turn on or increase logging to try to identify the reason
for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula should print

The following files are in the Catalog but not on the Volume(s):

followed by the list of them.

If not, what is your Message resource in the bacula-dir.conf?


Whoops. I thought I had copied the entire message for JobId 8299. I'm
enclosing both JobId 8295 (the original backup job) and JobId 8299 (the
verify job) here:
...
As you can see Bacula does not print anything indicating which file is
not on the Volume. Message resource info below:
...
Does these help?

The messages look normal -- I would expect it to list them.

You could try the following SQL commands to get more info about what is in the
catalog for this job:

SELECT COUNT(*) FROM File
WHERE File.JobId=8295;

SELECT COUNT(*) FROM File
WHERE File.JobId=8295 AND File.FileIndex > 0;

SELECT Path.Path,Filename.Name FROM File,Path,Filename
WHERE File.JobId=8295 AND File.FileIndex > 0
AND File.MarkId!=8299 AND File.PathId=Path.PathId
AND File.FilenameId=Filename.FilenameId;

__Martin

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Tue, 31 Jan 2012 11:02:59 -0800, Doug Sampson said:

On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server two
weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on
device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir
5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
JobId: 8299
Job:
cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine each
Saturday.
The daily incremental backups appear to be fine. The machine
'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to
upgrading
to
5.2.3 on all Bacula devices, there were no errors reported on
this
instance.

How do I turn on or increase logging to try to identify the
reason
for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula should
print

The following files are in the Catalog but not on the Volume(s):

followed by the list of them.

If not, what is your Message resource in the bacula-dir.conf?


Whoops. I thought I had copied the entire message for JobId 8299.
I'm
enclosing both JobId 8295 (the original backup job) and JobId 8299
(the
verify job) here:
...
As you can see Bacula does not print anything indicating which file
is
not on the Volume. Message resource info below:
...
Does these help?

The messages look normal -- I would expect it to list them.

You could try the following SQL commands to get more info about what
is in
the
catalog for this job:

SELECT COUNT(*) FROM File
WHERE File.JobId=8295;

SELECT COUNT(*) FROM File
WHERE File.JobId=8295 AND File.FileIndex > 0;

SELECT Path.Path,Filename.Name FROM File,Path,Filename
WHERE File.JobId=8295 AND File.FileIndex > 0
AND File.MarkId!=8299 AND File.PathId=Path.PathId
AND File.FilenameId=Filename.FilenameId;



$ psql bacula
Welcome to psql 8.3.16, the PostgreSQL interactive terminal.

Type: \copyright for distribution terms
\h for help with SQL commands
\? for help with psql commands
\g or terminate with semicolon to execute query
\q to quit

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295;
count
-------
988
(1 row)

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0;
count
-------
988
(1 row)

bacula=# SELECT Path.Path,Filename.Name FROM File,Path,Filename
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0
bacula-# AND File.MarkId!=8299 AND File.PathId=Path.PathId
bacula-# AND File.FilenameId=Filename.FilenameId;
path | name
------+------
(0 rows)

bacula=#


Um, so where's the error coming from?

~Doug

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Thu, 2 Feb 2012 13:11:15 -0800, Doug Sampson said:

On Tue, 31 Jan 2012 11:02:59 -0800, Doug Sampson said:

On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server two
weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on
device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir
5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
JobId: 8299
Job:
cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine each
Saturday.
The daily incremental backups appear to be fine. The machine
'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to
upgrading
to
5.2.3 on all Bacula devices, there were no errors reported on
this
instance.

How do I turn on or increase logging to try to identify the
reason
for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula should
print

The following files are in the Catalog but not on the Volume(s):

followed by the list of them.

If not, what is your Message resource in the bacula-dir.conf?


Whoops. I thought I had copied the entire message for JobId 8299.
I'm
enclosing both JobId 8295 (the original backup job) and JobId 8299
(the
verify job) here:
...
As you can see Bacula does not print anything indicating which file
is
not on the Volume. Message resource info below:
...
Does these help?

The messages look normal -- I would expect it to list them.

You could try the following SQL commands to get more info about what
is in
the
catalog for this job:

SELECT COUNT(*) FROM File
WHERE File.JobId=8295;

SELECT COUNT(*) FROM File
WHERE File.JobId=8295 AND File.FileIndex > 0;

SELECT Path.Path,Filename.Name FROM File,Path,Filename
WHERE File.JobId=8295 AND File.FileIndex > 0
AND File.MarkId!=8299 AND File.PathId=Path.PathId
AND File.FilenameId=Filename.FilenameId;



$ psql bacula
Welcome to psql 8.3.16, the PostgreSQL interactive terminal.

Type: \copyright for distribution terms
\h for help with SQL commands
\? for help with psql commands
\g or terminate with semicolon to execute query
\q to quit

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295;
count
-------
988
(1 row)

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0;
count
-------
988
(1 row)

bacula=# SELECT Path.Path,Filename.Name FROM File,Path,Filename
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0
bacula-# AND File.MarkId!=8299 AND File.PathId=Path.PathId
bacula-# AND File.FilenameId=Filename.FilenameId;
path | name
------+------
(0 rows)

bacula=#


Um, so where's the error coming from?

~Doug


The error occurs because Bacula thinks there are 989 files in the backup,
though only 988 were recorded in the File table.

What is the fileset definition?

What does the following SQL command print?

SELECT MIN(FileIndex), MAX(FileIndex) FROM File WHERE JobId=8295;

You could try to compare the list of files printed by

list files jobid=8295

with the output of the bls command for the volume containing that job (that
will print the files from all jobs on the volume, so you will have to filter
it).

__Martin

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Thu, 2 Feb 2012 13:11:15 -0800, Doug Sampson said:

On Tue, 31 Jan 2012 11:02:59 -0800, Doug Sampson said:

On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server
two
weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1
on
device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir
5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
JobId: 8299
Job:
cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine each
Saturday.
The daily incremental backups appear to be fine. The machine
'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to
upgrading
to
5.2.3 on all Bacula devices, there were no errors reported
on
this
instance.

How do I turn on or increase logging to try to identify the
reason
for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula should
print

The following files are in the Catalog but not on the
Volume(s):

followed by the list of them.

If not, what is your Message resource in the bacula-dir.conf?


Whoops. I thought I had copied the entire message for JobId
8299.
I'm
enclosing both JobId 8295 (the original backup job) and JobId
8299
(the
verify job) here:
...
As you can see Bacula does not print anything indicating which
file
is
not on the Volume. Message resource info below:
...
Does these help?

The messages look normal -- I would expect it to list them.

You could try the following SQL commands to get more info about
what
is in
the
catalog for this job:

SELECT COUNT(*) FROM File
WHERE File.JobId=8295;

SELECT COUNT(*) FROM File
WHERE File.JobId=8295 AND File.FileIndex > 0;

SELECT Path.Path,Filename.Name FROM File,Path,Filename
WHERE File.JobId=8295 AND File.FileIndex > 0
AND File.MarkId!=8299 AND File.PathId=Path.PathId
AND File.FilenameId=Filename.FilenameId;



$ psql bacula
Welcome to psql 8.3.16, the PostgreSQL interactive terminal.

Type: \copyright for distribution terms
\h for help with SQL commands
\? for help with psql commands
\g or terminate with semicolon to execute query
\q to quit

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295;
count
-------
988
(1 row)

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0;
count
-------
988
(1 row)

bacula=# SELECT Path.Path,Filename.Name FROM File,Path,Filename
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0
bacula-# AND File.MarkId!=8299 AND File.PathId=Path.PathId
bacula-# AND File.FilenameId=Filename.FilenameId;
path | name
------+------
(0 rows)

bacula=#


Um, so where's the error coming from?

~Doug


The error occurs because Bacula thinks there are 989 files in the
backup,
though only 988 were recorded in the File table.

What is the fileset definition?

# This is my cepheus (W2K3 Server) fileset:
FileSet {
Name = "cepheus"
enable VSS = "yes"
Include {
Options {
signature = MD5
# aclsupport = yes
compression = GZIP6
Exclude = yes
IgnoreCase = yes
# Exclude Mozilla-based programs' file caches
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache"
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache.Trash"
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/ImapMail"
# Exclude user's registry files - they're always in use anyway.
WildFile = "[A-Z]:/Documents and Settings/*/Local
Settings/Application Data/Microsoft/Windows/usrclass.*"
WildFile = "[A-Z]:/Documents and Settings/*/ntuser.*"
# Exclude directories full of lots and lots of useless little files
WildDir = "[A-Z]:/Documents and Settings/*/Cookies"
WildDir = "[A-Z]:/Documents and Settings/*/Recent"
WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/History"
WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/Temp"
WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/Temporary
Internet Files"
# These are always open and unable to be backed up
WildFile = "[A-Z]:/Documents and Settings/All Users/Application
Data/Microsoft/Network/Downloader/qmgr[01].dat"
# Some random bits of Windows we want to ignore
WildFile = "[A-Z]:/Windows/security/logs/scepol.log"
WildDir = "[A-Z]:/Windows/system32/config"
WildDir = "[A-Z]:/Windows/msdownld.tmp"
WildDir = "[A-Z]:/Windows/Internet Logs"
WildDir = "[A-Z]:/Windows/$Nt*Uninstall*"
WildDir = "[A-Z]:/Windows/sysvol"
WildFile = "[A-Z]:/Windows/cluster/CLUSDB"
WildFile = "[A-Z]:/Windows/cluster/CLUSDB.LOG"
WildFile = "[A-Z]:/Windows/NTDS/edb.log"
WildFile = "[A-Z]:/Windows/NTDS/ntds.dit"
WildFile = "[A-Z]:/Windows/NTDS/temp.edb"
WildFile = "[A-Z]:/Windows/ntfrs/jet/log/edb.log"
WildFile = "[A-Z]:/Windows/ntfrs/jet/ntfrs.jdb"
WildFile = "[A-Z]:/Windows/ntfrs/jet/temp/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/CPL.CFG"
WildFile = "[A-Z]:/Windows/system32/dhcp/dhcp.mdb"
WildFile = "[A-Z]:/Windows/system32/dhcp/j50.log"
WildFile = "[A-Z]:/Windows/system32/dhcp/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/LServer/edb.log"
WildFile = "[A-Z]:/Windows/system32/LServer/TLSLic.edb"
WildFile = "[A-Z]:/Windows/system32/LServer/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/wins/j50.log"
WildFile = "[A-Z]:/Windows/system32/wins/wins.mdb"
WildFile = "[A-Z]:/Windows/system32/wins/winstmp.mdb"
# Temporary directories & files
WildDir = "[A-Z]:/Windows/Temp"
WildDir = "[A-Z]:/[Tt][Ee][Mm][Pp]"
WildFile = "*.tmp"
WildFile = "*.avi"
WildFile = "*.mpg"
WildFile = "*.mpeg"
WildFile = "*.wmv"
WildFile = "*.iso"
WildFile = "*.rmvb"
WildDir = "[A-Z]:/tmp"
WildDir = "[A-Z]:/var/tmp"
# Recycle bins
WildDir = "[A-Z]:/RECYCLER"
# Swap files
WildFile = "[A-Z]:/pagefile.sys"
# These are programs and are easier to reinstall than restore from
backup
WildDir = "[A-Z]:/cygwin"
WildDir = "[A-Z]:/Program Files/Grisoft"
WildDir = "[A-Z]:/Program Files/Java"
WildDir = "[A-Z]:/Program Files/Java Web Start"
WildDir = "[A-Z]:/Program Files/JavaSoft"
WildDir = "[A-Z]:/Program Files/Microsoft Office"
WildDir = "[A-Z]:/Program Files/Mozilla Firefox"
WildDir = "[A-Z]:/Program Files/Mozilla Thunderbird"
WildDir = "[A-Z]:/Program Files/mozilla.org"
WildDir = "[A-Z]:/Program Files/OpenOffice*"
}
Options {
# Files that we don't want to compress too heavily.
signature = MD5
aclsupport = yes
compression = GZIP1
HFS Plus Support = yes
# compressed archival formats
wild = *.gz
wild = *.gzip
wild = *.tgz
wild = *.tz
wild = *.bz
wild = *.bz2
wild = *.bzip
wild = *.bzip2
wild = *.Z
wild = *.7z
wild = *.zip
wild = *.zipx
wild = *.iso
wild = *.dmg
wild = *.cab
wild = *.rar
wild = *.sea
wild = *.sit
wild = *.sitx
# compressed image formats
wild = *.jpg
wild = *.jpeg
wild = *.gif
wild = *.png
wild = *.bmp
# compressed video formats
wild = *.dv
wild = *.flv
wild = *.m2v
wild = *.mp2
wild = *.mp4
wild = *.mpeg
wild = *.mpg
wild = *.mov
wild = *.qt
wild = *.wmv
# compressed audio formats
wild = *.aac
wild = *.mp3
}
# Cepheus has C: and D: as the main hard drives.
File = "C:/"
File = "D:/"
}
}


What does the following SQL command print?

SELECT MIN(FileIndex), MAX(FileIndex) FROM File WHERE JobId=8295;


bacula=# SELECT MIN(FileIndex), MAX(FileIndex) FROM File WHERE
JobId=8295;
min | max
-----+-----
1 | 988
(1 row)

bacula=#

You could try to compare the list of files printed by

list files jobid=8295

with the output of the bls command for the volume containing that job
(that
will print the files from all jobs on the volume, so you will have to
filter
it).

How do I output the results of the bconsole 'list' command to a file?
I've outputted from the 'bls' command quite easily.

~Doug

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Thu, 2 Feb 2012 13:11:15 -0800, Doug Sampson said:

On Tue, 31 Jan 2012 11:02:59 -0800, Doug Sampson said:

On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4
server
two
weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1
on
device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula
pisces-dir
5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
JobId: 8299
Job:
cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine
each
Saturday.
The daily incremental backups appear to be fine. The
machine
'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to
upgrading
to
5.2.3 on all Bacula devices, there were no errors reported
on
this
instance.

How do I turn on or increase logging to try to identify
the
reason
for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula
should
print

The following files are in the Catalog but not on the
Volume(s):

followed by the list of them.

If not, what is your Message resource in the
bacula-dir.conf?

Whoops. I thought I had copied the entire message for JobId
8299.
I'm
enclosing both JobId 8295 (the original backup job) and JobId
8299
(the
verify job) here:
...
As you can see Bacula does not print anything indicating which
file
is
not on the Volume. Message resource info below:
...
Does these help?

The messages look normal -- I would expect it to list them.

You could try the following SQL commands to get more info about
what
is in
the
catalog for this job:

SELECT COUNT(*) FROM File
WHERE File.JobId=8295;

SELECT COUNT(*) FROM File
WHERE File.JobId=8295 AND File.FileIndex > 0;

SELECT Path.Path,Filename.Name FROM File,Path,Filename
WHERE File.JobId=8295 AND File.FileIndex > 0
AND File.MarkId!=8299 AND File.PathId=Path.PathId
AND File.FilenameId=Filename.FilenameId;



$ psql bacula
Welcome to psql 8.3.16, the PostgreSQL interactive terminal.

Type: \copyright for distribution terms
\h for help with SQL commands
\? for help with psql commands
\g or terminate with semicolon to execute query
\q to quit

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295;
count
-------
988
(1 row)

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0;
count
-------
988
(1 row)

bacula=# SELECT Path.Path,Filename.Name FROM File,Path,Filename
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0
bacula-# AND File.MarkId!=8299 AND File.PathId=Path.PathId
bacula-# AND File.FilenameId=Filename.FilenameId;
path | name
------+------
(0 rows)

bacula=#


Um, so where's the error coming from?

~Doug


The error occurs because Bacula thinks there are 989 files in the
backup,
though only 988 were recorded in the File table.

What is the fileset definition?

# This is my cepheus (W2K3 Server) fileset:
FileSet {
Name = "cepheus"
enable VSS = "yes"
Include {
Options {
signature = MD5
# aclsupport = yes
compression = GZIP6
Exclude = yes
IgnoreCase = yes
# Exclude Mozilla-based programs' file caches
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache"
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache.Trash"
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/ImapMail"
# Exclude user's registry files - they're always in use anyway.
WildFile = "[A-Z]:/Documents and Settings/*/Local
Settings/Application Data/Microsoft/Windows/usrclass.*"
WildFile = "[A-Z]:/Documents and Settings/*/ntuser.*"
# Exclude directories full of lots and lots of useless little files
WildDir = "[A-Z]:/Documents and Settings/*/Cookies"
WildDir = "[A-Z]:/Documents and Settings/*/Recent"
WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/History"
WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/Temp"
WildDir = "[A-Z]:/Documents and Settings/*/Local
Settings/Temporary
Internet Files"
# These are always open and unable to be backed up
WildFile = "[A-Z]:/Documents and Settings/All Users/Application
Data/Microsoft/Network/Downloader/qmgr[01].dat"
# Some random bits of Windows we want to ignore
WildFile = "[A-Z]:/Windows/security/logs/scepol.log"
WildDir = "[A-Z]:/Windows/system32/config"
WildDir = "[A-Z]:/Windows/msdownld.tmp"
WildDir = "[A-Z]:/Windows/Internet Logs"
WildDir = "[A-Z]:/Windows/$Nt*Uninstall*"
WildDir = "[A-Z]:/Windows/sysvol"
WildFile = "[A-Z]:/Windows/cluster/CLUSDB"
WildFile = "[A-Z]:/Windows/cluster/CLUSDB.LOG"
WildFile = "[A-Z]:/Windows/NTDS/edb.log"
WildFile = "[A-Z]:/Windows/NTDS/ntds.dit"
WildFile = "[A-Z]:/Windows/NTDS/temp.edb"
WildFile = "[A-Z]:/Windows/ntfrs/jet/log/edb.log"
WildFile = "[A-Z]:/Windows/ntfrs/jet/ntfrs.jdb"
WildFile = "[A-Z]:/Windows/ntfrs/jet/temp/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/CPL.CFG"
WildFile = "[A-Z]:/Windows/system32/dhcp/dhcp.mdb"
WildFile = "[A-Z]:/Windows/system32/dhcp/j50.log"
WildFile = "[A-Z]:/Windows/system32/dhcp/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/LServer/edb.log"
WildFile = "[A-Z]:/Windows/system32/LServer/TLSLic.edb"
WildFile = "[A-Z]:/Windows/system32/LServer/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/wins/j50.log"
WildFile = "[A-Z]:/Windows/system32/wins/wins.mdb"
WildFile = "[A-Z]:/Windows/system32/wins/winstmp.mdb"
# Temporary directories & files
WildDir = "[A-Z]:/Windows/Temp"
WildDir = "[A-Z]:/[Tt][Ee][Mm][Pp]"
WildFile = "*.tmp"
WildFile = "*.avi"
WildFile = "*.mpg"
WildFile = "*.mpeg"
WildFile = "*.wmv"
WildFile = "*.iso"
WildFile = "*.rmvb"
WildDir = "[A-Z]:/tmp"
WildDir = "[A-Z]:/var/tmp"
# Recycle bins
WildDir = "[A-Z]:/RECYCLER"
# Swap files
WildFile = "[A-Z]:/pagefile.sys"
# These are programs and are easier to reinstall than restore from
backup
WildDir = "[A-Z]:/cygwin"
WildDir = "[A-Z]:/Program Files/Grisoft"
WildDir = "[A-Z]:/Program Files/Java"
WildDir = "[A-Z]:/Program Files/Java Web Start"
WildDir = "[A-Z]:/Program Files/JavaSoft"
WildDir = "[A-Z]:/Program Files/Microsoft Office"
WildDir = "[A-Z]:/Program Files/Mozilla Firefox"
WildDir = "[A-Z]:/Program Files/Mozilla Thunderbird"
WildDir = "[A-Z]:/Program Files/mozilla.org"
WildDir = "[A-Z]:/Program Files/OpenOffice*"
}
Options {
# Files that we don't want to compress too heavily.
signature = MD5
aclsupport = yes
compression = GZIP1
HFS Plus Support = yes
# compressed archival formats
wild = *.gz
wild = *.gzip
wild = *.tgz
wild = *.tz
wild = *.bz
wild = *.bz2
wild = *.bzip
wild = *.bzip2
wild = *.Z
wild = *.7z
wild = *.zip
wild = *.zipx
wild = *.iso
wild = *.dmg
wild = *.cab
wild = *.rar
wild = *.sea
wild = *.sit
wild = *.sitx
# compressed image formats
wild = *.jpg
wild = *.jpeg
wild = *.gif
wild = *.png
wild = *.bmp
# compressed video formats
wild = *.dv
wild = *.flv
wild = *.m2v
wild = *.mp2
wild = *.mp4
wild = *.mpeg
wild = *.mpg
wild = *.mov
wild = *.qt
wild = *.wmv
# compressed audio formats
wild = *.aac
wild = *.mp3
}
# Cepheus has C: and D: as the main hard drives.
File = "C:/"
File = "D:/"
}
}


What does the following SQL command print?

SELECT MIN(FileIndex), MAX(FileIndex) FROM File WHERE JobId=8295;


bacula=# SELECT MIN(FileIndex), MAX(FileIndex) FROM File WHERE
JobId=8295;
min | max
-----+-----
1 | 988
(1 row)

bacula=#

You could try to compare the list of files printed by

list files jobid=8295

with the output of the bls command for the volume containing that
job
(that
will print the files from all jobs on the volume, so you will have
to
filter
it).

How do I output the results of the bconsole 'list' command to a file?
I've outputted from the 'bls' command quite easily.


I forgot to report that the bls output indicated 988 files. So the extra
file should be in the output from the bconsole 'list' command. Correct?

~Doug

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Fri, 3 Feb 2012 14:34:22 -0800, Doug Sampson said:

On Thu, 2 Feb 2012 13:11:15 -0800, Doug Sampson said:

On Tue, 31 Jan 2012 11:02:59 -0800, Doug Sampson said:

On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:

Hello-

Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4
server
two
weeks
ago, I've started seeing this message:

28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1
on
device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula
pisces-dir
5.2.3
(16Dec11):
Build OS: i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
JobId: 8299
Job:
cepheusVerifyData.2012-01-28_06.00.00_15
FileSet: cepheus
Verify Level: VolumeToCatalog
Client: cepheus-fd
Verify JobId: 8295
Verify Job:
Start time: 28-Jan-2012 06:00:00
End time: 28-Jan-2012 06:08:40
Files Expected: 989
Files Examined: 988
Non-fatal FD errors: 0
FD termination status: OK
SD termination status: OK
Termination: *** Verify Error ***

This is for a differential backup of a Windows machine
each
Saturday.
The daily incremental backups appear to be fine. The
machine
'cepheus'
is a Windows 2003 server running Winbacula 5.2.3. Prior to
upgrading
to
5.2.3 on all Bacula devices, there were no errors reported
on
this
instance.

How do I turn on or increase logging to try to identify
the
reason
for
the skip? Or at least identify the file being skipped?

Check the log lines above the ones you posted. Bacula
should
print

The following files are in the Catalog but not on the
Volume(s):

followed by the list of them.

If not, what is your Message resource in the
bacula-dir.conf?

Whoops. I thought I had copied the entire message for JobId
8299.
I'm
enclosing both JobId 8295 (the original backup job) and JobId
8299
(the
verify job) here:
...
As you can see Bacula does not print anything indicating which
file
is
not on the Volume. Message resource info below:
...
Does these help?

The messages look normal -- I would expect it to list them.

You could try the following SQL commands to get more info about
what
is in
the
catalog for this job:

SELECT COUNT(*) FROM File
WHERE File.JobId=8295;

SELECT COUNT(*) FROM File
WHERE File.JobId=8295 AND File.FileIndex > 0;

SELECT Path.Path,Filename.Name FROM File,Path,Filename
WHERE File.JobId=8295 AND File.FileIndex > 0
AND File.MarkId!=8299 AND File.PathId=Path.PathId
AND File.FilenameId=Filename.FilenameId;



$ psql bacula
Welcome to psql 8.3.16, the PostgreSQL interactive terminal.

Type: \copyright for distribution terms
\h for help with SQL commands
\? for help with psql commands
\g or terminate with semicolon to execute query
\q to quit

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295;
count
-------
988
(1 row)

bacula=# SELECT COUNT(*) FROM File
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0;
count
-------
988
(1 row)

bacula=# SELECT Path.Path,Filename.Name FROM File,Path,Filename
bacula-# WHERE File.JobId=8295 AND File.FileIndex > 0
bacula-# AND File.MarkId!=8299 AND File.PathId=Path.PathId
bacula-# AND File.FilenameId=Filename.FilenameId;
path | name
------+------
(0 rows)

bacula=#


Um, so where's the error coming from?

~Doug


The error occurs because Bacula thinks there are 989 files in the
backup,
though only 988 were recorded in the File table.

What is the fileset definition?

# This is my cepheus (W2K3 Server) fileset:
FileSet {
Name = "cepheus"
enable VSS = "yes"
Include {
Options {
signature = MD5
# aclsupport = yes
compression = GZIP6
Exclude = yes
IgnoreCase = yes
# Exclude Mozilla-based programs' file caches
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache"
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache.Trash"
WildDir = "[A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/ImapMail"
# Exclude user's registry files - they're always in use anyway.
WildFile = "[A-Z]:/Documents and Settings/*/Local
Settings/Application Data/Microsoft/Windows/usrclass.*"
WildFile = "[A-Z]:/Documents and Settings/*/ntuser.*"
# Exclude directories full of lots and lots of useless little files
WildDir = "[A-Z]:/Documents and Settings/*/Cookies"
WildDir = "[A-Z]:/Documents and Settings/*/Recent"
WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/History"
WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/Temp"
WildDir = "[A-Z]:/Documents and Settings/*/Local
Settings/Temporary
Internet Files"
# These are always open and unable to be backed up
WildFile = "[A-Z]:/Documents and Settings/All Users/Application
Data/Microsoft/Network/Downloader/qmgr[01].dat"
# Some random bits of Windows we want to ignore
WildFile = "[A-Z]:/Windows/security/logs/scepol.log"
WildDir = "[A-Z]:/Windows/system32/config"
WildDir = "[A-Z]:/Windows/msdownld.tmp"
WildDir = "[A-Z]:/Windows/Internet Logs"
WildDir = "[A-Z]:/Windows/$Nt*Uninstall*"
WildDir = "[A-Z]:/Windows/sysvol"
WildFile = "[A-Z]:/Windows/cluster/CLUSDB"
WildFile = "[A-Z]:/Windows/cluster/CLUSDB.LOG"
WildFile = "[A-Z]:/Windows/NTDS/edb.log"
WildFile = "[A-Z]:/Windows/NTDS/ntds.dit"
WildFile = "[A-Z]:/Windows/NTDS/temp.edb"
WildFile = "[A-Z]:/Windows/ntfrs/jet/log/edb.log"
WildFile = "[A-Z]:/Windows/ntfrs/jet/ntfrs.jdb"
WildFile = "[A-Z]:/Windows/ntfrs/jet/temp/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/CPL.CFG"
WildFile = "[A-Z]:/Windows/system32/dhcp/dhcp.mdb"
WildFile = "[A-Z]:/Windows/system32/dhcp/j50.log"
WildFile = "[A-Z]:/Windows/system32/dhcp/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/LServer/edb.log"
WildFile = "[A-Z]:/Windows/system32/LServer/TLSLic.edb"
WildFile = "[A-Z]:/Windows/system32/LServer/tmp.edb"
WildFile = "[A-Z]:/Windows/system32/wins/j50.log"
WildFile = "[A-Z]:/Windows/system32/wins/wins.mdb"
WildFile = "[A-Z]:/Windows/system32/wins/winstmp.mdb"
# Temporary directories & files
WildDir = "[A-Z]:/Windows/Temp"
WildDir = "[A-Z]:/[Tt][Ee][Mm][Pp]"
WildFile = "*.tmp"
WildFile = "*.avi"
WildFile = "*.mpg"
WildFile = "*.mpeg"
WildFile = "*.wmv"
WildFile = "*.iso"
WildFile = "*.rmvb"
WildDir = "[A-Z]:/tmp"
WildDir = "[A-Z]:/var/tmp"
# Recycle bins
WildDir = "[A-Z]:/RECYCLER"
# Swap files
WildFile = "[A-Z]:/pagefile.sys"
# These are programs and are easier to reinstall than restore from
backup
WildDir = "[A-Z]:/cygwin"
WildDir = "[A-Z]:/Program Files/Grisoft"
WildDir = "[A-Z]:/Program Files/Java"
WildDir = "[A-Z]:/Program Files/Java Web Start"
WildDir = "[A-Z]:/Program Files/JavaSoft"
WildDir = "[A-Z]:/Program Files/Microsoft Office"
WildDir = "[A-Z]:/Program Files/Mozilla Firefox"
WildDir = "[A-Z]:/Program Files/Mozilla Thunderbird"
WildDir = "[A-Z]:/Program Files/mozilla.org"
WildDir = "[A-Z]:/Program Files/OpenOffice*"
}
Options {
# Files that we don't want to compress too heavily.
signature = MD5
aclsupport = yes
compression = GZIP1
HFS Plus Support = yes
# compressed archival formats
wild = *.gz
wild = *.gzip
wild = *.tgz
wild = *.tz
wild = *.bz
wild = *.bz2
wild = *.bzip
wild = *.bzip2
wild = *.Z
wild = *.7z
wild = *.zip
wild = *.zipx
wild = *.iso
wild = *.dmg
wild = *.cab
wild = *.rar
wild = *.sea
wild = *.sit
wild = *.sitx
# compressed image formats
wild = *.jpg
wild = *.jpeg
wild = *.gif
wild = *.png
wild = *.bmp
# compressed video formats
wild = *.dv
wild = *.flv
wild = *.m2v
wild = *.mp2
wild = *.mp4
wild = *.mpeg
wild = *.mpg
wild = *.mov
wild = *.qt
wild = *.wmv
# compressed audio formats
wild = *.aac
wild = *.mp3
}
# Cepheus has C: and D: as the main hard drives.
File = "C:/"
File = "D:/"
}
}

OK, I don't see any problems with the fileset.



What does the following SQL command print?

SELECT MIN(FileIndex), MAX(FileIndex) FROM File WHERE JobId=8295;


bacula=# SELECT MIN(FileIndex), MAX(FileIndex) FROM File WHERE
JobId=8295;
min | max
-----+-----
1 | 988
(1 row)

bacula=#

You could try to compare the list of files printed by

list files jobid=8295

with the output of the bls command for the volume containing that
job
(that
will print the files from all jobs on the volume, so you will have
to
filter
it).

How do I output the results of the bconsole 'list' command to a file?
I've outputted from the 'bls' command quite easily.


Use

< at > output filename
list files jobid=8295
< at > output


I forgot to report that the bls output indicated 988 files. So the extra
file should be in the output from the bconsole 'list' command. Correct?

No, I was expecting bls to show 989 files. The bconsole 'list' command should
match the SQL commands because it uses the same data.

It might be something caused by VSS. What is the output of

SELECT ObjectName, ObjectType, FileIndex
FROM RestoreObject
WHERE JobId=8295;

__Martin

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
How do I output the results of the bconsole 'list' command to a
file?
I've outputted from the 'bls' command quite easily.


Use

< at > output filename
list files jobid=8295
< at > output


Okay, I've learned a thing here! Thanks for the tip.

I've outputted a list of files from this and compared with the bls
output.
Even though the bconsole 'list' files reports 989 lines, there are
actually only 988 lines as far as I can determine. The output between
the
bls output and the list output is identical in every respect except for
the lines of output reported by each. 988 versus 989.

Is this a VSS error?


I forgot to report that the bls output indicated 988 files. So the
extra
file should be in the output from the bconsole 'list' command.
Correct?

No, I was expecting bls to show 989 files. The bconsole 'list'
command
should
match the SQL commands because it uses the same data.

It might be something caused by VSS. What is the output of

SELECT ObjectName, ObjectType, FileIndex
FROM RestoreObject
WHERE JobId=8295;

bacula=# SELECT ObjectName, ObjectType, FileIndex
bacula-# FROM RestoreObject
bacula-# WHERE JobId=8295;
objectname | objecttype | fileindex
------------------+------------+-----------
job_metadata.xml | 25 | 989
(1 row)

bacula=#


How do I output a list of files from this in order to compare?

~Doug

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Mon, 6 Feb 2012 17:48:51 -0800, Doug Sampson said:

I've outputted a list of files from this and compared with the bls
output.
Even though the bconsole 'list' files reports 989 lines, there are
actually only 988 lines as far as I can determine. The output between
the
bls output and the list output is identical in every respect except for
the lines of output reported by each. 988 versus 989.

Is this a VSS error?

It looks like a bug/misfeature in verify of a VSS job. The problem is that
the count of files in a VSS backup includes a special object called
job_metadata.xml, but this isn't a real file so verify can't find it.

I'm not convinced that VolumeToCatalog verify can be used reliably with VSS
jobs anyway though, because it will be verifying the current state rather than
the snapshot. That can lead to false mismatches, even without the
job_metadata.xml issue.

__Martin

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Post missing a file during verification 
On Mon, 6 Feb 2012 17:48:51 -0800, Doug Sampson said:

I've outputted a list of files from this and compared with the bls
output.
Even though the bconsole 'list' files reports 989 lines, there are
actually only 988 lines as far as I can determine. The output
between
the
bls output and the list output is identical in every respect except
for
the lines of output reported by each. 988 versus 989.

Is this a VSS error?

It looks like a bug/misfeature in verify of a VSS job. The problem is
that
the count of files in a VSS backup includes a special object called
job_metadata.xml, but this isn't a real file so verify can't find it.

I'm not convinced that VolumeToCatalog verify can be used reliably
with
VSS
jobs anyway though, because it will be verifying the current state
rather
than
the snapshot. That can lead to false mismatches, even without the
job_metadata.xml issue.


I suspected that but I wanted to work my way through to the end to
confirm that there wasn't any data missing from the backup other than
the job_metedata.xml file. Thanks for your input, Martin- much
appreciated!

~Doug

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB