Backup Central

Hi,
I have some trouble with a copy job from disk to tape.

After months of tests I'm able to run a copy job:

14-Jun 15:43 b01-dir JobId 16002: The following 1 JobId was chosen to be
copied: 14334
14-Jun 15:43 b01-dir JobId 16002: Copying using JobId=14334
Job=myclient-job.2012-05-06_00.30.01_26
14-Jun 15:43 b01-dir JobId 16002: Bootstrap records written
to /var/lib/bacula/b01-dir.restore.1.bsr
14-Jun 15:43 b01-dir JobId 16002: Start Copying JobId 16002,
Job=myclient-TapeCopyFull.2012-06-14_15.43.08_03
14-Jun 15:43 b01-dir JobId 16002: Using Device "TL2000-LTO4-1"
14-Jun 15:43 b01-sd JobId 16002: Ready to read from volume
"20120506_0150-myclient-full" on device
"myclient-FileStorage" (/var/bacula/backups/clients/myclient).
14-Jun 15:43 b01-sd JobId 16002: Forward spacing Volume
"20120506_0150-myclient-full" to file:block 0:245.
14-Jun 15:44 b01-sd JobId 16002: End of Volume at file 1 on device
"myclient-FileStorage" (/var/bacula/backups/clients/myclient), Volume
"20120506_0150-myclient-full"
14-Jun 15:44 b01-sd JobId 16002: End of all volumes.
14-Jun 15:45 b01-dir JobId 16002: Bacula b01-dir 5.0.2 (28Apr10):
14-Jun-2012 15:45:28
Build OS: x86_64-pc-linux-gnu debian squeeze/sid
Prev Backup JobId: 14334
Prev Backup Job: myclient-job.2012-05-06_00.30.01_26
New Backup JobId: 16003
Current JobId: 16002
Current Job: myclient-TapeCopyFull.2012-06-14_15.43.08_03
Backup Level: Full
Client: b01-fd
FileSet: "None" 2012-04-27 10:18:31
Read Pool: "myclient-FullPool" (From Job resource)
Read Storage: "myclient-Storage" (From Job resource)
Write Pool: "TapeFullPool" (From Job Pool's NextPool
resource)
Write Storage: "Libreria DELL TL2000" (From Storage from
Pool's NextPool resource)
Catalog: "MY_Catalog" (From Client resource)
Start time: 14-Jun-2012 15:43:10
End time: 14-Jun-2012 15:45:28
Elapsed time: 2 mins 18 secs
Priority: 11
SD Files Written: 178,215
SD Bytes Written: 4,929,778,080 (4.929 GB)
Rate: 35723.0 KB/s
Volume name(s): 001003L4
Volume Session Id: 4
Volume Session Time: 1339677455
Last Volume Bytes: 11,580,871,680 (11.58 GB)
SD Errors: 0
SD termination status: OK
Termination: Copying OK

14-Jun 15:45 b01-dir JobId 16002: Begin pruning Jobs older than 6
months .
14-Jun 15:45 b01-dir JobId 16002: No Jobs found to prune.
14-Jun 15:45 b01-dir JobId 16002: Begin pruning Jobs.
14-Jun 15:45 b01-dir JobId 16002: No Files found to prune.
14-Jun 15:45 b01-dir JobId 16002: End auto prune.




Seems to be all OK, but how can I ensure that these files was
copied properly to the tape library?

35723.0 KB/s seems a bit too high for an LTO4 tape.

How can I verify the copy? Can I list the contents of my tapes?




------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Thu, 14 Jun 2012 16:29:58 +0200
Gandalf Corvotempesta <newsletter-ale < at > guest.net> wrote:

[...]
How can I verify the copy? Can I list the contents of my tapes?
Sure: `bls` to list the tape contents and `bextract` to fetch something
for test.

Note that `bextract` is *very* slow unless you feed it with a
bootstrap file generated by your backup job (assuming the tape has many
jobs).

`bls` is also slow--on my LTO-4 drive connected via fiber channel to
the host, its full run through one tape (with quite many jobs and very
large number of (small) files) it takes more than 2 hours to complete,
so be prepared.

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Il 14/06/2012 16:29, Gandalf Corvotempesta ha scritto:
How can I verify the copy? Can I list the contents of my tapes?
Maybe you can use bscan to scan the tape, the tool returns a DB
resultset normally used to retrive tape content due to recover a pruned job.

Simone


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Thu, Jun 14, 2012 at 1:03 PM, Konstantin Khomoutov
<flatworm < at > users.sourceforge.net> wrote:
On Thu, 14 Jun 2012 16:29:58 +0200
Gandalf Corvotempesta <newsletter-ale < at > guest.net> wrote:

[...]
How can I verify the copy? Can I list the contents of my tapes?
Sure: `bls` to list the tape contents and `bextract` to fetch something
for test.

Note that `bextract` is *very* slow unless you feed it with a
bootstrap file generated by your backup job (assuming the tape has many
jobs).

`bls` is also slow--on my LTO-4 drive connected via fiber channel to
the host, its full run through one tape (with quite many jobs and very
large number of (small) files) it takes more than 2 hours to complete,
so be prepared.


Also there is a verify command that allows you to compare the tape to
the database and the filesystem to the database however I believe
these did not work as expected until bacula-5.2.X. What I mean by did
not work as expected was bacula always verified the last job on the
client even though you selected some other job.

John

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Il giorno gio, 14/06/2012 alle 21.03 +0400, Konstantin Khomoutov ha
scritto:
Sure: `bls` to list the tape contents and `bextract` to fetch something
for test.

Ok, i'll try in this way.
And how can I restore a file from a tapeset, in case of backup server
failure?

Actually i'm doing a copy job from a full set stored on disk to a tape
library. In case i'll loose my disk-based storage, how can I restore a
single file or a whole set from the tape?

Can I do this from bconsole using "restore" command? Actually I can't
see any copied job from bconsole's restore procedure.


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Ok, i'll try in this way.
And how can I restore a file from a tapeset, in case of backup server
failure?


bextract or bscan entire database + normal restore


Actually i'm doing a copy job from a full set stored on disk to a tape
library. In case i'll loose my disk-based storage, how can I restore a
single file or a whole set from the tape?

Again
bextract or bscan entire database + normal restore

Can I do this from bconsole using "restore" command? Actually I can't
see any copied job from bconsole's restore procedure.

I believe if you used bscan on the tape you can restore it from
bconsole. However I am not sure what happens if the disk records for
the job exist in the database.

John

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Il giorno ven, 15/06/2012 alle 04.57 -0400, John Drescher ha scritto:
bextract or bscan entire database + normal restore

So, to restore from a tape i'll have to rescan the whole library
and then restore it as usual?

It's very time consuming, why bacula doesn't update it's catalog
with files wrote on tape to avoit a full scan?

Another question:
actually, during a running copy job I see:

Running Jobs:
Console connected at 15-Jun-12 10:30
JobId Level Name Status
======================================================================
16056 Full myclient-TapeCopyFull.2012-06-15_10.29.43_03 is running
16057 Increme myclient-job.2012-06-15_10.29.43_04 is running
====

job 16056 is ok, but job 16057 should be Full and not Incremental.

I have a selection pattern like this:

Selection Pattern = "SELECT * FROM Job WHERE (EndTime BETWEEN NOW() -
INTERVAL 40 DAY AND NOW()) AND Type = 'B' AND Level = 'F' AND (JobStatus
= 'e' OR JobStatus = 'T') AND Name = 'myclient-job' GROUP BY Name;"

This query is ok, i can get the latest FULL backup but bacula still
shown "incremental".

Is this ok?


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Fri, Jun 15, 2012 at 5:11 AM, Gandalf Corvotempesta
<newsletter-ale < at > guest.net> wrote:
Il giorno ven, 15/06/2012 alle 04.57 -0400, John Drescher ha scritto:
bextract or bscan entire database + normal restore

So, to restore from a tape i'll have to rescan the whole library
and then restore it as usual?

If you lost your database in the server going down you would need to
bscan or at least bextract a backup of the database. If you did not
loose the catalog you may be able to make the copy restorable without
bscan as the manual suggests.

http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html

It seems you need to purge the disk volumes and the tapes will become
restorable. However I have not tried that.

John

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Fri, Jun 15, 2012 at 11:11:26AM +0200, Gandalf Corvotempesta wrote:
Il giorno ven, 15/06/2012 alle 04.57 -0400, John Drescher ha scritto:
bextract or bscan entire database + normal restore

So, to restore from a tape i'll have to rescan the whole library
and then restore it as usual?

It's very time consuming, why bacula doesn't update it's catalog
with files wrote on tape to avoit a full scan?


The recommended procedure is to dump your bacula db offsite (or to
another host) after the backups complete. When you lose your
backup-server or your database, recovering the current bacula state is
just a mysql < dump.sql away.


Another question:
actually, during a running copy job I see:

Running Jobs:
Console connected at 15-Jun-12 10:30
JobId Level Name Status
======================================================================
16056 Full myclient-TapeCopyFull.2012-06-15_10.29.43_03 is running
16057 Increme myclient-job.2012-06-15_10.29.43_04 is running
====

job 16056 is ok, but job 16057 should be Full and not Incremental.


I think this is normal, my copy jobs show up as "incremental", too.


All the best, Uwe



------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Il giorno ven, 15/06/2012 alle 11.32 +0200, Uwe Schuerkamp ha scritto:
The recommended procedure is to dump your bacula db offsite (or to
another host) after the backups complete. When you lose your
backup-server or your database, recovering the current bacula state is
just a mysql < dump.sql away.

Ok.

I think this is normal, my copy jobs show up as "incremental", too.

Perfect.

Now I have another issue.

I've set:

Write Bootstrap =
"/var/bacula/backups/clients/myclient/myclient-tape.bsr"

But bootstrap file is not created after a succesful backup
and from the log I see:

15-Jun 10:29 b01-dir JobId 16056: Bootstrap records written
to /var/lib/bacula/b01-dir.restore.1.bsr

but even this file does not exist.

Is not possibile to specify a bootstrap file in a copyjob?


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users