Backup Central

Hi all,
I have been using Bacula to backup several servers. Recently, the backupcatalog job takes so long to finish. I'm pretty sure it's related to the size of bacula.sql file.
Code:
ls root < at > servername:/var/lib/bacula# ls -l
-rw------- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sql
I've been reading bacula catalog manual here: http://www.bacula.org/3.0.x-manuals/...og/catalog.pdf
and in the 1.2 Compacting Your MySQL Database section, it's talking about compacting the database:
I have been handed this server by the previous IT guy and don't have the info required to access the MySQL database.
This is the part of bacula-dir.conf which has the reference to the bacula.sql:
Code:
# This is the backup of the catalog
FileSet {
Name = "Catalog"
Include {
Options {
signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
}
}
Can someone please let me know how I can compact the bacula database?

Thanks,
h

[b]
[/b]

Excerpts from Honia A's message of Wed Jan 11 13:11:45 -0500 2012:

I have been handed this server by the previous IT guy and don't have
the info required to access the MySQL database.

The mysql password for the account bacula uses should be available to
you in the Catalog stanza of the bacula-dir.conf file (or another file
that it includes). Search for dbpassword.

If you don't have the root password to your mysql instance, you can
reset that by following something like:
http://www.cyberciti.biz/tips/recover-mysql-root-password.html

Thanks
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302


------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Hi Ben,

I found bacula mysql password in bacula-dir.conf file but I think it's encrypted. So can't tell what the password is...

Thanks for the instruction, I reset MySQL root password. Now, would you pelase let me know how I can retrieve bacula db password and also how to compact the size of the bacula.sql?

Thanks,
h
[b]
[/b]



From: bwalton < at > artsci.utoronto.ca
To: bacula-users < at > lists.sourceforge.net
Date: Wed, 11 Jan 2012 13:19:07 -0500
Subject: Re: [Bacula-users] Bacula database is getting too long

Excerpts from Honia A's message of Wed Jan 11 13:11:45 -0500 2012:

I have been handed this server by the previous IT guy and don't have
the info required to access the MySQL database.

The mysql password for the account bacula uses should be available to
you in the Catalog stanza of the bacula-dir.conf file (or another file
that it includes). Search for dbpassword.

If you don't have the root password to your mysql instance, you can
reset that by following something like:
http://www.cyberciti.biz/tips/recover-mysql-root-password.html

Thanks
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302


------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

root < at > servername:/etc/init.d# du -sh /var/lib/mysql/bacula/
814M /var/lib/mysql/bacula/


I just reset MySQL root password but can't really see user bacula's db password in bacula-dir.conf as it appears to be encrypted.

I just followed the instruction found here: http://www.bacula.org/en/dev-manual/main/main/Catalog_Maintenance.html and ran the following commands:


mysqldump -f --opt bacula > bacula.sql
mysql bacula < bacula.sql
rm -f bacula.sql


But when I checked the size of the database it's still really large:


root < at > servername:/var/lib ([email]root < at > servername:/var/lib[/email])# cd bacula
root < at > servername:/var/lib/bacula ([email]root < at > servername:/var/lib/bacula[/email])# ls -l
-rw------- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sql


Maybe I didn't do this correctly?

Please help,

Thank you in advance

[b]
[/b]



From: bwalton < at > artsci.utoronto.ca
To: bacula-users < at > lists.sourceforge.net
Date: Wed, 11 Jan 2012 13:19:07 -0500
Subject: Re: [Bacula-users] Bacula database is getting too long

Excerpts from Honia A's message of Wed Jan 11 13:11:45 -0500 2012:

I have been handed this server by the previous IT guy and don't have
the info required to access the MySQL database.

The mysql password for the account bacula uses should be available to
you in the Catalog stanza of the bacula-dir.conf file (or another file
that it includes). Search for dbpassword.

If you don't have the root password to your mysql instance, you can
reset that by following something like:
http://www.cyberciti.biz/tips/recover-mysql-root-password.html

Thanks
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302


------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Wed, 11 Jan 2012, Honia A wrote:

But when I checked the size of the database it's still really large:

root < at > servername:/var/lib/bacula# ls -l
-rw------- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sql

Depending on what you are backing up, that is not really all that big.
Mine is about 20 times that size.

-s

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

I'm backing up a handful number of Unix boxes, they all get backed up very quickly but we can't access them due to the BackupCatalog job being very slow. When I read online, I see people said it's because of the database size getting larger and larger.

I cancel the backup catalog job and all the servers become accessible. This is the configuration for catalog:

# This is the backup of the catalog
FileSet {
Name = "Catalog"
Include {
Options {
signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
}
}

All backups finish around 5 AM but all the servers remain inaccessible until 8:30 or so. The last job running is that backup job so I thought the process getting slower and slower everyday might have something to do with the size of th ebacula.sql file.



[b]
[/b]



Date: Wed, 11 Jan 2012 14:10:13 -0500
From: smt < at > vgersoft.com
To: bacula-users < at > lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula database is getting too long

On Wed, 11 Jan 2012, Honia A wrote:

But when I checked the size of the database it's still really large:

root < at > servername:/var/lib/bacula# ls -l
-rw------- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sql

Depending on what you are backing up, that is not really all that big.
Mine is about 20 times that size.

-s

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

2012/1/11 Honia A <honia2002 < at > hotmail.com>:
I'm backing up a handful number of Unix boxes, they all get backed up very
quickly but we can't access them due to the BackupCatalog job being very
slow. When I read online, I see people said it's because of the database
size getting larger and larger.

I cancel the backup catalog job and all the servers become accessible. This
is the configuration for catalog:


# This is the backup of the catalog
FileSet {
  Name = "Catalog"
  Include {
    Options {
      signature = MD5
    }
    File = "/var/lib/bacula/bacula.sql"
  }
}


There is really nothing you can do with the bacula config files to change that.


All backups finish around 5 AM but all the servers remain inaccessible until
8:30 or so. The last job running is that backup job so I thought the process
getting slower and slower everyday might have something to do with the size
of th ebacula.sql file.



You really need to tune your mysql database / filesystem the db is on.
My database is ~39GB and the catalog job takes less than 10 minutes to
complete. Although I am using postgres instead of mysql both databases
should be tuned in a lot of cases since the defaults are very low for
for a modern machine with 8GB+ of ram.

John

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Wed, Jan 11, 2012 at 2:45 PM, John Drescher <drescherjm < at > gmail.com> wrote:
2012/1/11 Honia A <honia2002 < at > hotmail.com>:
I'm backing up a handful number of Unix boxes, they all get backed up very
quickly but we can't access them due to the BackupCatalog job being very
slow. When I read online, I see people said it's because of the database
size getting larger and larger.

I cancel the backup catalog job and all the servers become accessible. This
is the configuration for catalog:


# This is the backup of the catalog
FileSet {
  Name = "Catalog"
  Include {
    Options {
      signature = MD5
    }
    File = "/var/lib/bacula/bacula.sql"
  }
}


There is really nothing you can do with the bacula config files to change that.

I forgot a couple of things.

1. You may want to optimize your database and check it with dbcheck.
This will remove orphaned data from the database

2. You may want to reduce your file and job retention periods. This
will clear old metadata out of the database quicker.

John

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On 01/11/12 14:21, Honia A wrote:
I'm backing up a handful number of Unix boxes, they all get backed up
very quickly but we can't access them due to the BackupCatalog job being
very slow. When I read online, I see people said it's because of the
database size getting larger and larger.

200MB is NOTHING. My company has customers with MySQl Dbs approachint 1TB.

Have you looked at your MySQL configuration? I'm going to go out on a
limb here and take a wild guess that your MySQL instance was installed
long ago using a default configuration file, then never upgraded and
never tuned. You don't want to know how many production websites I've
seen trying to run off MySQL instances with "small to medium server"
configuration files that were written back when a "large server" was one
that had more than 32MB of RAM.


--
Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
alaric < at > caerllewys.net alaric < at > metrocast.net phil < at > co.ordinate.org
Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater
It's not the years, it's the mileage.

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Wed, 11 Jan 2012 14:21:52 -0500, Honia A said:

I'm backing up a handful number of Unix boxes, they all get backed up very
quickly but we can't access them due to the BackupCatalog job being very
slow. When I read online, I see people said it's because of the database
size getting larger and larger.

I cancel the backup catalog job and all the servers become accessible. This
is the configuration for catalog:

# This is the backup of the catalog
FileSet {
Name = "Catalog"
Include {
Options {
signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
}
}

All backups finish around 5 AM but all the servers remain inaccessible until
8:30 or so. The last job running is that backup job so I thought the process
getting slower and slower everyday might have something to do with the size
of th ebacula.sql file.

The bacula.sql you showed in your first email was written at 05:23, so it
seems unlikely that Bacula was doing anything at 8:30.

Please post the log output from the BackupCatalog job.

Also, can you describe exactly what you mean by inaccessible?

__Martin

------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Thanks for everyone's helpful responses.

I was handed this backup server which has bacula installed and looks like there was no maintenance work ever done to it. The backupcatalog job is the one with error every morning:
Error 12-Jan-12 05:39 BackupCatalog

I typed the command "messages" in bconsole to get the messages and pasted that below. Is there anywhere else I should be looking to get specifically the logs for backupcatalog?

The mail server's name is Gauss and although I have it setup babar (name of the backup server where has bacula installed) to start at 20:05 every night, the mail server will not be accessible until 8:15 AM and by that I mean people at work cannot get their messages or send messages because the server is not responding.

Thanks in advance for youe help, here's the output of messages:

11-Jan 20:11 babar-dir JobId 1637: Begin pruning Jobs older than 6 months .
11-Jan 20:11 babar-dir JobId 1637: Pruned 1 Job for client athena-fd from catalog.
11-Jan 20:11 babar-dir JobId 1637: Begin pruning Jobs.
11-Jan 20:11 babar-dir JobId 1637: No Files found to prune.
11-Jan 20:11 babar-dir JobId 1637: End auto prune.
11-Jan 20:11 babar-dir JobId 1638: Start Backup JobId 1638, Job=Gauss.2012-01-11_20.05.00_44
11-Jan 20:11 babar-dir JobId 1638: Using Device "GaussFileStorage"
11-Jan 20:18 gauss-fd JobId 1638: DIR and FD clocks differ by 395 seconds, FD automatically compensating.
11-Jan 20:11 babar-sd JobId 1638: Volume "Gauss-0258" previously written, moving to end of data.
11-Jan 20:11 babar-sd JobId 1638: Ready to append to end of Volume "Gauss-0258" size=187238097
11-Jan 20:40 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 20:40 babar-sd JobId 1638: End of medium on Volume "Gauss-0258" Bytes=4,499,994,102 Blocks=69,755 at 11-Jan-2012 20:40.
11-Jan 20:40 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0259". Marking it purged.
11-Jan 20:40 babar-dir JobId 1638: All records pruned from Volume "Gauss-0259"; marking it "Purged"
11-Jan 20:40 babar-dir JobId 1638: Recycled volume "Gauss-0259"
11-Jan 20:40 babar-sd JobId 1638: Labeled new Volume "Gauss-0259" on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 20:40 babar-sd JobId 1638: Wrote label to prelabeled Volume "Gauss-0259" on device "GaussFileStorage" (/home/backup/gauss)
11-Jan 20:40 babar-sd JobId 1638: New volume "Gauss-0259" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 20:40.
11-Jan 21:07 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:07 babar-sd JobId 1638: End of medium on Volume "Gauss-0259" Bytes=4,499,970,069 Blocks=69,754 at 11-Jan-2012 21:07.
11-Jan 21:07 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0260". Marking it purged.
11-Jan 21:07 babar-dir JobId 1638: All records pruned from Volume "Gauss-0260"; marking it "Purged"
11-Jan 21:07 babar-dir JobId 1638: Recycled volume "Gauss-0260"
11-Jan 21:07 babar-sd JobId 1638: Labeled new Volume "Gauss-0260" on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:07 babar-sd JobId 1638: Wrote label to prelabeled Volume "Gauss-0260" on device "GaussFileStorage" (/home/backup/gauss)
11-Jan 21:07 babar-sd JobId 1638: New volume "Gauss-0260" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:07.
11-Jan 21:33 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:33 babar-sd JobId 1638: End of medium on Volume "Gauss-0260" Bytes=4,499,970,013 Blocks=69,754 at 11-Jan-2012 21:33.
11-Jan 21:33 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0261". Marking it purged.
11-Jan 21:33 babar-dir JobId 1638: All records pruned from Volume "Gauss-0261"; marking it "Purged"
11-Jan 21:33 babar-dir JobId 1638: Recycled volume "Gauss-0261"
11-Jan 21:33 babar-sd JobId 1638: Labeled new Volume "Gauss-0261" on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:33 babar-sd JobId 1638: Wrote label to prelabeled Volume "Gauss-0261" on device "GaussFileStorage" (/home/backup/gauss)
11-Jan 21:33 babar-sd JobId 1638: New volume "Gauss-0261" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:33.
11-Jan 21:58 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:58 babar-sd JobId 1638: End of medium on Volume "Gauss-0261" Bytes=4,499,970,051 Blocks=69,754 at 11-Jan-2012 21:58.
11-Jan 21:58 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0262". Marking it purged.
11-Jan 21:58 babar-dir JobId 1638: All records pruned from Volume "Gauss-0262"; marking it "Purged"
11-Jan 21:58 babar-dir JobId 1638: Recycled volume "Gauss-0262"
11-Jan 21:58 babar-sd JobId 1638: Recycled volume "Gauss-0262" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 21:58 babar-sd JobId 1638: New volume "Gauss-0262" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:58.
11-Jan 22:17 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 22:17 babar-sd JobId 1638: End of medium on Volume "Gauss-0262" Bytes=4,499,970,109 Blocks=69,754 at 11-Jan-2012 22:17.
11-Jan 22:17 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0263". Marking it purged.
11-Jan 22:17 babar-dir JobId 1638: All records pruned from Volume "Gauss-0263"; marking it "Purged"
11-Jan 22:17 babar-dir JobId 1638: Recycled volume "Gauss-0263"
11-Jan 22:17 babar-sd JobId 1638: Recycled volume "Gauss-0263" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 22:17 babar-sd JobId 1638: New volume "Gauss-0263" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 22:17.
11-Jan 22:36 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 22:36 babar-sd JobId 1638: End of medium on Volume "Gauss-0263" Bytes=4,499,970,069 Blocks=69,754 at 11-Jan-2012 22:36.
11-Jan 22:36 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0264". Marking it purged.
11-Jan 22:36 babar-dir JobId 1638: All records pruned from Volume "Gauss-0264"; marking it "Purged"
11-Jan 22:36 babar-dir JobId 1638: Recycled volume "Gauss-0264"
11-Jan 22:36 babar-sd JobId 1638: Recycled volume "Gauss-0264" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 22:36 babar-sd JobId 1638: New volume "Gauss-0264" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 22:36.
11-Jan 22:56 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 22:56 babar-sd JobId 1638: End of medium on Volume "Gauss-0264" Bytes=4,499,970,121 Blocks=69,754 at 11-Jan-2012 22:56.
11-Jan 22:56 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0265". Marking it purged.
11-Jan 22:56 babar-dir JobId 1638: All records pruned from Volume "Gauss-0265"; marking it "Purged"
11-Jan 22:56 babar-dir JobId 1638: Recycled volume "Gauss-0265"
11-Jan 22:56 babar-sd JobId 1638: Recycled volume "Gauss-0265" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 22:56 babar-sd JobId 1638: New volume "Gauss-0265" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 22:56.
11-Jan 23:15 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 23:15 babar-sd JobId 1638: End of medium on Volume "Gauss-0265" Bytes=4,499,970,053 Blocks=69,754 at 11-Jan-2012 23:15.
11-Jan 23:15 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0266". Marking it purged.
11-Jan 23:15 babar-dir JobId 1638: All records pruned from Volume "Gauss-0266"; marking it "Purged"
11-Jan 23:15 babar-dir JobId 1638: Recycled volume "Gauss-0266"
11-Jan 23:15 babar-sd JobId 1638: Recycled volume "Gauss-0266" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 23:15 babar-sd JobId 1638: New volume "Gauss-0266" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 23:15.
11-Jan 23:34 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 23:34 babar-sd JobId 1638: End of medium on Volume "Gauss-0266" Bytes=4,499,970,129 Blocks=69,754 at 11-Jan-2012 23:34.
11-Jan 23:34 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0267". Marking it purged.
11-Jan 23:34 babar-dir JobId 1638: All records pruned from Volume "Gauss-0267"; marking it "Purged"
11-Jan 23:34 babar-dir JobId 1638: Recycled volume "Gauss-0267"
11-Jan 23:35 babar-sd JobId 1638: Recycled volume "Gauss-0267" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 23:35 babar-sd JobId 1638: New volume "Gauss-0267" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 23:35.
11-Jan 23:54 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 23:54 babar-sd JobId 1638: End of medium on Volume "Gauss-0267" Bytes=4,499,970,133 Blocks=69,754 at 11-Jan-2012 23:54.
11-Jan 23:54 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0268". Marking it purged.
11-Jan 23:54 babar-dir JobId 1638: All records pruned from Volume "Gauss-0268"; marking it "Purged"
11-Jan 23:54 babar-dir JobId 1638: Recycled volume "Gauss-0268"
11-Jan 23:54 babar-sd JobId 1638: Recycled volume "Gauss-0268" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 23:54 babar-sd JobId 1638: New volume "Gauss-0268" mounted on device "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 23:54.
12-Jan 00:13 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 00:13 babar-sd JobId 1638: End of medium on Volume "Gauss-0268" Bytes=4,499,970,161 Blocks=69,754 at 12-Jan-2012 00:13.
12-Jan 00:13 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0270". Marking it purged.
12-Jan 00:13 babar-dir JobId 1638: All records pruned from Volume "Gauss-0270"; marking it "Purged"
12-Jan 00:13 babar-dir JobId 1638: Recycled volume "Gauss-0270"
12-Jan 00:13 babar-sd JobId 1638: Recycled volume "Gauss-0270" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 00:13 babar-sd JobId 1638: New volume "Gauss-0270" mounted on device "GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 00:13.
12-Jan 00:33 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 00:33 babar-sd JobId 1638: End of medium on Volume "Gauss-0270" Bytes=4,499,970,053 Blocks=69,754 at 12-Jan-2012 00:33.
12-Jan 00:33 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0271". Marking it purged.
12-Jan 00:33 babar-dir JobId 1638: All records pruned from Volume "Gauss-0271"; marking it "Purged"
12-Jan 00:33 babar-dir JobId 1638: Recycled volume "Gauss-0271"
12-Jan 00:33 babar-sd JobId 1638: Recycled volume "Gauss-0271" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 00:33 babar-sd JobId 1638: New volume "Gauss-0271" mounted on device "GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 00:33.
12-Jan 00:52 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 00:52 babar-sd JobId 1638: End of medium on Volume "Gauss-0271" Bytes=4,499,970,105 Blocks=69,754 at 12-Jan-2012 00:52.
12-Jan 00:52 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0272". Marking it purged.
12-Jan 00:52 babar-dir JobId 1638: All records pruned from Volume "Gauss-0272"; marking it "Purged"
12-Jan 00:52 babar-dir JobId 1638: Recycled volume "Gauss-0272"
12-Jan 00:52 babar-sd JobId 1638: Recycled volume "Gauss-0272" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 00:52 babar-sd JobId 1638: New volume "Gauss-0272" mounted on device "GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 00:52.
12-Jan 01:11 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 01:11 babar-sd JobId 1638: End of medium on Volume "Gauss-0272" Bytes=4,499,970,101 Blocks=69,754 at 12-Jan-2012 01:11.
12-Jan 01:11 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0273". Marking it purged.
12-Jan 01:11 babar-dir JobId 1638: All records pruned from Volume "Gauss-0273"; marking it "Purged"
12-Jan 01:11 babar-dir JobId 1638: Recycled volume "Gauss-0273"
12-Jan 01:11 babar-sd JobId 1638: Recycled volume "Gauss-0273" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 01:11 babar-sd JobId 1638: New volume "Gauss-0273" mounted on device "GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 01:11.
12-Jan 01:32 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 01:32 babar-sd JobId 1638: End of medium on Volume "Gauss-0273" Bytes=4,499,970,085 Blocks=69,754 at 12-Jan-2012 01:32.
12-Jan 01:32 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0274". Marking it purged.
12-Jan 01:32 babar-dir JobId 1638: All records pruned from Volume "Gauss-0274"; marking it "Purged"
12-Jan 01:32 babar-dir JobId 1638: Recycled volume "Gauss-0274"
12-Jan 01:32 babar-sd JobId 1638: Recycled volume "Gauss-0274" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 01:32 babar-sd JobId 1638: New volume "Gauss-0274" mounted on device "GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 01:32.
12-Jan 03:20 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 03:20 babar-sd JobId 1638: End of medium on Volume "Gauss-0274" Bytes=4,499,970,097 Blocks=69,754 at 12-Jan-2012 03:20.
12-Jan 03:20 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0275". Marking it purged.
12-Jan 03:20 babar-dir JobId 1638: All records pruned from Volume "Gauss-0275"; marking it "Purged"
12-Jan 03:20 babar-dir JobId 1638: Recycled volume "Gauss-0275"
12-Jan 03:20 babar-sd JobId 1638: Recycled volume "Gauss-0275" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 03:20 babar-sd JobId 1638: New volume "Gauss-0275" mounted on device "GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 03:20.
12-Jan 05:19 babar-sd JobId 1638: User defined maximum volume capacity 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 05:19 babar-sd JobId 1638: End of medium on Volume "Gauss-0275" Bytes=4,499,970,089 Blocks=69,754 at 12-Jan-2012 05:19.
12-Jan 05:19 babar-dir JobId 1638: There are no more Jobs associated with Volume "Gauss-0276". Marking it purged.
12-Jan 05:19 babar-dir JobId 1638: All records pruned from Volume "Gauss-0276"; marking it "Purged"
12-Jan 05:19 babar-dir JobId 1638: Recycled volume "Gauss-0276"
12-Jan 05:19 babar-sd JobId 1638: Recycled volume "Gauss-0276" on device "GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 05:19 babar-sd JobId 1638: New volume "Gauss-0276" mounted on device "GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 05:19.
12-Jan 05:38 babar-sd JobId 1638: Job write elapsed time = 09:26:46, Transfer rate = 2.289 M Bytes/second
12-Jan 05:39 babar-dir JobId 1638: Bacula babar-dir 5.0.1 (24Feb10): 12-Jan-2012 05:39:09
Build OS: x86_64-pc-linux-gnu ubuntu 10.04
JobId: 1638
Job: Gauss.2012-01-11_20.05.00_44
Backup Level: Incremental, since=2012-01-10 20:53:08
Client: "gauss-fd" 3.0.3 (18Oct09) x86_64-unknown-linux-gnu,redhat,
FileSet: "Gauss Daily" 2011-02-02 19:36:55
Pool: "GaussPool" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "GaussFile" (From Job resource)
Scheduled time: 11-Jan-2012 20:05:00
Start time: 11-Jan-2012 20:11:50
End time: 12-Jan-2012 05:39:09
Elapsed time: 9 hours 27 mins 19 secs
Priority: 10
FD Files Written: 5,821
SD Files Written: 5,821
FD Bytes Written: 77,862,544,832 (77.86 GB)
SD Bytes Written: 77,864,636,604 (77.86 GB)
Rate: 2287.5 KB/s
Software Compression: 66.3 %
VSS: no
Encryption: yes
Accurate: no
Volume name(s): Gauss-0258|Gauss-0259|Gauss-0260|Gauss-0261|Gauss-0262|Gauss-0263|Gauss-0264|Gauss-0265|Gauss-0266|Gauss-0267|Gauss-0268|Gauss-0270|Gauss-0271|Gauss-0272|Gauss-0273|Gauss-0274|Gauss-0275|Gauss-0276
Volume Session Id: 73
Volume Session Time: 1325258050
Last Volume Bytes: 1,638,464,512 (1.638 GB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
12-Jan 05:39 babar-dir JobId 1638: Begin pruning Jobs older than 3 months .
12-Jan 05:39 babar-dir JobId 1638: No Jobs found to prune.
12-Jan 05:39 babar-dir JobId 1638: Begin pruning Jobs.
12-Jan 05:39 babar-dir JobId 1638: No Files found to prune.
12-Jan 05:39 babar-dir JobId 1638: End auto prune.
12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob "/etc/bacula/scripts/make_catalog_backup.pl MyCatalog"
12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create /var/lib/bacula/bacula.sql: Permission denied
12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned non-zero status=2. ERR=Child exited with code 2
12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 (24Feb10): 12-Jan-2012 05:39:13
Build OS: x86_64-pc-linux-gnu ubuntu 10.04
JobId: 1639
Job: BackupCatalog.2012-01-11_21.55.00_45
Backup Level: Full
Client: "babar-fd" 5.0.1 (24Feb10) x86_64-pc-linux-gnu,ubuntu,10.04
FileSet: "Catalog" 2011-02-03 01:10:00
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 11-Jan-2012 21:55:00
Start time: 12-Jan-2012 05:39:13
End time: 12-Jan-2012 05:39:13
Elapsed time: 0 secs
Priority: 11
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 B)
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s):
Volume Session Id: 0
Volume Session Time: 0
Last Volume Bytes: 0 (0 B)
Non-fatal FD errors: 1
SD Errors: 0
FD termination status:
SD termination status:
Termination: *** Backup Error ***
12-Jan 08:37 babar-dir JobId 0: Fatal error: bsock.c:135 Unable to connect to Client: applecrisps-fd on applecrisps:9102. ERR=Interrupted system call



[b]
[/b]



Date: Thu, 12 Jan 2012 10:57:56 +0000
From: martin < at > lispworks.com
To: bacula-users < at > lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula database is getting too long

On Wed, 11 Jan 2012 14:21:52 -0500, Honia A said:

I'm backing up a handful number of Unix boxes, they all get backed up very
quickly but we can't access them due to the BackupCatalog job being very
slow. When I read online, I see people said it's because of the database
size getting larger and larger.

I cancel the backup catalog job and all the servers become accessible. This
is the configuration for catalog:

# This is the backup of the catalog
FileSet {
Name = "Catalog"
Include {
Options {
signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
}
}

All backups finish around 5 AM but all the servers remain inaccessible until
8:30 or so. The last job running is that backup job so I thought the process
getting slower and slower everyday might have something to do with the size
of th ebacula.sql file.

The bacula.sql you showed in your first email was written at 05:23, so it
seems unlikely that Bacula was doing anything at 8:30.

Please post the log output from the BackupCatalog job.

Also, can you describe exactly what you mean by inaccessible?

__Martin

------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

2012/1/12 Honia A <honia2002 < at > hotmail.com>:
Thanks for everyone's  helpful responses.

I was handed this backup server which has bacula installed and looks like
there was no maintenance work ever done to it. The backupcatalog job is the
one with error every morning:
Error    12-Jan-12 05:39 BackupCatalog

I typed the command "messages" in bconsole to get the messages and
pasted that below. Is there anywhere else I should be looking to get
specifically the logs for backupcatalog?

The mail server's name is Gauss and although I have it setup babar (name of
the backup server where has bacula installed) to start at 20:05 every night,
the mail server will not be accessible until 8:15 AM and by that I mean
people at work cannot get their messages or send messages because the server
is not responding.

Thanks in advance for youe help, here's the output of messages:

11-Jan 20:11 babar-dir JobId 1637: Begin pruning Jobs older than 6 months .
11-Jan 20:11 babar-dir JobId 1637: Pruned 1 Job for client athena-fd from
catalog.
11-Jan 20:11 babar-dir JobId 1637: Begin pruning Jobs.
11-Jan 20:11 babar-dir JobId 1637: No Files found to prune.
11-Jan 20:11 babar-dir JobId 1637: End auto prune.
11-Jan 20:11 babar-dir JobId 1638: Start Backup JobId 1638,
Job=Gauss.2012-01-11_20.05.00_44
11-Jan 20:11 babar-dir JobId 1638: Using Device "GaussFileStorage"
11-Jan 20:18 gauss-fd JobId 1638: DIR and FD clocks differ by 395 seconds,
FD automatically compensating.
11-Jan 20:11 babar-sd JobId 1638: Volume "Gauss-0258" previously written,
moving to end of data.
11-Jan 20:11 babar-sd JobId 1638: Ready to append to end of Volume
"Gauss-0258" size=187238097
11-Jan 20:40 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 20:40 babar-sd JobId 1638: End of medium on Volume "Gauss-0258"
Bytes=4,499,994,102 Blocks=69,755 at 11-Jan-2012 20:40.
11-Jan 20:40 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0259". Marking it purged.
11-Jan 20:40 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0259"; marking it "Purged"
11-Jan 20:40 babar-dir JobId 1638: Recycled volume "Gauss-0259"
11-Jan 20:40 babar-sd JobId 1638: Labeled new Volume "Gauss-0259" on device
"GaussFileStorage" (/home/backup/gauss).
11-Jan 20:40 babar-sd JobId 1638: Wrote label to prelabeled Volume
"Gauss-0259" on device "GaussFileStorage" (/home/backup/gauss)
11-Jan 20:40 babar-sd JobId 1638: New volume "Gauss-0259" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 20:40.
11-Jan 21:07 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:07 babar-sd JobId 1638: End of medium on Volume "Gauss-0259"
Bytes=4,499,970,069 Blocks=69,754 at 11-Jan-2012 21:07.
11-Jan 21:07 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0260". Marking it purged.
11-Jan 21:07 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0260"; marking it "Purged"
11-Jan 21:07 babar-dir JobId 1638: Recycled volume "Gauss-0260"
11-Jan 21:07 babar-sd JobId 1638: Labeled new Volume "Gauss-0260" on device
"GaussFileStorage" (/home/backup/gauss).
11-Jan 21:07 babar-sd JobId 1638: Wrote label to prelabeled Volume
"Gauss-0260" on device "GaussFileStorage" (/home/backup/gauss)
11-Jan 21:07 babar-sd JobId 1638: New volume "Gauss-0260" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:07.
11-Jan 21:33 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:33 babar-sd JobId 1638: End of medium on Volume "Gauss-0260"
Bytes=4,499,970,013 Blocks=69,754 at 11-Jan-2012 21:33.
11-Jan 21:33 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0261". Marking it purged.
11-Jan 21:33 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0261"; marking it "Purged"
11-Jan 21:33 babar-dir JobId 1638: Recycled volume "Gauss-0261"
11-Jan 21:33 babar-sd JobId 1638: Labeled new Volume "Gauss-0261" on device
"GaussFileStorage" (/home/backup/gauss).
11-Jan 21:33 babar-sd JobId 1638: Wrote label to prelabeled Volume
"Gauss-0261" on device "GaussFileStorage" (/home/backup/gauss)
11-Jan 21:33 babar-sd JobId 1638: New volume "Gauss-0261" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:33.
11-Jan 21:58 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 21:58 babar-sd JobId 1638: End of medium on Volume "Gauss-0261"
Bytes=4,499,970,051 Blocks=69,754 at 11-Jan-2012 21:58.
11-Jan 21:58 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0262". Marking it purged.
11-Jan 21:58 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0262"; marking it "Purged"
11-Jan 21:58 babar-dir JobId 1638: Recycled volume "Gauss-0262"
11-Jan 21:58 babar-sd JobId 1638: Recycled volume "Gauss-0262" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 21:58 babar-sd JobId 1638: New volume "Gauss-0262" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:58.
11-Jan 22:17 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 22:17 babar-sd JobId 1638: End of medium on Volume "Gauss-0262"
Bytes=4,499,970,109 Blocks=69,754 at 11-Jan-2012 22:17.
11-Jan 22:17 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0263". Marking it purged.
11-Jan 22:17 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0263"; marking it "Purged"
11-Jan 22:17 babar-dir JobId 1638: Recycled volume "Gauss-0263"
11-Jan 22:17 babar-sd JobId 1638: Recycled volume "Gauss-0263" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 22:17 babar-sd JobId 1638: New volume "Gauss-0263" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 22:17.
11-Jan 22:36 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 22:36 babar-sd JobId 1638: End of medium on Volume "Gauss-0263"
Bytes=4,499,970,069 Blocks=69,754 at 11-Jan-2012 22:36.
11-Jan 22:36 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0264". Marking it purged.
11-Jan 22:36 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0264"; marking it "Purged"
11-Jan 22:36 babar-dir JobId 1638: Recycled volume "Gauss-0264"
11-Jan 22:36 babar-sd JobId 1638: Recycled volume "Gauss-0264" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 22:36 babar-sd JobId 1638: New volume "Gauss-0264" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 22:36.
11-Jan 22:56 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 22:56 babar-sd JobId 1638: End of medium on Volume "Gauss-0264"
Bytes=4,499,970,121 Blocks=69,754 at 11-Jan-2012 22:56.
11-Jan 22:56 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0265". Marking it purged.
11-Jan 22:56 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0265"; marking it "Purged"
11-Jan 22:56 babar-dir JobId 1638: Recycled volume "Gauss-0265"
11-Jan 22:56 babar-sd JobId 1638: Recycled volume "Gauss-0265" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 22:56 babar-sd JobId 1638: New volume "Gauss-0265" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 22:56.
11-Jan 23:15 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 23:15 babar-sd JobId 1638: End of medium on Volume "Gauss-0265"
Bytes=4,499,970,053 Blocks=69,754 at 11-Jan-2012 23:15.
11-Jan 23:15 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0266". Marking it purged.
11-Jan 23:15 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0266"; marking it "Purged"
11-Jan 23:15 babar-dir JobId 1638: Recycled volume "Gauss-0266"
11-Jan 23:15 babar-sd JobId 1638: Recycled volume "Gauss-0266" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 23:15 babar-sd JobId 1638: New volume "Gauss-0266" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 23:15.
11-Jan 23:34 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 23:34 babar-sd JobId 1638: End of medium on Volume "Gauss-0266"
Bytes=4,499,970,129 Blocks=69,754 at 11-Jan-2012 23:34.
11-Jan 23:34 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0267". Marking it purged.
11-Jan 23:34 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0267"; marking it "Purged"
11-Jan 23:34 babar-dir JobId 1638: Recycled volume "Gauss-0267"
11-Jan 23:35 babar-sd JobId 1638: Recycled volume "Gauss-0267" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 23:35 babar-sd JobId 1638: New volume "Gauss-0267" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 23:35.
11-Jan 23:54 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
11-Jan 23:54 babar-sd JobId 1638: End of medium on Volume "Gauss-0267"
Bytes=4,499,970,133 Blocks=69,754 at 11-Jan-2012 23:54.
11-Jan 23:54 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0268". Marking it purged.
11-Jan 23:54 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0268"; marking it "Purged"
11-Jan 23:54 babar-dir JobId 1638: Recycled volume "Gauss-0268"
11-Jan 23:54 babar-sd JobId 1638: Recycled volume "Gauss-0268" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
11-Jan 23:54 babar-sd JobId 1638: New volume "Gauss-0268" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 23:54.
12-Jan 00:13 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 00:13 babar-sd JobId 1638: End of medium on Volume "Gauss-0268"
Bytes=4,499,970,161 Blocks=69,754 at 12-Jan-2012 00:13.
12-Jan 00:13 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0270". Marking it purged.
12-Jan 00:13 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0270"; marking it "Purged"
12-Jan 00:13 babar-dir JobId 1638: Recycled volume "Gauss-0270"
12-Jan 00:13 babar-sd JobId 1638: Recycled volume "Gauss-0270" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 00:13 babar-sd JobId 1638: New volume "Gauss-0270" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 00:13.
12-Jan 00:33 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 00:33 babar-sd JobId 1638: End of medium on Volume "Gauss-0270"
Bytes=4,499,970,053 Blocks=69,754 at 12-Jan-2012 00:33.
12-Jan 00:33 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0271". Marking it purged.
12-Jan 00:33 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0271"; marking it "Purged"
12-Jan 00:33 babar-dir JobId 1638: Recycled volume "Gauss-0271"
12-Jan 00:33 babar-sd JobId 1638: Recycled volume "Gauss-0271" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 00:33 babar-sd JobId 1638: New volume "Gauss-0271" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 00:33.
12-Jan 00:52 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 00:52 babar-sd JobId 1638: End of medium on Volume "Gauss-0271"
Bytes=4,499,970,105 Blocks=69,754 at 12-Jan-2012 00:52.
12-Jan 00:52 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0272". Marking it purged.
12-Jan 00:52 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0272"; marking it "Purged"
12-Jan 00:52 babar-dir JobId 1638: Recycled volume "Gauss-0272"
12-Jan 00:52 babar-sd JobId 1638: Recycled volume "Gauss-0272" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 00:52 babar-sd JobId 1638: New volume "Gauss-0272" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 00:52.
12-Jan 01:11 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 01:11 babar-sd JobId 1638: End of medium on Volume "Gauss-0272"
Bytes=4,499,970,101 Blocks=69,754 at 12-Jan-2012 01:11.
12-Jan 01:11 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0273". Marking it purged.
12-Jan 01:11 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0273"; marking it "Purged"
12-Jan 01:11 babar-dir JobId 1638: Recycled volume "Gauss-0273"
12-Jan 01:11 babar-sd JobId 1638: Recycled volume "Gauss-0273" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 01:11 babar-sd JobId 1638: New volume "Gauss-0273" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 01:11.
12-Jan 01:32 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 01:32 babar-sd JobId 1638: End of medium on Volume "Gauss-0273"
Bytes=4,499,970,085 Blocks=69,754 at 12-Jan-2012 01:32.
12-Jan 01:32 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0274". Marking it purged.
12-Jan 01:32 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0274"; marking it "Purged"
12-Jan 01:32 babar-dir JobId 1638: Recycled volume "Gauss-0274"
12-Jan 01:32 babar-sd JobId 1638: Recycled volume "Gauss-0274" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 01:32 babar-sd JobId 1638: New volume "Gauss-0274" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 01:32.
12-Jan 03:20 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 03:20 babar-sd JobId 1638: End of medium on Volume "Gauss-0274"
Bytes=4,499,970,097 Blocks=69,754 at 12-Jan-2012 03:20.
12-Jan 03:20 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0275". Marking it purged.
12-Jan 03:20 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0275"; marking it "Purged"
12-Jan 03:20 babar-dir JobId 1638: Recycled volume "Gauss-0275"
12-Jan 03:20 babar-sd JobId 1638: Recycled volume "Gauss-0275" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 03:20 babar-sd JobId 1638: New volume "Gauss-0275" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 03:20.
12-Jan 05:19 babar-sd JobId 1638: User defined maximum volume capacity
4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss).
12-Jan 05:19 babar-sd JobId 1638: End of medium on Volume "Gauss-0275"
Bytes=4,499,970,089 Blocks=69,754 at 12-Jan-2012 05:19.
12-Jan 05:19 babar-dir JobId 1638: There are no more Jobs associated with
Volume "Gauss-0276". Marking it purged.
12-Jan 05:19 babar-dir JobId 1638: All records pruned from Volume
"Gauss-0276"; marking it "Purged"
12-Jan 05:19 babar-dir JobId 1638: Recycled volume "Gauss-0276"
12-Jan 05:19 babar-sd JobId 1638: Recycled volume "Gauss-0276" on device
"GaussFileStorage" (/home/backup/gauss), all previous data lost.
12-Jan 05:19 babar-sd JobId 1638: New volume "Gauss-0276" mounted on device
"GaussFileStorage" (/home/backup/gauss) at 12-Jan-2012 05:19.
12-Jan 05:38 babar-sd JobId 1638: Job write elapsed time = 09:26:46,
Transfer rate = 2.289 M Bytes/second
12-Jan 05:39 babar-dir JobId 1638: Bacula babar-dir 5.0.1 (24Feb10):
12-Jan-2012 05:39:09
  Build OS:               x86_64-pc-linux-gnu ubuntu 10.04
  JobId:                  1638
  Job:                    Gauss.2012-01-11_20.05.00_44
  Backup Level:           Incremental, since=2012-01-10 20:53:08
  Client:                 "gauss-fd" 3.0.3 (18Oct09)
x86_64-unknown-linux-gnu,redhat,
  FileSet:                "Gauss Daily" 2011-02-02 19:36:55
  Pool:                   "GaussPool" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "GaussFile" (From Job resource)
  Scheduled time:         11-Jan-2012 20:05:00
  Start time:             11-Jan-2012 20:11:50
  End time:               12-Jan-2012 05:39:09
  Elapsed time:           9 hours 27 mins 19 secs
  Priority:               10
  FD Files Written:       5,821
  SD Files Written:       5,821
  FD Bytes Written:       77,862,544,832 (77.86 GB)
  SD Bytes Written:       77,864,636,604 (77.86 GB)
  Rate:                   2287.5 KB/s
  Software Compression:   66.3 %
  VSS:                    no
  Encryption:             yes
  Accurate:               no
  Volume name(s):
Gauss-0258|Gauss-0259|Gauss-0260|Gauss-0261|Gauss-0262|Gauss-0263|Gauss-0264|Gauss-0265|Gauss-0266|Gauss-0267|Gauss-0268|Gauss-0270|Gauss-0271|Gauss-0272|Gauss-0273|Gauss-0274|Gauss-0275|Gauss-0276
  Volume Session Id:      73
  Volume Session Time:    1325258050
  Last Volume Bytes:      1,638,464,512 (1.638 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

The "Gauss Daily" job you did took 9 hours and 27 minutes.

12-Jan 05:39 babar-dir JobId 1638: Begin pruning Jobs older than 3 months .
12-Jan 05:39 babar-dir JobId 1638: No Jobs found to prune.
12-Jan 05:39 babar-dir JobId 1638: Begin pruning Jobs.
12-Jan 05:39 babar-dir JobId 1638: No Files found to prune.
12-Jan 05:39 babar-dir JobId 1638: End auto prune.
12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob
"/etc/bacula/scripts/make_catalog_backup.pl MyCatalog"
12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create
/var/lib/bacula/bacula.sql: Permission denied
12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned
non-zero status=2. ERR=Child exited with code 2
12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 (24Feb10):
12-Jan-2012 05:39:13
  Build OS:               x86_64-pc-linux-gnu ubuntu 10.04
  JobId:                  1639
  Job:                    BackupCatalog.2012-01-11_21.55.00_45
  Backup Level:           Full
  Client:                 "babar-fd" 5.0.1 (24Feb10)
x86_64-pc-linux-gnu,ubuntu,10.04
  FileSet:                "Catalog" 2011-02-03 01:10:00
  Pool:                   "File" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "File" (From Job resource)
  Scheduled time:         11-Jan-2012 21:55:00
  Start time:             12-Jan-2012 05:39:13
  End time:               12-Jan-2012 05:39:13
  Elapsed time:           0 secs
  Priority:               11
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               no
  Volume name(s):
  Volume Session Id:      0
  Volume Session Time:    0
  Last Volume Bytes:      0 (0 B)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:
  SD termination status:
  Termination:            *** Backup Error ***
12-Jan 08:37 babar-dir JobId 0: Fatal error: bsock.c:135 Unable to connect
to Client: applecrisps-fd on applecrisps:9102. ERR=Interrupted system call


That shows your catalog backup took 0 seconds because the fd for some
reason was down.

John

------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

The backup catalog did not run because of a permission denied error on
the /var/lib/bacula/ folder.

12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob
"/etc/bacula/scripts/make_catalog_backup.pl MyCatalog"
12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create
/var/lib/bacula/bacula.sql: Permission denied
12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned
non-zero status=2. ERR=Child exited with code 2
12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 (24Feb10):

------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Thu, 12 Jan 2012 09:29:47 -0500, Honia A said:

The mail server's name is Gauss and although I have it setup babar (name of
the backup server where has bacula installed) to start at 20:05 every night,
the mail server will not be accessible until 8:15 AM and by that I mean
people at work cannot get their messages or send messages because the server
is not responding.

This is very unlikely to be caused by Bacula.

__Martin

------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Excerpts from Martin Simmons's message of Thu Jan 12 10:25:02 -0500 2012:

The mail server's name is Gauss and although I have it setup babar
(name of the backup server where has bacula installed) to start at
20:05 every night, the mail server will not be accessible until
8:15 AM and by that I mean people at work cannot get their
messages or send messages because the server is not responding.

This is very unlikely to be caused by Bacula.

Agreed, but if there are, say, network issues, bacula could exacerbate
a problem that flies under the radar during normal operation. I'd be
checking the network settings on every device from the NIC to the
backup server and running some performance tools while bacula is not
active to see if you experience the same degradation.

HTH
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302


------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users