Backup Central

Sorry, forgot the title in my former message. Here it goes again.

Hi list,

Here's my setup :
DIR, SD and FD are on different virtual machines. They are debian squeeze vservers (all of them). Until recently, we were running 2.4.4.1 (lenny) and everything was fine. I had to update some servers in squeeze, so I also created new virtual machines and configured them with bacula (DIR/SD), version 5.0.2-2.2+b1 and configured my clients with the corresponding FD.

Now the problem :

When executing a backup for big servers (100 Gb +), I get this error :

Fatal error: sql_create.c:800 sql_create.c:800 insert -- followed by the mysql query.

Then :

Fatal error: catreq.c:497 attribute create error. sql_find.c:376 Request for Volume item 1 greater than max 0 or less than 1
13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error: Network error with FD during Backup: ERR=Interrupted system call
13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error: No Job status returned from FD.
13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error: sql_get.c:373 sql_get.c:373 query SELECT VolumeName,MAX(VolIndex) FROM JobMedia,Media WHERE JobMedia.JobId=170 AND JobMedia.MediaId=Media.MediaId GROUP BY VolumeName ORDER BY 2 ASC failed:
Got error 28 from storage engine

I did read the faq and added

wait_timeout=691200
interactive_timeout=691200

To my.cnf.

I also added HearbeatInterval = 1 min

to bacula-sd.conf and bacula-fd.conf (on the vserver that had problems).

But still no go. Backup runs for about 15 minutes and then hangs with this error.

I have increased other my.cnf params :

key_buffer              = 64M
max_allowed_packet      = 16M
thread_stack            = 192K
thread_cache_size       = 8
# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
myisam-recover         = BACKUP
max_connections        = 100
table_cache            = 256
thread_concurrency     = 10

But still nothing.

Any idea would be very much appreciated since I've got no backup now for most of my servers...

Thanks!

On Wed, Jun 13, 2012 at 10:37:45PM +0200, Jean-François Leroux wrote:

wait_timeout=691200
interactive_timeout=691200

To my.cnf.

I also added HearbeatInterval = 1 min

to bacula-sd.conf and bacula-fd.conf (on the vserver that had problems).

But still no go. Backup runs for about 15 minutes and then hangs with this
error.

Hi,

does the backup *always* crash after 15 minutes? What's the value of
tcp_keepalive_timeout on the systems involved?

I'm asking because recently we had a weird effect where a backup of a
windows client would start off just fine, but simply die after the
amount of seconds for tcp_keepalive_time + 2 secs or so.

Any firewalls involved in the communication among the vservers?

Can you ssh into the other servers from the director without the idle
ssh sessions timing out on you?

All the best, Uwe

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Jean-François Leroux <leroux.jeanfrancois <at> gmail.com> writes:



Sorry, forgot the title in my former message. Here it goes again.Hi
list,Here's my setup : DIR, SD and FD are on different
virtual machines. They are debian squeeze vservers (all of them). Until
recently, we were running 2.4.4.1 (lenny) and everything was fine. I had
to update some servers in squeeze, so I also created new virtual
machines and configured them with bacula (DIR/SD), version 5.0.2-2.2+b1
and configured my clients with the corresponding FD.Now the problem :When
executing a backup for big servers (100 Gb +), I get this error :Fatal error:
sql_create.c:800 sql_create.c:800 insert -- followed by the mysql query.Then
:Fatal error: catreq.c:497 attribute create error. sql_find.c:376 Request for
Volume item 1 greater than max 0 or less than 1

13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error:
Network error with FD during Backup: ERR=Interrupted system call13-Jun 18:01
unisson.private.tice.ac-orlea JobId 170: Fatal error: No Job status returned
from FD.
13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error:
sql_get.c:373 sql_get.c:373 query SELECT VolumeName,MAX(VolIndex) FROM
JobMedia,Media WHERE JobMedia.JobId=170 AND
JobMedia.MediaId=Media.MediaId GROUP BY VolumeName ORDER BY 2 ASC
failed:
Got error 28 from storage engine

Try a google search for "error 28 mysql" and you will find out its
a known mysql error for telling you run out of space. So I would
search in the mysql space first something is filling probably some
temp space.

Marco


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Your main problem is probably here:

Got error 28 from storage engine

which means:

# perror 28
OS error code  28:  No space left on device

So please check space on filesystem where mysql creates temporary tables.

Regards
Piotr

Hi Uwe,
Thanks for the answer.
I've found it in the meantime: my vserver was defined with a 16 Mb /tmp directory. Increasing it to 100 made the job.
Anyway, I'll keep your advice about tcp_keepalive ready if it happens again.

Cheers.
Jean-François

2012/6/14 Uwe Schuerkamp <uwe.schuerkamp < at > nionex.net ([email]uwe.schuerkamp < at > nionex.net[/email])>
On Wed, Jun 13, 2012 at 10:37:45PM +0200, Jean-François Leroux wrote:

wait_timeout=691200
interactive_timeout=691200

To my.cnf.

I also added HearbeatInterval = 1 min

to bacula-sd.conf and bacula-fd.conf (on the vserver that had problems).

But still no go. Backup runs for about 15 minutes and then hangs with this
error.


Hi,

does the backup *always* crash after 15 minutes? What's the value of
tcp_keepalive_timeout on the systems involved?

I'm asking because recently we had a weird effect where a backup of a
windows client would start off just fine, but simply die after the
amount of seconds for tcp_keepalive_time + 2 secs or so.

Any firewalls involved in the communication among the vservers?

Can you ssh into the other servers from the director without the idle
ssh sessions timing out on you?

All the best, Uwe

Thanks, everybody.
That was my /tmp directory, as you said. It was mounted with 16 Mb
inside the vserver. I corrected that and it works now.
All I have to do is updating my other servers in squeeze :)

Thanks again.
Jean-François

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users