SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
OT: amanda configuration
Author Message
Post OT: amanda configuration 
On 05/06 11:10 , Les Mikesell wrote:
(like not scheduling large
backups to go on tape first, so the tape gets filled maximally; or not
first backing up hosts that haven't been backed up for a while, so they're
more likely to get to tape instead of continuing to fail;

Give it some holding disk space and these things take care of themselves
as you flush anything that didn't fit on the first try. You shouldn't
ever have anything that continues to fail (or even fails once).

when I say 'fail' here, I mean "amanda won't do a full backup, because it
thinks its out of space" (i.e. I have less space on tape than the data I
want to back up; and no money for a changer). Eventually the last full
backup gets overwritten, and you have (effectively) a 'failed' backup. See
below.

or easily telling
it "back up as much as you can to tape, leave the leftovers on disk to be
flushed manually").

If that doesn't happen by itself you have something configured wrong.
Your 'reserve' value has to be reasonable

I eventually got this right; but only after someone explained it to me on
the amanda mailing list... the documentation in the amanda.conf file is
completely counter-intuitive:

# If amanda cannot find a tape on which to store backups, it will run
# as many backups as it can to the holding disks. In order to save
# space for unattended backups, by default, amanda will only perform
# incremental backups in this case, i.e., it will reserve 100% of the
# holding disk space for the so-called degraded mode backups.
# However, if you specify a different value for the `reserve'
# parameter, amanda will not degrade backups if they will fit in the
# non-reserved portion of the holding disk.

reserve 90 # percent
<<<

it makes it sound like the 'reserve' value is how much you're saving for
_degraded mode_ backups. If you squint your eyes and read it enough times,
you might come up with the correct interpretation (that 'reserve' is how
much you save for non-degraded-mode); but it's not what you'd read from a
first glance.

even with this set; it *still* puts itself in degraded mode when it runs out
of space on tape (according to what the specified size of the tape is);
refusing to ever do a proper backup of some machines. what I've ended up
doing is lying about the tape size; so that it hopefully does as many normal
backups as possible, before running out of space on tape, and then going to
degraded mode (even tho there might be 30-40GB of holding disk space left to
use for normal backups).

in the end, lengthening the tape cycle solved most of the problems; letting
me space out full backups farther in between the incrementals, so the amount
it's trying to back up at once is less.

Meanwhile amanda does the best job I've seen at making
sure that within every set of 10 tapes there is at least one full run
of every filesystem, and every night it has at least an incremental
of each one and the incremental levels are the lowest that are likely
to fit. I don't see any way to get those concepts to mesh with
backuppc.

amanda does a decent job for the environment it was designed for... a
University, back when tape was big and disk was small. many machines backed
up to one tape. this is no longer the world we live in... disk is big, tape
is small; disk is cheap, tape is expensive.

BackupPC wins by far in this world. Smile

Carl Soderstrom.
--
Systems Administrator
Real-Time Enterprises
www.real-time.com


-------------------------------------------------------
This SF.Net email is sponsored by Sleepycat Software
Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver
higher performing products faster, at low TCO.
http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Post OT: amanda configuration 
On Thu, 2004-05-06 at 11:48, Carl Wilhelm Soderstrom wrote:

when I say 'fail' here, I mean "amanda won't do a full backup, because it
thinks its out of space" (i.e. I have less space on tape than the data I
want to back up; and no money for a changer). Eventually the last full
backup gets overwritten, and you have (effectively) a 'failed' backup. See
below.

It only does a little guesswork about this. Basically it is doing
real calculations and it isn't amanda's fault if you don't like
the results.

it makes it sound like the 'reserve' value is how much you're saving for
_degraded mode_ backups. If you squint your eyes and read it enough times,
you might come up with the correct interpretation (that 'reserve' is how
much you save for non-degraded-mode); but it's not what you'd read from a
first glance.

It does mean for degraded mode. Degraded mode means no fulls. It's
a percentage, so 100-setting is what it will consider for fulls that
don't fit on tape. The default value is 100 so you don't get any
fulls unless you change it.

even with this set; it *still* puts itself in degraded mode when it runs out
of space on tape (according to what the specified size of the tape is);
refusing to ever do a proper backup of some machines. what I've ended up
doing is lying about the tape size; so that it hopefully does as many normal
backups as possible, before running out of space on tape, and then going to
degraded mode (even tho there might be 30-40GB of holding disk space left to
use for normal backups).

Your reserve should be a small number, like 10 or 20. You need
to have plenty of space that is not reserved so it can start a
full (non-degraded). Also keep in mind that it runs a lot of things
concurrently so it may have allocated the space for something else
at the time and released it after writing a chunk to tape.

in the end, lengthening the tape cycle solved most of the problems; letting
me space out full backups farther in between the incrementals, so the amount
it's trying to back up at once is less.

Yes, that is the real beauty of amanda's calculations. It can spread
the fulls among the incrementals so things fit that wouldn't otherwise.
All you have to do is give it enough tapes.

amanda does a decent job for the environment it was designed for... a
University, back when tape was big and disk was small. many machines backed
up to one tape. this is no longer the world we live in... disk is big, tape
is small; disk is cheap, tape is expensive.

BackupPC wins by far in this world. Smile

Tapes are still pretty sturdy compared to disks though. Disks are
a big win for online recent backups and I hope I never actually have
to restore from a tape again. I'm not quite convinced disks are
great for either offsite migration or long term archives. Maybe
whatever HD-DVD format wins will work for a while as a tape
replacement.

---
Les Mikesell
les < at > futuresource.com




-------------------------------------------------------
This SF.Net email is sponsored by Sleepycat Software
Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver
higher performing products faster, at low TCO.
http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Post OT: amanda configuration 
It only does a little guesswork about this. Basically it is doing
real calculations and it isn't amanda's fault if you don't like
the results.

I've spent a lot of time looking at amanda's logfiles; and yes, I know it
does some halfway-smart calculations about what to back up when. I just
think they could be a bit smarter about a lot of things.

Your reserve should be a small number, like 10 or 20.

I tried it that way. several times with many different values, to make sure
I wasn't just seeing things. doesn't work. the number has to be high in
order to get as much backed up as possible before amanda decides it won't do
full backups anymore.

Tapes are still pretty sturdy compared to disks though.

yeah, that's why I like them for offsite backup. I don't worry about
dropping a tape in my pocket and going to the restaurant... I do worry if
it's an HDD.

which is why I'm wondering why you decided to go with firewire disks instead
of tapes?

Carl Soderstrom.
--
Systems Administrator
Real-Time Enterprises
www.real-time.com


-------------------------------------------------------
This SF.Net email is sponsored by Sleepycat Software
Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver
higher performing products faster, at low TCO.
http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Post OT: amanda configuration 
On Thu, 2004-05-06 at 12:55, Carl Wilhelm Soderstrom wrote:

Your reserve should be a small number, like 10 or 20.

I tried it that way. several times with many different values, to make sure
I wasn't just seeing things. doesn't work. the number has to be high in
order to get as much backed up as possible before amanda decides it won't do
full backups anymore.

That doesn't make sense to me - the default is 100, meaning no space
for fulls. Mine's at 20 and if I forget to swap tapes, I'll still
get the normal fulls on the holding disk to flush later. But my
holding disk is about 2x the tape capacity.

Tapes are still pretty sturdy compared to disks though.

yeah, that's why I like them for offsite backup. I don't worry about
dropping a tape in my pocket and going to the restaurant... I do worry if
it's an HDD.

which is why I'm wondering why you decided to go with firewire disks instead
of tapes?

I haven't yet, but the price is going down to where the disks will be
almost disposable. My current tapes are dds4 and even dds5's are
going to have trouble with amanda's inability to span a single
filesystem run across tapes as the servers grow. We do have multiple
locations though, and if bandwidth between them becomes a little
cheaper I might just run another instance of backuppc (doing rsync
over ssh -C) elsewhere for the offsite copy instead of physically
moving anything.

---
Les Mikesell
les < at > futuresource.com




-------------------------------------------------------
This SF.Net email is sponsored by Sleepycat Software
Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver
higher performing products faster, at low TCO.
http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB