Welcome! » Log In » Create A New Profile

Out of space

Posted by Anonymous 
Out of space
March 29, 2011 02:00PM
Hi!

What will happen if I run out of space, will that somehow corrupt the
backups? Sorry if I'm asking a question that has been answered
already.

Thanks for a great piece of software!

Sincerely,
Markus Hedlund
[getsnowfire.com]

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 29, 2011 02:09PM
Hallo, Markus,

Du meintest am 29.03.11:

Quote

What will happen if I run out of space, will that somehow corrupt the
backups?

No - the existing backups remain unchanged, at least those of the lowest
interval (p.e. "hourly").

The higher intervals run on: "daily" is rotated, "weekly" is rotated,
...

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 12:20AM
Even if we run out of space mid-backup?

Thanks,
Markus

On Tue, Mar 29, 2011 at 11:06 PM, Helmut Hullen <Hullen < at > t-online.de> wrote:
Quote

Hallo, Markus,

Du meintest am 29.03.11:

Quote

What will happen if I run out of space, will that somehow corrupt the
backups?

No - the existing backups remain unchanged, at least those of the lowest
interval (p.e. "hourly").

The higher intervals run on: "daily" is rotated, "weekly" is rotated,
...

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 12:40AM
Hallo, Markus,

Du meintest am 30.03.11:

Quote

Quote

Quote

What will happen if I run out of space, will that somehow corrupt
the backups?
Quote

Quote

No - the existing backups remain unchanged, at least those of the
lowest interval (p.e. "hourly").
Quote

Even if we run out of space mid-backup?
The program rebuilds the old backups. Just take a try - it doesn't hurt.

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 01:00AM
Okay, thanks!

On Wed, Mar 30, 2011 at 9:36 AM, Helmut Hullen <Hullen < at > t-online.de> wrote:
Quote

Hallo, Markus,

Du meintest am 30.03.11:

Quote

Quote

Quote

What will happen if I run out of space, will that somehow corrupt
the backups?
Quote

Quote

No - the existing backups remain unchanged, at least those of the
lowest interval (p.e. "hourly").
Quote

Even if we run out of space mid-backup?
The program rebuilds the old backups. Just take a try - it doesn't hurt.

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 06:01AM
On Wed, Mar 30, 2011 at 09:00:51AM +0200, Markus Hedlund wrote:
Quote

Even if we run out of space mid-backup?
On Tue, Mar 29, 2011 at 11:06 PM, Helmut Hullen <Hullen < at > t-online.de> wrote:
Quote

Hallo, Markus,
Quote

What will happen if I run out of space, will that somehow corrupt the
backups?
No - the existing backups remain unchanged, at least those of the lowest
interval (p.e. "hourly").
Because it interrupts the flow of the conversation and makes it harder
to read.
Quote

Why shouldn't I top-post?
If you run out of space during a backup, you may end up with a dodgy
daily.0 (or whatever your most frequent backup is called). And this
dodginess may slowly spread, as that backup gets copied to daily.1,
daily.2 etc. But you'll see from your logs (which you do, of course,
read) that that happened, and so be able to rectify the problem before
it becomes severe.

In this, rsnapshot is the same as any other backup scheme.

--
David Cantrell | even more awesome than a panda-fur coat

THIS IS THE LANGUAGE POLICE
PUT DOWN YOUR THESAURUS
STEP AWAY FROM THE CLICHE

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 06:18AM
On Wed, Mar 30, 2011 at 01:59:20PM +0100, David Cantrell (david < at > cantrell.org.uk) wrote:

Quote

If you run out of space during a backup, you may end up with a dodgy
daily.0 (or whatever your most frequent backup is called). And this
dodginess may slowly spread, as that backup gets copied to daily.1,
daily.2 etc.
sync_first with the recommended setup avoids the problem
pretty well: if sync fails, the rotation simply doesn't
take place, all old backups remain intact.
The "dodginess" cannot spread, backups are merely
suspended until you make room.

--
Tapani Tarvainen

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 06:20AM
I guess I should put the log files on a separate partition. Otherwise
the logs won't be stored.

Rectify the problem, is that deleting the affected backup? Can
rsnapshot handle a missing backup? daily.0 daily.1 daily.3 for
example.

// Markus

On Wed, Mar 30, 2011 at 2:59 PM, David Cantrell <david < at > cantrell.org.uk> wrote:
Quote

On Wed, Mar 30, 2011 at 09:00:51AM +0200, Markus Hedlund wrote:
Quote

Even if we run out of space mid-backup?
On Tue, Mar 29, 2011 at 11:06 PM, Helmut Hullen <Hullen < at > t-online.de> wrote:
Quote

Hallo, Markus,
Quote

What will happen if I run out of space, will that somehow corrupt the
backups?
No - the existing backups remain unchanged, at least those of the lowest
interval (p.e. "hourly").
Because it interrupts the flow of the conversation and makes it harder
to read.
Quote

Why shouldn't I top-post?
If you run out of space during a backup, you may end up with a dodgy
daily.0 (or whatever your most frequent backup is called).  And this
dodginess may slowly spread, as that backup gets copied to daily.1,
daily.2 etc.  But you'll see from your logs (which you do, of course,
read) that that happened, and so be able to rectify the problem before
it becomes severe.

In this, rsnapshot is the same as any other backup scheme.

--
David Cantrell | even more awesome than a panda-fur coat

THIS IS THE LANGUAGE POLICE
PUT DOWN YOUR THESAURUS
STEP AWAY FROM THE CLICHE

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 06:23AM
On Wed, Mar 30, 2011 at 3:16 PM, Tapani Tarvainen
<rsnapshot < at > tapanitarvainen.fi> wrote:
Quote

On Wed, Mar 30, 2011 at 01:59:20PM +0100, David Cantrell (david < at > cantrell.org.uk) wrote:

Quote

If you run out of space during a backup, you may end up with a dodgy
daily.0 (or whatever your most frequent backup is called).  And this
dodginess may slowly spread, as that backup gets copied to daily.1,
daily.2 etc.
sync_first with the recommended setup avoids the problem
pretty well: if sync fails, the rotation simply doesn't
take place, all old backups remain intact.
The "dodginess" cannot spread, backups are merely
suspended until you make room.
That's good to know. Does rsnapshot check if there's space available,
regardless of sync_first?

Quote

--
Tapani Tarvainen

------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
------------------------------------------------------------------------------
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 07:10AM
Hallo, Markus,

Du meintest am 30.03.11:

Quote

Quote

sync_first with the recommended setup avoids the problem
pretty well: if sync fails, the rotation simply doesn't
take place, all old backups remain intact.
The "dodginess" cannot spread, backups are merely
suspended until you make room.
Quote

That's good to know. Does rsnapshot check if there's space available,
regardless of sync_first?
No - how should it check?
It doesn't know how much space it will use.

If nothing has changed it needs no additional space.
If all has changed it needs the whole space.

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 07:10AM
Hallo, Markus,

Du meintest am 30.03.11:

Quote

Quote

Quote

Quote

No - the existing backups remain unchanged, at least those of the
lowest interval (p.e. "hourly").
Because it interrupts the flow of the conversation and makes it
harder to read.
Quote

Why shouldn't I top-post?
[...]

[Top-post repaired]

Quote

I guess I should put the log files on a separate partition. Otherwise
the logs won't be stored.
???
The place of the log file is defined in "/etc/rsnapshot.conf" (or
whatelse you may define as config file). And I hope that you have
included "/var/log" into your backup.

Quote

Rectify the problem, is that deleting the affected backup? Can
rsnapshot handle a missing backup? daily.0 daily.1 daily.3 for
example.
Why should it? The programm rotates the backups when you tell it to
rotate them.

Why don't you test your ideas? It's a very simple job to look for a
small partition and then put a lot of "rsnapshot" backups into this
partition.

----------------------

Please don't top post.
Please don't full quote.
Thank you!

If you use the mail program from googlemail: that's nasty crap. Take a
better program. Thank you!

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 07:12AM
On Wed, Mar 30, 2011 at 03:18:50PM +0200, Markus Hedlund wrote:

Quote

I guess I should put the log files on a separate partition. Otherwise
the logs won't be stored.
Indeed.

Quote

Rectify the problem, is that deleting the affected backup?
If the problem is lack of space, then deleting a backup would only be a
temporary fix. A permanent fix would be to add more disk space.

--
David Cantrell | Godless Liberal Elitist

Planckton: n, the smallest possible living thing

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 07:14AM
On Wed, Mar 30, 2011 at 03:56:00PM +0200, Helmut Hullen wrote:
Quote

Hallo, Markus,
Quote

That's good to know. Does rsnapshot check if there's space available,
regardless of sync_first?
No - how should it check?
It doesn't know how much space it will use.
If nothing has changed it needs no additional space.
That's not quite true. It doesn't need any extra space for files, but
it will still need space for directories.

--
David Cantrell | Minister for Arbitrary Justice

Compromise: n: lowering my standards so you can meet them

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 07:17AM
On Wed, Mar 30, 2011 at 03:56:00PM +0200, Helmut Hullen (Hullen < at > t-online.de) wrote:

Quote

Quote

Quote

sync_first with the recommended setup avoids the problem
pretty well: if sync fails, the rotation simply doesn't
take place, all old backups remain intact.
The "dodginess" cannot spread, backups are merely
suspended until you make room.
Quote

That's good to know. Does rsnapshot check if there's space available,
regardless of sync_first?
No - how should it check?
It doesn't know how much space it will use.
Right. But the beauty of sync_first is that the sync call
in a sense acts as such a check, too: if it runs out of
space it fails before any corrupting rotation has occurred.

--
Tapani Tarvainen

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 08:57AM
Hallo, David,

Du meintest am 30.03.11:

Quote

Quote

Quote

That's good to know. Does rsnapshot check if there's space
available, regardless of sync_first?
Quote

Quote

No - how should it check?
It doesn't know how much space it will use.
If nothing has changed it needs no additional space.
Quote

That's not quite true. It doesn't need any extra space for files,
but it will still need space for directories.
Ok - may be some kilobytes ...

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 09:37AM
On Wed, Mar 30, 2011 at 05:52:00PM +0200, Helmut Hullen wrote:
Quote

Hallo, David,
Quote

Quote

If nothing has changed it needs no additional space.
That's not quite true. It doesn't need any extra space for files,
but it will still need space for directories.
Ok - may be some kilobytes ...
At minimum one block per directory. Picking one of my backups at
semi-random, that's 94829 directories, many of which are very big so may
take hundreds of blocks each.

And this is just my personal backups. At work, my home directory
contains ten times as many directories, and we can assume that each of
the dozen people I work with have something similar, for of the order of
100 times as many directories. It doesn't take long for all the
directories to start being measured in gigabytes.

--
David Cantrell
Professor of Unvironmental Science
University of Human Progress

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 30, 2011 02:22PM
Corrupting rotation may still happen during the rotation phase, when &#39;cp -al&#39; is being executed. And this is much harder to track. I had to create a wraper script for rsnapshot, which checks if the previous backup session has actually completed and if not it moves hourly.0 out of rotation.--
ó Õ×ÁÖÅÎÉÅÍ ÷ÌÁÄÉÍÉÒ ÷. âÅÒÅÖÎÏÊ

On Wed, Mar 30, 2011 at 18:15, Tapani Tarvainen <rsnapshot < at > tapanitarvainen.fi (rsnapshot &lt; at &gt; tapanitarvainen.fi)> wrote:
Quote

> No - how should it check?
Quote

It doesn&#39;t know how much space it will use.

Right. But the beauty of sync_first is that the sync call
in a sense acts as such a check, too: if it runs out of
space it fails before any corrupting rotation has occurred.
Out of space
March 31, 2011 12:06AM
2011/3/30 Владимир Бережной <non7top < at > gmail.com>:
Quote

Corrupting rotation may still happen during the rotation phase, when 'cp
-al' is being executed. And this is much harder to track. I had to create a
wraper script for rsnapshot, which checks if the previous backup session has
actually completed and if not it moves hourly.0 out of rotation.
That sounds great! Would you care to share it? :-)

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Out of space
March 31, 2011 01:07AM
Here it is
http://pastebin.com/fYUbyhmk

It is intended to be used with hourly rotation (lowest interval which executes &#39;cp -al&#39winking smiley--
ó Õ×ÁÖÅÎÉÅÍ ÷ÌÁÄÉÍÉÒ ÷. âÅÒÅÖÎÏÊ

On Thu, Mar 31, 2011 at 11:04, Markus Hedlund <znarkus < at > gmail.com (znarkus &lt; at &gt; gmail.com)> wrote:
Quote

2011/3/30 ÷ÌÁÄÉÍÉÒ âÅÒÅÖÎÏÊ <non7top < at > gmail.com (non7top &lt; at &gt; gmail.com)>:
Quote

Corrupting rotation may still happen during the rotation phase, when &#39;cp
-al&#39; is being executed. And this is much harder to track. I had to create a
wraper script for rsnapshot, which checks if the previous backup session has
actually completed and if not it moves hourly.0 out of rotation.

That sounds great! Would you care to share it? :-)
Out of space
March 31, 2011 01:12AM
2011/3/31 Владимир Бережной <non7top < at > gmail.com>:
Quote

Here it is
[pastebin.com]

It is intended to be used with hourly rotation (lowest interval which
executes 'cp -al')
Thank you very much!

------------------------------------------------------------------------------
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. [p.sf.net]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
[lists.sourceforge.net]
Sorry, only registered users may post in this forum.

Click here to login