SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Local rsnapshot rolling history - No local duplication
Author Message
Post Local rsnapshot rolling history - No local duplication 
Hi All

I am running rsnapshot locally.

AFAIK, the initial run of rsnapshot requires a complete duplication of the backup source to the destination.

In my case, the backup source and the destination are on the same volume.

As I understand, each successive rsnapshot refers to the one before it.

Would it be possible that even the very first snapshot uses the original data as it's reference?

I.e Even the very first snapshot that gets run would just be a set of hardlink's to the original source files?



Cheers
Michael

Post Local rsnapshot rolling history - No local duplication 
On Mon, Jul 25, 2011 at 09:36, Michael Lynch <michaellynch511 < at > gmail.com> wrote:
Hi All

I am running rsnapshot locally.

AFAIK, the initial run of rsnapshot requires a complete duplication of the
backup source to the destination.

In my case, the backup source and the destination are on the same volume.

As I understand, each successive rsnapshot refers to the one before it.

Would it be possible that even the very first snapshot uses the original
data as it's reference?

I.e Even the very first snapshot that gets run would just be a set of
hardlink's to the original source files?

You'll find a discussion about this approach in the list archive, from
fairly recently. However, why on earth would you want to do that? The
whole point is to have a backup, and if you're hard linking to the
original document you don't have a backup.

More to the point, if you're storing the backup on the same disk as
the master, you've hardly got a backup anyway.

--
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

------------------------------------------------------------------------------
Storage Efficiency Calculator
This modeling tool is based on patent-pending intellectual property that
has been used successfully in hundreds of IBM storage optimization engage-
ments, worldwide. Store less, Store more with what you own, Move data to
the right place. Try It Now! http://www.accelacomm.com/jaw/sfnl/114/51427378/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post Local rsnapshot rolling history - No local duplication 
On Mon, Jul 25, 2011 at 09:50:57AM +0100, Chris Dennis wrote:
On 07/25/2011 09:45 AM, Rob MacGregor wrote:
AFAIK, the initial run of rsnapshot requires a complete duplication of the
backup source to the destination.

Would it be possible that even the very first snapshot uses the original
data as it's reference?
You'll find a discussion about this approach in the list archive, from
fairly recently. However, why on earth would you want to do that? The
whole point is to have a backup, and if you're hard linking to the
original document you don't have a backup.
The OP may not want a 'backup' -- they may just want a 'snapshot' of the
current versions of the files.

He won't get a snapshot.

If somefile is hard-linked to /backups/daily.0/home/david/somefile,
then if I edit somefile, /backups/daily.0/home/david/somefile will
also get edited, as will all the other "snapshots" of it, and rsnapshot
won't be able to tell what you've changed and so break the links. This
will apply to *every* change made to that file and its inode - content
changes, mode changes, date/time changes - apart from renames.

In practice, he'll end up with snapshots of some files and not of
others, depending on what tools he uses to edit them, as some tools will
create a new file with the same name when they save data, and others
will edit in place.

It's a very bad idea that will lead to inconsistent results, and an
inconsistent untrustworthy backup (or snapshot) is even worse than
having no backups at all.

--
David Cantrell | semi-evolved ape-thing

We found no search results for "crotchet". Did you mean "crotch"?

------------------------------------------------------------------------------
Storage Efficiency Calculator
This modeling tool is based on patent-pending intellectual property that
has been used successfully in hundreds of IBM storage optimization engage-
ments, worldwide. Store less, Store more with what you own, Move data to
the right place. Try It Now! http://www.accelacomm.com/jaw/sfnl/114/51427378/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post Local rsnapshot rolling history - No local duplication 
I didn't think of that - modifying the source data will modify the snapshot data.

Yes, snapshot is what I want, not back up.
But I was picturing something more akin to copy-on-write.

I only have 4TB, and I want to provide a simple one week history for bulk, non-critical data.

Any ideas ?? Razz

I eagerly await for the manufacture, QNAP, to integrate Zumastor Smile

Thanks

On Mon, Jul 25, 2011 at 8:17 PM, Chris Dennis <cgdennis < at > btinternet.com ([email]cgdennis < at > btinternet.com[/email])> wrote:
On 07/25/2011 10:34 AM, David Cantrell wrote:
On Mon, Jul 25, 2011 at 09:50:57AM +0100, Chris Dennis wrote:
On 07/25/2011 09:45 AM, Rob MacGregor wrote:
AFAIK, the initial run of rsnapshot requires a complete duplication of the
backup source to the destination.

Would it be possible that even the very first snapshot uses the original
data as it's reference?
You'll find a discussion about this approach in the list archive, from
fairly recently. However, why on earth would you want to do that? The
whole point is to have a backup, and if you're hard linking to the
original document you don't have a backup.
The OP may not want a 'backup' -- they may just want a 'snapshot' of the
current versions of the files.

He won't get a snapshot.

If somefile is hard-linked to /backups/daily.0/home/david/somefile,
then if I edit somefile, /backups/daily.0/home/david/somefile will
also get edited, as will all the other "snapshots" of it, and rsnapshot
won't be able to tell what you've changed and so break the links.  This
will apply to *every* change made to that file and its inode - content
changes, mode changes, date/time changes - apart from renames.


Yes, you're right.  I was thinking about editing a file (e.g. with vim),
which creates a new version, leaving the hard-linked copy intact.  But
of course there are many ways of changing a file 'in situ' which also
change the hard-linked references to it.

So it would be foolish to hard-link the first snapshot to the original data.

cheers

Chris
--
Chris Dennis                                  cgdennis < at > btinternet.com ([email]cgdennis < at > btinternet.com[/email])
Fordingbridge, Hampshire, UK

------------------------------------------------------------------------------


Storage Efficiency Calculator
This modeling tool is based on patent-pending intellectual property that
has been used successfully in hundreds of IBM storage optimization engage-
ments, worldwide.  Store less, Store more with what you own, Move data to
the right place. Try It Now! http://www.accelacomm.com/jaw/sfnl/114/51427378/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net ([email]rsnapshot-discuss < at > lists.sourceforge.net[/email])
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss




Post Local rsnapshot rolling history - No local duplication 
On Mon, Jul 25, 2011 at 15:39, Michael Lynch <michaellynch511 < at > gmail.com> wrote:
I didn't think of that - modifying the source data will modify the snapshot
data.

Yes, snapshot is what I want, not back up.
But I was picturing something more akin to copy-on-write.

I only have 4TB, and I want to provide a simple one week history for bulk,
non-critical data.

Any ideas ?? :P

Does your file system or volume manager support snapshots? If so that
may be your simplest option, and closest to what you're wanting to
achieve.

--
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

------------------------------------------------------------------------------
Storage Efficiency Calculator
This modeling tool is based on patent-pending intellectual property that
has been used successfully in hundreds of IBM storage optimization engage-
ments, worldwide. Store less, Store more with what you own, Move data to
the right place. Try It Now! http://www.accelacomm.com/jaw/sfnl/114/51427378/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post Local rsnapshot rolling history - No local duplication 
Thanks Rob. Fully aware of my copy-on-write options... I think.... (ZFS, Zumastore, something to do with LVM...).

Just waiting for QNAP to support ddsnap Smile

Anyone know how to make gmail behave with email distribution lists?

Michael.

On Tue, Jul 26, 2011 at 3:36 AM, Rob MacGregor <rob.macgregor < at > gmail.com ([email]rob.macgregor < at > gmail.com[/email])> wrote:
On Mon, Jul 25, 2011 at 15:39, Michael Lynch <michaellynch511 < at > gmail.com ([email]michaellynch511 < at > gmail.com[/email])> wrote:
I didn't think of that - modifying the source data will modify the snapshot
data.

Yes, snapshot is what I want, not back up.
But I was picturing something more akin to copy-on-write.

I only have 4TB, and I want to provide a simple one week history for bulk,
non-critical data.

Any ideas ?? Razz


Does your file system or volume manager support snapshots? If so that
may be your simplest option, and closest to what you're wanting to
achieve.

--
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

------------------------------------------------------------------------------


Storage Efficiency Calculator
This modeling tool is based on patent-pending intellectual property that
has been used successfully in hundreds of IBM storage optimization engage-
ments, worldwide.  Store less, Store more with what you own, Move data to
the right place. Try It Now! http://www.accelacomm.com/jaw/sfnl/114/51427378/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net ([email]rsnapshot-discuss < at > lists.sourceforge.net[/email])
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss




Post Local rsnapshot rolling history - No local duplication 
On 26/07/11 10:38, Michael Lynch wrote:
Thanks Rob. Fully aware of my copy-on-write options... I think....
(ZFS, Zumastore, something to do with LVM...).


LVM can do both ro and rw snapshots, as does btrfs, AFAIK.

Tim.

------------------------------------------------------------------------------
Magic Quadrant for Content-Aware Data Loss Prevention
Research study explores the data loss prevention market. Includes in-depth
analysis on the changes within the DLP market, and the criteria used to
evaluate the strengths and weaknesses of these DLP solutions.
http://www.accelacomm.com/jaw/sfnl/114/51385063/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post Local rsnapshot rolling history - No local duplication 
Amazing what we do with file systems these days.

Anyone remember when NTFS introduced fancy features and everybody cried that it would slow it down and that FAT was a better choice?

lol Smile

Michael.

On Tue, Jul 26, 2011 at 8:10 PM, Tim Small <tim < at > buttersideup.com ([email]tim < at > buttersideup.com[/email])> wrote:
On 26/07/11 10:38, Michael Lynch wrote:
Thanks Rob. Fully aware of my copy-on-write options... I think....
(ZFS, Zumastore, something to do with LVM...).



LVM can do both ro and rw snapshots, as does btrfs, AFAIK.

Tim.


Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB