SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
snapshot size...
Author Message
Post snapshot size... 
Dear List!

running rsnapshot on my local Linux machine I get an initial large
snapshot and all subsequent snapshots are small. This is the result of
running "sudo rsnapshot du". So far everything is as expected.

For remote Linux boxes, however, all snapshots have the same size!

Anybody has a clue why this could be?

The local system is a OpenSuSE 11.0 and the remote systems range between
SuSE7.0 ... openSuSE11.2.

rsnapshot is version 1.3.1

thanx in advance, Ruedi



+---------------------------------------------------------------+
Rudolf Widmer-Schnidrig
Black Forest Observatory (BFO)
Heubach 206
D-77709 Wolfach, Germany
e-mail: widmer < at > geophys.uni-stuttgart.de
phone: +49 7836 2151 fax: +49 7836 955240
48d 19' 48.24" North 8d 19' 23.13" East
+---------------------------------------------------------------+

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post snapshot size... 
Hallo, Rudolf,

Du meintest am 19.02.10:

running rsnapshot on my local Linux machine I get an initial large
snapshot and all subsequent snapshots are small. This is the result
of running "sudo rsnapshot du". So far everything is as expected.

For remote Linux boxes, however, all snapshots have the same size!

Where runs "rsnapshot"? Does it get the backup files and store it on the
main machine, or does it put the backup files to the resp. remote box?

How are the remote boxes connected to the main machine: rsync, nfs,
samba?

If rsnapshot has to write on the remote box: what file system? (vfat,
ext2/ext3, reiser, ...)

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post snapshot size... 
Dear Helmut,

rsnapshot runs on one machine - my main machine - and the snapshots are
stored on an external 1TB USB disk mounted on this main machine. The
connection to the remote machines is via rsync/ssh.

Your questions inspired me to take a look at /etc/mtab:
The line for the USB disk reads

/dev/sdc1 /data1 ext3 rw,noexec,nosuid,nodev,acl,user_xattr 0 0

this seemed unusual when compared to the internal disks and I changed
fstab to include the attributes user,exec,dev,suid

/etc/mtab now reads as follows:
/dev/sdc1 /data1 ext3 rw,acl,user_xattr 0 0

Maybe that fixed it? I will give it a try and let you know.
Would you expect rsnapshot to behave the way it did, given the mtab
entries on my main machine?

Sincerely -Ruedi

+---------------------------------------------------------------+
Rudolf Widmer-Schnidrig
Black Forest Observatory (BFO)
Heubach 206
D-77709 Wolfach, Germany
e-mail: widmer < at > geophys.uni-stuttgart.de
phone: +49 7836 2151 fax: +49 7836 955240
48d 19' 48.24" North 8d 19' 23.13" East
+---------------------------------------------------------------+

On Fri, 19 Feb 2010, Helmut Hullen wrote:

Hallo, Rudolf,

Du meintest am 19.02.10:

running rsnapshot on my local Linux machine I get an initial large
snapshot and all subsequent snapshots are small. This is the result
of running "sudo rsnapshot du". So far everything is as expected.

For remote Linux boxes, however, all snapshots have the same size!

Where runs "rsnapshot"? Does it get the backup files and store it on the
main machine, or does it put the backup files to the resp. remote box?

How are the remote boxes connected to the main machine: rsync, nfs,
samba?

If rsnapshot has to write on the remote box: what file system? (vfat,
ext2/ext3, reiser, ...)

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss



------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post snapshot size... 
Dear Helmut,

the change in the /etc/fstab did not change the situation: I still get
snapshots of essentially the same size for all machines except my local
rsnapshot "server".

Any suggestions/ideas what to check next?

sincerely, Ruedi

+---------------------------------------------------------------+
Rudolf Widmer-Schnidrig
Black Forest Observatory (BFO)
Heubach 206
D-77709 Wolfach, Germany
e-mail: widmer < at > geophys.uni-stuttgart.de
phone: +49 7836 2151 fax: +49 7836 955240
48d 19' 48.24" North 8d 19' 23.13" East
+---------------------------------------------------------------+

On Fri, 19 Feb 2010, Rudolf Widmer-Schnidrig wrote:

Dear Helmut,

rsnapshot runs on one machine - my main machine - and the snapshots are
stored on an external 1TB USB disk mounted on this main machine. The
connection to the remote machines is via rsync/ssh.

Your questions inspired me to take a look at /etc/mtab:
The line for the USB disk reads

/dev/sdc1 /data1 ext3 rw,noexec,nosuid,nodev,acl,user_xattr 0 0

this seemed unusual when compared to the internal disks and I changed
fstab to include the attributes user,exec,dev,suid

/etc/mtab now reads as follows:
/dev/sdc1 /data1 ext3 rw,acl,user_xattr 0 0

Maybe that fixed it? I will give it a try and let you know.
Would you expect rsnapshot to behave the way it did, given the mtab
entries on my main machine?

Sincerely -Ruedi

+---------------------------------------------------------------+
Rudolf Widmer-Schnidrig
Black Forest Observatory (BFO)
Heubach 206
D-77709 Wolfach, Germany
e-mail: widmer < at > geophys.uni-stuttgart.de
phone: +49 7836 2151 fax: +49 7836 955240
48d 19' 48.24" North 8d 19' 23.13" East
+---------------------------------------------------------------+

On Fri, 19 Feb 2010, Helmut Hullen wrote:

Hallo, Rudolf,

Du meintest am 19.02.10:

running rsnapshot on my local Linux machine I get an initial large
snapshot and all subsequent snapshots are small. This is the result
of running "sudo rsnapshot du". So far everything is as expected.

For remote Linux boxes, however, all snapshots have the same size!

Where runs "rsnapshot"? Does it get the backup files and store it on the
main machine, or does it put the backup files to the resp. remote box?

How are the remote boxes connected to the main machine: rsync, nfs,
samba?

If rsnapshot has to write on the remote box: what file system? (vfat,
ext2/ext3, reiser, ...)

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss



------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss



------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post snapshot size... 
Hallo, Rudolf,

Du meintest am 22.02.10:

the change in the /etc/fstab did not change the situation: I still
get snapshots of essentially the same size for all machines except my
local rsnapshot "server".

Perhaps "hardlink" helps; you find a tarball at

<http://helmut.hullen.de/filebox/Linux/slackware/ap/hardlink-1.2-i486-1hln.tgz>

Test:

cd /path/to/daily.*

hardlink daily.?

should work a while, and then it should have hard linked as many files
as possible.

I run this program sometimes especially in the directories of my Windows
backups ...

You should run this program at a time where the "daily" backups are not
changed.

If that helps then you know that the external disk can use hard links
(that's not quite sure know).

Please excuse my gerlish - "wir können alles, ausser Hochdeutsch" ...

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post snapshot size... 
Dear Helmut,

as you suggested I ran "hardlink" on my snapshots and
- yes - it took a while to finish! There were actually very many
duplicate files that could be replaced by a hard link.

Is there anything I can do to rsnapshot so that fewer duplicate files make
it into the snapshots? 99% of the duplicate files come from backups of
remote machines. Snapshots of the local machine are small (except for the
most recent one).

Do you have any documentation on what exactly "hardlink" is doing?

Vielen Dank! -Ruedi

+---------------------------------------------------------------+
Rudolf Widmer-Schnidrig
Black Forest Observatory (BFO)
Heubach 206
D-77709 Wolfach, Germany
e-mail: widmer < at > geophys.uni-stuttgart.de
phone: +49 7836 2151 fax: +49 7836 955240
48d 19' 48.24" North 8d 19' 23.13" East
+---------------------------------------------------------------+

On Mon, 22 Feb 2010, Helmut Hullen wrote:

Hallo, Rudolf,

Du meintest am 22.02.10:

the change in the /etc/fstab did not change the situation: I still
get snapshots of essentially the same size for all machines except my
local rsnapshot "server".

Perhaps "hardlink" helps; you find a tarball at

<http://helmut.hullen.de/filebox/Linux/slackware/ap/hardlink-1.2-i486-1hln.tgz>

Test:

cd /path/to/daily.*

hardlink daily.?

should work a while, and then it should have hard linked as many files
as possible.

I run this program sometimes especially in the directories of my Windows
backups ...

You should run this program at a time where the "daily" backups are not
changed.

If that helps then you know that the external disk can use hard links
(that's not quite sure know).

Please excuse my gerlish - "wir können alles, ausser Hochdeutsch" ...

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss


------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post snapshot size... 
Hallo, Rudolf,

Du meintest am 04.03.10:

Is there anything I can do to rsnapshot so that fewer duplicate files
make it into the snapshots? 99% of the duplicate files come from
backups of remote machines.

I don't know - sorry.
On my machines that happens most times on Windows machines, especially
after changing from summer time to winter time and back. "rsync" is very
pedantic in accepting "that's an identic file".

Do you have any documentation on what exactly "hardlink" is doing?

If you have used

<http://helmut.hullen.de/filebox/Linux/slackware/ap/hardlink-1.2-i486-1hln.tgz>

then you can read the source in "/usr/local/doc/hardlink".

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB