Deprecated: __autoload() is deprecated, use spl_autoload_register() instead in /home/pbuc/public_html/forum/mods/ext_phorummail/ezc/Base/src/ezc_bootstrap.php on line 36

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; KeyCAPTCHA_CLASS has a deprecated constructor in /home/pbuc/public_html/forum/mods/keycaptcha/keycaptcha.php on line 108
Real disk usage report
Welcome! » Log In » Create A New Profile

Real disk usage report

Posted by Anonymous 
Real disk usage report
October 21, 2014 04:51PM
hi,
Is there a way to have a report of the real usage of individual snapshots from a WHOLE repository considering hard links and all?

Eg:
~~~~~~~~~~~~~~
daily.0 contains 120 incremental files changed since daily.1 (Total 1.07Gb)
daily.1 contains 137 incremental files changed since daily.2 (Total 0.85 Gb)
...
Your whole repository contains: 738Gb of unique files
~~~~~~~~~~~~~~

Tried[b] rsnapshot du[/b] /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"

And not sure it will help in fact.

Thanks!
- Thierry
Real disk usage report
October 21, 2014 05:13PM
From an earlier thread on this forum:

My answer, could be used to track things on the fly.

I use the rsync logging capabilities to track exactly how many bytes get pushed, haven't tried using this in the rsnapshot.conf file, but I don't see why it wouldn't work. The format options are given in the rsyncd.conf man page. The timestamp and PID are apparently always on, my selected options are operation, file, and bytes transfered.
rsync -a --log-file=gets_big_fast --log-file-format='%o %f %b'  source dest

Sample output, directory and file

2013/07/14 08:20:05 [21441] send source/working/projects 0
2013/07/14 08:20:05 [21441] send source/working/projects/some_page.html 95
[img]https://ssl.gstatic.com/ui/v1/icons/mail/images/cleardot.gif[/img]

Better answer, from c.feige

Do you know "Rsnapgraph"?

[url=https://github.com/miracle2k/rsnapgraph]https://github.com/miracle2k/rsnapgraph[/url]

Quote:
   rsnapgraph is a utility that will analyze the snapshot backups created
   by rsnapshot, and produce two graphs showing
   file and disk space changes over time.

On Tue, Oct 21, 2014 at 9:50 AM, Thierry Lavallee <thierry < at > 8p-design.com ([email]thierry < at > 8p-design.com[/email])> wrote:
[quote] hi,
Is there a way to have a report of the real usage of individual snapshots from a WHOLE repository considering hard links and all?

Eg:
~~~~~~~~~~~~~~
daily.0 contains 120 incremental files changed since daily.1 (Total 1.07Gb)
daily.1 contains 137 incremental files changed since daily.2 (Total 0.85 Gb)
...
Your whole repository contains: 738Gb of unique files
~~~~~~~~~~~~~~

Tried[b] rsnapshot du[/b] /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"

And not sure it will help in fact.

Thanks!
- Thierry

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
[url=http://p.sf.net/sfu/Zoho]http://p.sf.net/sfu/Zoho[/url]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net ([email]rsnapshot-discuss < at > lists.sourceforge.net[/email])
[url=https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss]https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss[/url]

[/quote]

--
Paul Mackinney
Systems & Quality Manager
O.N. Diagnostics, LLC
2150 Shattuck Ave. Suite 610, Berkeley, CA 94704
510-204-0688 (phone) | 510-356-4349 (fax)
_____________________________________________
If you receive this message in error, please delete it immediately. This message may contain information that is privileged, confidential and exempt from disclosure and dissemination under applicable law.
Real disk usage report
October 21, 2014 05:19PM
Hallo, Thierry,

Du meintest am 21.10.14:

[quote]Is there a way to have a report of the real usage of individual
snapshots from a WHOLE repository considering hard links and all?
[/quote]
[quote]Eg:
~~~~~~~~~~~~~~
daily.0 contains 120 incremental files changed since daily.1 (Total
1.07Gb) daily.1 contains 137 incremental files changed since daily.2
(Total 0.85 Gb) ..
Your whole repository contains: 738Gb of unique files
~~~~~~~~~~~~~~
[/quote]
[quote]Tried*rsnapshot du* /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"
[/quote]
What about

rsnapshot du

It uses the usual rsnapshot configuration file. And it tells the really
used space, not the number of changed files.

Perhaps

rsnapshot diff

shows what you want.

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Real disk usage report
October 21, 2014 10:32PM
Hallo Helmut, :)

As stated, I did try rsnapshot du, but not sure where I need to be and what I need to invoke.

Also Tried rsnapshot du /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"

As for rsnapshot diff, it seems I can only compare TWO snapshots at a time, which does not give me a nice overview I am looking for. :/
Also, I need a summary, not a full list of files.

any clue!?
thx!

On 2014-10-21 1:12 PM, Helmut Hullen wrote:

[quote] [quote]Hallo, Thierry,

Du meintest am 21.10.14:

[quote]Is there a way to have a report of the real usage of individual
snapshots from a WHOLE repository considering hard links and all?
[/quote] [quote]Eg:
~~~~~~~~~~~~~~
daily.0 contains 120 incremental files changed since daily.1 (Total
1.07Gb) daily.1 contains 137 incremental files changed since daily.2
(Total 0.85 Gb) ..
Your whole repository contains: 738Gb of unique files
~~~~~~~~~~~~~~
[/quote] [quote]Tried*rsnapshot du* /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"
[/quote] What about

rsnapshot du

It uses the usual rsnapshot configuration file. And it tells the really
used space, not the number of changed files.

Perhaps

rsnapshot diff

shows what you want.

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
[url=http://p.sf.net/sfu/Zoho]http://p.sf.net/sfu/Zoho[/url]
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net ([email]rsnapshot-discuss < at > lists.sourceforge.net[/email])
[url=https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss]https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss[/url]
[/quote] [/quote]
Real disk usage report
October 21, 2014 10:45PM
Thierry,

How about just
rsnapshot du
with nothing after the du.

That will always do a du on the repository configured in
/etc/rsnapshot.conf (or you can use rsnapshot -c configfile du
if you want to use a different repository).

It doesn't matter what directory you are cd'ed into when you run it.

On Tue, Oct 21, 2014 at 06:30:06PM -0400, Thierry Lavallee wrote:
[quote]Hallo Helmut, :)
As stated, I did try rsnapshot du, but not sure where I need to be and
what I need to invoke.
Also Tried rsnapshot du /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"
As for rsnapshot diff, it seems I can only compare TWO snapshots at a
time, which does not give me a nice overview I am looking for. :/
Also, I need a summary, not a full list of files.
any clue!?
thx!
On 2014-10-21 1:12 PM, Helmut Hullen wrote:

Hallo, Thierry,

Du meintest am 21.10.14:

Is there a way to have a report of the real usage of individual
snapshots from a WHOLE repository considering hard links and all?

Eg:
~~~~~~~~~~~~~~
daily.0 contains 120 incremental files changed since daily.1 (Total
1.07Gb) daily.1 contains 137 incremental files changed since daily.2
(Total 0.85 Gb) ..
Your whole repository contains: 738Gb of unique files
~~~~~~~~~~~~~~

Tried*rsnapshot du* /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"

What about

rsnapshot du

It uses the usual rsnapshot configuration file. And it tells the really
used space, not the number of changed files.

Perhaps

rsnapshot diff

shows what you want.

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
[1]http://p.sf.net/sfu/Zoho
_______________________________________________
rsnapshot-discuss mailing list
[2]rsnapshot-discuss < at > lists.sourceforge.net
[3]https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

References

1. http://p.sf.net/sfu/Zoho
2. mailto:rsnapshot-discuss < at > lists.sourceforge.net
3. https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
[/quote]
[quote]------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
[/quote]
[quote]_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
[/quote]

--
___________________________________________________________________________
David Keegel <djk < at > cyber.com.au> Cyber IT Solutions Pty. Ltd.
http://www.cyber.com.au/~djk/ Linux & Unix Systems Administration

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Real disk usage report
October 21, 2014 10:49PM
man rsnapshot:

"It is also possible to pass a relative file path as a second argument,
to get a report on a particular file or subdirectory.

rsnapshot du localhost/home/
"

note: *relative* paths.

On Tue, 21 Oct 2014 18:30:06 -0400
Thierry Lavallee <thierry < at > 8p-design.com> wrote:

[quote]Hallo Helmut, :)

As stated, I did try rsnapshot du, but not sure where I need to be and
what I need to invoke.

Also Tried rsnapshot du /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"

[/quote]<snip...>

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Real disk usage report
October 22, 2014 03:15AM
great. I am getting somewhere with the full command. :)

root < at > server:# rsnapshot -c
/root/scripts/backup/rsnapshot.wscpb_cpbackup.conf du

thanks all!

On 2014-10-21 6:42 PM, David Keegel wrote:
[quote]Thierry,

How about just
rsnapshot du
with nothing after the du.

That will always do a du on the repository configured in
/etc/rsnapshot.conf (or you can use rsnapshot -c configfile du
if you want to use a different repository).

It doesn't matter what directory you are cd'ed into when you run it.

On Tue, Oct 21, 2014 at 06:30:06PM -0400, Thierry Lavallee wrote:
[quote]Hallo Helmut, :)
As stated, I did try rsnapshot du, but not sure where I need to be and
what I need to invoke.
Also Tried rsnapshot du /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"
As for rsnapshot diff, it seems I can only compare TWO snapshots at a
time, which does not give me a nice overview I am looking for. :/
Also, I need a summary, not a full list of files.
any clue!?
thx!
On 2014-10-21 1:12 PM, Helmut Hullen wrote:

Hallo, Thierry,

Du meintest am 21.10.14:

Is there a way to have a report of the real usage of individual
snapshots from a WHOLE repository considering hard links and all?

Eg:
~~~~~~~~~~~~~~
daily.0 contains 120 incremental files changed since daily.1 (Total
1.07Gb) daily.1 contains 137 incremental files changed since daily.2
(Total 0.85 Gb) ..
Your whole repository contains: 738Gb of unique files
~~~~~~~~~~~~~~

Tried*rsnapshot du* /media/mydirectory/myfiles/myrepositary/
But I get "ERROR: Full paths are not allowed"

What about

rsnapshot du

It uses the usual rsnapshot configuration file. And it tells the really
used space, not the number of changed files.

Perhaps

rsnapshot diff

shows what you want.

Viele Gruesse!
Helmut

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
[1]http://p.sf.net/sfu/Zoho
_______________________________________________
rsnapshot-discuss mailing list
[2]rsnapshot-discuss < at > lists.sourceforge.net
[3]https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

References

1. http://p.sf.net/sfu/Zoho
2. mailto:rsnapshot-discuss < at > lists.sourceforge.net
3. https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
[/quote]
[/quote]

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Real disk usage report
October 26, 2014 05:24PM
On Tue, 21 Oct 2014 23:13:07 -0400
Thierry Lavallee <thierry < at > 8p-design.com> wrote:

[quote]great. I am getting somewhere with the full command. :)

root < at > server:# rsnapshot -c
/root/scripts/backup/rsnapshot.wscpb_cpbackup.conf du

thanks all!

[/quote]
something else you may want to try:

#!/bin/bash
sizes=( $(find . -type f -and -links 1 -exec ls -la '{}' ; |
awk '{ print $5 }') )

echo "0 ${sizes[ < at > ]/#/ +}" | bc
# end

this produces the total on-disk size of all non-hardlinked files below
the current directory

--
Regards,
Christopher Barry

Random geeky fortune:
The autodecrement is not magical.
-- Larry Wall in the perl man page

------------------------------------------------------------------------------
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Real disk usage report
October 26, 2014 09:30PM
Hi Christopher!

Am 26.10.2014 18:22, schrieb Christopher Barry:
[quote]...
[quote]root < at > server:# rsnapshot -c
/root/scripts/backup/rsnapshot.wscpb_cpbackup.conf du
...
[/quote]
something else you may want to try:

#!/bin/bash
sizes=( $(find . -type f -and -links 1 -exec ls -la '{}' ; |
awk '{ print $5 }') )

echo "0 ${sizes[ < at > ]/#/ +}" | bc
# end
[/quote]

While this is a nice example of bash text conversion features (and I'm a
bash fan), it's a waste of ressources (lots of fork/exec calls). I'd
write it as

#!/bin/sh
(echo -n "0"; find . -type f -links 1 -printf " +%s"; echo) | bc

[quote]this produces the total on-disk size of all non-hardlinked files below
the current directory
...
[/quote]
Kind regards,
Mark Dominik Buerkle

------------------------------------------------------------------------------
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Sorry, only registered users may post in this forum.

Click here to login