Deprecated: __autoload() is deprecated, use spl_autoload_register() instead in /home/pbuc/public_html/forum/mods/ext_phorummail/ezc/Base/src/ezc_bootstrap.php on line 36

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; KeyCAPTCHA_CLASS has a deprecated constructor in /home/pbuc/public_html/forum/mods/keycaptcha/keycaptcha.php on line 108
rsnapshot script runs part way through and hangs <eternal
Welcome! » Log In » Create A New Profile

rsnapshot script runs part way through and hangs <eternal

Posted by HarryPutnam 
rsnapshot script runs part way through and hangs <eternal
December 30, 2014 03:15PM
Setup: Gentoo linux running as vbox guest on win7 64bit

I'm having an odd problem with rsnapshot that I don't recall ever
running into before.

my rsnapshot.conf (posted at the end) runs 2 backup.... It starts
running the first but part way thru.. not at the same spot far as I
can tell.

If I leave it run, it never finishes. If I kill it with
interupsts... it takes two. So both runs are hitting some spot in the
process and hanging.

If I check processes I see (wrapped for mail):

ps wwaux|grep rsync

root 7033 0.0 0.0 13516 2956 pts/4 S+ 09:32 0:00 /usr/bin/rsync
-avvlRv --stats --exclude-from=/etc/rsnap/ex/rsnap_Misc_exclude
/usr/local/common/merc/ /bk/rsnap/misc/hourly.0/gv/

root 7034 0.0 0.0 7788 2604 pts/4 S+ 09:32 0:00 /usr/bin/rsync -avvlRv
--stats --exclude-from=/etc/rsnap/ex/rsnap_Misc_exclude
/usr/local/common/merc/ /bk/rsnap/misc/hourly.0/gv/

root 7035 0.0 0.0 13720 2676 pts/4 S+ 09:32 0:00 /usr/bin/rsync
-avvlRv --stats --exclude-from=/etc/rsnap/ex/rsnap_Misc_exclude
/usr/local/common/merc/ /bk/rsnap/misc/hourly.0/gv/

By the directory level I can see they are all running in the same
phase of the backup

I've used nearly the defaults for flags with the exception of adding
adding -vv (-l) --links, promoting `-relative' (-R), to short_args and
adding `--stats' to long_args.

I've got rsnapshots verbosity and log level set to 4.

However, tailing the designated log, there isn't enough yet releases
when the hang happens to tell me anything very usefull:

Then after ^c more is unbuffered but having to do whith the unexpected
interrupt.

In neither case it helping my understand what is happening.
(log output below)

So what can anyone suggest to solve the problem?

------- ------- ---=--- ------- -------
(output of tailing rsnapshot log: wrapped for mail)

[30/Dec/2014] /usr/bin/rsnapshot -c
/etc/rsnap/rc/rsnap_Misc.conf hourly: started

[30/Dec/2014] Setting locale to POSIX "C"

[30/Dec/2014] echo 7123 > /var/run/rsnapshot.pid

[30/Dec/2014] mv /bk/rsnap/misc/hourly.3/
/bk/rsnap/misc/hourly.4/

[30/Dec/2014] mv /bk/rsnap/misc/hourly.2/
/bk/rsnap/misc/hourly.3/

[30/Dec/2014] mv /bk/rsnap/misc/hourly.1/
/bk/rsnap/misc/hourly.2/

[30/Dec/2014] /bin/cp -al /bk/rsnap/misc/hourly.0
/bk/rsnap/misc/hourly.1

[30/Dec/2014] /usr/bin/rsync -avvlRv --stats
--exclude-from=/etc/rsnap/ex/rsnap_Misc_exclude /merb/
/bk/rsnap/misc/hourly.0/gv/

[30/Dec/2014] /usr/bin/rsync -avvlRv --stats
--exclude-from=/etc/rsnap/ex/rsnap_Misc_exclude
/usr/local/common/merc/ /bk/rsnap/misc/hourly.0/gv/
------- ------- ---=--- ------- -------

After interrupt:

[...]
[30/Dec/2014] /usr/bin/rsnapshot -c
/etc/rsnap/rc/rsnap_Misc.conf hourly: ERROR: /usr/bin/rsync returned
20 while processing /usr/local/common/merc

[30/Dec/2014] /usr/bin/logger -i -p user.err -t rsnapshot
/usr/bin/rsnapshot -c /etc/rsnap/rc/rsnap_Misc.conf hourly: ERROR:
/usr/bin/rsync returned 20 while processing /usr/local/common/merc

[30/Dec/2014] touch /bk/rsnap/misc/hourly.0/

[30/Dec/2014] rm -f /var/run/rsnapshot.pid

[30/Dec/2014] /usr/bin/logger -i -p user.err -t rsnapshot
/usr/bin/rsnapshot -c /etc/rsnap/rc/rsnap_Misc.conf hourly: ERROR:
/usr/bin/rsnapshot -c /etc/rsnap/rc/rsnap_Misc.conf hourly: completed,
but with some errors

[30/Dec/2014] /usr/bin/rsnapshot -c
/etc/rsnap/rc/rsnap_Misc.conf hourly: ERROR: /usr/bin/rsnapshot -c
/etc/rsnap/rc/rsnap_Misc.conf hourly: completed, but with some errors

------- ------- ---=--- ------- -------

Content of rsnap_Misc.conf

root # grep '^ *[^#]' /etc/rsnap/rc/rsnap_Misc.conf

config_version 1.2
snapshot_root /bk/rsnap/misc
cmd_cp /bin/cp
cmd_rm /bin/rm
cmd_rsync /usr/bin/rsync
cmd_logger /usr/bin/logger
cmd_du /usr/bin/du
cmd_rsnapshot_diff /usr/bin/rsnapshot-diff
interval hourly 6
interval daily 7
interval weekly 4
interval monthly 3
verbose 4
loglevel 4
logfile /var/log/rsnap_Misc.log
lockfile /var/run/rsnapshot.pid
rsync_short_args -avvlR
rsync_long_args --stats --delete --numeric-ids --delete-excluded
exclude_file /etc/rsnap/ex/rsnap_Misc_exclude
backup /merb/ gv/
backup /usr/local/common/merc gv/

------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
rsnapshot script runs part way through and hangs &lt;eternal
December 30, 2014 03:28PM
Harry Putnam <reader < at > newsguy.com> writes:

[quote]Setup: Gentoo linux running as vbox guest on win7 64bit

[/quote]Sorry, I gave in accurate and incomplete info in Setup section:

The host is not win 7 but OpenIndiana (a branch of solaris)

rsnapshot-1.3.1
rsync-3.1.1 protocol version 31

OS:
uname -a:
Linux gv 3.18.0-gentoo #3 SMP Sun Dec 14 13:29:08 EST 2014 i686
Intel(R) Xeon(R) CPU X5470 < at > 3.33GHz GenuineIntel GNU/Linu

------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
rsnapshot script runs part way through and hangs &lt;eternal
December 31, 2014 03:55PM
Am 30.12.2014 um 16:13 schrieb Harry Putnam:
[quote]...
my rsnapshot.conf (posted at the end) runs 2 backup.... It starts
running the first but part way thru.. not at the same spot far as I
can tell.
[/quote]
Dear Harry,

it is normal behaviour that rsync spawns a client and a server process
(that makes three of them) to do the actual work.
You can investigate what the rsync processes are doing by looking at
their file descriptors, e.g.

ls -l /proc/7033/fd/ /proc/7034/fd/ /proc/7035/fd/

to see where / with what they are consuming their time.
I suspect someone drew a symlink to some large directory; I would
propose You add

one_fs 1

to Your rsnapshot configuration file and see if it gets better.

Kind regards,
mdbuerkle

------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
rsnapshot script runs part way through and hangs &lt;eternal
December 31, 2014 08:13PM
Mark Dominik Bürkle <dominik.buerkle < at > web.de> writes:

[quote]Am 30.12.2014 um 16:13 schrieb Harry Putnam:
[quote]...
my rsnapshot.conf (posted at the end) runs 2 backup.... It starts
running the first but part way thru.. not at the same spot far as I
can tell.
[/quote]
Dear Harry,

it is normal behaviour that rsync spawns a client and a server process
(that makes three of them) to do the actual work.
You can investigate what the rsync processes are doing by looking at
their file descriptors, e.g.

ls -l /proc/7033/fd/ /proc/7034/fd/ /proc/7035/fd/

to see where / with what they are consuming their time.
I suspect someone drew a symlink to some large directory; I would
propose You add

one_fs 1
[/quote]
Thanks for the useful input.

No help with one_fs 1

However, I think I found the problem, and it may even be an honest to
god (small) bug.

I used these short rsync_short_args -avvlR

In all attempts I made.

If I remove one of the `v's it works... if double vv it does not.

That extra -v seems to be the direct cause of the hang.

Perhpas you can reproduce it.

------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
rsnapshot script runs part way through and hangs &lt;eternal
December 31, 2014 08:27PM
Harry Putnam <reader < at > newsguy.com> writes:

[quote]Mark Dominik Bürkle <dominik.buerkle < at > web.de> writes:

[quote]Am 30.12.2014 um 16:13 schrieb Harry Putnam:
[quote]...
my rsnapshot.conf (posted at the end) runs 2 backup.... It starts
running the first but part way thru.. not at the same spot far as I
can tell.
[/quote]
Dear Harry,

it is normal behaviour that rsync spawns a client and a server process
(that makes three of them) to do the actual work.
You can investigate what the rsync processes are doing by looking at
their file descriptors, e.g.

ls -l /proc/7033/fd/ /proc/7034/fd/ /proc/7035/fd/

to see where / with what they are consuming their time.
I suspect someone drew a symlink to some large directory; I would
propose You add

one_fs 1
[/quote]
Thanks for the useful input.

No help with one_fs 1

However, I think I found the problem, and it may even be an honest to
god (small) bug.

I used these short rsync_short_args -avvlR

In all attempts I made.

If I remove one of the `v's it works... if double vv it does not.

That extra -v seems to be the direct cause of the hang.

Perhpas you can reproduce it.
[/quote]
PS - I meant to add that -vv worked ok when I last setup rsnapshot on
a HOST... it been a good while... well over a year.

------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
rsnapshot script runs part way through and hangs &lt;eternal
December 31, 2014 09:35PM
On 31/12/2014 20:11, Harry Putnam wrote:

[quote]However, I think I found the problem, and it may even be an honest to
god (small) bug.

I used these short rsync_short_args -avvlR

In all attempts I made.

If I remove one of the `v's it works... if double vv it does not.

That extra -v seems to be the direct cause of the hang.

Perhpas you can reproduce it.
[/quote]
-vv makes rsync a lot more chatty, but that's all it does. And rsnapshot
doesn't parse that argument at all. What it does do is add things to it,
so it's possible that it's adding a 'v' to the end if you've turned
verbosity up in the rsnapshot config, and -avvlRv confuses rsync. I
wouldn't expect it to though.

The other possibility is that rsync's output is being buffered somewhere
and making it more chatty makes that buffer ridiculously big and so
something eats all the memory in the world. At that point, your machine
starts swapping or the OOM-killer kills it off, and as a result it
appears that something has hung when in fact it's just running
RRRRREEEEEAAAAAALLLLYYYY SSSSLLLLOOOOWWWWLLLLYYYY or just got killed
without logging anything.

I recommend not mentioning -v at all in rsync_short_args.

--
David Cantrell | Reality Engineer, Ministry of Information

engineer: n. one who, regardless of how much effort he puts in
to a job, will never satisfy either the suits or the scientists

------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
rsnapshot script runs part way through and hangs &lt;eternal
January 08, 2015 03:16PM
David Cantrell <david < at > cantrell.org.uk> writes:

[quote][quote]That extra -v seems to be the direct cause of the hang.

Perhpas you can reproduce it.
[/quote]
-vv makes rsync a lot more chatty, but that's all it does. And rsnapshot
doesn't parse that argument at all. What it does do is add things to it,
so it's possible that it's adding a 'v' to the end if you've turned
verbosity up in the rsnapshot config, and -avvlRv confuses rsync. I
wouldn't expect it to though.
[/quote]
Ok, great input... thanks for that.. It's kind of a relief to just
forget about -v -vv or whatever.

------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Sorry, only registered users may post in this forum.

Click here to login