SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Rsyncd slows Windows XP
Author Message
Post Rsyncd slows Windows XP 
Howdy,
I've only recently installed and setup BackupPC - so please forgive
me if I'm missing something REALLY obvious.

I've deployed the rsyncd daemon which is available from
http://backuppc.sf.net to several computers - one of which is WindowsXP =
SP2
RC2.

When the BackupPC server triggers a backup of the WinXP machine - the
XP machine slows to a crawl. There is very little CPU usage, but all =
the
foreground programs are sluggish to respond. The backup job DOES =
complete -
26gb over 290 minutes for a full backup - but the workstation is still =
slow
during this time. And the workstation is a P4-2.8ghz with 512 memory.

Has anyone else had these problems? My complaint is less the speed
of the backup, but more of why the workstation slows to a crawl during =
the
operation...

Any help is appreciated!

--b

--
Ben Higgins | Worcester Polytechnic Institute - ME Department
100 Institute Road | Computer Operations Manager, HL249
Worcester, MA 01609 | Phone: (508) 831-6756 FAX: (508) 831-5680
=20



-------------------------------------------------------
This SF.Net email sponsored by Black Hat Briefings & Training.
Attend Black Hat Briefings & Training, Las Vegas July 24-29 -
digital self defense, top technical experts, no vendor pitches,
unmatched networking opportunities. Visit www.blackhat.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Post Rsyncd slows Windows XP 
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1



Higgins, Benjamin John wrote:

| When the BackupPC server triggers a backup of the WinXP machine - the
| XP machine slows to a crawl. There is very little CPU usage, but all the
| foreground programs are sluggish to respond. The backup job DOES
complete -

Give the backup job a lower priority? Run smaller foreground programs,
with more RAM?

The really obvious thing you might be missing is, look at the disk
activity light, or listen to your computer if it's a noisy one. Rsyncd
will (I believe) read every single file it's backing up at least once,
even though it won't necessarily send everything it reads. This means
that if your network is fast enough and the changes in the files are
small enough, running rsync should place just a bit more load on the
machine than directly copying files from one hard drive to another
locally. Try that and see if it takes as long or slows things down as much.

If that's it, one possible solution would be to hack BackupPC to tell
rsync to use file mtimes first -- that is, if the system says a file
hasn't changed since the last backup, then it hasn't, and we don't need
to read the file to make sure. I have no idea how hard this is or if
it's even possible -- it looks like BackupPC speaks the rsync protocol
through a Perl module...

| Has anyone else had these problems? My complaint is less the speed
| of the backup, but more of why the workstation slows to a crawl during the
| operation...

I had a problem of -- rsyncd on Windows had CPU usage go to 100% and
rsyncd would hang. Maybe it would've finished eventually, but I gave it
a few hours with almost no disk activity and then dropped it.

The general rule is that rsync on cygwin has problems. Have you tried
using Samba instead? That worked out of the box for me, no problems, no
undue load on the Windows box. So if you're looking for the even more
obvious solution...


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iQIVAwUBQO4YtngHNmZLgCUhAQJmyA/7BdGKP0QaSOhp1Czr5KwSWgeeLdxTz1bp
vK2pEeayNIvj2waBO+iOuoDs+5f8vvm6xsvryetL95wdTqEDHRA8flQKa53C4mAb
3Tp/q1OHxzPRDnnEcJBa7LtwUl+BFImSKfVZbuxini0NFKmYTT+YN/eRzdyMFrkF
p5ruGueF25yxiO5psg9LPD6fnNnNOWTo5cX/A7AlI0FsagwfYibC9BR1tQKIbFxl
XBhW9M9Y1nmj2fFxS1OhIiSDyrWK5/HtmfAN8PDw4GdeB6f6U2EcXaBrUBGGCM6T
q9zl6RptOp7ww3k3oMSZZobljeyHeJbS4hm36AZQeWrAoUjFpiGp2MWBEcql8MkY
scaiDUUOCpIDRevmfJkP9nkQ89VdDsPyH+WIksuC2zgnsRQg8u5H1sya4DYyh6gV
XB/T3Yzzi82nGECQkEf+klJj4llpQnsiRKCJplmOfEgadyhxMQZ2Sg/yAnMzmgPw
MDruGuVBdPVHOj2RJyZG7Wc6b4Qi2URHSeP2kl3Sms05rVwDXyAI4XV65c+Ddccy
yQseCQ/Y9Ht5Ezdr1Sbw6fKrXp156CBkCiXr/pVOHu6xiR52LQYM5H6BlP7qDHLn
MZ4jQD+x4014NkXgzn5TXrUXjMEwgYs6A5/rXPKL67rt+vLXb8bF0li+Ekyhfvfd
1Iky9QyppF4=
=Emwi
-----END PGP SIGNATURE-----


-------------------------------------------------------
This SF.Net email sponsored by Black Hat Briefings & Training.
Attend Black Hat Briefings & Training, Las Vegas July 24-29 -
digital self defense, top technical experts, no vendor pitches,
unmatched networking opportunities. Visit www.blackhat.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Post Rsyncd slows Windows XP 
David Masover writes:

The really obvious thing you might be missing is, look at the disk
activity light, or listen to your computer if it's a noisy one. Rsyncd
will (I believe) read every single file it's backing up at least once,
even though it won't necessarily send everything it reads. This means
that if your network is fast enough and the changes in the files are
small enough, running rsync should place just a bit more load on the
machine than directly copying files from one hard drive to another
locally. Try that and see if it takes as long or slows things down as much.

If that's it, one possible solution would be to hack BackupPC to tell
rsync to use file mtimes first -- that is, if the system says a file
hasn't changed since the last backup, then it hasn't, and we don't need
to read the file to make sure. I have no idea how hard this is or if
it's even possible -- it looks like BackupPC speaks the rsync protocol
through a Perl module...

Rsync already works this way - for incrementals it only checks
the attributes (mtime, modes, ownership, size etc) and doesn't
read the file unless an attribute has changed.

Craig


-------------------------------------------------------
This SF.Net email sponsored by Black Hat Briefings & Training.
Attend Black Hat Briefings & Training, Las Vegas July 24-29 -
digital self defense, top technical experts, no vendor pitches,
unmatched networking opportunities. Visit www.blackhat.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Post Rsyncd slows Windows XP 
Ben writes:

I've deployed the rsyncd daemon which is available from
http://backuppc.sf.net to several computers - one of which is WindowsXP SP2
RC2.

When the BackupPC server triggers a backup of the WinXP machine - the
XP machine slows to a crawl. There is very little CPU usage, but all the
foreground programs are sluggish to respond. The backup job DOES complete -
26gb over 290 minutes for a full backup - but the workstation is still slow
during this time. And the workstation is a P4-2.8ghz with 512 memory.

Has anyone else had these problems? My complaint is less the speed
of the backup, but more of why the workstation slows to a crawl during the
operation...

I've haven't tried SP2, so I don't know if this is an issue specific
to SP2.

How much memory is rsync using when it is running? Rsync builds a
complete list of files in memory first, so the amount of memory
being used is proportional to the total number of files. If that
uses a good chunk of the physical memory then that would explain the
application slow down. If rsync memory usage is large, I would
recommend breaking the backup into several pieces by splitting
it into multiple shares.

Secondly, when rsync has to read files that seems to cause application
memory to get swapped out. I find on my WinXP laptop that after an
rsync backup it takes several seconds for applications to

My experience is that rsync has less impact on Win system performance
versus smb, but other people report the opposite. So you could try
smb instead.

Also, there might be some registry tweaks, or settings in the WinXP
Control Panel -> System -> Advanced -> Performance -> Settings
dialog that might make a difference.

Finally, the cygwin developers claim a significant performance
improvement in cygwin 1.5.10, but I haven't tried it yet so I
don't know if it makes much difference with rsync. You could
try the latest cygwin1.dll version 1.5.10.

Craig


-------------------------------------------------------
This SF.Net email sponsored by Black Hat Briefings & Training.
Attend Black Hat Briefings & Training, Las Vegas July 24-29 -
digital self defense, top technical experts, no vendor pitches,
unmatched networking opportunities. Visit www.blackhat.com
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Post Rsyncd slows Windows XP 
Okay - I was able to find one problem.... I was running rsync 2.5.7 on =
the
RedHat BackupPC server (DOH!). I've upgraded it to 2.6.2 and things =
*seems*
to be running smoother on the Windows client...

As for memory footprint: on the WinXP box there are currently two =
processes
(one for the service, one for the actual rsync process - I would =
assume). =20

Image Name User Name CPU Mem Usage
rsync.exe SYSTEM 00 1,260 K
rsync.exe SYSTEM 07 14,176 K

The WindowsXP box now is sluggish, rather than completely useless, when =
the
backup occurs. I did JUST notice that the process has spiked to 37%
occasionally - but tends to stay aroun 10-17%...

As for upgrading the cygwin1.dll... Well if it were as easy as dropping =
in a
DLL I can download from somewhere - everyone would be doing it. =20

If anyone can hold my hand and help me compile a new cygwin1.dll with =
Visual
Studio .NET (off the mailing list) - I would appreciate it.

Thanks!

--b

--
Ben Higgins | Worcester Polytechnic Institute - ME Department
100 Institute Road | Computer Operations Manager, HL249
Worcester, MA 01609 | Phone: (508) 831-6756 FAX: (508) 831-5680
=20

-----Original Message-----
From: Craig Barratt [mailto:cbarratt < at > users.sourceforge.net]=20
Sent: Friday, July 09, 2004 12:40 AM
To: Higgins, Benjamin John
Cc: backuppc-users < at > lists.sourceforge.net
Subject: Re: [BackupPC-users] Rsyncd slows Windows XP=20
=20
Ben writes:
=20
I've deployed the rsyncd daemon which is available from=20
http://backuppc.sf.net to several computers - one of which is=20
WindowsXP SP2 RC2.
=20
When the BackupPC server triggers a backup of the WinXP=20
machine - the=20
XP machine slows to a crawl. There is very little CPU=20
usage, but all=20
the foreground programs are sluggish to respond. The=20
backup job DOES=20
complete - 26gb over 290 minutes for a full backup - but the=20
workstation is still slow during this time. And the=20
workstation is a P4-2.8ghz with 512 memory.
=20
Has anyone else had these problems? My complaint is=20
less the speed=20
of the backup, but more of why the workstation slows to a=20
crawl during=20
the operation...
=20
I've haven't tried SP2, so I don't know if this is an issue=20
specific to SP2.
=20
How much memory is rsync using when it is running? Rsync=20
builds a complete list of files in memory first, so the=20
amount of memory being used is proportional to the total=20
number of files. If that uses a good chunk of the physical=20
memory then that would explain the application slow down. If=20
rsync memory usage is large, I would recommend breaking the=20
backup into several pieces by splitting it into multiple shares.
=20
Secondly, when rsync has to read files that seems to cause=20
application memory to get swapped out. I find on my WinXP=20
laptop that after an rsync backup it takes several seconds=20
for applications to
=20
My experience is that rsync has less impact on Win system=20
performance versus smb, but other people report the opposite.=20
So you could try smb instead.
=20
Also, there might be some registry tweaks, or settings in the=20
WinXP Control Panel -> System -> Advanced -> Performance ->=20
Settings dialog that might make a difference.
=20
Finally, the cygwin developers claim a significant=20
performance improvement in cygwin 1.5.10, but I haven't tried=20
it yet so I don't know if it makes much difference with=20
rsync. You could try the latest cygwin1.dll version 1.5.10.
=20
Craig
=20
=20
=20

Post Rsyncd slows Windows XP 
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1



Higgins, Benjamin John wrote:

| As for upgrading the cygwin1.dll... Well if it were as easy as
dropping in a
| DLL I can download from somewhere - everyone would be doing it.

Isn't it almost that easy? Go to cygwin.com, and download the setup.exe
- -- this will install Cygwin, letting you choose which versions of which
programs to install with it. If you don't want the whole thing, you can
always take the dll and use it with the mini cygwin/rsyncd from
backuppc.sourceforge.net, right?

(I've never tried this, I use Samba to avoid the hassle...)


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iQIVAwUBQPRDRHgHNmZLgCUhAQKyTA//ZCEG6Xg6L4xfuVTqshpLv5GY0gSKucB+
Q0V84kbcSPcBhs3xApb6MYtX8QvbGLB7g4oYBWXGwRHBTct7oMNQKfci+qgmikWv
RUhvBB2OBXDhDR5Kn/5malgFjHaT4mSRMa/79Squa7c4sVvlJugpDKyDMa0y3/Wx
Zv5ujm5SnYS7xUKxHsTViLZZeTKixX7onL3fVngLS37dDzPNiDPSkp4ATxkAENYj
etIzEyPjnNn9Xb7rAhWbwwppuXF1bCZ9/Jx56Xc1X+E8xadMcuaMvbeeM9MSwPlF
WWuq16j0sQSa0Vz1qmRxsxNJToIl5L7ioO3a7RXypVJcl6LPAsDmH4qQS1CJ9OjM
oVpgObIGPpVNnm0qhjXC5FdQlbkvWHSZLAam81VYpNETUeRfJjNFgC3Z5tepU5jA
BULM5oJ8jySCelmGeMVPNiGXi1/nmRnXyBcmNRt8bq3J6zh/uEnhCHKrg/+5z78e
psIpcBsu+wyovMuO7VsPg3JbhMBtzoZ4RBpJKF9A8+U0Ep02ndGoeJ4SjdcTMDMH
HApDNAw3Na24R+vtqnx1BjCCz7R2tqwGg1riOkZW/LxPJqtlzh4M2GGuwWqQ+pAy
/c35v7YU619YhFK+MhdcWh4fktjf1/KWEH6tGbolI19K5xRXKDUki6X9zQCj6JM3
zyUqDREajh8=
=dUCj
-----END PGP SIGNATURE-----

Post Rsyncd slows Windows XP 
Actually - I DID try that (I may be a newbie with cygwin - but I'm not =
THAT
new Wink

I received an error when trying to run the rsynchd from backuppc.sf.net:

"This application has fialed to start because cygpopt-0.dll was not =
found.
Re-installing the application may fix this problem."

Upon trying it again... Well - it seems to work this time Wink I'll see =
how
the performance is and report back later. Thanks!

--b

--
Ben Higgins | Worcester Polytechnic Institute - ME Department
100 Institute Road | Computer Operations Manager, HL249
Worcester, MA 01609 | Phone: (508) 831-6756 FAX: (508) 831-5680
=20

-----Original Message-----
From: David Masover [mailto:ninja < at > slaphack.com]=20
Sent: Tuesday, July 13, 2004 4:17 PM
To: Higgins, Benjamin John
Cc: Craig Barratt; backuppc-users < at > lists.sourceforge.net
Subject: Re: [BackupPC-users] Rsyncd slows Windows XP
=20
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
=20
=20
=20
Higgins, Benjamin John wrote:
=20
| As for upgrading the cygwin1.dll... Well if it were as easy as
dropping in a
| DLL I can download from somewhere - everyone would be doing it.
=20
Isn't it almost that easy? Go to cygwin.com, and download=20
the setup.exe
- -- this will install Cygwin, letting you choose which=20
versions of which programs to install with it. If you don't=20
want the whole thing, you can always take the dll and use it=20
with the mini cygwin/rsyncd from backuppc.sourceforge.net, right?
=20
(I've never tried this, I use Samba to avoid the hassle...)
=20
=20
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
=20
iQIVAwUBQPRDRHgHNmZLgCUhAQKyTA//ZCEG6Xg6L4xfuVTqshpLv5GY0gSKucB+
Q0V84kbcSPcBhs3xApb6MYtX8QvbGLB7g4oYBWXGwRHBTct7oMNQKfci+qgmikWv
RUhvBB2OBXDhDR5Kn/5malgFjHaT4mSRMa/79Squa7c4sVvlJugpDKyDMa0y3/Wx
Zv5ujm5SnYS7xUKxHsTViLZZeTKixX7onL3fVngLS37dDzPNiDPSkp4ATxkAENYj
etIzEyPjnNn9Xb7rAhWbwwppuXF1bCZ9/Jx56Xc1X+E8xadMcuaMvbeeM9MSwPlF
WWuq16j0sQSa0Vz1qmRxsxNJToIl5L7ioO3a7RXypVJcl6LPAsDmH4qQS1CJ9OjM
oVpgObIGPpVNnm0qhjXC5FdQlbkvWHSZLAam81VYpNETUeRfJjNFgC3Z5tepU5jA
BULM5oJ8jySCelmGeMVPNiGXi1/nmRnXyBcmNRt8bq3J6zh/uEnhCHKrg/+5z78e
psIpcBsu+wyovMuO7VsPg3JbhMBtzoZ4RBpJKF9A8+U0Ep02ndGoeJ4SjdcTMDMH
HApDNAw3Na24R+vtqnx1BjCCz7R2tqwGg1riOkZW/LxPJqtlzh4M2GGuwWqQ+pAy
/c35v7YU619YhFK+MhdcWh4fktjf1/KWEH6tGbolI19K5xRXKDUki6X9zQCj6JM3
zyUqDREajh8=3D
=3DdUCj
-----END PGP SIGNATURE-----
=20
=20
=20

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB