Backup Central

BackupPC is working just great for us. A couple of days ago, I added a new
Win2K server to the backup set that has all of the data for our Source Code
Revision Control system. I'm presently using cygwin rsyncd (needed cygwin ssh
to handle pre/post commands) so it may be difficult to try the one provided on
the BackupPC home page, but if I have to I'll try to compile it.

At any rate, the rocket scientists that wrote our RCS decided to put all of the
historyical diff type files in one directory. I have no control over this.
Presently the directory contains 11.1GB (not huge) in 249,031 files.

Unfortunately rsync gives up the ghost as follows:

Connected to tisvctl:873, remote version 27
Connected to module strepos
Sending args: --server --sender --numeric-ids --perms --owner --group --devices
--links --times --block-size=2048 --recursive . .
Xfer PIDs are now 737

[ -- snip -- ]


create 777 544/10513 47515 Vault/Archive/0001EF7B
create 777 544/10513 204511 Vault/Archive/0001EF7C
Read EOF: Connection reset by peer
Tried again: got 0 bytes
Child is aborting
Parent read EOF from child: fatal error!
Done: 127546 files, 5997486630 bytes

In general, any suggestions on troubleshooting or alternate methods would be
great.


--
Tony Nelson
Director of IT Operations
Starpoint Solutions LLC
115 Broadway, 2nd Fl
New York, NY 10006





-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/

Tony Nelson writes:

BackupPC is working just great for us. A couple of days ago, I added a new
Win2K server to the backup set that has all of the data for our Source Code
Revision Control system. I'm presently using cygwin rsyncd (needed cygwin ssh
to handle pre/post commands) so it may be difficult to try the one provided on
the BackupPC home page, but if I have to I'll try to compile it.

At any rate, the rocket scientists that wrote our RCS decided to put all of the
historyical diff type files in one directory. I have no control over this.
Presently the directory contains 11.1GB (not huge) in 249,031 files.

Unfortunately rsync gives up the ghost as follows:

Connected to tisvctl:873, remote version 27
Connected to module strepos
Sending args: --server --sender --numeric-ids --perms --owner --group --devices
--links --times --block-size=2048 --recursive . .
Xfer PIDs are now 737

[ -- snip -- ]


create 777 544/10513 47515 Vault/Archive/0001EF7B
create 777 544/10513 204511 Vault/Archive/0001EF7C
Read EOF: Connection reset by peer
Tried again: got 0 bytes
Child is aborting
Parent read EOF from child: fatal error!
Done: 127546 files, 5997486630 bytes

In general, any suggestions on troubleshooting or alternate methods would be
great.

I've never found rsync + ssh + cygwin to be reliable.

I would first recommend trying rsyncd. You can still use ssh for your
Post and Pre commands if you need them. The cygwin executable on
from the BackupPC SF download will work fine in regular mode with
ssh (rsync) and daemon mode (rsyncd).

There is a chance you are running out of memory on the client rsync.
Rsync stores the entire file list in memory, so there is a limit on
the number of files you can transfer in one go. However, I suspect
your server probably has a lot of memory, but maybe cygwin or
the cygwin user has some lower limits. If this is an issue you
could try to break the backup into some smaller pieces, but it's
not easy to break one big directory into separate transfers.

Craig


-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/