Backup Central

Hello,

I am having some speed issues using SSH on FreeBSD I think. I am
using rdiff-backup 0.12.7

/home/admin/ajw is NFS shared and is about 200M.

Backup using NFS:
ajw < at > dylan /tmp >time rdiff-backup /home/admin/ajw ajw

real 0m35.622s
user 0m6.491s
sys 0m8.195s

Backup using SSH:
ajw < at > dylan /tmp >time rdiff-backup --ssh-no-compression montrose::/home/admin/ajw ajw
Enter passphrase for key '/home/admin/ajw/.ssh/id_dsa':

real 6m22.974s
user 0m9.342s
sys 0m6.171s

dylan is a xeon 2.4 with SCSI disks running FreeBSD 5.2.1. montrose is a
tru64 machine with dual 667 alpha processors and that home directory is
stored on a fiber channel IDE raid. These machines are on the same LAN.

This is the result using a tru64 machine to back up the same directory
(500 Mhz dual CPU machine).

NFS:
ajw < at > spartha /tmp >time rdiff-backup /home/admin/ajw ajw

real 1m7.271s
user 0m21.949s
sys 0m17.422s

SSH:
ajw < at > spartha /tmp >time rdiff-backup --ssh-no-compression montrose::/home/admin/ajw ajw
Enter passphrase for key '/home/admin/ajw/.ssh/id_dsa':

real 1m55.916s
user 0m30.931s
sys 0m11.681s

What can I do to speed up the FreeBSD backup?

Andy

Make sure you have the latest and same versions of ssh on both sides. I saw
a 2x performance increase when I did this when transferring files between
Linux and FreeBSD.

Gary

--
Gary Mulder <mailto:gary.mulder < at > infotechfl.com>
Info Tech, Inc.
5700 SW 34th Street, Suite 1235 Phone: (352) 381-4400
Gainesville, FL 32608 Fax: (352) 381-4444

I am having some speed issues using SSH on FreeBSD I think. I am
using rdiff-backup 0.12.7

You can try making ssh use a quicker encryption algorithim, e.g to use
arcfour
ssh -c arcfour

(Use the --remote-schema option to rdiff backup to change the ssh
command).

You can see the relative performance of different algorithms using
openssl speed




BMRB International
http://www.bmrb.co.uk
+44 (0)20 8566 5000
_________________________________________________________________
This message (and any attachment) is intended only for the
recipient and may contain confidential and/or privileged
material. If you have received this in error, please contact the
sender and delete this message immediately. Disclosure, copying
or other action taken in respect of this email or in
reliance on it is prohibited. BMRB International Limited
accepts no liability in relation to any personal emails, or
content of any email which does not directly relate to our
business.

Ok

I combined all suggestions and upgraded OpenSSH to 3.9.1
(openssh-portable port on FreeBSD). I do the ssh to localhost, so
operating systems are the same and changed the cipher. I also backup
a local disk, now. The results are better, but still not fast.
(zebedee is a FreeBSD 5.2.1 on a xeon 2.4Ghz)


My .ssh/config looks like this:
host primary-backup
hostname 127.0.0.1
compression no
ciphers arcfour
protocol 2

ajw < at > zebedee /tmp >time rdiff-backup --ssh-no-compression primary-backup::/tmp/ajw /tmp/ajw-backup
Enter passphrase for key '/home/admin/ajw/.ssh/id_dsa':

real 4m14.582s
user 0m8.124s
sys 0m5.351s

rsync:
ajw < at > zebedee /tmp >time rsync -ar primary-backup:/tmp/ajw/ /tmp/ajw-backup/
Enter passphrase for key '/home/admin/ajw/.ssh/id_dsa':

real 0m35.896s
user 0m5.500s
sys 0m3.445s

tar through ssh:
ajw < at > zebedee /tmp >time ssh primary-backup "tar -cf - /tmp/ajw" > ajw.tar
Enter passphrase for key '/home/admin/ajw/.ssh/id_dsa':

real 0m21.646s
user 0m4.033s
sys 0m1.444s

These are the results on the NFS server running Tru64 (same .ssh/config):
ajw < at > montrose /tmp >time rdiff-backup --ssh-no-compression primary-backup::/export/home/admin/ajw /tmp/ajw-backup
Enter passphrase for key '/home/admin/ajw/.ssh/id_dsa':

real 1m19.408s
user 0m20.694s
sys 0m13.173s

ajw < at > montrose /tmp >time rsync -ar primary-backup:/export/home/admin/ajw/ /tmp/ajw-backup/
Enter passphrase for key '/home/admin/ajw/.ssh/id_dsa':

real 0m39.735s
user 0m10.303s
sys 0m7.015s