SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
multiple hosts pushing to a remote nfs s
Author Message
Post multiple hosts pushing to a remote nfs s 
Hi all,

My network setup consists of about 10 desktop Linux machines with each
user having their home directory on their own machine. The most straight
forward rsnapshot backup solution is to have these machines nfs mount an
exported directory from the backup server and have rsnapshot write to it.
This way, it is very easy for the users to pull backups if they need to.

However, if each machine's crontab is identical to the others, there would
be a quite the nasty load on the backup server when the time for backups
came around. Has anyone been able to come up with a reasonable backup
schedule to spread out the load? Or, conversely, does a better way exist
to arrange the backup system? For reference, the home directories on the
desktops can be quite large, at about 50-80 GB.

Thanks,
Mike S.


--
Michael Seymour
Department of Astronomy & Astrophysics
University of Toronto
60 St. George Street, Toronto, ON M5S 3H8 Canada
Tel: 416-946-5433
Fax: 416-946-7287
seymour < at > astro.utoronto.ca


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post multiple hosts pushing to a remote nfs s 
On Apr 11, 2005 7:17 PM, Michael D. Seymour <seymour < at > astro.utoronto.ca> wrote:
Hi all,

My network setup consists of about 10 desktop Linux machines with each
user having their home directory on their own machine. The most straight
forward rsnapshot backup solution is to have these machines nfs mount an
exported directory from the backup server and have rsnapshot write to it.
This way, it is very easy for the users to pull backups if they need to.

Why not do it the way the documentation suggests - run rsnapshot
centrally and then NFS export the backups for clients to pull from?

--
Please keep list traffic on the list.
Rob MacGregor
Whoever fights monsters should see to it that in the process he
doesn't become a monster. Friedrich Nietzsche


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post multiple hosts pushing to a remote nfs s 
Hi Rob,

Thanks for the response.

Why not do it the way the documentation suggests - run rsnapshot
centrally and then NFS export the backups for clients to pull from?

I think the documentation is talking about exporting a local directory to
the same local machine. The backup directory in our setup presently
resides on a central server, and is exported to the clients so they can
push the data to the server.

The problem with running rsnapshot on a central server is the
proliferation of nfs mounts exported from the backup clients to the
server. Any time I want to add another directory to back up, I would have
to export it. The advantage is simplifying scheduling. The central server
can then do one directory at a time, but only one. I think there was a
thread earlier about parallelizing rsnapshot.

Am I not seeing something I should?

Mike

--
Michael Seymour
Department of Astronomy & Astrophysics
University of Toronto
60 St. George Street, Toronto, ON M5S 3H8 Canada
Tel: 416-946-5433
Fax: 416-946-7287
seymour < at > astro.utoronto.ca


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post multiple hosts pushing to a remote nfs s 
On Apr 11, 2005 10:20 PM, Michael D. Seymour <seymour < at > astro.utoronto.ca> wrote:
Am I not seeing something I should?

Yeah - rsnapshot is designed to use rsync over ssh. There's no need
to export *anything* from the clients to the backup server - check the
documentation (I'd write more, but it's late here).

--
Please keep list traffic on the list.
Rob MacGregor
Whoever fights monsters should see to it that in the process he
doesn't become a monster. Friedrich Nietzsche


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Post multiple hosts pushing to a remote nfs s 
Not an rsnapshot solution but... What if you had the cron-jobs on each
machine add their names to a queue-file on the backup server with
something like:

hostname >> /nfs/backup/rsnap-queue

There would be some kind of initial race to append to the file (if all the
machines kicked off their cron-jobs at the same moment) but hopefully the
nfs locking would handle it.

Then have the cron-job script wait for that machine's name to get to the
top of the list before running rsnapshot (with something like:)

while head -1 /nfs/backup/rsnap-queue | grep -cv `hostname`
do
sleep 10
done
rsnapshot


And when rsnapshot is done have the script remove themselves from the
queue with something like:

grep -v `hostname` /nfs/backup/rsnap-queue > /nfs/backup/rsnap-queue-new
mv /nfs/backup/rsnap-queue-new /nfs/backup/rsnap-queue


Another way would be to initially create a queue file with all the
hostnames in order, and have each machine wait for their name to get to
the top, then run rsnapshot, remove their name from the top and add it to
the bottom ready for the next backup. This would prevent the race
condition at the start but would stop the backups if one of the machines
died...

And of course no guarantees for my shell syntax here!

Justin



On Mon, 11 Apr 2005, Michael D. Seymour seymour-at-astro.utoronto.ca |rsnapshot-list| wrote:

Hi Rob,

Thanks for the response.

Why not do it the way the documentation suggests - run rsnapshot
centrally and then NFS export the backups for clients to pull from?

I think the documentation is talking about exporting a local directory to the
same local machine. The backup directory in our setup presently resides on a
central server, and is exported to the clients so they can push the data to
the server.

The problem with running rsnapshot on a central server is the proliferation
of nfs mounts exported from the backup clients to the server. Any time I want
to add another directory to back up, I would have to export it. The advantage
is simplifying scheduling. The central server can then do one directory at a
time, but only one. I think there was a thread earlier about parallelizing
rsnapshot.

Am I not seeing something I should?

Mike

--
Michael Seymour
Department of Astronomy & Astrophysics
University of Toronto
60 St. George Street, Toronto, ON M5S 3H8 Canada
Tel: 416-946-5433
Fax: 416-946-7287
seymour < at > astro.utoronto.ca


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss



-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB