SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Rsync method with $Conf{RsyncShareName} and $Conf{BackupFile
Author Message
Post Rsync method with $Conf{RsyncShareName} and $Conf{BackupFile 
Hello,
I try to backup a OpenVZ host with backupPC. For some other servers I've
a working rsync configuration that backups the whole file system. But
with this server I would like to backup the shares separately (because
of the many mounts that OpenVZ have for different /proc /sys and so on..).

When I use the BackupFilesExclude-option I notice that the remote
rsync-server sometimes "goes away". There are no running rsync-server on
the server and backuppc only displays one XFer PID on the status page.
That PID is the local one, no remote. Then I have to select
"Stop/Dequeue Backup" and then the backup continues on the next share.
If I run a full backup again it may succeed, or fail on another share.

The config for this host:
----
$Conf{XferMethod} = 'rsync';
$Conf{RsyncShareName} = [
'/',
'/boot',
'/mnt/backup',
'/var/lib/vz',
'/mnt/pbxdata'
];

$Conf{BackupFilesExclude} = {
'/mnt/pbxdata' => [
'/pbx_test/recordings', '/pbx_test/recordings2', '/heartofgold'
]
};

$Conf{RsyncArgs} = [
'--numeric-ids',
'--perms',
'--owner',
'--group',
'-D',
'--links',
'--hard-links',
'--times',
'--block-size=2048',
'--recursive',
'--checksum-seed=32761',
'--one-file-system',
];

----
This is an excerpt of the log where the backup got stalled on share
/var/lib/vz (hostname edited):

full backup started for directory /mnt/backup (baseline backup #Cool
Running: /usr/bin/ssh -q -x -l root -p 1022 hostname.example.com /usr/bin/rsync --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --checksum-seed=32761 --one-file-system --ignore-times . /mnt/backup/
Xfer PIDs are now 6336
Got remote protocol 30
Negotiated protocol version 28
Checksum caching enabled (checksumSeed = 32761)
Xfer PIDs are now 6336,6337
create d 755 0/0 4096 .
create 644 0/0 0 empty-file
create d 700 0/0 16384 lost+found
Done: 1 files, 0 bytes
full backup started for directory /var/lib/vz (baseline backup #Cool
Running: /usr/bin/ssh -q -x -l root -p 1022 hostname.example.com /usr/bin/rsync --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --checksum-seed=32761 --one-file-system --ignore-times . /var/lib/vz/
Xfer PIDs are now 6338
Done: 0 files, 0 bytes
full backup started for directory /mnt/pbxdata (baseline backup #Cool
Running: /usr/bin/ssh -q -x -l root -p 1022 hostname.example.com /usr/bin/rsync --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --checksum-seed=32761 --one-file-system --ignore-times . /mnt/pbxdata/
Xfer PIDs are now 6403
Got remote protocol 30
Negotiated protocol version 28
Checksum caching enabled (checksumSeed = 32761)
Sent exclude: /pbx_test/recordings
Sent exclude: /pbx_test/recordings2
Sent exclude: /heartofgold
Xfer PIDs are now 6403,6405
create d 755 0/0 4096 .
create 644 0/0 0 empty-file
create d 755 0/0 4096 pbx_test
create 644 0/0 0 pbx_test/TEST3
same 644 0/0 5 pbx_test/should-be-transfered.txt
Done: 3 files, 5 bytes
Got fatal error during xfer (No files dumped for share /var/lib/vz)
Backup aborted by user signal
Saving this as a partial backup, replacing the prior one (got 41684 and 3 files versus 0)


Does anyone have a solution for this?

Thanks!

/Johan

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Post Rsync method with $Conf{RsyncShareName} and $Conf{BackupFile 
On Mon, Jan 2, 2012 at 6:50 AM, Johan Wilfer <lists < at > jttech.se> wrote:

When I use the BackupFilesExclude-option I notice that the remote
rsync-server sometimes "goes away".

The most likely cause of processes 'going away' would be the linux
out-of-memory killer. Is that possible here - perhaps a large number
of directory entries? Maybe it isn't the exclude option itself, but
the fact that you need to use it for that target.

--
Les Mikesell
lesmikesell < at > gmail.com

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Post Rsync method with $Conf{RsyncShareName} and $Conf{BackupFile 
2012-01-02 18:45, Les Mikesell skrev:
On Mon, Jan 2, 2012 at 6:50 AM, Johan Wilfer <lists < at > jttech.se> wrote:

When I use the BackupFilesExclude-option I notice that the remote
rsync-server sometimes "goes away".
The most likely cause of processes 'going away' would be the linux
out-of-memory killer. Is that possible here - perhaps a large number
of directory entries? Maybe it isn't the exclude option itself, but
the fact that you need to use it for that target.


Thanks for the suggestion, but it's not the case this time. One of the
targets it crashes on has only one file.
Both machines are Debian Squeeze AMD64, the backup server that receives
the backup has 5GB ram, the client has 12GB.

It works one time, next full backup you have to stop. Then it works one
time. And so on...

Very strange.

/Johan

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Post Rsync method with $Conf{RsyncShareName} and $Conf{BackupFile 
On Mon, Jan 2, 2012 at 11:55 AM, Johan Wilfer <lists < at > jttech.se> wrote:
2012-01-02 18:45, Les Mikesell skrev:
On Mon, Jan 2, 2012 at 6:50 AM, Johan Wilfer <lists < at > jttech.se> wrote:

When I use the BackupFilesExclude-option I notice that the remote
rsync-server sometimes "goes away".
The most likely cause of processes 'going away' would be the linux
out-of-memory killer.  Is that possible here - perhaps a large number
of directory entries?  Maybe it isn't the exclude option itself, but
the fact that you need to use it for that target.


Thanks for the suggestion, but it's not the case this time. One of the
targets it crashes on has only one file.
Both machines are Debian Squeeze AMD64, the backup server that receives
the backup has 5GB ram, the client has 12GB.

The OOM killer doesn't necessarily kill the program that uses the most
ram - it is somewhat random. And it doesn't matter how much ram you
have, it is whether something/anything has used it all. Does the
client ever use swap at all - and possibly enough to run out?

It works one time, next full backup you have to stop. Then it works one
time. And so on...

A bug in a particular version of rsync is always possible. Is your
version up to date for the distribution?

--
Les Mikesell
lesmikesell < at > gmail.com

------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Post Rsync method with $Conf{RsyncShareName} and $Conf{BackupFile 
2012-01-02 19:09, Les Mikesell skrev:

The OOM killer doesn't necessarily kill the program that uses the most
ram - it is somewhat random. And it doesn't matter how much ram you
have, it is whether something/anything has used it all. Does the
client ever use swap at all - and possibly enough to run out?
free -m
total used free shared buffers cached
Mem: 12011 5099 6911 0 316 4161
-/+ buffers/cache: 620 11390
Swap: 19071 0 19071

Plenty of ram..

It works one time, next full backup you have to stop. Then it works one
time. And so on...
A bug in a particular version of rsync is always possible. Is your
version up to date for the distribution?

Yes, both are Debian Squeeze and are up-to-date.

rsync version 3.0.7 protocol version 30
Copyright (C) 1996-2009 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
append, ACLs, xattrs, iconv, symtimes



--
Med vänlig hälsning

Johan Wilfer email: johan < at > jttech.se
JT Tech | Utvecklare webb: http://jttech.se
direkt: +46 31 380 91 01 support: +46 31 380 91 00


------------------------------------------------------------------------------
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB