Backup Central

I've had an rdiff backup running for about 1 1/2 hrs or longer. This is
much longer than it's ever taken in the past. Is there a way I can
check that it's still running right? I hate to just abort it at this point.

Related: what can I safely do on the computer while the rdiff-backup is
running? Does it work off a snapshot or does it get messed up if I
change files while it's running?

Thanks.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

Assuming you don't have access to the system or can't see any hard
drive lights blinking rapidly, check lsof | grep -i rdiff to see if
the list of files that it's touching is changing . You can also check
dstat -d or iostat -d 1 to see if there's lots of I/O occurring

On Wed, Feb 29, 2012 at 12:26 PM, Eric Beversluis
<ebever < at > researchintegration.org> wrote:
I've had an rdiff backup running for about  1 1/2 hrs or longer. This is
much longer than it's ever taken in the past.  Is there a way I can check
that it's still running right? I hate to just abort it at this point.

Related: what can I safely do on the computer while the rdiff-backup is
running? Does it work off a snapshot or does it get messed up if I change
files while it's running?

Thanks.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL:
http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

There's also a logfile that it generates some in the rdiff dir under
the backup destination isn't there?

On Wed, Feb 29, 2012 at 12:38 PM, Sabuj Pattanayek <sabujp < at > gmail.com> wrote:
Assuming you don't have access to the system or can't see any hard
drive lights blinking rapidly, check lsof | grep -i rdiff to see if
the list of files that it's touching is changing . You can also check
dstat -d or iostat -d 1 to see if there's lots of I/O occurring

On Wed, Feb 29, 2012 at 12:26 PM, Eric Beversluis
<ebever < at > researchintegration.org> wrote:
I've had an rdiff backup running for about  1 1/2 hrs or longer. This is
much longer than it's ever taken in the past.  Is there a way I can check
that it's still running right? I hate to just abort it at this point.

Related: what can I safely do on the computer while the rdiff-backup is
running? Does it work off a snapshot or does it get messed up if I change
files while it's running?

Thanks.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL:
http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

This is what I get when I do lsof | grep -i rdiff. I don't know how to
interpret this, tho. I notice the bottom file listed as open in the
Windows vdi. I don't think that has even changed since the last time I
did the backup. I haven't used it.
=====
[root < at > localhost eric]# lsof | grep -i rdiff
lsof: WARNING: can't stat() fuse.gvfs-fuse-daemon file
system /home/eric/.gvfs
Output information may be incomplete.
rdiff-bac 15329 root cwd DIR 253,2
12288 1441793 /home/eric
rdiff-bac 15329 root rtd DIR 253,1
4096 2 /
rdiff-bac 15329 root txt REG 253,1
9144 3158546 /usr/bin/python
rdiff-bac 15329 root mem REG 253,1
95872 1835342 /lib64/libz.so.1.2.5
rdiff-bac 15329 root mem REG 253,1
56648 3160289 /usr/lib64/librsync.so.1.0.2
rdiff-bac 15329 root mem REG 253,1
1662680 1840085 /lib64/libcrypto.so.1.0.0g
rdiff-bac 15329 root mem REG 253,1
153472 1835020 /lib64/ld-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
1947608 1835024 /lib64/libc-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
140960 1835044 /lib64/libpthread-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
22696 1835040 /lib64/libdl-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
598832 1835042 /lib64/libm-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
124984 1835942 /lib64/libselinux.so.1
rdiff-bac 15329 root mem REG 253,1
118072 1835941 /lib64/libresolv-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
20064 1840243 /lib64/libattr.so.1.1.0
rdiff-bac 15329 root mem REG 253,1
15104 1840070 /lib64/libcom_err.so.2.1
rdiff-bac 15329 root mem REG 253,1
34392 1840245 /lib64/libacl.so.1.1.0
rdiff-bac 15329 root mem REG 253,1
9720 1839325 /lib64/libkeyutils-1.2.so
rdiff-bac 15329 root mem REG 253,1
39288 1840200 /lib64/libpopt.so.0.0.0
rdiff-bac 15329 root mem REG 253,1
66552 1840199 /lib64/libbz2.so.1.0.6
rdiff-bac 15329 root mem REG 253,1
17520 1840491 /lib64/libutil-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
1763488 3170207 /usr/lib64/libpython2.7.so.1.0
rdiff-bac 15329 root mem REG 253,1
911816 1835064 /lib64/libkrb5.so.3.3
rdiff-bac 15329 root mem REG 253,1
272496 1835304 /lib64/libgssapi_krb5.so.2.2
rdiff-bac 15329 root mem REG 253,1
177680 1835054 /lib64/libk5crypto.so.3.1
rdiff-bac 15329 root mem REG 253,1
46480 1835032 /lib64/libkrb5support.so.0.1
rdiff-bac 15329 root mem REG 253,1
376160 3149797 /usr/lib64/libssl.so.1.0.0g
rdiff-bac 15329 root mem REG 253,1
61688 1835037 /lib64/libnss_files-2.14.1.so
rdiff-bac 15329 root mem REG 253,1
12840
281245 /usr/lib64/python2.7/site-packages/rdiff_backup/_librsync.so
rdiff-bac 15329 root mem REG 253,1
41920 3156195 /usr/lib64/python2.7/lib-dynload/arraymodule.so
rdiff-bac 15329 root mem REG 253,1
36392 3154594 /usr/lib64/python2.7/site-packages/posix1e.so
rdiff-bac 15329 root mem REG 253,1
26248 3154511 /usr/lib64/python2.7/site-packages/xattr.so
rdiff-bac 15329 root mem REG 253,1
76688 3156199 /usr/lib64/python2.7/lib-dynload/cPickle.so
rdiff-bac 15329 root mem REG 253,1
11968 281142 /usr/lib64/python2.7/site-packages/rdiff_backup/C.so
rdiff-bac 15329 root mem REG 253,1
21608 3156182 /usr/lib64/python2.7/lib-dynload/_localemodule.so
rdiff-bac 15329 root mem REG 253,1
82792 3156203 /usr/lib64/python2.7/lib-dynload/datetime.so
rdiff-bac 15329 root mem REG 253,1
149792 3156180 /usr/lib64/python2.7/lib-dynload/_io.so
rdiff-bac 15329 root mem REG 253,1
24328 3156231 /usr/lib64/python2.7/lib-dynload/zlibmodule.so
rdiff-bac 15329 root mem REG 253,1
34544 3156194 /usr/lib64/python2.7/lib-dynload/_struct.so
rdiff-bac 15329 root mem REG 253,1
9080 3156209 /usr/lib64/python2.7/lib-dynload/grpmodule.so
rdiff-bac 15329 root mem REG 253,1
22240 3156178 /usr/lib64/python2.7/lib-dynload/_heapq.so
rdiff-bac 15329 root mem REG 253,1
9968 3156162 /usr/lib64/python2.7/lib-dynload/_bisectmodule.so
rdiff-bac 15329 root mem REG 253,1
58864 3156211 /usr/lib64/python2.7/lib-dynload/itertoolsmodule.so
rdiff-bac 15329 root mem REG 253,1
41968 3156216 /usr/lib64/python2.7/lib-dynload/operator.so
rdiff-bac 15329 root mem REG 253,1
29776 3156170 /usr/lib64/python2.7/lib-dynload/_collectionsmodule.so
rdiff-bac 15329 root mem REG 253,1
21128 3156227 /usr/lib64/python2.7/lib-dynload/timemodule.so
rdiff-bac 15329 root mem REG 253,1
14632 3156206 /usr/lib64/python2.7/lib-dynload/fcntlmodule.so
rdiff-bac 15329 root mem REG 253,1
12520 3156187 /usr/lib64/python2.7/lib-dynload/_randommodule.so
rdiff-bac 15329 root mem REG 253,1
17160 3156177 /usr/lib64/python2.7/lib-dynload/_hashlib.so
rdiff-bac 15329 root mem REG 253,1
21136 3156197 /usr/lib64/python2.7/lib-dynload/binascii.so
rdiff-bac 15329 root mem REG 253,1
34720 3156213 /usr/lib64/python2.7/lib-dynload/math.so
rdiff-bac 15329 root mem REG 253,1
104997456 3165765 /usr/lib/locale/locale-archive
rdiff-bac 15329 root mem REG 253,1
19184 3156200 /usr/lib64/python2.7/lib-dynload/cStringIO.so
rdiff-bac 15329 root mem REG 253,1
34272 3156193 /usr/lib64/python2.7/lib-dynload/_ssl.so
rdiff-bac 15329 root mem REG 253,1
12352 3156176 /usr/lib64/python2.7/lib-dynload/_functoolsmodule.so
rdiff-bac 15329 root mem REG 253,1
60784 3156191 /usr/lib64/python2.7/lib-dynload/_socketmodule.so
rdiff-bac 15329 root 0u CHR 136,0
0t0 3 /dev/pts/0
rdiff-bac 15329 root 1u CHR 136,0
0t0 3 /dev/pts/0
rdiff-bac 15329 root 2u CHR 136,0
0t0 3 /dev/pts/0
rdiff-bac 15329 root 3w REG 8,17
426
12091403 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/backup.log
rdiff-bac 15329 root 4r REG 8,17
2987993
12091540 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/mirror_metadata.2011-12-31T10:37:50-05:00.snapshot.gz
rdiff-bac 15329 root 5w REG 8,17
2134016
12093419 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/mirror_metadata.2012-02-29T11:33:55-05:00.snapshot.gz
rdiff-bac 15329 root 6r REG 8,17
376370
12094251 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/extended_attributes.2011-12-31T10:37:50-05:00.snapshot.gz
rdiff-bac 15329 root 7w REG 8,17
737280
12094383 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/file_statistics.2012-02-29T11:33:55-05:00.data.gz
rdiff-bac 15329 root 8w REG 8,17
0
12094345 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/error_log.2012-02-29T11:33:55-05:00.data.gz
rdiff-bac 15329 root 9w REG 8,17
241664
12094732 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/extended_attributes.2012-02-29T11:33:55-05:00.snapshot.gz
rdiff-bac 15329 root 10r REG 8,17
21474922496
4784131 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/home/eric/VirtualBox VMs/Windows7/rdiff-backup.tmp.66256
rdiff-bac 15329 root 11r REG 8,17
21474922496
13805550 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/home/eric/VirtualBox VMs/Windows7/Windows7.vdi

=====
On Wed, 2012-02-29 at 12:38 -0600, Sabuj Pattanayek wrote:
Assuming you don't have access to the system or can't see any hard
drive lights blinking rapidly, check lsof | grep -i rdiff to see if
the list of files that it's touching is changing . You can also check
dstat -d or iostat -d 1 to see if there's lots of I/O occurring

On Wed, Feb 29, 2012 at 12:26 PM, Eric Beversluis
<ebever < at > researchintegration.org> wrote:
I've had an rdiff backup running for about 1 1/2 hrs or longer. This is
much longer than it's ever taken in the past. Is there a way I can check
that it's still running right? I hate to just abort it at this point.

Related: what can I safely do on the computer while the rdiff-backup is
running? Does it work off a snapshot or does it get messed up if I change
files while it's running?

Thanks.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL:
http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki



_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

you can also do an lsof | grep -i somePath (where somePath is some
part of the source path that you're backing up) to look to see if some
related python processes are touching different files


12091403 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/backup.log

12094345 /media/b080d187-ad00-4b4a-9721-fcbe5e839827/Fedora15Backup/rdiff-backup-data/error_log.2012-02-29T11:33:55-05:00.data.gz

^^^ As I mentioned you've got these log files to tail -f as well , or
zcat | tail -f

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

version 1.2.8 calls fsync ridiculously often. I found that on NetBSD
with a journaling filesystem, fsync caused a flush of the log followed
by a cache flush (which is reasonable, since fsync is supposed to
guarantee that the bits are reliably on disk). This slowed it down so
far as to be totally unusable, so in my local copy of pkgsrc I patched
rdiff-backup to skip the fsync. Now, it runs reasonably fast.

So, I would ask if you have changed your filesystem in some way that
fsync is more expensive than it used to be. And use ktrace or similar
to see what the system call history and timing is.

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users < at > nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki