Backup Central

Hi All,

I have been using BackupPC for a while now, starting with it running on
Fedora in 2007 before switching to Ubuntu LTS. I am using the sudoers
method of allow backuppc to access my systems. I'm using rsync
transfers from all remote machines and use tar to backup /home on
localhost of the archiver. For some unknown reason, it hasn't backed
up /home on this machine since 17 Nov. The system seems to be working
fine in all other respects.

I have had two remote machines fail and had to replace them entirely
with new hardware. The first was a workstation in October, and a server
on 31 Dec. I had to regenerate keys for the new machines, but I don't
see how that should have impacted the backup of localhost. But the
localhost backup stopped at about the time that I was putting the first
of the failures back into the system.

The system starts the backup and then quits:
2012-01-07 01:00:16 full backup started for directory /home
2012-01-07 01:00:18 Got fatal error during xfer (No files dumped for share /home)

My sudoers file is:
==================================================================
# /etc/sudoers -- smbsrvr2 (backuppc server)
#
# This file MUST be edited with the 'visudo' command as root.
#
# See the man page for details on how to write a sudoers file.
#

Defaults env_reset

# Uncomment to allow members of group sudo to not need a password
# %sudo ALL=NOPASSWD: ALL

# Host alias specification
Host_Alias LOCAL = smbsrvr2

# User alias specification

# Cmnd alias specification

# User privilege specification
root ALL=(ALL) ALL

# ---------------- BackupPC Command Authorizations -----------------
# To restore files, uncomment restore cmd and comment backup cmd lines.
# Switch them back after restore complete.
#
# backuppc LOCAL=NOPASSWD: /bin/tar -c *, /bin/tar -x *
# ^^^^^^^^^^^^^^^^^^^^^^^^ restore command ^^^^^^^^^^^^^^^^^^^^^^^^^
#
backuppc LOCAL=NOPASSWD: /bin/tar -c *
# ^^^^^^^^^^^^^^^^^^^^^^^^ backup command ^^^^^^^^^^^^^^^^^^^^^^^^^^
# --------------------- End BackupPC Authorizations ----------------

# Members of the admin group may gain root privileges
%admin ALL=(ALL) ALL
====================================================================

My TarClientCmd is:
/usr/bin/env LC_ALL=C sudo /bin/tar -c -v -f - -C $shareName --totals

and my TarClientRestoreCMD is:
/usr/bin/env LC_ALL=C sudo /bin/tar -x -v -f - -C $shareName --totals

I'm generally computer literate, but don't claim to be fluent in Linux.
I was able to get this running with quite a bit of help and am not sure
where I need to start looking to find the problem.

Any suggestions will be gladly received and appreciated. -- ken


------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On 01/13 08:09 , Kenneth L. Owen wrote:
2012-01-07 01:00:18 Got fatal error during xfer (No files dumped for share /home)

Are there any files in /home?
BackupPC will exit if it does not find any files, because it assumes some
disastrous error has occurred and it does not want to clobber good backups
with empty ones.

--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On Mon, 2012-01-16 at 09:49 -0500, Carl Wilhelm Soderstrom wrote:
On 01/13 08:09 , Kenneth L. Owen wrote:
2012-01-07 01:00:18 Got fatal error during xfer (No files dumped for share /home)

Are there any files in /home?
BackupPC will exit if it does not find any files, because it assumes some
disastrous error has occurred and it does not want to clobber good backups
with empty ones.

Hi Carl,

This machine is remotely located from all other machines to provide
diversity of location in case of fire., etc...

It is in my workshop and backs up my system at night (01:00AM --
6:00AM). It also serves as the workstation for this location and dual
boots (Ubuntu Linux and Windows XP). Occasionally, I will fail to
reboot Linux when leaving for the day.

Before this problem started, it was backing up with no problem. Then I
started getting errors:
-------------------------------- Archiver log:
2011-11-17 01:00:01 incr backup started back to 2011-11-12 00:00:01
(backup #316) for directory /home
2011-11-17 01:00:19 incr backup 320 complete, 1792 files, 0 bytes,
0 xferErrs (0 bad files, 0 bad shares, 0 other)
2011-11-17 01:00:19 removing incr backup 313
2011-11-18 01:00:01 incr backup started back to 2011-11-12 00:00:01
(backup #316) for directory /home
2011-11-18 01:00:43 Got fatal error during xfer (Tar exited with error
512 () status)
2011-11-18 01:00:48 Backup aborted (Tar exited with error 512 () status)
------------------------------------------------------------------

Then it seemed to start working again...

----------------------------- Archiver log:
2011-11-19 06:22:21 Got fatal error during xfer (Tar exited with error 512
() status)
2011-11-19 06:22:26 Backup aborted (Tar exited with error 512 () status)
2011-11-19 06:22:26 Saved partial dump 321
2011-11-28 01:00:01 full backup started for directory /home
2011-11-28 02:30:28 full backup 321 complete, 21393 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-11-28 02:30:28 removing full backup 300
2011-11-29 01:00:04 incr backup started back to 2011-11-28 00:00:01
(backup #321) for directory /home
2011-11-29 01:00:39 incr backup 322 complete, 1791 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-11-29 01:00:39 removing incr backup 314
2011-11-30 01:00:01 incr backup started back to 2011-11-28 00:00:01 (backup #321)
for directory /home
2011-11-30 01:00:06 incr backup 323 complete, 1791 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-11-30 01:00:06 removing incr backup 315
------------------------------------------------------------------

I failed to reboot into Linux for a few days...

---------------------------------- Archiver log:
2011-12-04 01:00:03 incr backup started back to 2011-11-28 00:00:01 (backup #321)
for directory /home
2011-12-04 01:01:17 incr backup 324 complete, 1847 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-12-04 01:01:17 removing incr backup 317
2011-12-05 01:00:01 full backup started for directory /home
2011-12-05 02:29:36 full backup 325 complete, 21396 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-12-05 02:29:36 removing full backup 305
2011-12-09 01:00:01 incr backup started back to 2011-12-05 00:00:01 (backup #325)
for directory /home
2011-12-09 01:00:56 incr backup 326 complete, 1836 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-12-09 01:00:56 removing incr backup 318
2011-12-14 02:00:00 full backup started for directory /home
2011-12-14 03:28:48 full backup 327 complete, 21396 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-12-14 03:28:48 removing full backup 309
2011-12-15 02:00:01 incr backup started back to 2011-12-14 01:00:00 (backup #327)
for directory /home
2011-12-15 02:00:07 incr backup 328 complete, 1791 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-12-15 02:00:07 removing incr backup 319
2011-12-19 01:00:01 removing incr backup 320
2011-12-19 01:00:03 incr backup started back to 2011-12-14 01:00:00 (backup #327)
for directory /home
2011-12-19 01:01:09 incr backup 329 complete, 1837 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-12-20 01:00:00 incr backup started back to 2011-12-14 01:00:00 (backup #327)
for directory /home
2011-12-20 01:00:28 incr backup 330 complete, 1837 files, 0 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-12-20 01:00:28 removing incr backup 322
----------------------------------------------------------------------

Then, it started giving this response after returning the file server that failed
back to the system:
----------------------- Archiver log:
2012-01-07 01:00:16 removing incr backup 323
2012-01-07 01:00:16 removing incr backup 324
2012-01-07 01:00:16 full backup started for directory /home
2012-01-07 01:00:18 Got fatal error during xfer (No files dumped for share /home)
2012-01-07 01:00:23 Backup aborted (No files dumped for share /home)
2012-01-07 02:00:01 full backup started for directory /home
2012-01-07 02:00:03 Got fatal error during xfer (No files dumped for share /home)
...
Last nights run:
2012-01-16 01:00:06 full backup started for directory /home
2012-01-16 01:00:08 Got fatal error during xfer (No files dumped for share /home)
2012-01-16 01:00:13 Backup aborted (No files dumped for share /home)
2012-01-16 02:00:01 full backup started for directory /home
2012-01-16 02:00:03 Got fatal error during xfer (No files dumped for share /home)
2012-01-16 02:00:08 Backup aborted (No files dumped for share /home)
2012-01-16 03:00:01 full backup started for directory /home
2012-01-16 03:00:03 Got fatal error during xfer (No files dumped for share /home)
2012-01-16 03:00:08 Backup aborted (No files dumped for share /home)
2012-01-16 04:00:01 full backup started for directory /home
2012-01-16 04:00:03 Got fatal error during xfer (No files dumped for share /home)
2012-01-16 04:00:08 Backup aborted (No files dumped for share /home)
2012-01-16 05:00:01 full backup started for directory /home
2012-01-16 05:00:03 Got fatal error during xfer (No files dumped for share /home)
2012-01-16 05:00:08 Backup aborted (No files dumped for share /home)
2012-01-16 06:00:01 full backup started for directory /home
2012-01-16 06:00:03 Got fatal error during xfer (No files dumped for share /home)
2012-01-16 06:00:08 Backup aborted (No files dumped for share /home)
---------------------------------------------------------------------

As I said in the opening post, I have had problems with two other machines failing.
Both had been in service for about ten years, so they gave good service.
A workstation failed in October (dual-boot Linux & Windows XP). The motherboard
failed and the hardware replaced with new. I set it up dual boot Linux and Windows 7.
It is a 64 bit machine. This was placed on the system as a new client on 22 OCT.
On this machine /home is all that is backed up using rsync.

------------------------------ 64 bit Workstation log:
2011-10-22 14:56:03 full backup started for directory /home
2011-10-22 15:07:30 full backup 0 complete, 10393 files, 7421799505 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-10-24 01:00:27 incr backup started back to 2011-10-22 14:56:03 (backup #0)
for directory /home
2011-10-24 02:36:32 incr backup 1 complete, 426 files, 50665487587 bytes, 1 xferErrs
(0 bad files, 0 bad shares, 1 other)
2011-10-25 01:00:06 incr backup started back to 2011-10-22 14:56:03 (backup #0)
for directory /home
2011-10-25 02:33:46 incr backup 2 complete, 727 files, 50703843032 bytes, 3 xferErrs
(0 bad files, 0 bad shares, 3 other)
2011-10-26 01:00:10 incr backup started back to 2011-10-22 14:56:03 (backup #0)
for directory /home
2011-10-26 02:32:23 incr backup 3 complete, 815 files, 50714882644 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-10-27 02:00:01 incr backup started back to 2011-10-22 14:56:03 (backup #0)
for directory /home
2011-10-27 03:32:41 incr backup 4 complete, 1046 files, 51319200360 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-10-28 02:00:00 incr backup started back to 2011-10-22 14:56:03 (backup #0)
for directory /home
2011-10-28 03:38:58 incr backup 5 complete, 1192 files, 51363365003 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2011-10-29 02:00:00 incr backup started back to 2011-10-22 14:56:03 (backup #0)
for directory /home
2011-10-29 03:15:11 incr backup 6 complete, 2029 files, 51540214309 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
--------------------------------------------------------------------

On 31 Dec, I had a file server fail. Again, it was a hardware failure requiring
replacement of the platform. I set up a similar machine with essentially the same
configuration as the original. It was returned to the system as the same share name
as the failed platform carrying the the same share volumes as the original. Only the
shares are backed using rsync.

The file server was place back into service, fixed a problem with my keys, and all
appears to be working fine.

---------------------------- File Server log:
2012-01-06 13:59:27 removing incr backup 351
2012-01-06 13:59:27 removing incr backup 352
2012-01-06 13:59:27 full backup started for directory /media/COMPDATA (baseline backup #358)
2012-01-06 13:59:28 Got fatal error during xfer (Unable to read 4 bytes)
2012-01-06 13:59:33 Backup aborted (Unable to read 4 bytes)
2012-01-06 14:43:51 full backup started for directory /media/COMPDATA (baseline backup #358)
2012-01-06 15:21:24 full backup started for directory /media/LANDATA (baseline backup #358)
2012-01-06 16:04:06 full backup 359 complete, 59202 files, 80723590391 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2012-01-08 01:00:05 removing incr backup 354
2012-01-08 01:00:05 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/COMPDATA
2012-01-08 01:02:14 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/LANDATA
2012-01-08 01:04:59 incr backup 360 complete, 138 files, 576498254 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-09 01:00:06 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/COMPDATA
2012-01-09 01:02:45 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/LANDATA
2012-01-09 01:04:38 incr backup 361 complete, 146 files, 674397110 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-10 01:00:30 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/COMPDATA
2012-01-10 01:02:55 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/LANDATA
2012-01-10 01:04:54 incr backup 362 complete, 153 files, 674439739 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-11 01:00:43 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/COMPDATA
2012-01-11 01:02:31 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/LANDATA
2012-01-11 01:04:23 incr backup 363 complete, 153 files, 674514411 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-11 01:04:23 removing incr backup 356
2012-01-12 01:00:06 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/COMPDATA
2012-01-12 01:03:01 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/LANDATA
2012-01-12 01:04:48 incr backup 364 complete, 204 files, 693297742 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-12 01:04:48 removing incr backup 357
2012-01-13 01:00:00 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/COMPDATA
2012-01-13 01:01:56 incr backup started back to 2012-01-06 14:43:51 (backup #359)
for directory /media/LANDATA
2012-01-13 01:03:53 incr backup 365 complete, 207 files, 701973071 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-13 01:03:53 removing incr backup 358
2012-01-14 01:00:07 full backup started for directory /media/COMPDATA
(baseline backup #365)
2012-01-14 02:02:58 full backup started for directory /media/LANDATA
(baseline backup #365)
2012-01-14 02:47:17 full backup 366 complete, 59345 files, 81339156623 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-14 02:47:17 removing full backup 349
2012-01-15 01:00:07 incr backup started back to 2012-01-14 01:00:07 (backup #366)
for directory /media/COMPDATA
2012-01-15 01:02:37 incr backup started back to 2012-01-14 01:00:07 (backup #366)
for directory /media/LANDATA
2012-01-15 01:03:45 incr backup 367 complete, 289 files, 5491531 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-15 01:03:45 removing incr backup 360
2012-01-16 01:00:06 incr backup started back to 2012-01-14 01:00:07 (backup #366)
for directory /media/COMPDATA
2012-01-16 01:02:58 incr backup started back to 2012-01-14 01:00:07 (backup #366)
for directory /media/LANDATA
2012-01-16 01:03:51 incr backup 368 complete, 404 files, 6097416 bytes, 0 xferErrs
(0 bad files, 0 bad shares, 0 other)
2012-01-16 01:03:51 removing incr backup 361
------------------------------------------------------------------------


------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On 01/16 11:38 , Kenneth L. Owen wrote:
Before this problem started, it was backing up with no problem. Then I
started getting errors:

If you do a 'ls -al /home' using a command shell (command line) on the
machine in question does it show files, or just the usual '.' and '..'
directory entries?

Do you have exclude patterns set up for this backup, which might be
excluding all the files actually there?

What happens if you run the BackupPC dump by hand?
You'll need to run as the backuppc user for this; possibly by su'ing from
root with a command like 'su -s /bin/bash - backuppc'. It will allow you to
watch the backup take place in more detail:
/usr/share/backuppc/bin/BackupPC_dump -f -v localhost

You may have to modify that to fit your environment, based on the path to
BackupPC_dump and whatever you call 'localhost' in your /etc/backuppc/hosts
file.


--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On Mon, 2012-01-16 at 13:25 -0500, Carl Wilhelm Soderstrom wrote:
On 01/16 11:38 , Kenneth L. Owen wrote:
Before this problem started, it was backing up with no problem. Then I
started getting errors:

If you do a 'ls -al /home' using a command shell (command line) on the
machine in question does it show files, or just the usual '.' and '..'
directory entries?

Do you have exclude patterns set up for this backup, which might be
excluding all the files actually there?

What happens if you run the BackupPC dump by hand?
You'll need to run as the backuppc user for this; possibly by su'ing from
root with a command like 'su -s /bin/bash - backuppc'. It will allow you to
watch the backup take place in more detail:
/usr/share/backuppc/bin/BackupPC_dump -f -v localhost

You may have to modify that to fit your environment, based on the path to
BackupPC_dump and whatever you call 'localhost' in your /etc/backuppc/hosts
file.


Hi Carl,

Thanks for taking a look at this!

I'm running this remotely via ssh...

As ken:
-----------------------------------------------------------------------------
ken < at > archiver:/home$ ls -al
total 24
drwxr-xr-x 6 root root 4096 2010-04-03 16:13 .
drwxr-xr-x 23 root root 4096 2011-12-20 14:20 ..
drwxr-xr-x 31 backuppc root 4096 2012-01-15 16:28 backuppc
drwxr-xr-x 23 jo root 4096 2010-04-03 14:27 jo
drwxr-xr-x 49 ken root 4096 2012-01-15 16:45 ken
drwx------ 2 root root 4096 2010-03-10 12:06 lost+found

ken < at > archiver:~$ ls -al
total 804
drwxr-xr-x 49 ken root 4096 2012-01-15 16:45 .
drwxr-xr-x 6 root root 4096 2010-04-03 16:13 ..
-rw-r--r-- 1 ken root 8650 2010-03-08 22:21 20100308.backuppc_install.txt
...
drwxr-xr-x 2 ken root 4096 2011-10-23 18:53 Desktop

AS BACKUPPC:
----------------------------------------------------------------------------
backuppc < at > archiver:/home/ken$ /usr/share/backuppc/bin/BackupPC_dump -f -v localhost
cmdSystemOrEval: about to system /bin/ping -c 1 localhost
cmdSystemOrEval: finished: got output PING localhost (127.0.0.1) 56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.027 ms

--- localhost ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.027/0.027/0.027/0.000 ms

cmdSystemOrEval: about to system /bin/ping -c 1 localhost
cmdSystemOrEval: finished: got output PING localhost (127.0.0.1) 56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.031 ms

--- localhost ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.031/0.031/0.031/0.000 ms

CheckHostAlive: returning 0.031
Running: /usr/bin/env LC_ALL=C sudo /bin/tar -c -v -f - -C /home --totals .
full backup started for directory /home
started full dump, share=/home
Xfer PIDs are now 5836,5835
xferPids 5836,5835
cmdExecOrEval: about to exec /usr/bin/env LC_ALL=C sudo /bin/tar -c -v -f - -C /home --totals .
...

AND IN LOG FILE:
2012-01-16 15:28:10 full backup started for directory /home

In the terminal session it appears the job is running...

I'm going to the workshop to physically observe activity...

The machine is showing disk activity approximately every one or two seconds as if comparing files.

I'll post again when I can get a final status.

-- ken

On Mon, 2012-01-16 at 15:52 -0500, Kenneth L. Owen wrote:
On Mon, 2012-01-16 at 13:25 -0500, Carl Wilhelm Soderstrom wrote:
On 01/16 11:38 , Kenneth L. Owen wrote:
Before this problem started, it was backing up with no problem. Then I
started getting errors:

If you do a 'ls -al /home' using a command shell (command line) on the
machine in question does it show files, or just the usual '.' and '..'
directory entries?

Do you have exclude patterns set up for this backup, which might be
excluding all the files actually there?

What happens if you run the BackupPC dump by hand?
You'll need to run as the backuppc user for this; possibly by su'ing from
root with a command like 'su -s /bin/bash - backuppc'. It will allow you to
watch the backup take place in more detail:
/usr/share/backuppc/bin/BackupPC_dump -f -v localhost

You may have to modify that to fit your environment, based on the path to
BackupPC_dump and whatever you call 'localhost' in your /etc/backuppc/hosts
file.


Hi Carl,

Thanks for taking a look at this!

I'm running this remotely via ssh...

As ken:
-----------------------------------------------------------------------------
ken < at > archiver:/home$ ls -al
total 24
drwxr-xr-x 6 root root 4096 2010-04-03 16:13 .
drwxr-xr-x 23 root root 4096 2011-12-20 14:20 ..
drwxr-xr-x 31 backuppc root 4096 2012-01-15 16:28 backuppc
drwxr-xr-x 23 jo root 4096 2010-04-03 14:27 jo
drwxr-xr-x 49 ken root 4096 2012-01-15 16:45 ken
drwx------ 2 root root 4096 2010-03-10 12:06 lost+found

ken < at > archiver:~$ ls -al
total 804
drwxr-xr-x 49 ken root 4096 2012-01-15 16:45 .
drwxr-xr-x 6 root root 4096 2010-04-03 16:13 ..
-rw-r--r-- 1 ken root 8650 2010-03-08 22:21
20100308.backuppc_install.txt
...
drwxr-xr-x 2 ken root 4096 2011-10-23 18:53 Desktop

AS BACKUPPC:
----------------------------------------------------------------------------
backuppc < at > archiver:/home/ken$ /usr/share/backuppc/bin/BackupPC_dump -f
-v localhost
cmdSystemOrEval: about to system /bin/ping -c 1 localhost
cmdSystemOrEval: finished: got output PING localhost (127.0.0.1)
56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.027 ms

--- localhost ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.027/0.027/0.027/0.000 ms

cmdSystemOrEval: about to system /bin/ping -c 1 localhost
cmdSystemOrEval: finished: got output PING localhost (127.0.0.1)
56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.031 ms

--- localhost ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.031/0.031/0.031/0.000 ms

CheckHostAlive: returning 0.031
Running: /usr/bin/env LC_ALL=C sudo /bin/tar -c -v -f - -C /home
--totals .
full backup started for directory /home
started full dump, share=/home
Xfer PIDs are now 5836,5835
xferPids 5836,5835
cmdExecOrEval: about to exec /usr/bin/env LC_ALL=C sudo /bin/tar -c -v
-f - -C /home --totals .
...

AND IN LOG FILE:
2012-01-16 15:28:10 full backup started for directory /home

In the terminal session it appears the job is running...

I'm going to the workshop to physically observe activity...

The machine is showing disk activity approximately every one or two
seconds as if comparing files.

I'll post again when I can get a final status.

-- ken

Hi Carl,

Reviewing my logs, a full backup of localhost usually takes about one
and a half hours with the maximum being close to 2 hours and this is
when this job is running concurrently with the rsync backups on the
remote machines. It has been approximately two hours now with this job
running exclusively. I have checked on the machine periodically and it
does not look like a tar create is in progress. My terminal session has
given NO errors. I'm going to abort the command to see if it get any
additional information.

I got the following:
----------------------------------------------------------------
exiting after signal ALRM
Not saving this as a partial backup since it has fewer files than the
prior one (got 0 and 0 files versus 0)
dump failed: received signal=ALRM
----------------------------------------------------------------

So, I still in the dark!

-- ken


------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Sorry about the slow (and probably unhelpful) reply to this.

On 01/16 05:31 , Kenneth L. Owen wrote:
Reviewing my logs, a full backup of localhost usually takes about one
and a half hours with the maximum being close to 2 hours and this is
when this job is running concurrently with the rsync backups on the
remote machines. It has been approximately two hours now with this job
running exclusively. I have checked on the machine periodically and it
does not look like a tar create is in progress. My terminal session has
given NO errors. I'm going to abort the command to see if it get any
additional information.

I got the following:
----------------------------------------------------------------
exiting after signal ALRM
Not saving this as a partial backup since it has fewer files than the
prior one (got 0 and 0 files versus 0)
dump failed: received signal=ALRM
----------------------------------------------------------------

While you were running the BackupPC_tarCreate job, did you watch the
processes on the system (using another login of course) using 'ps ax' or
'top' or the like? Was there actually a tar process started?

--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On Mon, Jan 23, 2012 at 1:44 PM, Carl Wilhelm Soderstrom
<chrome < at > real-time.com> wrote:
While you were running the BackupPC_tarCreate job, did you watch the
processes on the system (using another login of course) using 'ps ax' or
'top' or the like? Was there actually a tar process started?

Also worth mentioning. "atop" is great for seeing the top processes
and other resources (memory, disk, swap usage, and network load)
simultaneously.

Richard

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Hi Carl,

As I said in my opening problem description, I'm computer literate, but
not very Linux knowledgeable. Before I retired, my employer used
Windows and since I networked into the system, I had to comply with
their rules. Now I run Linux as my primary boot and resort to Windows
only when I don't know how to get it done in Linux.

I have been running personal computers since 1980 and am still
supporting these vintage machines! My original build is still running.

I know there are many facilities to monitor processes to get data to
better understand how the system is working, but I don't command these
tools, as yet... BUT, I am a good student!

I'm not familiar with the ps command but will probably get more familiar
with it tomorrow!

When I ran the localhost backup job in manual, it reported that it was
starting with all of the right log entries, etc., but the overall system
observation did not support a tar create in progress. I run gkrellm
system monitor for CPU, processes, power supply, and disk activity on
the various mounts. None of this supported a tar backup in progress.
The log for the test was ...

2012-01-16 15:28:10 full backup started for directory /home
2012-01-16 17:27:35 Aborting backup up after signal INT

This backup process has been troublesome ever since I set up using the
sudoers method. When I first set it up, all looked good then I started
getting errors...

2011-03-24 01:00:02 incr backup started back to 2011-03-17 01:00:02
(backup #234) for directory /home
2011-03-24 01:00:28 incr backup 237 complete, 1728 files, bytes, 3 xferErrs ( bad files, bad shares, 3 other)
2011-03-24 01:00:28 removing incr backup 230
2011-03-25 01:00:01 full backup started for directory /home
2011-03-25 01:37:11 Got fatal error during xfer (Tar exited with error 512 () status)
2011-03-25 01:37:17 Backup aborted (Tar exited with error 512 () status)
2011-03-25 01:37:17 Saved partial dump 238

Then it started working again...

2011-08-08 06:00:01 incr backup started back to 2011-08-02 00:00:01 (backup #270) for directory /home/ken
2011-08-08 06:00:04 Got fatal error during xfer (Tar exited with error 512 () status)
2011-08-08 06:00:09 Backup aborted (Tar exited with error 512 () status)
2011-08-15 01:00:01 removing incr backup 264
2011-08-15 01:00:04 full backup started for directory /home/ken
2011-08-15 01:42:40 full backup 272 complete, 14079 files, 0 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2011-08-15 01:42:40 removing full backup 263

All seemed to be fine until I started getting current error ...

2012-01-22 05:00:01 full backup started for directory /home
2012-01-22 05:00:03 Got fatal error during xfer (No files dumped for share /home)
2012-01-22 05:00:08 Backup aborted (No files dumped for share /home)
2012-01-22 06:00:01 full backup started for directory /home
2012-01-22 06:00:03 Got fatal error during xfer (No files dumped for share /home)
2012-01-22 06:00:08 Backup aborted (No files dumped for share /home)

The home directory is not very critical mostly because I don't trust it and copy all critical files to the data server which get backed up via rsync and seems to be working just fine.

But I fear there may be some underlying problem that may put the entire
system at risk.

Later, -- ken

On Mon, 2012-01-23 at 14:44 -0500, Carl Wilhelm Soderstrom wrote:
Sorry about the slow (and probably unhelpful) reply to this.

On 01/16 05:31 , Kenneth L. Owen wrote:
Reviewing my logs, a full backup of localhost usually takes about one
and a half hours with the maximum being close to 2 hours and this is
when this job is running concurrently with the rsync backups on the
remote machines. It has been approximately two hours now with this job
running exclusively. I have checked on the machine periodically and it
does not look like a tar create is in progress. My terminal session has
given NO errors. I'm going to abort the command to see if it get any
additional information.

I got the following:
----------------------------------------------------------------
exiting after signal ALRM
Not saving this as a partial backup since it has fewer files than the
prior one (got 0 and 0 files versus 0)
dump failed: received signal=ALRM
----------------------------------------------------------------

While you were running the BackupPC_tarCreate job, did you watch the
processes on the system (using another login of course) using 'ps ax' or
'top' or the like? Was there actually a tar process started?





------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On Mon, Jan 23, 2012 at 7:47 PM, Kenneth L. Owen <tx836519 < at > bellsouth.net> wrote:


The home directory is not very critical mostly because I don't trust it and copy all critical files to the data server which get backed up via rsync and seems to be working just fine.

But I fear there may be some underlying problem that may put the entire
system at risk.

You can always do localhost via rsync over ssh just like any other system.

--
Les Mikesell
lesmikesell < at > gmail.com

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Hi Les,

Now that's a thought! I didn't realize this.

Hmmm, so does backuppc need a key for local host like the remote
machines?

-- ken


On Mon, 2012-01-23 at 20:05 -0600, Les Mikesell wrote:
On Mon, Jan 23, 2012 at 7:47 PM, Kenneth L. Owen <tx836519 < at > bellsouth.net> wrote:


The home directory is not very critical mostly because I don't trust it and copy all critical files to the data server which get backed up via rsync and seems to be working just fine.

But I fear there may be some underlying problem that may put the entire
system at risk.

You can always do localhost via rsync over ssh just like any other system.




------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On Mon, Jan 23, 2012 at 8:13 PM, Kenneth L. Owen <tx836519 < at > bellsouth.net> wrote:
Hi Les,

Now that's a thought!  I didn't realize this.

Hmmm, so does backuppc need a key for local host like the remote
machines?

Yes, everything works exactly the same. It's slightly less efficient
than running tar locally, but the machine probably doesn't have
anything else to do then anyway.

--
Les Mikesell
lesmikesell < at > gmail.com

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Hi Les,

I'm not getting something about setting up to use rsync to backup /home
on localhost. The instructions that I filed for generating keys is:

Setting up BackupPC software to run rsync using visudo:

Create user backuppc on the server and each client.

Then generate keys for your server backuppc user:
backuppc$> ssh-keygen -t rsa
use ssh-copy-id to copy the pub key to each of the clients
backuppc$>ssh-copy-id client

Likewise, on each client generate keys for backuppc user:
backuppc$> ssh-keygen -t rsa
use ssh-copy-id to copy the pub key to the server:
backuppc$>ssh-copy-id archive-server

On the archiving server, backuppc would ssh-copy-id localhost ??
Where does the reciprocal key come from ??

-- ken


On Mon, 2012-01-23 at 20:43 -0600, Les Mikesell wrote:
On Mon, Jan 23, 2012 at 8:13 PM, Kenneth L. Owen <tx836519 < at > bellsouth.net> wrote:
Hi Les,

Now that's a thought! I didn't realize this.

Hmmm, so does backuppc need a key for local host like the remote
machines?

Yes, everything works exactly the same. It's slightly less efficient
than running tar locally, but the machine probably doesn't have
anything else to do then anyway.




------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On Mon, Jan 23, 2012 at 10:07 PM, Kenneth L. Owen
<tx836519 < at > bellsouth.net> wrote:
Hi Les,

I'm not getting something about setting up to use rsync to backup /home
on localhost.  The instructions that I filed for generating keys is:

Setting up BackupPC software to run rsync using visudo:

Create user backuppc on the server and each client.

Then generate keys for your server backuppc user:
backuppc$> ssh-keygen -t rsa
use ssh-copy-id to copy the pub key to each of the clients
backuppc$>ssh-copy-id client

Likewise, on each client generate keys for backuppc user:
backuppc$> ssh-keygen -t rsa
use ssh-copy-id to copy the pub key to the server:
backuppc$>ssh-copy-id archive-server

On the archiving server, backuppc would ssh-copy-id localhost ??
Where does the reciprocal key come from ??

You don't need to generate new keys. The keys are a public/private
pair that identify the backuppc user and you should have already had a
set. You copy the public side of the key (this is what the
ssh-copy-id command does...) _from_ the user/host where the command
will originate (i.e. backuppc on the server) to the user/host where
the execution will be allowed (normally root on the target hosts
unless you are using a more complicated sudo command). The way ssh
works is that the receiving end of the connection will use the public
key that you added to the authorized_hosts file to make the
originating side prove that it has read access to the private side of
the same key. If you overwrote the original backuppc user's private
key, you'll have to update the matching public side on all the
targets.

--
Les Mikesell
lesmikesell < at > gmail.com

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

On Mon, 2012-01-23 at 22:36 -0600, Les Mikesell wrote:
On Mon, Jan 23, 2012 at 10:07 PM, Kenneth L. Owen
<tx836519 < at > bellsouth.net> wrote:
Hi Les,

I'm not getting something about setting up to use rsync to backup /home
on localhost. The instructions that I filed for generating keys is:

Setting up BackupPC software to run rsync using visudo:

Create user backuppc on the server and each client.

Then generate keys for your server backuppc user:
backuppc$> ssh-keygen -t rsa
use ssh-copy-id to copy the pub key to each of the clients
backuppc$>ssh-copy-id client

Likewise, on each client generate keys for backuppc user:
backuppc$> ssh-keygen -t rsa
use ssh-copy-id to copy the pub key to the server:
backuppc$>ssh-copy-id archive-server

On the archiving server, backuppc would ssh-copy-id localhost ??
Where does the reciprocal key come from ??

You don't need to generate new keys. The keys are a public/private
pair that identify the backuppc user and you should have already had a
set. You copy the public side of the key (this is what the
ssh-copy-id command does...) _from_ the user/host where the command
will originate (i.e. backuppc on the server) to the user/host where
the execution will be allowed (normally root on the target hosts
unless you are using a more complicated sudo command). The way ssh
works is that the receiving end of the connection will use the public
key that you added to the authorized_hosts file to make the
originating side prove that it has read access to the private side of
the same key. If you overwrote the original backuppc user's private
key, you'll have to update the matching public side on all the
targets.

I am not wanting to generate a new private key on the archiver for
backuppc user for just the reason you gave -- the clients are in sync
with this key.

backuppc ssh connects to the client as backuppc where he has an account.
The clients sudoers file gives backuppc root privilege for the commands
needed to perform backup and no others. If I need to do a restore, I
must revise the sodoers file to to switch to the commands for restore so
backuppc can write the files. Then when the restore is complete it is
changed back so that only the backup function is allowed.

On the archiver, backuppc has a logon ID. The sudoers file gives
backuppc root authority on archiver system, but only for the commands
needed to perform a tar backup of /home.

So, to switch to rsync, I revise sudoers to give backuppc root privilege
for the commands to perform rsync backup of /home. Then BackupPC
application will ssh connect to localhost as user backuppc on localhost.

Am I missing something here?

-- ken


------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/