Welcome! » Log In » Create A New Profile

Backuppc keeps hanging on restore

Posted by robp2175 
Backuppc keeps hanging on restore
July 21, 2016 04:21AM
I am trying to complete a restore and let the restore go for two days. When I went to troubleshoot I found that by running the command "lsof | grep rsync" I could see the current file it was trying to restore and it was hung on this file. However, when I try to run restore again, it just ends up hanging on a different file. Any assistance to figure out what is going on would be appreciated. I am currently on version 3.3.1 of BackupPC. The rsync version on BackupPC server is rsync version 3.1.2pre1. The rsync version on the target server is rsync version 3.0.6.
Backuppc keeps hanging on restore
July 21, 2016 06:12AM
The restore seems to be getting stuck on the larger files. There is plenty of space on the disk.
Backuppc keeps hanging on restore
July 21, 2016 06:44AM
I am trying to complete a restore and let the restore go for two days. When I went to troubleshoot I found that by running the command "lsof | grep rsync" I could see the current file it was trying to restore and it was hung on this file. However, when I try to run restore again, it just ends up hanging on a different file. Any assistance to figure out what is going on would be appreciated. I am currently on version 3.3.1 of BackupPC. The rsync version on BackupPC server is rsync version 3.1.2pre1. The rsync version on the target server is rsync version 3.0.6.

It always seems to hang up on larger files, although I have plenty of space on my drive.
Backuppc keeps hanging on restore
July 21, 2016 07:03AM
Correction, when I run restore again it does indeed hang on the same file every time. Unless I delete the file, in which case it will obviously hang on a different one.

[b]From:[/b] Pelletier, Robert [mailto]
[b]Sent:[/b] Thursday, July 21, 2016 9:27 AM
[b]To:[/b] backuppc-users < at > lists.sourceforge.net
[b]Subject:[/b] [BackupPC-users] Backuppc keeps hanging on restore

I am trying to complete a restore and let the restore go for two days. When I went to troubleshoot I found that by running the command "lsof | grep rsync" I could see the current file it was trying to restore and it was hung on this file. However, when I try to run restore again, it just ends up hanging on a different file. Any assistance to figure out what is going on would be appreciated. I am currently on version 3.3.1 of BackupPC. The rsync version on BackupPC server is rsync version 3.1.2pre1. The rsync version on the target server is rsync version 3.0.6.

It always seems to hang up on larger files, although I have plenty of space on my drive.
Backuppc keeps hanging on restore
July 21, 2016 07:20AM
On 07/21 06:12 , robp2175 wrote:
[quote]The restore seems to be getting stuck on the larger files. There is plenty of space on the disk.
[/quote]
My advice would be to try doing a restore using tar and netcat, but only
because that's what I do and it works reliably for me.

This would at least allow you to narrow it down to a problem with rsync, or
BackupPC itself.

1. set a netcat process listening and piping to tar; something like:
nc -l -p 8888|tar xzvp -C /path/to/target/dir

2. on the backuppc server, use BackupPC_tarCreate to build a tarball of
the backup you want, pipe that through gzip, then pipe it to netcat in
order to send it across the wire
/usr/share/backuppc/bin/BackupPC_tarCreate -h <hostname> -n -1 -s /
/|gzip| nc 192.168.123.123 8888

Run /usr/share/backuppc/bin/BackupPC_tarCreate without any arguments to get
a (entirely too brief) help message.

If it's a Windows box you're restoring to, the above will still work, you'll
just need the cygwin tools installed.

--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Backuppc keeps hanging on restore
July 21, 2016 07:44AM
This seems to be working nicely, although not at all ideal. May I ask how this will help me troubleshoot my issue? Given how well this method is performing, It does seem like it is an rsync issue, but I have tried a few versions of rsync and all are giving me the issue. Argh.

This method is working great to restore my backup, so thank you very much, it is greatly appreciated.

I did have to change a couple of commands to make this work, for those folks whom stumble upon this.

First of all, I had to install netcat
Yum install nc

Then on the target box (notice I removed the -p, which was not necessary, I am guessing this is dependent on your distro and/or netcat version):
nc -p 8888|tar xzvp -C /path/to/target/dir

Lastly on the backuppc box:
su backuppc (in case you forget this must be run as the backuppc user)
/usr/share/BackupPC/bin/BackupPC_tarCreate -h <hostname> -n -1 -s / /|gzip| nc <ip/hostname of target box> 8888
I highly recommend reading the help file, although brief, should be enough to assist with the format of the above command.

Thanks Carl!

-----Original Message-----
From: Carl Wilhelm Soderstrom [mailto]
Sent: Thursday, July 21, 2016 10:18 AM
To: backuppc-users < at > lists.sourceforge.net
Subject: Re: [BackupPC-users] Backuppc keeps hanging on restore

On 07/21 06:12 , robp2175 wrote:
[quote]The restore seems to be getting stuck on the larger files. There is plenty of space on the disk.
[/quote]
My advice would be to try doing a restore using tar and netcat, but only because that's what I do and it works reliably for me.

This would at least allow you to narrow it down to a problem with rsync, or BackupPC itself.

1. set a netcat process listening and piping to tar; something like:
nc -l -p 8888|tar xzvp -C /path/to/target/dir

2. on the backuppc server, use BackupPC_tarCreate to build a tarball of the backup you want, pipe that through gzip, then pipe it to netcat in order to send it across the wire
/usr/share/backuppc/bin/BackupPC_tarCreate -h <hostname> -n -1 -s / /|gzip| nc 192.168.123.123 8888

Run /usr/share/backuppc/bin/BackupPC_tarCreate without any arguments to get a (entirely too brief) help message.

If it's a Windows box you're restoring to, the above will still work, you'll just need the cygwin tools installed.

--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic patterns at an interface-level. Reveals which users, apps, and protocols are consuming the most bandwidth. Provides multi-vendor support for NetFlow, J-Flow, sFlow and other flows. Make informed decisions using capacity planning reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Backuppc keeps hanging on restore
July 21, 2016 08:11AM
On 07/21 02:41 , Pelletier, Robert wrote:
[quote]This seems to be working nicely, although not at all ideal. May I ask how this will help me troubleshoot my issue? Given how well this method is performing, It does seem like it is an rsync issue, but I have tried a few versions of rsync and all are giving me the issue. Argh.
[/quote]
Since I always just stop at doing backups this way (I don't trust giving the
backup server write permissions to the client), all I can say is that at
least we've narrowed your problem down to something in the rsync
implementation.

I have seen rsync hang occasionally when backing up a client, so seeing it
hang when restoring to a client doesn't surprise me.

[quote]This method is working great to restore my backup, so thank you very much, it is greatly appreciated.

I did have to change a couple of commands to make this work, for those folks whom stumble upon this.

First of all, I had to install netcat
Yum install nc

Then on the target box (notice I removed the -p, which was not necessary, I am guessing this is dependent on your distro and/or netcat version):
nc -p 8888|tar xzvp -C /path/to/target/dir

Lastly on the backuppc box:
su backuppc (in case you forget this must be run as the backuppc user)
/usr/share/BackupPC/bin/BackupPC_tarCreate -h <hostname> -n -1 -s / /|gzip| nc <ip/hostname of target box> 8888
I highly recommend reading the help file, although brief, should be enough to assist with the format of the above command.
[/quote]
Yeah, I wrote those instructions quite a few years ago and filed them away
in a document, and haven't updated them since. The netcat options changed
slightly since then.

[quote]Thanks Carl!
[/quote]
You're welcome.

--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Backuppc keeps hanging on restore
July 21, 2016 09:40AM
This sounds like possibly a bad hard-drive.

-----Original Message-----
From: Pelletier, Robert
Sent: Thursday, July 21, 2016 10:41 AM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] Backuppc keeps hanging on restore

This seems to be working nicely, although not at all ideal. May I ask how
this will help me troubleshoot my issue? Given how well this method is
performing, It does seem like it is an rsync issue, but I have tried a few
versions of rsync and all are giving me the issue. Argh.

This method is working great to restore my backup, so thank you very much,
it is greatly appreciated.

I did have to change a couple of commands to make this work, for those folks
whom stumble upon this.

First of all, I had to install netcat
Yum install nc

Then on the target box (notice I removed the -p, which was not necessary, I
am guessing this is dependent on your distro and/or netcat version):
nc -p 8888|tar xzvp -C /path/to/target/dir

Lastly on the backuppc box:
su backuppc (in case you forget this must be run as the backuppc
user)
/usr/share/BackupPC/bin/BackupPC_tarCreate -h <hostname> -n -1 -s / /|gzip|
nc <ip/hostname of target box> 8888
I highly recommend reading the help file, although brief, should be enough
to assist with the format of the above command.

Thanks Carl!

-----Original Message-----
From: Carl Wilhelm Soderstrom [mailto]
Sent: Thursday, July 21, 2016 10:18 AM
To: backuppc-users < at > lists.sourceforge.net
Subject: Re: [BackupPC-users] Backuppc keeps hanging on restore

On 07/21 06:12 , robp2175 wrote:
[quote]The restore seems to be getting stuck on the larger files. There is plenty
of space on the disk.
[/quote]
My advice would be to try doing a restore using tar and netcat, but only
because that's what I do and it works reliably for me.

This would at least allow you to narrow it down to a problem with rsync, or
BackupPC itself.

1. set a netcat process listening and piping to tar; something like:
nc -l -p 8888|tar xzvp -C /path/to/target/dir

2. on the backuppc server, use BackupPC_tarCreate to build a tarball of the
backup you want, pipe that through gzip, then pipe it to netcat in order to
send it across the wire
/usr/share/backuppc/bin/BackupPC_tarCreate -h <hostname> -n -1 -s /
/|gzip| nc 192.168.123.123 8888

Run /usr/share/backuppc/bin/BackupPC_tarCreate without any arguments to get
a (entirely too brief) help message.

If it's a Windows box you're restoring to, the above will still work, you'll
just need the cygwin tools installed.

--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Backuppc keeps hanging on restore
July 21, 2016 10:05AM
It is not, but thank you.

-----Original Message-----
From: Norm Legare [mailto]
Sent: Thursday, July 21, 2016 11:06 AM
To: General list for user discussion, questions and support <backuppc-users < at > lists.sourceforge.net>
Subject: Re: [BackupPC-users] Backuppc keeps hanging on restore

This sounds like possibly a bad hard-drive.

-----Original Message-----
From: Pelletier, Robert
Sent: Thursday, July 21, 2016 10:41 AM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] Backuppc keeps hanging on restore

This seems to be working nicely, although not at all ideal. May I ask how this will help me troubleshoot my issue? Given how well this method is performing, It does seem like it is an rsync issue, but I have tried a few versions of rsync and all are giving me the issue. Argh.

This method is working great to restore my backup, so thank you very much, it is greatly appreciated.

I did have to change a couple of commands to make this work, for those folks whom stumble upon this.

First of all, I had to install netcat
Yum install nc

Then on the target box (notice I removed the -p, which was not necessary, I am guessing this is dependent on your distro and/or netcat version):
nc -p 8888|tar xzvp -C /path/to/target/dir

Lastly on the backuppc box:
su backuppc (in case you forget this must be run as the backuppc
user)
/usr/share/BackupPC/bin/BackupPC_tarCreate -h <hostname> -n -1 -s / /|gzip| nc <ip/hostname of target box> 8888 I highly recommend reading the help file, although brief, should be enough to assist with the format of the above command.

Thanks Carl!

-----Original Message-----
From: Carl Wilhelm Soderstrom [mailto]
Sent: Thursday, July 21, 2016 10:18 AM
To: backuppc-users < at > lists.sourceforge.net
Subject: Re: [BackupPC-users] Backuppc keeps hanging on restore

On 07/21 06:12 , robp2175 wrote:
[quote]The restore seems to be getting stuck on the larger files. There is
plenty of space on the disk.
[/quote]
My advice would be to try doing a restore using tar and netcat, but only because that's what I do and it works reliably for me.

This would at least allow you to narrow it down to a problem with rsync, or BackupPC itself.

1. set a netcat process listening and piping to tar; something like:
nc -l -p 8888|tar xzvp -C /path/to/target/dir

2. on the backuppc server, use BackupPC_tarCreate to build a tarball of the backup you want, pipe that through gzip, then pipe it to netcat in order to send it across the wire
/usr/share/backuppc/bin/BackupPC_tarCreate -h <hostname> -n -1 -s / /|gzip| nc 192.168.123.123 8888

Run /usr/share/backuppc/bin/BackupPC_tarCreate without any arguments to get a (entirely too brief) help message.

If it's a Windows box you're restoring to, the above will still work, you'll just need the cygwin tools installed.

--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic patterns at an interface-level. Reveals which users, apps, and protocols are consuming the most bandwidth. Provides multi-vendor support for NetFlow, J-Flow, sFlow and other flows. Make informed decisions using capacity planning reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic patterns at an interface-level. Reveals which users, apps, and protocols are consuming the most bandwidth. Provides multi-vendor support for NetFlow, J-Flow, sFlow and other flows. Make informed decisions using capacity planning reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users < at > lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Sorry, only registered users may post in this forum.

Click here to login