SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
NSR 7.4.5 Entire Catalog dump to text file...????
Author Message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
I need to dump an entire Networker catalog, to include a file listing of what's backed up and retention to text file. The plan is to use scanner at a later date for specific file recovery on another Legato environment on an "as needed" basis.

In other words, the customer will say I want:
/u01/app/file_name.txt restored from old_server_long_retired

Put the file on new_server_in_production

I will need to search the dump text file for that file in the date range specified by the customer, find out what tape and SSID it is in and use scanner to recover said file.

All this is for a just in case for their long retention data and they really need to retire the old server.

As always, advice and pointers welcomed and appreciated.

View user's profile Send private message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
I need to dump an entire Networker catalog, to include a file
listing of what's backed up and retention to text file. The plan is
to use scanner at a later date for specific file recovery on another
Legato environment on an "as needed" basis.

In other words, the customer will say I want:
/u01/app/file_name.txt restored from old_server_long_retired

Put the file on new_server_in_production

I will need to search the dump text file for that file in the date
range specified by the customer, find out what tape and SSID it is
in and use scanner to recover said file.

All this is for a just in case for their long retention data and
they really need to retire the old server.

As always, advice and pointers welcomed and appreciated.

I did something similar once. I did an mminfo of the old server, saved as
a CSV file, which I then imported in an Excel Spreadsheet. I would use the
data features to find what I wanted, and then just did a scanner for the
specific saveset ID.

I did an mminfo of

client,client-ID,date-time,client,ssid,volume,name

Then when I needed an old saveset, I would make a client with the right
client ID, do the scanner of the volume for the specific ssid I wanted,
and then do a re-directed recovery onto an current client.

I would start with something like that.


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

Post NSR 7.4.5 Entire Catalog dump to text file...???? 
As someone who has been asked to restore data from as far back as 20
years...

My advice would be against that. Not that it can't be done, more the
issue of finding the proper data. If there is a potential requirement
that the data will be restored, consider a data migration service. The
cost to migrate data is small when planned for in advance when compared
to the cost of spelunking for some of this data.

Just a thought sir, from a humble serf...

Semper fidelis et paratus, /ALE


-----Original Message-----
From: EMC NetWorker discussion [mailto:NETWORKER < at > LISTSERV.TEMPLE.EDU] On
Behalf Of Dennis Peacock
Sent: Wednesday, January 18, 2012 3:38 PM
To: NETWORKER < at > LISTSERV.TEMPLE.EDU
Subject: [Networker] NSR 7.4.5 Entire Catalog dump to text file...????

I need to dump an entire Networker catalog, to include a file listing of
what's backed up and retention to text file. The plan is to use scanner
at a later date for specific file recovery on another Legato environment
on an "as needed" basis.

In other words, the customer will say I want:
/u01/app/file_name.txt restored from old_server_long_retired

Put the file on new_server_in_production

I will need to search the dump text file for that file in the date range
specified by the customer, find out what tape and SSID it is in and use
scanner to recover said file.

All this is for a just in case for their long retention data and they
really need to retire the old server.

As always, advice and pointers welcomed and appreciated.

+----------------------------------------------------------------------
|This was sent by dpeaco < at > acxiom.com via Backup Central.
|Forward SPAM to abuse < at > backupcentral.com.
+----------------------------------------------------------------------


type "signoff networker" in the body of the email. Please write to
networker-request < at > listserv.temple.edu if you have any problems with this
list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

Post  
Eddie,
I understand what you are saying, but this particular customer is downsizing and there is ZERO money to be spent on migration. When labor is considered "free", then we are pushed to use what we have, make everything out of nothing, and show utter perfection when there is none. Rolling Eyes

I guess I'll need at least the following:
SSID
VOLSER
RETENTION
DATE
CLIENT
FILE NAME to include the full path

Can this be done? Even if someone has a script, it would be great.

View user's profile Send private message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
You might have to do a lot of dirty work here.
Here is my suggestion, first do an "mminfo" to document the required saveset details and then run an nsrinfo for one client at a time and populate this information in a separate document so that when you have a restore request for a particular machine you can go and search the information in the required document, get the corresponding saveset information from the mminfo document and run a scanner on that tape.

Rovin A. D'Souza

-----Original Message-----
From: EMC NetWorker discussion [mailto:NETWORKER < at > LISTSERV.TEMPLE.EDU] On Behalf Of Dennis Peacock
Sent: Thursday, January 19, 2012 2:57 AM
To: NETWORKER < at > LISTSERV.TEMPLE.EDU
Subject: [Networker] NSR 7.4.5 Entire Catalog dump to text file...????

Eddie,
I understand what you are saying, but this particular customer is downsizing and there is ZERO money to be spent on migration. When labor is considered "free", then we are pushed to use what we have, make everything out of nothing, and show utter perfection when there is none. [Rolling Eyes]

I guess I'll need at least the following:
SSID
VOLSER
RETENTION
DATE
CLIENT
FILE NAME to include the full path

Can this be done? Even if someone has a script, it would be great.

+----------------------------------------------------------------------
|This was sent by dpeaco < at > acxiom.com via Backup Central.
|Forward SPAM to abuse < at > backupcentral.com.
+----------------------------------------------------------------------


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

View user's profile Send private message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
In regard to: [Networker] NSR 7.4.5 Entire Catalog dump to text...:

I need to dump an entire Networker catalog, to include a file listing of
what's backed up and retention to text file. The plan is to use scanner
at a later date for specific file recovery on another Legato environment
on an "as needed" basis.

In NetWorker parlance, it's generally not called a "catalog". I think
what you're asking about is a list of all the files that were backed up
as part of each saveset.

In other words, the customer will say I want:
/u01/app/file_name.txt restored from old_server_long_retired

Put the file on new_server_in_production

I will need to search the dump text file for that file in the date range
specified by the customer, find out what tape and SSID it is in and use
scanner to recover said file.

You generally don't use scanner to recover files. You typically use
scanner to rebuild either

1) the media database, but only if NetWorker has for some reason forgotten
about a particular tape or the saveset ids on that tape. This would
generally only happen if the tape was relabelled/recycled (in which case
the data is going to be extremely challenging to recover anyway) or you
purposely deleted the tape from your media database, but kept it around.

2) the client file indexes, which is what lets you browse using the
"recover" command and select individual files for recovery.

Also, if you know the exact path to the file and you know the saveset
that contains the (version of the) file you want, you don't need to
scanner. You can recover it directly, bypassing the need for a client
file index.

Are you certain that saving a giant text file that lists every file
backed up in every saveset is going to be any more efficient, in any
metric you choose to use, than it would be to just keep the client file
index around for as long as you need to be able to recover data for
that client?

If you're determined to go the giant text file route, then you want to
do something like (assuming both commands being run on a UNIX/Linux box
and a Bourne-like shell)


#! /bin/sh

client=your_exact_client_name_here
server=your_networker_server_name_here
ssid_nsavetime_tmp=`mktemp /tmp/ssid_savetime.XXXXXX`

#
# dump the ssid,nsavetime to a file and iterate over it
#
mminfo -s "$server" -xc, -ot -q "client=$client" -r 'ssid,nsavetime' \
> $ssid_nsavetime_tmp

#
# get rid of any previous <client>.txt file
#
rm -f "${client}.txt"

#
# save the mminfo output, listing all the things we care about.
# you may want to redirect error output from mminfo, as it may spit out
# warnings about not being able to resolve clients that have been removed
# from the DNS.
#
mminfo -s "$server" -ot -q "client=$client" \
-r 'volume,ssid,client,name,savetime(22),nsavetime,level,totalsize,nfiles' \
> ${client}-mminfo.txt

for l in `egrep -v 'ssid' $ssid_nsavetime_tmp`
do
ssid=`echo "$l" | cut -d , -f 1`
nsavetime=`echo "$l" | cut -d , -f 2`

echo "Contents of ssid=$ssid" >> "${client}.txt"
echo "==================================" >> "${client}.txt"
# if the saveset isn't browseable, you'll get nothing useful here
nsrinfo -s "$server" -t "$nsavetime" $client >> "${client}.txt"
echo "" >> "${client}.txt"
done

rm -f $ssid_nsavetime_tmp



I'm just giving you rope here, though. I'm not responsible for any
unfortunate circumstances you find yourself in because of that rope. Wink

Tim
--
Tim Mooney Tim.Mooney < at > ndsu.edu
Enterprise Computing & Infrastructure 701-231-1076 (Voice)
Room 242-J6, IACC Building 701-231-8541 (Fax)
North Dakota State University, Fargo, ND 58105-5164


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

View user's profile Send private message
Post  
Please allow me to paint a better picture here:

Customer Fuzzy has several Legator masters backing up several clients.
Customer Fuzzy decides that it's time to downsize and retire 8 clients from one master server, Master-B and also retire Master-B.
Due to a requirement of law for a 7 year retention,
Customer Fuzzy has to have a way to recover one of the archived files from historical backup if/when requested, until the data expires.
Customer Fuzzy has Master-A that they want to use to recover any old archive data from Master-B if/when the need ever arises.
We just need a way for them to find the file(s) they want to recover (if/when it ever comes up) and have a process to go through in order to restore said archived data to Master-A so they can play with their data from 7 years ago.

Make more sense now? I hope so. Very Happy

View user's profile Send private message
Post  
BTW Tim,

"if you know the exact path to the file and you know the saveset
that contains the (version of the) file you want, you don't need to
scanner. You can recover it directly, bypassing the need for a client
file index."

This is exactly what I'd prefer to do. I'm not looking to rebuild an index, I just want to recover a file they want IF....they ever need it. I just have to prove that it can be done, document the process, and we can move along from there. Wink

View user's profile Send private message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
In regard to: [Networker] NSR 7.4.5 Entire Catalog dump to text...:

Please allow me to paint a better picture here:

Customer Fuzzy has several Legator masters backing up several clients.
Customer Fuzzy decides that it's time to downsize and retire 8 clients from one master server, Master-B and also retire Master-B.
Due to a requirement of law for a 7 year retention,
Customer Fuzzy has to have a way to recover one of the archived files from historical backup if/when requested, until the data expires.
Customer Fuzzy has Master-A that they want to use to recover any old archive data from Master-B if/when the need ever arises.
We just need a way for them to find the file(s) they want to recover (if/when it ever comes up) and have a process to go through in order to restore said archived data to Master-A so they can play with their data from 7 years ago.

Make more sense now? I hope so. Very Happy

It does.

Be advised that moving volumes (and clients, to a much smaller extent)
between NetWorker servers gets tricky. Because Master-B won't know
anything about the tape volume(s) from Master-A, you are correct that
you'll need to use scanner. I think there's a chance, at least in theory,
that you could have a volid clash when you do that scanner. I think the
chance is pretty remote, but it's something to be aware of.

The same chance exists for clientid, but it's even more remote.

If I were in your situation, I would pursue one of the following options:

1) is it an option to keep master B around, even if it's turned off? The
NetWorker license allows you to do recoveries in perpetuity, so you could
essentially quit paying for the licenses for Master-B, and although you
would not be able to do any backups with it, you could do recoveries down
the road.

I'm guessing that's not an option, but I thought I would at least mention
it.

2) *Don't* wait until you need to do a recovery to see if you're going to
be able to use scanner to rebuild the media and client file index! If
nothing else, run "scanner -m" on the tapes *now* (you may need to create
the volume pool, if Master A has different pools than Master B). scanner
-m only populates the media database, which takes very little space.

If you're talking about more than a couple dozen tapes, this probably
isn't an option either, but if you can do it now, you're increasing your
chances of success down the road. Let's face it, recovery time is not
the time when you want to run into problems or have processes take longer
than they need to.

If you have the disk space on Master A, you could even recreate the
clients now (using the same client id that they have on Master B). If
memory serves, clients don't actually take up a license until after their
first backup, so if you create them but don't add them to any active group
and don't ever run a backup for them, you can have the client defined and
ready to go, but essentially inactive. You'll want to test that, but I
believe that's the way the licensing works.

Tim
--
Tim Mooney Tim.Mooney < at > ndsu.edu
Enterprise Computing & Infrastructure 701-231-1076 (Voice)
Room 242-J6, IACC Building 701-231-8541 (Fax)
North Dakota State University, Fargo, ND 58105-5164


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

View user's profile Send private message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
In regard to: [Networker] NSR 7.4.5 Entire Catalog dump to text...:

"if you know the exact path to the file and you know the saveset
that contains the (version of the) file you want, you don't need to
scanner. You can recover it directly, bypassing the need for a client
file index."

This is exactly what I'd prefer to do. I'm not looking to rebuild an
index, I just want to recover a file they want IF....they ever need it.
I just have to prove that it can be done, document the process, and we
can move along from there. [Wink]

I've done that exact thing many times over the years *but* I haven't had
to do it since they retired the old Motif-based networker "green gui".
I believe the option to do it used to be under the "Saveset" or "Saveset
Recovery" menu. You could pick the saveset you wanted and then just type
in one or more exact paths, and the recovery would essentially search
the saveset for those exact paths and recover them. If the path was a
directory, it recovered it and all its contents.

As I said, I haven't had to do that recently, but if I did have to, I
would start with the recover command, using both the -S and -a options.
I think that's how it's accomplished these days.

Note that this partial saveset recovery still requires that the NetWorker
server know about the volume and all the savesets contained on it, so
at a minimum you would still need to use "scanner -m" to populate just
the media database. saveset recovery & partial saveset recovery bypasses
the client file index, but not the media database.

Tim
--
Tim Mooney Tim.Mooney < at > ndsu.edu
Enterprise Computing & Infrastructure 701-231-1076 (Voice)
Room 242-J6, IACC Building 701-231-8541 (Fax)
North Dakota State University, Fargo, ND 58105-5164


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

View user's profile Send private message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
On 18/01/12 23:20, Dennis Peacock wrote:
Please allow me to paint a better picture here:

Customer Fuzzy has several Legator masters backing up several clients.
Customer Fuzzy decides that it's time to downsize and retire 8 clients from one master server, Master-B and also retire Master-B.
Due to a requirement of law for a 7 year retention,
Customer Fuzzy has to have a way to recover one of the archived files from historical backup if/when requested, until the data expires.
Customer Fuzzy has Master-A that they want to use to recover any old archive data from Master-B if/when the need ever arises.
We just need a way for them to find the file(s) they want to recover (if/when it ever comes up) and have a process to go through in order to restore said archived data to Master-A so they can play with their data from 7 years ago.

Make more sense now? I hope so. Very Happy

My preference would be to keep the media DB and CFI somewhere as they
are. This could be on a VM, or on an old low-spec machine. It doesn't
even need to be kept powered on. This is by far the safest way, and in
the long run will be the cheapest.


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

View user's profile Send private message
Post NSR 7.4.5 Entire Catalog dump to text file...???? 
I second this. Migrate the clients to the other server. You may want
to read esg67488
https://solutions.emc.com/emcsolutionview.asp?id=esg67488 which
describes servers merge.

On 01/19/2012 02:00 AM, Tim Mooney wrote:
In regard to: [Networker] NSR 7.4.5 Entire Catalog dump to text...:

Please allow me to paint a better picture here:

Customer Fuzzy has several Legator masters backing up several clients.
Customer Fuzzy decides that it's time to downsize and retire 8 clients
from one master server, Master-B and also retire Master-B.
Due to a requirement of law for a 7 year retention,
Customer Fuzzy has to have a way to recover one of the archived files
from historical backup if/when requested, until the data expires.
Customer Fuzzy has Master-A that they want to use to recover any old
archive data from Master-B if/when the need ever arises.
We just need a way for them to find the file(s) they want to recover
(if/when it ever comes up) and have a process to go through in order
to restore said archived data to Master-A so they can play with their
data from 7 years ago.

Make more sense now? I hope so. Very Happy

It does.

Be advised that moving volumes (and clients, to a much smaller extent)
between NetWorker servers gets tricky. Because Master-B won't know
anything about the tape volume(s) from Master-A, you are correct that
you'll need to use scanner. I think there's a chance, at least in theory,
that you could have a volid clash when you do that scanner. I think the
chance is pretty remote, but it's something to be aware of.

The same chance exists for clientid, but it's even more remote.

If I were in your situation, I would pursue one of the following options:

1) is it an option to keep master B around, even if it's turned off? The
NetWorker license allows you to do recoveries in perpetuity, so you could
essentially quit paying for the licenses for Master-B, and although you
would not be able to do any backups with it, you could do recoveries down
the road.

I'm guessing that's not an option, but I thought I would at least mention
it.

2) *Don't* wait until you need to do a recovery to see if you're going to
be able to use scanner to rebuild the media and client file index! If
nothing else, run "scanner -m" on the tapes *now* (you may need to create
the volume pool, if Master A has different pools than Master B). scanner
-m only populates the media database, which takes very little space.

If you're talking about more than a couple dozen tapes, this probably
isn't an option either, but if you can do it now, you're increasing your
chances of success down the road. Let's face it, recovery time is not
the time when you want to run into problems or have processes take longer
than they need to.

If you have the disk space on Master A, you could even recreate the
clients now (using the same client id that they have on Master B). If
memory serves, clients don't actually take up a license until after their
first backup, so if you create them but don't add them to any active group
and don't ever run a backup for them, you can have the client defined and
ready to go, but essentially inactive. You'll want to test that, but I
believe that's the way the licensing works.

Tim


--

-- Yaron.


via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

View user's profile Send private message
Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB