Backup Central

------=_NextPart_000_0044_01C4F124.85A7A650
Content-Transfer-Encoding: quoted-printable

Hi,

I am backing up a server with lots and lots of small files (about 3
million). Before tapewriting starts, netbackup counts up every file to =
get
the estimated number of files. This takes about two to three hours...
Is there an easy way to disable this feature?

thank=B4s
------=_NextPart_000_0044_01C4F124.85A7A650

Content-Transfer-Encoding: quoted-printable

Hello Daniel,

=20

I'm assuming that this is a Windows server. Please correct me if not.

=20

Find the resource that is causing this to be slow and address it first. =
Use perfmon to determine if the server disk is 100% utilized, if the =
network is saturated or determine if the master server is somehow the =
bottleneck.=20

=20

This is a common problem with a plethora of solutions, depending on =
what's happening. Here are a few:

Defrag the server's drive (I know, that might take a month..)

Do all full backups.

Do only differential incremental backups and use (with NBU 5.0 and =
later) synthetic backups to create full backups periodically and do only =
differential incremental backups.

Try toggling the "use archive bit" in the client definition. Perhaps use =
(or non use) of the archive bit will be faster for you (CAUTION - make =
sure no other application sets or clears archive bits if you use it to =
flag files for backup)

=20

More suggestions would fall along the lines of making the master =
(catalog) server and the network path to it more responsive.

=20

These are just some ideas, but you need to find out what resource is =
saturated before proceeding.

=20

Mickey Baker

Senior Consultant

GlassHouse Technologies.

=20

________________________________

From: veritas-bu-admin < at > mailman.eng.auburn.edu =
[mailto:veritas-bu-admin < at > mailman.eng.auburn.edu] On Behalf Of Daniel =
Suzuki
Sent: Sunday, January 02, 2005 9:41 PM
To: veritas-bu < at > mailman.eng.auburn.edu
Subject: [Veritas-bu] Disable file estimate before start backup

=20

Hi,

I am backing up a server with lots and lots of small files (about 3
million). Before tapewriting starts, netbackup counts up every file to =
get
the estimated number of files. This takes about two to three hours...
Is there an easy way to disable this feature?

thank=B4s

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I believe you can use the no history flag for the job, to disable file
history. I think this is done in bp.conf, but I believe if it is
possible to do it in the job, itself, it would be best to do it there.

If you use this, though, you can only do a complete restore of the
entire image.

Jason


Daniel Suzuki wrote:
| Hi,
|
| I am backing up a server with lots and lots of small files (about 3
| million). Before tapewriting starts, netbackup counts up every file to get
| the estimated number of files. This takes about two to three hours...
| Is there an easy way to disable this feature?
| thank´s
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)

iD8DBQFB2ZiLE8NXcvhlySYRAgoDAJ90aKotinqcOUzyEMXit5XWT/AV5QCdHumY
vOxyUwQLwKb2py9517bapYQ=
=Qagp
-----END PGP SIGNATURE-----

--Apple-Mail-1--48744299
Content-Transfer-Encoding: quoted-printable
charset=ISO-8859-1;
format=flowed

El 03/01/2005, a las 03:41, Daniel Suzuki escribi=F3:

The key is DONT_SORT_DIR, at least on UNIX systems. Do a touch on the=20
/usr/openv/netbackup directory and will help a little not sorting all=20
the files when create the file list. Helped me on a Filesystem with=20
more than 900K files of about 2 or 3Kb each.

Hi,

I am backing up a server with lots and lots of small files (about 3
million). Before tapewriting starts, netbackup counts up every file to=20=

get
the estimated number of files. This takes about two to three hours...
Is there an easy way to disable this feature?
thank=B4s

--Apple-Mail-1--48744299
Content-Transfer-Encoding: quoted-printable

----=_NextPart_ST_07_57_13_Thursday_January_06_2005_7626
Content-Transfer-Encoding: quoted-printable

I have this note on DONT_SORT_DIR
=20
Disables reading and storing of directory entries. Has been used to improv=
e
slow performance. Caution if VxFS is also in place be careful, check with
ENG or backline prior to touching this file.

_____ =20

From: veritas-bu-admin < at > mailman.eng.auburn.edu
[mailto:veritas-bu-admin < at > mailman.eng.auburn.edu] On Behalf Of Alfonso
Correas Serrat
Sent: Wednesday, January 05, 2005 4:20 PM
To: Daniel Suzuki
Cc: veritas-bu < at > mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Disable file estimate before start backup



El 03/01/2005, a las 03:41, Daniel Suzuki escribi=F3:=20


The key is DONT_SORT_DIR, at least on UNIX systems. Do a touch on the
/usr/openv/netbackup directory and will help a little not sorting all the
files when create the file list. Helped me on a Filesystem with more than
900K files of about 2 or 3Kb each.=20


Hi,=20


I am backing up a server with lots and lots of small files (about 3=20

million). Before tapewriting starts, netbackup counts up every file to get

the estimated number of files. This takes about two to three hours...=20

Is there an easy way to disable this feature?=20

thank=B4s=20


----=_NextPart_ST_07_57_13_Thursday_January_06_2005_7626

Content-Transfer-Encoding: quoted-printable

Wow... with that many small files the 3 hours to calculate the size of =
the
job is probably the least of your time concerns...
=20
Have you considered using a block level backup (not to sound like a
NetBackup Sales Rep)
=20
Brian
=20

-----Original Message-----
From: veritas-bu-admin < at > mailman.eng.auburn.edu
[mailto:veritas-bu-admin < at > mailman.eng.auburn.edu] On Behalf Of Stump, =
Robert
(Contractor) (J6B)
Sent: January 6, 2005 07:59 AM
To: 'Alfonso Correas Serrat'; Daniel Suzuki
Cc: veritas-bu < at > mailman.eng.auburn.edu
Subject: RE: [Veritas-bu] Disable file estimate before start backup


I have this note on DONT_SORT_DIR
=20
Disables reading and storing of directory entries. Has been used to =
improve
slow performance. Caution if VxFS is also in place be careful, check =
with
ENG or backline prior to touching this file.

_____ =20

From: veritas-bu-admin < at > mailman.eng.auburn.edu
[mailto:veritas-bu-admin < at > mailman.eng.auburn.edu] On Behalf Of Alfonso
Correas Serrat
Sent: Wednesday, January 05, 2005 4:20 PM
To: Daniel Suzuki
Cc: veritas-bu < at > mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Disable file estimate before start backup



El 03/01/2005, a las 03:41, Daniel Suzuki escribi=F3:=20


The key is DONT_SORT_DIR, at least on UNIX systems. Do a touch on the
/usr/openv/netbackup directory and will help a little not sorting all =
the
files when create the file list. Helped me on a Filesystem with more =
than
900K files of about 2 or 3Kb each.=20


Hi,=20


I am backing up a server with lots and lots of small files (about 3=20

million). Before tapewriting starts, netbackup counts up every file to =
get=20

the estimated number of files. This takes about two to three hours...=20

Is there an easy way to disable this feature?=20

thank=B4s=20

On Thu, Jan 06, 2005 at 09:28:29AM -0500, Stewart, Brian C wrote:
Wow... with that many small files the 3 hours to calculate the size of the
job is probably the least of your time concerns...

Have you considered using a block level backup (not to sound like a
NetBackup Sales Rep)

We have. It doesn't work - we had a call open for several months as
Veritas tried to resolve the issues. They had duplicated the problem
but were unable to fix before we gave up. Windows clients with Solaris
master server. We ended up being forced into using Windows mount points
which the Advanced Client doesn't support at all for block-level backups
so were really sunk then.

There are also a bunch of other gross limitations - the target volume
must be *exactly* the same size as the source volume. That means that
if you happen to change your underlying hardware and can't get volumes
the exact same size any more (which happened to us as we were migrating
from Symmetrix to EVA), you're out of luck. A larger volume wouldn't
suffice.

If you're using block-level backups, make really sure you've done some
restore testing - we had some backups that claimed to be successful but
the files weren't restorable.

Veritas may have fixed these issues in the last 6 months so I could be
passing on old information but you really do need to do some serious
testing of your recoverability (not that you shouldn't anyway...).

--
Ed Wilts, Mounds View, MN, USA
mailto:ewilts < at > ewilts.org

Content-Transfer-Encoding: quoted-printable

Anyone know if there is something similar for a windows client? I have =
a
couple of windows clients that have a couple million files . . . really =
nice
to backup . . .
=20
Thanks!

-----Original Message-----
From: Alfonso Correas Serrat [mailto:alfonso.correas < at > arrakis.es]=20
Sent: Wednesday, January 05, 2005 1:20 PM
To: Daniel Suzuki
Cc: veritas-bu < at > mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Disable file estimate before start backup



El 03/01/2005, a las 03:41, Daniel Suzuki escribi=F3:=20


The key is DONT_SORT_DIR, at least on UNIX systems. Do a touch on the
/usr/openv/netbackup directory and will help a little not sorting all =
the
files when create the file list. Helped me on a Filesystem with more =
than
900K files of about 2 or 3Kb each.=20


Hi,=20


I am backing up a server with lots and lots of small files (about 3=20

million). Before tapewriting starts, netbackup counts up every file to =
get=20

the estimated number of files. This takes about two to three hours...=20

Is there an easy way to disable this feature?=20

thank=B4s=20

Content-Transfer-Encoding: quoted-printable

RAW partition backups I believe are designed especially for this =
situation?

=20

Eric Ljungblad =20
Computer Operator=20
Copley Information Services=20
Eric.Ljungblad < at > copleypress.com <mailto:Eric.Ljungblad < at > copleypress.com> =

(858) 729-8010=20

-----Original Message-----
From: Chapman, Scott [mailto:Scott.Chapman < at > icbc.com]=20
Sent: Monday, January 10, 2005 7:29 PM
To: 'Alfonso Correas Serrat'; Daniel Suzuki
Cc: veritas-bu < at > mailman.eng.auburn.edu
Subject: RE: [Veritas-bu] Disable file estimate before start backup

=20

Anyone know if there is something similar for a windows client? I have =
a
couple of windows clients that have a couple million files . . . really =
nice
to backup . . .

=20

Thanks!

-----Original Message-----
From: Alfonso Correas Serrat [mailto:alfonso.correas < at > arrakis.es]=20
Sent: Wednesday, January 05, 2005 1:20 PM
To: Daniel Suzuki
Cc: veritas-bu < at > mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Disable file estimate before start backup

El 03/01/2005, a las 03:41, Daniel Suzuki escribi=F3:=20

=20

The key is DONT_SORT_DIR, at least on UNIX systems. Do a touch on the
/usr/openv/netbackup directory and will help a little not sorting all =
the
files when create the file list. Helped me on a Filesystem with more =
than
900K files of about 2 or 3Kb each.=20

=20

Hi,=20

=20

I am backing up a server with lots and lots of small files (about 3=20

million). Before tapewriting starts, netbackup counts up every file to =
get=20

the estimated number of files. This takes about two to three hours...=20

Is there an easy way to disable this feature?=20

thank=B4s=20