Welcome! » Log In » Create A New Profile

NDMP NetApp vfiler millions of files...

Posted by ramjet666 
NDMP NetApp vfiler millions of files...
June 01, 2009 04:17PM
Hi,

We are trying to backup a file system containing hundreds of thousands of folders and millions of files.

This data has recently been transferred from a windows 2003 box to a vfiler running on a NetApp fas 3020. We are using NDMP from filer to LTO4 and getting 6300 KB/Sec.

I know its the amount of files causing the issue, the only thing we can think of is robocopying the data to a LUN and backing up a snapshot of it. Seems long winded to me.

Is there any way to increase the backup performance?

Cheers.
NDMP NetApp vfiler millions of files...
June 02, 2009 01:55PM
Hi,

I have the same now, but with EMC Celerra, I tested with multistreaming and multiple backup policies for different mount points, I also created multiple mount points on the filer instead a giant one. I can see it streams better, now I want to team the nics on the media backup server and see how it works. Also EMC and Symantec recommend to have 6.5.3 patch level as it has many fixes for NDMP. Also, you might consider to use fiber attach your filer to the tape library, per Symantec, you should be able to use SSO as well.

Hope it helps.

Regards,
Boris 

On Mon, Jun 1, 2009 at 7:17 PM, ramjet666 <netbackup-forum < at > backupcentral.com ([email]netbackup-forum < at > backupcentral.com[/email])> wrote:
[quote]
Hi,

We are trying to backup a file system containing hundreds of thousands of folders and millions of files.

This data has recently been transferred from a windows 2003 box to a vfiler running on a NetApp fas 3020. We are using NDMP from filer to LTO4 and getting 6300 KB/Sec.

I know its the amount of files causing the issue, the only thing we can think of is robocopying the data to a LUN and backing up a snapshot of it. Seems long winded to me.

Is there any way to increase the backup performance?

Cheers.

+----------------------------------------------------------------------
|This was sent by roger < at > peppiatt.com ([email]roger < at > peppiatt.com[/email]) via Backup Central.
|Forward SPAM to abuse < at > backupcentral.com ([email]abuse < at > backupcentral.com[/email]).
+----------------------------------------------------------------------

_______________________________________________
Veritas-bu maillist  -  Veritas-bu < at > mailman.eng.auburn.edu ([email]Veritas-bu < at > mailman.eng.auburn.edu[/email])
[url=http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu]http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu[/url]
[/quote]
NDMP NetApp vfiler millions of files...
June 02, 2009 11:39PM
Block size could play a role. Increasing the "SIZE_DATA_BUFFERS" to say, 256k, might help. You need to set "SIZE_DATA_BUFFERS_NDMP" also.

[b]From:[/b] veritas-bu-bounces < at > mailman.eng.auburn.edu [mailto] [b]On Behalf Of [/b]Boris Kraizman
[b]Sent:[/b] Wednesday, June 03, 2009 2:25 AM
[b]To:[/b] VERITAS-BU < at > mailman.eng.auburn.edu
[b]Subject:[/b] Re: [Veritas-bu] NDMP NetApp vfiler & millions of files...

Hi,

I have the same now, but with EMC Celerra, I tested with multistreaming and multiple backup policies for different mount points, I also created multiple mount points on the filer instead a giant one. I can see it streams better, now I want to team the nics on the media backup server and see how it works. Also EMC and Symantec recommend to have 6.5.3 patch level as it has many fixes for NDMP. Also, you might consider to use fiber attach your filer to the tape library, per Symantec, you should be able to use SSO as well.

Hope it helps.

Regards,
Boris
On Mon, Jun 1, 2009 at 7:17 PM, ramjet666 <netbackup-forum < at > backupcentral.com ([email]netbackup-forum < at > backupcentral.com[/email])> wrote:

Hi,

We are trying to backup a file system containing hundreds of thousands of folders and millions of files.

This data has recently been transferred from a windows 2003 box to a vfiler running on a NetApp fas 3020. We are using NDMP from filer to LTO4 and getting 6300 KB/Sec.

I know its the amount of files causing the issue, the only thing we can think of is robocopying the data to a LUN and backing up a snapshot of it. Seems long winded to me.

Is there any way to increase the backup performance?

Cheers.

+----------------------------------------------------------------------
|This was sent by roger < at > peppiatt.com ([email]roger < at > peppiatt.com[/email]) via Backup Central.
|Forward SPAM to abuse < at > backupcentral.com ([email]abuse < at > backupcentral.com[/email]).
+----------------------------------------------------------------------

_______________________________________________
Veritas-bu maillist - Veritas-bu < at > mailman.eng.auburn.edu ([email]Veritas-bu < at > mailman.eng.auburn.edu[/email])
[url=http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu]http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu[/url]
NDMP NetApp vfiler millions of files...
June 03, 2009 10:06AM
As I'm sure many others can attest, SSO for NDMP works quite well.

[b]Rusty Major, MCSE, BCFP, VCS[/b] ▪ Sr. Storage Engineer ▪ SunGard Availability Services ▪ 757 N. Eldridge Suite 200, Houston TX 77079 ▪ 281-584-4693
Keeping People and Information Connected® ▪ [url=Tahoma][u]http://availability.sungard.com/[/u][/url]
P [b]Think before you print[/b]
CONFIDENTIALITY: This e-mail (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this e-mail in error, please notify the sender and delete this e-mail from your system.

[b]Boris Kraizman <sysadminzone < at > gmail.com>[/b]
Sent by: veritas-bu-bounces < at > mailman.eng.auburn.edu
06/02/2009 03:55 PM To
VERITAS-BU < at > mailman.eng.auburn.edu cc
Subject
Re: [Veritas-bu] NDMP NetApp vfiler & millions of files...

Hi,

I have the same now, but with EMC Celerra, I tested with multistreaming and multiple backup policies for different mount points, I also created multiple mount points on the filer instead a giant one. I can see it streams better, now I want to team the nics on the media backup server and see how it works. Also EMC and Symantec recommend to have 6.5.3 patch level as it has many fixes for NDMP. Also, you might consider to use fiber attach your filer to the tape library, per Symantec, you should be able to use SSO as well.

Hope it helps.

Regards,
Boris

On Mon, Jun 1, 2009 at 7:17 PM, ramjet666 <[u]netbackup-forum < at > backupcentral.com[/u] ([email]netbackup-forum < at > backupcentral.com[/email])> wrote:

Hi,

We are trying to backup a file system containing hundreds of thousands of folders and millions of files.

This data has recently been transferred from a windows 2003 box to a vfiler running on a NetApp fas 3020. We are using NDMP from filer to LTO4 and getting 6300 KB/Sec.

I know its the amount of files causing the issue, the only thing we can think of is robocopying the data to a LUN and backing up a snapshot of it. Seems long winded to me.

Is there any way to increase the backup performance?

Cheers.

+----------------------------------------------------------------------
|This was sent by [u]roger < at > peppiatt.com[/u] via Backup Central.
|Forward SPAM to [u]abuse < at > backupcentral.com[/u].
+----------------------------------------------------------------------

_______________________________________________
Veritas-bu maillist - [u]Veritas-bu < at > mailman.eng.auburn.edu[/u] ([email]Veritas-bu < at > mailman.eng.auburn.edu[/email])[u]
[/u][url=http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu][u]http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu[/u][/url]
_______________________________________________
Veritas-bu maillist - Veritas-bu < at > mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
NDMP NetApp vfiler millions of files...
June 03, 2009 11:47AM
On Mon, Jun 01, 2009 at 07:17:11PM -0400, ramjet666 wrote:
[quote]We are trying to backup a file system containing hundreds of thousands of folders and millions of files.

This data has recently been transferred from a windows 2003 box to a vfiler running on a NetApp fas 3020. We are using NDMP from filer to LTO4 and getting 6300 KB/Sec.

I know its the amount of files causing the issue, the only thing we can think of is robocopying the data to a LUN and backing up a snapshot of it. Seems long winded to me.

[/quote]
Have you tested that robocopying millions of files is faster?

Some of this could be poor master server catalog performance as it
writes information about the files. You might try a full backup with
'HIST=N' set. That will backup the same files, but won't send per-file
data to the server. Makes restores harder.

Another data point is to just use 'dump' on the filer to the 'null'
device and see how long that takes. You'll never go faster than that.

netapp> dump 0f null /vol/bigvol

[quote]Is there any way to increase the backup performance?
[/quote]
Probably not your issue, but make sure your filer isn't overloaded from
user operations. If those get high, ontap will deprioritize NDMP so
that it crawls...

--
Darren
_______________________________________________
Veritas-bu maillist - Veritas-bu < at > mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
NDMP NetApp vfiler millions of files...
June 03, 2009 11:50AM
On Wed, Jun 03, 2009 at 12:09:23PM +0530, Praveen Gupta wrote:
[quote]Block size could play a role. Increasing the "SIZE_DATA_BUFFERS" to say,
256k, might help. You need to set "SIZE_DATA_BUFFERS_NDMP" also.
[/quote]
Sounded to me like the OP is doing direct NDMP. Those buffer settings
only affect remote NDMP.

--
Darren
_______________________________________________
Veritas-bu maillist - Veritas-bu < at > mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
NDMP NetApp vfiler millions of files...
June 03, 2009 08:51PM
On Wed, Jun 3, 2009 at 2:50 PM, A Darren Dunham <ddunham < at > taos.com ([email]ddunham < at > taos.com[/email])> wrote:
[quote] On Wed, Jun 03, 2009 at 12:09:23PM +0530, Praveen Gupta wrote:
[quote]Block size could play a role. Increasing the "SIZE_DATA_BUFFERS" to say,
256k, might help. You need to set "SIZE_DATA_BUFFERS_NDMP" also.
[/quote]

Sounded to me like the OP is doing direct NDMP.  Those buffer settings
only affect remote NDMP.[/quote]
I don&#39;t have "SIZE_DATA_BUFFERS_NDMP", just regular buffer settings set to 256k, I did change the buffer setting on the Celerra, and I tested with a Solaris media server today, I saw over 70 megabytes /sec on LTO3 tape drives. I also tried multi streaming and multiple jobs. I am planing to team the NICs on the backup media server as well to see if it gives any diffirance. Then I will see how 5T of data will be running.

Thanks,
Boris

[quote]

--
Darren

_______________________________________________
Veritas-bu maillist  -  Veritas-bu < at > mailman.eng.auburn.edu ([email]Veritas-bu < at > mailman.eng.auburn.edu[/email])
[url=http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu]http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu[/url]

[/quote]
NDMP NetApp vfiler millions of files...
September 21, 2009 06:15PM
I am also interested in the performance of NDMP backup of filers. What performance did you get for the 5TB? How many files are there? Is there a published or practical limit of the number of files an NBU/NDMP backup stream can handle?

Thanks,
Ray[/list]
NDMP NetApp vfiler millions of files...
September 21, 2009 07:51PM
how many volumes do you have the millions of files spread across?

large files? small files?

how wide is the directory structure?

how many disks (raid groups) are volume(s) spread accross?

how many tape drives are available to the netapp?

are the files largely static?

we can get better throughput with some tricks, but there will be a limit which will likely be unacceptable for the backup window

such is the Netapp

[quote]Hi,

We are trying to backup a file system containing hundreds of thousands of folders and millions of files.

This data has recently been transferred from a windows 2003 box to a vfiler running on a NetApp fas 3020. We are using NDMP from filer to LTO4 and getting 6300 KB/Sec.

I know its the amount of files causing the issue, the only thing we can think of is robocopying the data to a LUN and backing up a snapshot of it. Seems long winded to me.

Is there any way to increase the backup performance?

Cheers.[/quote]
Sorry, only registered users may post in this forum.

Click here to login