Welcome! » Log In » Create A New Profile

Backing Up Millions of Files

Posted by reuvygroovy 
Backing Up Millions of Files
August 12, 2009 03:57AM
Anyone have any experience with backing up millions of files with DP? We are about to embark on a backup upgrade and are heading to choose DP.

Thing is we currently have a large file store of over 50,000,000 files - small Tiff image files. Each file varies from 100 - 500k.

Anyone use DP to backup to disk or tape and/or with NDMP? Anyone experience any problems?

Thanks,
Reuv
Backing Up Millions of Files
August 13, 2009 05:16AM
Hi,

You will find many answers in the latest Performance White Paper:
[bizsupport1.austin.hp.com]

Regards,
Michael
Backing Up Millions of Files
September 22, 2009 08:50AM
When you deal with small files DP does not hndle them well. You need to set up a raw backup of the data, then it will complete in a timely manner. Its not neat but it does work.
Backing Up Millions of Files
September 29, 2009 02:40AM
We're using ndmp (DP 5.5) to backup some rather large file system stores. There's a limit on how many files a single object can contain, so if your file store has more than about 20 mill. files, you must split the object (Rather than /share - split to /share/dir1, /share/dir2, etc..). Building file lists take hours before some actual data is transfered.

We backup to both physical tapes and VTL. COPY is not supported for NDMP backup medias.

One anoying thing is that DDAR is not currently supported by DP. So any directory restore requires a full scan of all medias in the backup job. So a restore job that would take less than 15 min. had it been non-ndmp can take more than 15 hours if the backup spans several medias.

Quote

Anyone have any experience with backing up millions of files with DP? We are about to embark on a backup upgrade and are heading to choose DP.

Thing is we currently have a large file store of over 50,000,000 files - small Tiff image files. Each file varies from 100 - 500k.

Anyone use DP to backup to disk or tape and/or with NDMP? Anyone experience any problems?

Thanks,
Reuv
Backing Up Millions of Files
September 30, 2009 08:09AM
I believe that in DP you can turn off the tree walk function. IT may be in the global file.
Sorry, only registered users may post in this forum.

Click here to login