SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Backing Up Millions of Files
Author Message
Post Backing Up Millions of Files 
Anyone have any experience with backing up millions of files with DP? We are about to embark on a backup upgrade and are heading to choose DP.

Thing is we currently have a large file store of over 50,000,000 files - small Tiff image files. Each file varies from 100 - 500k.

Anyone use DP to backup to disk or tape and/or with NDMP? Anyone experience any problems?

Thanks,
Reuv

View user's profile Send private message
Post Re: Backing Up Millions of Files 
Hi,

You will find many answers in the latest Performance White Paper:
http://bizsupport1.austin.hp.com/bc/docs/support/SupportManual/c01116958/c01116958.pdf

Regards,
Michael

View user's profile Send private message
Post Small file backup with DP 
When you deal with small files DP does not hndle them well. You need to set up a raw backup of the data, then it will complete in a timely manner. Its not neat but it does work.

View user's profile Send private message
Post Re: Backing Up Millions of Files 
We're using ndmp (DP 5.5) to backup some rather large file system stores. There's a limit on how many files a single object can contain, so if your file store has more than about 20 mill. files, you must split the object (Rather than /share - split to /share/dir1, /share/dir2, etc..). Building file lists take hours before some actual data is transfered.

We backup to both physical tapes and VTL. COPY is not supported for NDMP backup medias.

One anoying thing is that DDAR is not currently supported by DP. So any directory restore requires a full scan of all medias in the backup job. So a restore job that would take less than 15 min. had it been non-ndmp can take more than 15 hours if the backup spans several medias.

Anyone have any experience with backing up millions of files with DP? We are about to embark on a backup upgrade and are heading to choose DP.

Thing is we currently have a large file store of over 50,000,000 files - small Tiff image files. Each file varies from 100 - 500k.

Anyone use DP to backup to disk or tape and/or with NDMP? Anyone experience any problems?

Thanks,
Reuv

View user's profile Send private message
Post  
I believe that in DP you can turn off the tree walk function. IT may be in the global file.

View user's profile Send private message
Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB