Welcome! » Log In » Create A New Profile

Device Streams

Posted by Anonymous 
Device Streams
January 03, 2011 10:25AM
Hello -

What dictates the # of device streams setting for a storage policy?

Our maglibs mount paths allocation policy are all set to 'maximum allowed writers'

From CV's documentation below, can someone clarify 'sum of drives available and/or the sum of writers...'? Is it the physical # of hard drives that make up the LUN? Is it the total # of mount paths for all libraries (used as alternate data paths)? Also, we just changed the device streams on our storage policies for file system from 5 to 10 to see how it goes (as a lot of the jobs were queued over the weekend as the storage policy could only handle 5 streams). How will the system behave if, let's say, we bumped it up to 20, or even 30, device streams?

Thank you.

From CV's documentation below:

"If alternate data paths are added, it is recommended that the number of streams must be equal to the sum of drives available in all the libraries and/or the sum of writers in all the magnetic library/mount paths associated with all the data paths."

__._,_.___
Reply to sender ([email]rickyv87 < at > yahoo.com?subject=Re%3A%20Device%20Streams[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20Device%20Streams[/email]) | [url=http://groups.yahoo.com/group/commvault/post;_ylc=X3oDMTJwb28yaG1yBF9TAzk3MzU5NzE0BGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBG1zZ0lkAzQ1MTgEc2VjA2Z0cgRzbGsDcnBseQRzdGltZQMxMjk0MDc5MTMw?act=reply&messageNum=4518]Reply via web post[/url] | [url=http://groups.yahoo.com/group/commvault/post;_ylc=X3oDMTJldDZzaGtrBF9TAzk3MzU5NzE0BGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBHNlYwNmdHIEc2xrA250cGMEc3RpbWUDMTI5NDA3OTEzMA--]Start a New Topic[/url]
[url=http://groups.yahoo.com/group/commvault/message/4518;_ylc=X3oDMTM0N2pjZHUzBF9TAzk3MzU5NzE0BGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBG1zZ0lkAzQ1MTgEc2VjA2Z0cgRzbGsDdnRwYwRzdGltZQMxMjk0MDc5MTMwBHRwY0lkAzQ1MTg-]Messages in this topic[/url] (1)
Recent Activity: [list] [*] [url=http://groups.yahoo.com/group/commvault/members;_ylc=X3oDMTJmN2k1ZWg4BF9TAzk3MzU5NzE0BGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBHNlYwN2dGwEc2xrA3ZtYnJzBHN0aW1lAzEyOTQwNzkxMjk-?o=6]New Members[/url] 2 [/list] [url=http://groups.yahoo.com/group/commvault;_ylc=X3oDMTJlYzNyMzc5BF9TAzk3MzU5NzE0BGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBHNlYwN2dGwEc2xrA3ZnaHAEc3RpbWUDMTI5NDA3OTEyOQ--]Visit Your Group[/url]

Commvault Documentation here:
[url=http://documentation.commvault.com/]http://documentation.commvault.com/[/url]
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; [url=http://docs.yahoo.com/info/terms/]Terms of Use[/url]

.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=4518/stime=1294079130/nc1=1/nc2=2/nc3=3[/img]
__,_._,___
Device Streams
January 03, 2011 11:19AM
If you're dealing with tape, that's where the # of drives makes the difference. In dealing with MagLib, you're really just trying to find the number where you're getting your optimal read/write speeds. Adding more doesn't get you anything, reducing the number reduces the total write speeds.

In my environment, I have the maglib set for max, but then I use Storage Policies to limit the # of jobs. What was happening was that I had a large amount of WAN backups and because they ran so slow, some LAN jobs here would be stuck waiting while slow WAN jobs ran. So I have a storage policy for WAN jobs and I allow 90 jobs at once to run, because even 90 jobs at one time from the WAN doesn't amount to a lot of throughput. But the LAN jobs, I limit them to about 25 per media agent. This number comes from how many jobs until I see its NIC hit 100% from incoming client data and how much data my disk can write comfortably.

[quote][quote][quote]"rickyv87" <rickyv87 < at > yahoo.com> 1/3/2011 10:22 AM >>>
[/quote][/quote][/quote]
Hello -

What dictates the # of device streams setting for a storage policy?

Our maglibs mount paths allocation policy are all set to 'maximum allowed writers'

From CV's documentation below, can someone clarify 'sum of drives available and/or the sum of writers...'? Is it the physical # of hard drives that make up the LUN? Is it the total # of mount paths for all libraries (used as alternate data paths)? Also, we just changed the device streams on our storage policies for file system from 5 to 10 to see how it goes (as a lot of the jobs were queued over the weekend as the storage policy could only handle 5 streams). How will the system behave if, let's say, we bumped it up to 20, or even 30, device streams?

Thank you.

From CV's documentation below:

"If alternate data paths are added, it is recommended that the number of streams must be equal to the sum of drives available in all the libraries and/or the sum of writers in all the magnetic library/mount paths associated with all the data paths."
Device Streams
January 10, 2011 10:24AM
[quote]What dictates the # of device streams setting for a storage policy? [/quote]

There are a number of places that you can adjust the streams. For a MagLib you want to limit the number of streams to the number of spindles minus 1. In my case I have 5 LUN's presented with 6 spindles for each LUN. So I could allocate up to 5 streams per LUN, but I only allow 2 per for best performance (I use 2TB SATA drives).

I have a shared storage policy with 80 streams, my MagLibs are all set to spill and fill, each Drive in my MagLib's is allocated 5 streams, and each agent subclient is allocated 10 streams. For my VMDK backups this works out to average 2 streams per Drive (LUN). Gives me my best performance.

You will have to adjust each part until you get to your best performance. I know it gets complicated but with CommVault's granularity you can really tweek for performance.
Sorry, only registered users may post in this forum.

Click here to login