Backup Central

Hi

We use HDPS (Commvault in our environment. The full backup consume 10TB of data. I have configured disk spool in order to reduce backup window and to increase throughput.There are two magnetic library and a tape robot are used for backup.The meglibs are
Meglib1 - 2.27 TB
Meglib2 - 3.17 TB
Meglib1 is used for incremental backup storage.
Meglib2 is used for disk spool (for full backup) and auxiliary copy has been configured to copy the backup from Meglib2 to tape. Then the backup in the Meglib2 is erased automatically.When full backup is performed, the backup is copied to Meglib2, then Auxiliary copy (tape) has to wait till primary copy (disk spool) is completed. Then only auxiliary copy is executed.Till primary copy is completed, auxiliary copy shows no data to be copied (when I check 'Media not copied').This leads two problem.

1. Certain clients data are bigger than 3.17 (bigger than spool area), so you have to backup directly to tape.

2. Aux is idle since full backup get finished.

Is there any way I can execute Aux copy while primary copy in progress. So Aux copy will clear the spool area, so I can fit bigger data client into spool area.

I am not looking for parallel copy option in Aux (secondary) copy since it doesn't clear the data on primary copy.Ultimately I will end up with two identical backup copies .

Please give me a solution to copy the data from spool area to tape as primary copy in progress (without waiting for primary to finish).

I will appreciate your kind help.

Cheers
Alam.


__._,_.___
Reply to sender ([email]alampcs < at > yahoo.com?subject=Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply via web post | Start a New Topic
Messages in this topic (1)
Recent Activity:

• New Members 9

Visit Your Group

Commvault Documentation here:
http://documentation.commvault.com/
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; Terms of Use




.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=4626/stime=1295977834/nc1=4025338/nc2=4507179/nc3=5741395[/img]
__,_._,___

For any given backup job, the Auxiliary Copy can only copy from one Storage Policy Copy to the next if the backup job has completed.


So if you have 10 backup jobs and 3 have completed, with the remaining 7 still running, you can aux copy those 3x jobs off to tape but then have to wait for the other 7 to complete.


Would recommend instead that you look at de-duplication options or purchasing more disk.


Luke

On 25/01/2011, at 2:40 PM, alampcs wrote:

Hi

We use HDPS (Commvault in our environment. The full backup consume 10TB of data. I have configured disk spool in order to reduce backup window and to increase throughput.There are two magnetic library and a tape robot are used for backup.The meglibs are
Meglib1 - 2.27 TB
Meglib2 - 3.17 TB
Meglib1 is used for incremental backup storage.
Meglib2 is used for disk spool (for full backup) and auxiliary copy has been configured to copy the backup from Meglib2 to tape. Then the backup in the Meglib2 is erased automatically.When full backup is performed, the backup is copied to Meglib2, then Auxiliary copy (tape) has to wait till primary copy (disk spool) is completed. Then only auxiliary copy is executed.Till primary copy is completed, auxiliary copy shows no data to be copied (when I check 'Media not copied').This leads two problem.

1. Certain clients data are bigger than 3.17 (bigger than spool area), so you have to backup directly to tape.

2. Aux is idle since full backup get finished.

Is there any way I can execute Aux copy while primary copy in progress. So Aux copy will clear the spool area, so I can fit bigger data client into spool area.

I am not looking for parallel copy option in Aux (secondary) copy since it doesn't clear the data on primary copy.Ultimately I will end up with two identical backup copies .

Please give me a solution to copy the data from spool area to tape as primary copy in progress (without waiting for primary to finish).

I will appreciate your kind help.

Cheers
Alam.






__._,_.___
Reply to sender ([email]kaneda.san.sec < at > gmail.com?subject=Re%3A%20%5Bcommvault%5D%20Disk%20spool%20Best%20Practic[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20%5Bcommvault%5D%20Disk%20spool%20Best%20Practic[/email]) | Reply via web post | Start a New Topic
Messages in this topic (2)
Recent Activity:

• New Members 10

Visit Your Group

Commvault Documentation here:
http://documentation.commvault.com/
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; Terms of Use




.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=4632/stime=1295998655/nc1=5741393/nc2=4025304/nc3=4507179[/img]
__,_._,___

mmm cake.


On 27/01/2011, at 6:24 PM, Mark Edwards wrote:

Alam,



just be aware that although you will get _some_ benefit with block level dedupe, the vast majority of the storage benefit is obtained when storing additional full or incremental backups of the same client on the same magnetic library. Think of it like adding layers to a cake... each time you add a layer that is substantially similar to the previous 'layer' then you will receive a benefit. If the 3.17TB of data from one client itself contains duplicated blocks then you will benefit slightly from the dedupe, but the biggest benefit will occur when you layer a second 'full' of this client into the same policy copy.


What I am getting to here, is that even with dedupe enabled, you are still going to need additional disk to make this work properly.


regards,


mark.

On Thu, Jan 27, 2011 at 08:57, alampcs <alampcs < at > yahoo.com ([email]alampcs < at > yahoo.com[/email])> wrote:


Thank you very much for the input. I will look at dedup option.

Cheers
Alam.

--- In commvault < at > yahoogroups.com ([email]commvault%40yahoogroups.com[/email]), Luke <kaneda.san.sec < at > ...> wrote:

For any given backup job, the Auxiliary Copy can only copy from one Storage Policy Copy to the next if the backup job has completed.

So if you have 10 backup jobs and 3 have completed, with the remaining 7 still running, you can aux copy those 3x jobs off to tape but then have to wait for the other 7 to complete.

Would recommend instead that you look at de-duplication options or purchasing more disk.

Luke

On 25/01/2011, at 2:40 PM, alampcs wrote:

Hi

We use HDPS (Commvault in our environment. The full backup consume 10TB of data. I have configured disk spool in order to reduce backup window and to increase throughput.There are two magnetic library and a tape robot are used for backup.The meglibs are
Meglib1 - 2.27 TB
Meglib2 - 3.17 TB
Meglib1 is used for incremental backup storage.
Meglib2 is used for disk spool (for full backup) and auxiliary copy has been configured to copy the backup from Meglib2 to tape. Then the backup in the Meglib2 is erased automatically.When full backup is performed, the backup is copied to Meglib2, then Auxiliary copy (tape) has to wait till primary copy (disk spool) is completed. Then only auxiliary copy is executed.Till primary copy is completed, auxiliary copy shows no data to be copied (when I check 'Media not copied').This leads two problem.

1. Certain clients data are bigger than 3.17 (bigger than spool area), so you have to backup directly to tape.

2. Aux is idle since full backup get finished.

Is there any way I can execute Aux copy while primary copy in progress. So Aux copy will clear the spool area, so I can fit bigger data client into spool area.

I am not looking for parallel copy option in Aux (secondary) copy since it doesn't clear the data on primary copy.Ultimately I will end up with two identical backup copies .

Please give me a solution to copy the data from spool area to tape as primary copy in progress (without waiting for primary to finish).

I will appreciate your kind help.

Cheers
Alam.















--
regards,

Mark P. Edwards










__._,_.___
Reply to sender ([email]kaneda.san.sec < at > gmail.com?subject=Re%3A%20%5Bcommvault%5D%20Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20%5Bcommvault%5D%20Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply via web post | Start a New Topic
Messages in this topic (5)
Recent Activity:

• New Members 8

Visit Your Group

Commvault Documentation here:
http://documentation.commvault.com/
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; Terms of Use




.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=4649/stime=1296118278/nc1=1/nc2=2/nc3=3[/img]
__,_._,___

just be thankful that you can't de-dupe chocolate cake

On 27/01/2011, at 8:59 PM, Mark Edwards wrote:

yeah, cake. that didn't come out quite as well as I had hoped...

On Thu, Jan 27, 2011 at 19:51, Luke <kaneda.san.sec < at > gmail.com ([email]kaneda.san.sec < at > gmail.com[/email])> wrote:

mmm cake.



On 27/01/2011, at 6:24 PM, Mark Edwards wrote:





Alam,



just be aware that although you will get _some_ benefit with block level dedupe, the vast majority of the storage benefit is obtained when storing additional full or incremental backups of the same client on the same magnetic library. Think of it like adding layers to a cake... each time you add a layer that is substantially similar to the previous 'layer' then you will receive a benefit. If the 3.17TB of data from one client itself contains duplicated blocks then you will benefit slightly from the dedupe, but the biggest benefit will occur when you layer a second 'full' of this client into the same policy copy.


What I am getting to here, is that even with dedupe enabled, you are still going to need additional disk to make this work properly.


regards,


mark.




On Thu, Jan 27, 2011 at 08:57, alampcs <alampcs < at > yahoo.com ([email]alampcs < at > yahoo.com[/email])> wrote:


Thank you very much for the input. I will look at dedup option.

Cheers
Alam.

--- In commvault < at > yahoogroups.com ([email]commvault%40yahoogroups.com[/email]), Luke <kaneda.san.sec < at > ...> wrote:

For any given backup job, the Auxiliary Copy can only copy from one Storage Policy Copy to the next if the backup job has completed.

So if you have 10 backup jobs and 3 have completed, with the remaining 7 still running, you can aux copy those 3x jobs off to tape but then have to wait for the other 7 to complete.

Would recommend instead that you look at de-duplication options or purchasing more disk.

Luke

On 25/01/2011, at 2:40 PM, alampcs wrote:

Hi

We use HDPS (Commvault in our environment. The full backup consume 10TB of data. I have configured disk spool in order to reduce backup window and to increase throughput.There are two magnetic library and a tape robot are used for backup.The meglibs are
Meglib1 - 2.27 TB
Meglib2 - 3.17 TB
Meglib1 is used for incremental backup storage.
Meglib2 is used for disk spool (for full backup) and auxiliary copy has been configured to copy the backup from Meglib2 to tape. Then the backup in the Meglib2 is erased automatically.When full backup is performed, the backup is copied to Meglib2, then Auxiliary copy (tape) has to wait till primary copy (disk spool) is completed. Then only auxiliary copy is executed.Till primary copy is completed, auxiliary copy shows no data to be copied (when I check 'Media not copied').This leads two problem.

1. Certain clients data are bigger than 3.17 (bigger than spool area), so you have to backup directly to tape.

2. Aux is idle since full backup get finished.

Is there any way I can execute Aux copy while primary copy in progress. So Aux copy will clear the spool area, so I can fit bigger data client into spool area.

I am not looking for parallel copy option in Aux (secondary) copy since it doesn't clear the data on primary copy.Ultimately I will end up with two identical backup copies .

Please give me a solution to copy the data from spool area to tape as primary copy in progress (without waiting for primary to finish).

I will appreciate your kind help.

Cheers
Alam.


















--
regards,

Mark P. Edwards



















--
regards,

Mark P. Edwards








__._,_.___
Reply to sender ([email]kaneda.san.sec < at > gmail.com?subject=Re%3A%20%5Bcommvault%5D%20Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20%5Bcommvault%5D%20Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply via web post | Start a New Topic
Messages in this topic (7)
Recent Activity:

• New Members 8

Visit Your Group

Commvault Documentation here:
http://documentation.commvault.com/
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; Terms of Use




.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=4651/stime=1296122724/nc1=1/nc2=2/nc3=3[/img]
__,_._,___

Hi Mark

It's a very clear explanation about dedup (any way cake )and thank you very much. I have already done some research on dedup. It's a good option to reduce the backup window, but it requires more capacity meglibs and fast disk. I think at the movement I will enable software compression on sub clients which have large data, then I will be able to stage those client's data into spool area.

I can't think about dedup at this stage since my total clients data size is 11 TB, but my hard drive space is around 5TB. So better option is at this stage - software compression, disk spool and aux to tape. What do you think about this idea?

Alam.


__._,_.___
Reply to sender ([email]alampcs < at > yahoo.com?subject=Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20Disk%20spool%20Best%20Practic[/email]) | Reply via web post | Start a New Topic
Messages in this topic (9)
Recent Activity:

• New Members 8

Visit Your Group

Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE

[url=http://global.ard.yahoo.com/SIG=15ofivs1g/M=493064.14543979.14365478.13298430/D=groups/S=1707277520:MKP1/Y=YAHOO/EXP=1296172080/L=1c3b426e-2a5f-11e0-968c-fbe71a991da7/B=0oCPDkwNPRc-/J=1296164880513344/K=V5RkyvMqzPgOJ0HhVK7.Aw/A=6060255/R=0/SIG=1194m4keh/*http://us.toolbar.yahoo.com/?.cpdl=grpj]Stay on top of your group activity without leaving the page you're on - Get the Yahoo! Toolbar now.[/url] if(window.yzq_d==null)window.yzq_d=new Object(); window.yzq_d['0oCPDkwNPRc-']='&U=13cjn2uur%2fN%3d0oCPDkwNPRc-%2fC%3d493064.14543979.14365478.13298430%2fD%3dMKP1%2fB%3d6060255%2fV%3d1'; [img]http://us.bc.yahoo.com/b?P=1c3b426e-2a5f-11e0-968c-fbe71a991da7&T=1checksvh%2fX%3d1296164880%2fE%3d1707277520%2fR%3dgroups%2fK%3d5%2fV%3d2.1%2fW%3dH%2fY%3dYAHOO%2fF%3d1261438953%2fH%3dY29udGVudD0iR287V2lkZ2V0cztQb2RjYXN0cztNb2JpbGU7RmxpY2tyO0dyb3VwcztBdWN0aW9ucztTbWFsbF9CdXNpbmVzcztCcmllZmNhc2U7RmluYW5jZTsiIGRpc2FibGVzaHVmZmxpbmc9IjEiIHNlcnZlSWQ9IjFjM2I0MjZlLTJhNWYtMTFlMC05NjhjLWZiZTcxYTk5MWRhNyIgc2l0ZUlkPSI0NDUyNTUxIiB0U3RtcD0iMTI5NjE2NDg4MDUwMjIyOSIg%2fQ%3d-1%2fS%3d1%2fJ%3d3B5EC442&U=13cjn2uur%2fN%3d0oCPDkwNPRc-%2fC%3d493064.14543979.14365478.13298430%2fD%3dMKP1%2fB%3d6060255%2fV%3d1[/img]

[url=http://global.ard.yahoo.com/SIG=15orc8vrk/M=493064.14543977.14365476.10835568/D=groups/S=1707277520:MKP1/Y=YAHOO/EXP=1296172080/L=1c3b426e-2a5f-11e0-968c-fbe71a991da7/B=1ICPDkwNPRc-/J=1296164880513344/K=V5RkyvMqzPgOJ0HhVK7.Aw/A=6260316/R=0/SIG=11bc8n8gt/*http://custom.yahoo.com/fibromyalgiazone/]Find useful articles and helpful tips on living with Fibromyalgia. Visit the Fibromyalgia Zone today![/url] if(window.yzq_d==null)window.yzq_d=new Object(); window.yzq_d['1ICPDkwNPRc-']='&U=13cq546ke%2fN%3d1ICPDkwNPRc-%2fC%3d493064.14543977.14365476.10835568%2fD%3dMKP1%2fB%3d6260316%2fV%3d1'; [img]http://us.bc.yahoo.com/b?P=1c3b426e-2a5f-11e0-968c-fbe71a991da7&T=1chfqplmv%2fX%3d1296164880%2fE%3d1707277520%2fR%3dgroups%2fK%3d5%2fV%3d2.1%2fW%3dH%2fY%3dYAHOO%2fF%3d3308120043%2fH%3dY29udGVudD0iR287V2lkZ2V0cztQb2RjYXN0cztNb2JpbGU7RmxpY2tyO0dyb3VwcztBdWN0aW9ucztTbWFsbF9CdXNpbmVzcztCcmllZmNhc2U7RmluYW5jZTsiIGRpc2FibGVzaHVmZmxpbmc9IjEiIHNlcnZlSWQ9IjFjM2I0MjZlLTJhNWYtMTFlMC05NjhjLWZiZTcxYTk5MWRhNyIgc2l0ZUlkPSI0NDUyNTUxIiB0U3RtcD0iMTI5NjE2NDg4MDUwMjIyOSIg%2fQ%3d-1%2fS%3d1%2fJ%3d3B5EC442&U=13cq546ke%2fN%3d1ICPDkwNPRc-%2fC%3d493064.14543977.14365476.10835568%2fD%3dMKP1%2fB%3d6260316%2fV%3d1[/img]


Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; Terms of Use




.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=4663/stime=1296164879/nc1=5898812/nc2=4507179/nc3=4025321[/img]
__,_._,___