SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Client Side Deduplication
Author Message
Post Client Side Deduplication 
I've been around Deduplication for a long time (using Data Domain units).

I'd like to get a better understanding of the commvault client-side dedupe. I've been using it on 10 of my remote clients on a new Storage Policy I created, but the answers I want are either not in the documentation, or not easily found.

Here are some questions off-hand (which will lead to more):

  • Right now the Storage Policy has 1 disk copy, no aux copies. If I create an Aux copy or a Selective Copy for fulls, (because I want to change the primary copy's retention rules down from 30 days/1 cycle to 7 days 1 cycle) will that worsen my deduplication compression? i.e. it will no longer use those backups that were moved off to tape to find redundant blocks for deduplication.

  • Is there any way around having to do a true full backup when going to a deduplication storage policy? I mean, a full is fine, but is there a way to use the data in an old storage policy to seed an existing deduplication storage policy? There's a page in the documentation called Seeding the sp, but it involves using USB drives and a bunch of pain.

My problem is many of these backups, if I had to do a real full backup with nothing being dedupe'd out, could take weeks to complete as I have a lot of servers with very slow network connections (or Frame Relay, because we party like it's 1993 here).

Most of these backups are vmware where we're using the Virtual Server Agent to do a VMware snapshot.

  • I have 5 media agents. When I create a storage policy for deduplication which uses my Global Deduplication policy (which sits on a media agent specifically to hold the global dedupe database), I can only have 1 of my media agents as a data path. I cannot add all 5. What's the point of having Gridstore if I can't fail over? It's not like the deduplication stores are sitting on the media agents that move the data. It's on my ddb server. This is a severe pain in the ass because that means if I want to load balance, I would need to create a storage policy for each media agent and then manually divide up the servers using Dedupe among them evenly.


************************************************************************
************************************************************************

The information in this electronic mail communication (e-mail) contains confidential information which is the property of the sender and may be protected by the attorney-client privilege and/or attorney work product doctrine. It is intended solely for the addressee. Access to this e-mail by anyone else is unauthorized by the sender. If you are not the intended recipient, you are hereby notified that any disclosure, copying, or distribution of the contents of this e-mail transmission or the taking or omission of any action in reliance thereon or pursuant thereto, is prohibited, and may be unlawful. If you received this e-mail in error, please notify us immediately of your receipt of this message by e-mail and destroy this communication, any attachments, and all copies thereof.
Southwest Gas Corporation does not guarantee the privacy or security of information transmitted by facsimile (fax) or other unsecure electronic means (including email). By choosing to send or receive information, including confidential or personal identifying information, via fax or unencrypted e-mail, you consent to accept any associated risk.
Thank you for your cooperation.

************************************************************************
************************************************************************

__._,_.___
Reply to sender ([email]Bill.Willis < at > swgas.com?subject=Re%3A%20Client%20Side%20Deduplication[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20Client%20Side%20Deduplication[/email]) | Reply via web post | Start a New Topic
Messages in this topic (9)
Recent Activity: Visit Your Group

Commvault Documentation here:
http://documentation.commvault.com/
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; Terms of Use




.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=5229/stime=1312232090/nc1=4507179/nc2=5758220/nc3=4025291[/img]
__,_._,___

Post Client Side Deduplication 
inline
From: Bill Willis <bill.willis < at > swgas.com>
To: commvault < at > yahoogroups.com
Sent: Monday, August 1, 2011 4:54 PM
Subject: [commvault] Client Side Deduplication


I've been around Deduplication for a long time (using Data Domain units).

I'd like to get a better understanding of the commvault client-side dedupe. I've been using it on 10 of my remote clients on a new Storage Policy I created, but the answers I want are either not in the documentation, or not easily found.

Here are some questions off-hand (which will lead to more):

  • Right now the Storage Policy has 1 disk copy, no aux copies. If I create an Aux copy or a Selective Copy for fulls, (because I want to change the primary copy's retention rules down from 30 days/1 cycle to 7 days 1 cycle) will that worsen my deduplication compression? i.e. it will no longer use those backups that were moved off to tape to find redundant blocks for deduplication.
Ans. if you don't seal the Dedupe store your dedupe ratio will not go down. it will keep blocks which are reference by new backups even though old backup of those blocks get prune off from commserver database. and if your AUX are dedupe also then you will see more benefit overall.when you seal dedupe store it will write new base line.
  • Is there any way around having to do a true full backup when going to a deduplication storage policy? I mean, a full is fine, but is there a way to use the data in an old storage policy to seed an existing deduplication storage policy? There's a page in the documentation called Seeding the sp, but it involves using USB drives and a bunch of pain.
Ans. seeding SP is require when you are doing AUX or backup across WAN. if your clients and MA are on LAN, you don't need to seed the SP. what you can do is create new de-dupe copy in existing non dedupe storage policy and copy all jobs when your copy is done promote dedupe copy to primary and remove old non dedupe copy. as you already have backups on primary copy just need to AUX to secondary copy either on same MA or other MA. so connection between MA1 to MA2 has to be good to finish AUX from non dedupe copy to dedupe copy.

My problem is many of these backups, if I had to do a real full backup with nothing being dedupe'd out, could take weeks to complete as I have a lot of servers with very slow network connections (or Frame Relay, because we party like it's 1993 here).



Most of these backups are vmware where we're using the Virtual Server Agent to do a VMware snapshot.

  • I have 5 media agents. When I create a storage policy for deduplication which uses my Global Deduplication policy (which sits on a media agent specifically to hold the global dedupe database), I can only have 1 of my media agents as a data path. I cannot add all 5. What's the point of having Gridstore if I can't fail over? It's not like the deduplication stores are sitting on the media agents that move the data. It's on my ddb server. This is a severe pain in the ass because that means if I want to load balance, I would need to create a storage policy for each media agent and then manually divide up the servers using Dedupe among them evenly.
Ans. DDB hosting media agent and data mover media agent are different. if your index is shared between all five media agents and if all five media agent shared same library (all five media agent should have access to all mount path in that library and at least one media agent should have write permission). you should be able to add other media agent in the data path and you should be able to fail over.

************************************************************************
************************************************************************

The information in this electronic mail communication (e-mail) contains confidential information which is the property of the sender and may be protected by the attorney-client privilege and/or attorney work product doctrine. It is intended solely for the addressee. Access to this e-mail by anyone else is unauthorized by the sender. If you are not the intended recipient, you are hereby notified that any disclosure, copying, or distribution of the contents of this e-mail transmission or the taking or omission of any action in reliance thereon or pursuant thereto, is prohibited, and may be unlawful. If you received this e-mail in error, please notify us immediately of your receipt of this message by e-mail and destroy this communication, any attachments, and all copies thereof.
Southwest Gas Corporation does not guarantee the privacy or security of information transmitted by facsimile (fax) or other unsecure electronic means (including email). By choosing to send or receive information, including confidential or personal identifying information, via fax or unencrypted e-mail, you consent to accept any associated risk.
Thank you for your cooperation.

************************************************************************
************************************************************************









__._,_.___
Reply to sender ([email]niravkapadia < at > yahoo.com?subject=Re%3A%20%5Bcommvault%5D%20Client%20Side%20Deduplication[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20%5Bcommvault%5D%20Client%20Side%20Deduplication[/email]) | Reply via web post | Start a New Topic
Messages in this topic (10)
Recent Activity: Visit Your Group

Commvault Documentation here:
http://documentation.commvault.com/
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) &bull; Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) &bull; Terms of Use




.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=5255/stime=1313386751[/img]
__,_._,___

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB