SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Scan complete 3x as quick on new server?!
Author Message
Post Scan complete 3x as quick on new server?! 
OK I had a physical server that had some LUNs assigned from our SAN. Without listing the entire spec, think year old quad core running 2003 x64, with plenty of RAM and dual HBAs into the SAN using Power path for failover.

The data is approx 7tb and 10m files, and a full scan would take approx 3.5 hours and then the backup phase would begin.

The server has had some problems so we took it out of service and re-assigned the data LUNs to our ESX boxes and then to a VM.

Today I installed the Windows iDataAgent on the new VM and the full backup started a while back.

To my surprise, the full scan has completed in 50 minutes?!

I guess there could be lots of reasons for this, but can anyone think of anything obvious as I would have expected the VM to be slower, not 3x faster?!

Incidentally, any idea why it may show a scan type of “Mixed” and the message under of Scan Change of:

“Some of the paths given do not support Change journal. 1040188539 customMessageId=0;”?

The file count looks correct.

Paul

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the e-mail as this is prohibited.

__._,_.___
Messages in this topic (1) Reply (via web post) | Start a new topic
Messages | Links | Database | Polls | Members | Calendar
Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE
[url=http://us.ard.yahoo.com/SIG=14ktv9tcn/M=493064.12016295.13271503.10835568/D=groups/S=1707277520:MKP1/Y=YAHOO/EXP=1256328929/L=/B=dLwKAkPDhEg-/J=1256321729806980/K=wrg9sXPDo0zwoU.oj8SFgQ/A=5697381/R=0/SIG=11eaa5dke/*http://groups.yahoo.com/group/mompowergroup/]Mom Power: Discover the community of moms doing more for their families, for the world and for each other[/url]


[/url]
[url=http://groups.yahoo.com/group/commvault/join;_ylc=X3oDMTJmOTBrbWVvBF9TAzk3NDc2NTkwBGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBHNlYwNmdHIEc2xrA3N0bmdzBHN0aW1lAzEyNTYzMjE3Mjk-]Change settings via the Web
(Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) | Switch format to Traditional
Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=[/email])


Recent Activity
Visit Your Group
Yahoo! Finance

[url=http://us.ard.yahoo.com/SIG=14hlvbig6/M=493064.12016257.12445664.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256328929/L=/B=dbwKAkPDhEg-/J=1256321729806980/K=wrg9sXPDo0zwoU.oj8SFgQ/A=4507179/R=0/SIG=12de4rskk/*http://us.rd.yahoo.com/evt=50284/*http://finance.yahoo.com/personal-finance]It's Now Personal[/url]
Guides, news,
advice & more.
Biz Resources

[url=http://us.ard.yahoo.com/SIG=14hr6ji8v/M=493064.12016255.12445662.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256328929/L=/B=drwKAkPDhEg-/J=1256321729806980/K=wrg9sXPDo0zwoU.oj8SFgQ/A=4025321/R=0/SIG=12a352npd/*http://us.rd.yahoo.com/evt=44092/*http://smallbusiness.yahoo.com/r-index]Y! Small Business[/url]
Articles, tools,
forms, and more.
Yahoo! Groups

[url=http://us.ard.yahoo.com/SIG=14hj2ud4f/M=493064.12662709.13497510.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256328929/L=/B=d7wKAkPDhEg-/J=1256321729806980/K=wrg9sXPDo0zwoU.oj8SFgQ/A=5689707/R=0/SIG=11eaa5dke/*http://groups.yahoo.com/group/mompowergroup/]Mom Power[/url]
Discover doing more
for your family



.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=2970/stime=1256321729/nc1=4507179/nc2=4025321/nc3=5689707[/img]
__,_._,___

Post Scan complete 3x as quick on new server?! 
Hi Paul


Change Journal isn't used if you have File Archiver installed


With 10million files i would install Data Classification enabler (DCE) which will stop thescan phase all together.

DCE is a small COmmVault DB that tracks file changes. When a backup starts, the FS iDA does a query against the DB to get the file list.

DCE is <$100 Aussie RRP so  it will be cheap as chips in pounds.


John


On Sat, Oct 24, 2009 at 5:04 AM, Paul Hutchings <paul.hutchings < at > mira.co.uk ([email]paul.hutchings < at > mira.co.uk[/email])> wrote:
 

OK I had a physical server that had some LUNs assigned from our SAN.  Without listing the entire spec, think year old quad core running 2003 x64, with plenty of RAM and dual HBAs into the SAN using Power path for failover.
 
The data is approx 7tb and 10m files, and a full scan would take approx 3.5 hours and then the backup phase would begin.
 
The server has had some problems so we took it out of service and re-assigned the data LUNs to our ESX boxes and then to a VM.
 
Today I installed the Windows iDataAgent on the new VM and the full backup started a while back.
 
To my surprise, the full scan has completed in 50 minutes?!
 
I guess there could be lots of reasons for this, but can anyone think of anything obvious as I would have expected the VM to be slower, not 3x faster?!
 
Incidentally, any idea why it may show a scan type of “Mixed” and the message under of Scan Change of:
 
“Some of the paths given do not support Change journal. 1040188539 customMessageId=0;”?
 
The file count looks correct.
 
Paul
 

MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the e-mail as this is prohibited.








__._,_.___
Messages in this topic (2) Reply (via web post) | Start a new topic
Messages | Links | Database | Polls | Members | Calendar
Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE
[url=http://us.ard.yahoo.com/SIG=14k7eg6kc/M=493064.12016295.13271503.10835568/D=groups/S=1707277520:MKP1/Y=YAHOO/EXP=1256345924/L=/B=j12EAkPDhFY-/J=1256338724246909/K=KU5CteYKf1sU4Q3BuROb5g/A=5697381/R=0/SIG=11eaa5dke/*http://groups.yahoo.com/group/mompowergroup/]Mom Power: Discover the community of moms doing more for their families, for the world and for each other[/url]


[/url]
[url=http://groups.yahoo.com/group/commvault/join;_ylc=X3oDMTJmZmxuNDlkBF9TAzk3NDc2NTkwBGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBHNlYwNmdHIEc2xrA3N0bmdzBHN0aW1lAzEyNTYzMzg3MjQ-]Change settings via the Web
(Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) | Switch format to Traditional
Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=[/email])


Recent Activity
Visit Your Group
Yahoo! Finance

[url=http://us.ard.yahoo.com/SIG=14hmpqgat/M=493064.12016257.12445664.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256345924/L=/B=kF2EAkPDhFY-/J=1256338724246909/K=KU5CteYKf1sU4Q3BuROb5g/A=4507179/R=0/SIG=12de4rskk/*http://us.rd.yahoo.com/evt=50284/*http://finance.yahoo.com/personal-finance]It's Now Personal[/url]
Guides, news,
advice & more.
Share Photos

[url=http://us.ard.yahoo.com/SIG=14hbq2e26/M=493064.12016255.12445662.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256345924/L=/B=kV2EAkPDhFY-/J=1256338724246909/K=KU5CteYKf1sU4Q3BuROb5g/A=4025373/R=0/SIG=12dtn7qjm/*http://us.rd.yahoo.com/evt=44092/*http://smallbusiness.yahoo.com/webhosting]Put your favorite[/url]
photos and
more online.
Yahoo! Groups

[url=http://us.ard.yahoo.com/SIG=14hqfre5m/M=493064.12016272.13586184.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256345924/L=/B=kl2EAkPDhFY-/J=1256338724246909/K=KU5CteYKf1sU4Q3BuROb5g/A=5758219/R=0/SIG=124m43uve/*http://finance.groups.yahoo.com/group/BankofAmerica_SmallBusiness/]Small Business Group[/url]
Own a business?
Connect with others.



.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=2971/stime=1256338724/nc1=4507179/nc2=4025373/nc3=5758219[/img]
__,_._,___

Post Scan complete 3x as quick on new server?! 
We've had some strange problems with scanning on a large W2k3-32bit
fileserver. It's approx 14million files on a single partition, and
approx 5TB. A few months ago, Change Journal just stopped responding to
the filesys agent. We changed to classic scan, and were able to complete
the scan in approx 8 hours, but it got progressively slower and started
taking about 12-14 hours to complete the scan. But recently the server's
mgr tweaked some general Windows performance settings, and we're back
down to 5-6 hours for the classic scan. This is a very sensitive server,
and I'm unsure whether to try the Journal scan again. I created a test
subclient for a single directory with approx 25 files, but the Journal
Scan ran for over a half-hour before I killed it. vs the 12secs with the
Classic scan for that directory.

We would like to try to Data Classification service, but we don't know
if it requires Journaling to be operational or not, and we're afraid of
putting any additional load on the server due to its sensitivity.

Paul Hutchings wrote:

OK I had a physical server that had some LUNs assigned from our SAN.
Without listing the entire spec, think year old quad core running 2003
x64, with plenty of RAM and dual HBAs into the SAN using Power path
for failover.

The data is approx 7tb and 10m files, and a full scan would take
approx 3.5 hours and then the backup phase would begin.

The server has had some problems so we took it out of service and
re-assigned the data LUNs to our ESX boxes and then to a VM.

Today I installed the Windows iDataAgent on the new VM and the full
backup started a while back.

To my surprise, the full scan has completed in 50 minutes?!

I guess there could be lots of reasons for this, but can anyone think
of anything obvious as I would have expected the VM to be slower, not
3x faster?!

Incidentally, any idea why it may show a scan type of “Mixed” and the
message under of Scan Change of:

“Some of the paths given do not support Change journal. 1040188539
customMessageId=0;”?

The file count looks correct.

Paul

------------------------------------------------------------------------

*MIRA Ltd*
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the
use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us
either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the
e-mail as this is prohibited.





------------------------------------

Commvault Documentation here:
http://documentation.commvault.com/Yahoo! Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/commvault/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/commvault/join
(Yahoo! ID required)

<*> To change settings via email:
mailto:commvault-digest < at > yahoogroups.com
mailto:commvault-fullfeatured < at > yahoogroups.com

<*> To unsubscribe from this group, send an email to:
commvault-unsubscribe < at > yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
http://docs.yahoo.com/info/terms/

Post Scan complete 3x as quick on new server?! 
Ntfs change journal is faster than scanning the file system? Sounds
about right.

On Friday, October 23, 2009, Paul Hutchings <paul.hutchings < at > mira.co.uk> wrote:


























OK I had a physical server that
had some LUNs assigned from our SAN.  Without listing the entire spec,
think year old quad core running 2003 x64, with plenty of RAM and dual HBAs
into the SAN using Power path for failover.



The data is approx 7tb and 10m
files, and a full scan would take approx 3.5 hours and then the backup phase
would begin.



The server has had some problems
so we took it out of service and re-assigned the data LUNs to our ESX boxes and
then to a VM.



Today I installed the Windows
iDataAgent on the new VM and the full backup started a while back.



To my surprise, the full scan
has completed in 50 minutes?!



I guess there could be lots of
reasons for this, but can anyone think of anything obvious as I would have expected
the VM to be slower, not 3x faster?!



Incidentally, any idea why it
may show a scan type of “Mixed” and the message under of Scan Change
of:



“Some of the paths given
do not support Change journal. 1040188539 customMessageId=0;”?



The file count looks correct.



Paul














MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for
the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify
us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of
the e-mail as this is prohibited.


















--
Regards,
Eugene Vilensky
evilensky < at > gmail.com


------------------------------------

Commvault Documentation here:
http://documentation.commvault.com/Yahoo! Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/commvault/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/commvault/join
(Yahoo! ID required)

<*> To change settings via email:
mailto:commvault-digest < at > yahoogroups.com
mailto:commvault-fullfeatured < at > yahoogroups.com

<*> To unsubscribe from this group, send an email to:
commvault-unsubscribe < at > yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
http://docs.yahoo.com/info/terms/

View user's profile Send private message
Post Scan complete 3x as quick on new server?! 
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
Perhaps you had 32 bit software on 64 bit server, try data classification agent could be quicker still although not sure it will work with 10 m files.

--------------------------
Sent using BlackBerry


-----Original Message-----
From: commvault < at > yahoogroups.com <commvault < at > yahoogroups.com>
To: commvault < at > yahoogroups.com <commvault < at > yahoogroups.com>
Sent: Fri Oct 23 19:04:49 2009
Subject: [commvault] Scan complete 3x as quick on new server?!



OK I had a physical server that had some LUNs assigned from our SAN. Without listing the entire spec, think year old quad core running 2003 x64, with plenty of RAM and dual HBAs into the SAN using Power path for failover.



The data is approx 7tb and 10m files, and a full scan would take approx 3.5 hours and then the backup phase would begin.



The server has had some problems so we took it out of service and re-assigned the data LUNs to our ESX boxes and then to a VM.



Today I installed the Windows iDataAgent on the new VM and the full backup started a while back.



To my surprise, the full scan has completed in 50 minutes?!



I guess there could be lots of reasons for this, but can anyone think of anything obvious as I would have expected the VM to be slower, not 3x faster?!



Incidentally, any idea why it may show a scan type of “Mixed” and the message under of Scan Change of:



“Some of the paths given do not support Change journal. 1040188539 customMessageId=0;”?



The file count looks correct.



Paul



________________________________

MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the e-mail as this is prohibited.




__._,_.___
Messages in this topic (5) Reply (via web post) | Start a new topic
Messages | Links | Database | Polls | Members | Calendar
Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE
[url=http://us.ard.yahoo.com/SIG=14k8vgrmn/M=493064.12016295.13271503.10835568/D=groups/S=1707277520:MKP1/Y=YAHOO/EXP=1256353010/L=/B=ByfHAkPDhFM-/J=1256345810411607/K=msWztIADV33v_OyaCXy7ZA/A=5697381/R=0/SIG=11eaa5dke/*http://groups.yahoo.com/group/mompowergroup/]Mom Power: Discover the community of moms doing more for their families, for the world and for each other[/url]


[/url]
[url=http://groups.yahoo.com/group/commvault/join;_ylc=X3oDMTJmOG1yZzczBF9TAzk3NDc2NTkwBGdycElkAzc0NTA4NTEEZ3Jwc3BJZAMxNzA3Mjc3NTIwBHNlYwNmdHIEc2xrA3N0bmdzBHN0aW1lAzEyNTYzNDU4MTA-]Change settings via the Web
(Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) | Switch format to Traditional
Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=[/email])


Recent Activity
Visit Your Group
Yahoo! Finance

[url=http://us.ard.yahoo.com/SIG=14h3bug3v/M=493064.12016257.12445664.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256353010/L=/B=CCfHAkPDhFM-/J=1256345810411607/K=msWztIADV33v_OyaCXy7ZA/A=4507179/R=0/SIG=12de4rskk/*http://us.rd.yahoo.com/evt=50284/*http://finance.yahoo.com/personal-finance]It's Now Personal[/url]
Guides, news,
advice & more.
Drive Traffic

[url=http://us.ard.yahoo.com/SIG=14h5ru4in/M=493064.12016255.12445662.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256353010/L=/B=CSfHAkPDhFM-/J=1256345810411607/K=msWztIADV33v_OyaCXy7ZA/A=4025338/R=0/SIG=12jnci1fd/*http://us.rd.yahoo.com/evt=44092/*http://searchmarketing.yahoo.com/srch/index.php]Sponsored Search[/url]
can help increase
your site traffic.
Yahoo! Groups

[url=http://us.ard.yahoo.com/SIG=14hthtqqn/M=493064.12016272.13586184.8674578/D=groups/S=1707277520:NC/Y=YAHOO/EXP=1256353010/L=/B=CyfHAkPDhFM-/J=1256345810411607/K=msWztIADV33v_OyaCXy7ZA/A=5758219/R=0/SIG=124m43uve/*http://finance.groups.yahoo.com/group/BankofAmerica_SmallBusiness/]Small Business Group[/url]
Own a business?
Connect with others.



.

[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=2974/stime=1256345810/nc1=4507179/nc2=4025338/nc3=5758219[/img]
__,_._,___

Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB