Welcome! » Log In » Create A New Profile

Scan complete 3x as quick on new server?!

Posted by Anonymous 
Scan complete 3x as quick on new server?!
October 23, 2009 11:15AM
OK I had a physical server that had some LUNs assigned from our SAN. Without listing the entire spec, think year old quad core running 2003 x64, with plenty of RAM and dual HBAs into the SAN using Power path for failover.

The data is approx 7tb and 10m files, and a full scan would take approx 3.5 hours and then the backup phase would begin.

The server has had some problems so we took it out of service and re-assigned the data LUNs to our ESX boxes and then to a VM.

Today I installed the Windows iDataAgent on the new VM and the full backup started a while back.

To my surprise, the full scan has completed in 50 minutes?!

I guess there could be lots of reasons for this, but can anyone think of anything obvious as I would have expected the VM to be slower, not 3x faster?!

Incidentally, any idea why it may show a scan type of Mixed and the message under of Scan Change of:

Some of the paths given do not support Change journal. 1040188539 customMessageId=0;?

The file count looks correct.

Paul

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the e-mail as this is prohibited.

__._,_.___
Messages in this topic (1) Reply (via web post) | Start a new topic
Messages | Links | Database | Polls | Members | Calendar
Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE
http://groups.yahoo.com/group/mompowergroup/]Mom Power: Discover the community of moms doing more for their families, for the world and for each other[/url]


Change settings via the Web (Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest (commvault-digest &lt; at &gt; yahoogroups.com?subject=Email Delivery: Digest) | Switch format to Traditional
Unsubscribe (commvault-unsubscribe &lt; at &gt; yahoogroups.com?subject=)

Recent Activity
Visit Your Group
Yahoo! Finance

http://us.rd.yahoo.com/evt=50284/*http://finance.yahoo.com/personal-finance]It's Now Personal[/url]
Guides, news,
advice & more.
Biz Resources

http://us.rd.yahoo.com/evt=44092/*http://smallbusiness.yahoo.com/r-index]Y! Small Business[/url]
Articles, tools,
forms, and more.
Yahoo! Groups

http://groups.yahoo.com/group/mompowergroup/]Mom Power[/url]
Discover doing more
for your family

.


__,_._,___
Scan complete 3x as quick on new server?!
October 23, 2009 03:58PM
Hi Paul

Change Journal isn&#39;t used if you have File Archiver installed

With 10million files i would install Data Classification enabler (DCE) which will stop thescan phase all together.

DCE is a small COmmVault DB that tracks file changes. When a backup starts, the FS iDA does a query against the DB to get the file list.

DCE is <$100 Aussie RRP so  it will be cheap as chips in pounds.

John

On Sat, Oct 24, 2009 at 5:04 AM, Paul Hutchings <paul.hutchings < at > mira.co.uk (paul.hutchings &lt; at &gt; mira.co.uk)> wrote:
Quote

 

OK I had a physical server that had some LUNs assigned from our SAN.  Without listing the entire spec, think year old quad core running 2003 x64, with plenty of RAM and dual HBAs into the SAN using Power path for failover.
 
The data is approx 7tb and 10m files, and a full scan would take approx 3.5 hours and then the backup phase would begin.
 
The server has had some problems so we took it out of service and re-assigned the data LUNs to our ESX boxes and then to a VM.
 
Today I installed the Windows iDataAgent on the new VM and the full backup started a while back.
 
To my surprise, the full scan has completed in 50 minutes?!
 
I guess there could be lots of reasons for this, but can anyone think of anything obvious as I would have expected the VM to be slower, not 3x faster?!
 
Incidentally, any idea why it may show a scan type of “Mixed” and the message under of Scan Change of:
 
“Some of the paths given do not support Change journal. 1040188539 customMessageId=0;”?
 
The file count looks correct.
 
Paul
 

MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the e-mail as this is prohibited.

__._,_.___
Messages in this topic (2) Reply (via web post) | Start a new topic
Messages | Links | Database | Polls | Members | Calendar
Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE
http://groups.yahoo.com/group/mompowergroup/]Mom Power: Discover the community of moms doing more for their families, for the world and for each other[/url]


Change settings via the Web (Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest (commvault-digest &lt; at &gt; yahoogroups.com?subject=Email Delivery: Digest) | Switch format to Traditional
Unsubscribe (commvault-unsubscribe &lt; at &gt; yahoogroups.com?subject=)

Recent Activity
Visit Your Group
Yahoo! Finance

http://us.rd.yahoo.com/evt=50284/*http://finance.yahoo.com/personal-finance]It's Now Personal[/url]
Guides, news,
advice & more.
Share Photos

http://us.rd.yahoo.com/evt=44092/*http://smallbusiness.yahoo.com/webhosting]Put your favorite[/url]
photos and
more online.
Yahoo! Groups

http://finance.groups.yahoo.com/group/BankofAmerica_SmallBusiness/]Small Business Group[/url]
Own a business?
Connect with others.

.


__,_._,___
Scan complete 3x as quick on new server?!
October 23, 2009 05:51PM
We've had some strange problems with scanning on a large W2k3-32bit
fileserver. It's approx 14million files on a single partition, and
approx 5TB. A few months ago, Change Journal just stopped responding to
the filesys agent. We changed to classic scan, and were able to complete
the scan in approx 8 hours, but it got progressively slower and started
taking about 12-14 hours to complete the scan. But recently the server's
mgr tweaked some general Windows performance settings, and we're back
down to 5-6 hours for the classic scan. This is a very sensitive server,
and I'm unsure whether to try the Journal scan again. I created a test
subclient for a single directory with approx 25 files, but the Journal
Scan ran for over a half-hour before I killed it. vs the 12secs with the
Classic scan for that directory.

We would like to try to Data Classification service, but we don't know
if it requires Journaling to be operational or not, and we're afraid of
putting any additional load on the server due to its sensitivity.

Paul Hutchings wrote:
Quote

OK I had a physical server that had some LUNs assigned from our SAN.
Without listing the entire spec, think year old quad core running 2003
x64, with plenty of RAM and dual HBAs into the SAN using Power path
for failover.

The data is approx 7tb and 10m files, and a full scan would take
approx 3.5 hours and then the backup phase would begin.

The server has had some problems so we took it out of service and
re-assigned the data LUNs to our ESX boxes and then to a VM.

Today I installed the Windows iDataAgent on the new VM and the full
backup started a while back.

To my surprise, the full scan has completed in 50 minutes?!

I guess there could be lots of reasons for this, but can anyone think
of anything obvious as I would have expected the VM to be slower, not
3x faster?!

Incidentally, any idea why it may show a scan type of “Mixed” and the
message under of Scan Change of:

“Some of the paths given do not support Change journal. 1040188539
customMessageId=0;”?

The file count looks correct.

Paul

------------------------------------------------------------------------

*MIRA Ltd*
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the
use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us
either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the
e-mail as this is prohibited.

------------------------------------

Commvault Documentation here:
[documentation.commvault.com]! Groups Links

<*> To visit your group on the web, go to:
[groups.yahoo.com]

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
[groups.yahoo.com]
(Yahoo! ID required)

<*> To change settings via email:
mailto:commvault-digest < at > yahoogroups.com
mailto:commvault-fullfeatured < at > yahoogroups.com

<*> To unsubscribe from this group, send an email to:
commvault-unsubscribe < at > yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
[docs.yahoo.com]
Scan complete 3x as quick on new server?!
October 23, 2009 05:56PM
Ntfs change journal is faster than scanning the file system? Sounds
about right.

On Friday, October 23, 2009, Paul Hutchings <paul.hutchings < at > mira.co.uk> wrote:
Quote


OK I had a physical server that
had some LUNs assigned from our SAN.  Without listing the entire spec,
think year old quad core running 2003 x64, with plenty of RAM and dual HBAs
into the SAN using Power path for failover.

The data is approx 7tb and 10m
files, and a full scan would take approx 3.5 hours and then the backup phase
would begin.

The server has had some problems
so we took it out of service and re-assigned the data LUNs to our ESX boxes and
then to a VM.

Today I installed the Windows
iDataAgent on the new VM and the full backup started a while back.

To my surprise, the full scan
has completed in 50 minutes?!

I guess there could be lots of
reasons for this, but can anyone think of anything obvious as I would have expected
the VM to be slower, not 3x faster?!

Incidentally, any idea why it
may show a scan type of “Mixed” and the message under of Scan Change
of:

“Some of the paths given
do not support Change journal. 1040188539 customMessageId=0;”?

The file count looks correct.

Paul

MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for
the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify
us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of
the e-mail as this is prohibited.
--
Regards,
Eugene Vilensky
evilensky < at > gmail.com

------------------------------------

Commvault Documentation here:
[documentation.commvault.com]! Groups Links

<*> To visit your group on the web, go to:
[groups.yahoo.com]

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
[groups.yahoo.com]
(Yahoo! ID required)

<*> To change settings via email:
mailto:commvault-digest < at > yahoogroups.com
mailto:commvault-fullfeatured < at > yahoogroups.com

<*> To unsubscribe from this group, send an email to:
commvault-unsubscribe < at > yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
[docs.yahoo.com]
Scan complete 3x as quick on new server?!
October 23, 2009 05:56PM
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
Perhaps you had 32 bit software on 64 bit server, try data classification agent could be quicker still although not sure it will work with 10 m files.

--------------------------
Sent using BlackBerry

-----Original Message-----
From: commvault < at > yahoogroups.com <commvault < at > yahoogroups.com>
To: commvault < at > yahoogroups.com <commvault < at > yahoogroups.com>
Sent: Fri Oct 23 19:04:49 2009
Subject: [commvault] Scan complete 3x as quick on new server?!

OK I had a physical server that had some LUNs assigned from our SAN. Without listing the entire spec, think year old quad core running 2003 x64, with plenty of RAM and dual HBAs into the SAN using Power path for failover.

The data is approx 7tb and 10m files, and a full scan would take approx 3.5 hours and then the backup phase would begin.

The server has had some problems so we took it out of service and re-assigned the data LUNs to our ESX boxes and then to a VM.

Today I installed the Windows iDataAgent on the new VM and the full backup started a while back.

To my surprise, the full scan has completed in 50 minutes?!

I guess there could be lots of reasons for this, but can anyone think of anything obvious as I would have expected the VM to be slower, not 3x faster?!

Incidentally, any idea why it may show a scan type of “Mixed” and the message under of Scan Change of:

“Some of the paths given do not support Change journal. 1040188539 customMessageId=0;”?

The file count looks correct.

Paul

________________________________

MIRA Ltd
Watling Street, Nuneaton, Warwickshire, CV10 0TU, England.
Registered in England and Wales No. 402570
VAT Registration GB 114 5409 96

The contents of this e-mail are confidential and are solely for the use of the intended recipient.
If you receive this e-mail in error, please delete it and notify us either by e-mail, telephone or fax.
You should not copy, forward or otherwise disclose the content of the e-mail as this is prohibited.

__._,_.___
Messages in this topic (5) Reply (via web post) | Start a new topic
Messages | Links | Database | Polls | Members | Calendar
Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE
http://groups.yahoo.com/group/mompowergroup/]Mom Power: Discover the community of moms doing more for their families, for the world and for each other[/url]


Change settings via the Web (Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest (commvault-digest &lt; at &gt; yahoogroups.com?subject=Email Delivery: Digest) | Switch format to Traditional
Unsubscribe (commvault-unsubscribe &lt; at &gt; yahoogroups.com?subject=)

Recent Activity
Visit Your Group
Yahoo! Finance

http://us.rd.yahoo.com/evt=50284/*http://finance.yahoo.com/personal-finance]It's Now Personal[/url]
Guides, news,
advice & more.
Drive Traffic

http://us.rd.yahoo.com/evt=44092/*http://searchmarketing.yahoo.com/srch/index.php]Sponsored Search[/url]
can help increase
your site traffic.
Yahoo! Groups

http://finance.groups.yahoo.com/group/BankofAmerica_SmallBusiness/]Small Business Group[/url]
Own a business?
Connect with others.

.


__,_._,___
Sorry, only registered users may post in this forum.

Click here to login