I am running simpana 8.0 latest service packs and patches. I have currently 1 VADP Proxy server to back up my VMware virtual servers. For the last few weeks during my weekend full back schedule there always 6-7 virtual machines that fail and they are not always the same virtual machines as the week prior that failed. I have no problem after they fail to kick off an individual job and those are always successful. I do not see any errors on those virtual machines inside Virtual Center nor do I see any issues with snapshots being taken and removed for those vms that fail. Here is a partial log file from one of the vm servers that failed. There is some network related errors I see but none I have about 25 virtual machines on the same vm cluster that is working. Anyone experience these types of issues?
Thanks
Chris Slack
4548 1648 04/16 12:00:46 19646 vsbkp::GetVMList() - VMName AUSLCDB07; ServerName auslcvc01.auslc.texasbar.com
4548 1648 04/16 12:01:05 19646 vsbkp::BackupAllVM() - Processing VM AUSLCDB07
4548 1648 04/16 12:01:05 19646 vsbkp::BackupAllVM() - Thread id is 1
4548 1a18 04/16 12:01:05 19646 CCVAPipelayer::SetRestartContext() - Setting restart context to 1
4548 1a18 04/16 12:01:05 19646 CCVAPipelayer::SendCommandToDSBackup() - Sent Command 291 to MediaAgent, Waiting for Response...
4548 1a18 04/16 12:01:06 ##### [PIPELAYER ] Tail response = Current Restart Context has been set to 1 Status = 0 dwCode = 0 MsgType = 16 MsgSubType = 291 EventError = 0
4548 1a18 04/16 12:01:06 19646 CVMWareMount::_Init() - Wait interval between successive mounts set to default of 2 minutes
4548 1a18 04/16 12:01:06 19646 CVcb2P2VXml::_Init() - _Init...
4548 1a18 04/16 12:01:06 19646 CVMDiskInfo::_GetVDDKInstallPath() - Using vStorage VDDK from [C:Program FilesVMwareVMware Virtual Disk Development Kit]
4548 594 04/16 12:01:07 19646 CVMDiskInfo::_VixDiskLibThread() - VixDiskLib thread running
4548 594 04/16 12:01:07 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Init for thread 1a18
4548 594 04/16 12:01:09 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Init for thread 1a18
4548 1a18 04/16 12:01:09 19646 CVMDiskInfo::Init() - Avaiable Transport modes: file:san:hotadd:nbdssl:nbd
4548 1a18 04/16 12:01:10 19646 CVMWareInfo::CVMWareInfo() - App Name from VMInfo:[vsbkp]
4548 1a18 04/16 12:01:10 19646 CVMWareInfo::CVMWareInfo() - Focus Name from VMInfo:[Instance001]
4548 1 04/16 12:01:10 ### ### ### --- Log Number from registry HKEY_LOCAL_MACHINESOFTWARECommVault SystemsGalaxyInstance001EventManager is 1
4548 1 04/16 12:01:10 ### ### ### --- Log Size from registry HKEY_LOCAL_MACHINESOFTWARECommVault SystemsGalaxyInstance001EventManager is 5
4548 1 04/16 12:01:10 ### ### ### --- Log Level from registry HKEY_LOCAL_MACHINESOFTWARECommVault SystemsGalaxyInstance001EventManager is 1
4548 1a18 04/16 12:01:10 19646 CVMWareInfo::Connect() - Connecting to Url=[https://auslcvc01.auslc.texasbar.com/sdk] User=[root]
4548 1 04/16 12:01:10 ### ### CVIWrapper::Connect --- Start>>
4548 1 04/16 12:02:13 ### ### CVIWrapper::Connect --- Connection succesfull with [https://auslcvc01.auslc.texasbar.com/sdk]
4548 1a18 04/16 12:02:13 19646 CVMWareInfo::Connect() - VCB4 is enabled
4548 1a18 04/16 12:02:13 19646 CVMWareInfo::Connect() - VCB4 is available
4548 1a18 04/16 12:02:13 19646 CVMWareInfo::_MountVM_VCB4() - VM:[AUSLCDB07] with GUID:[42153c44-ee21-7ad7-ffa7-24125bc16fe4]
4548 1a18 04/16 12:02:13 19646 CVMWareInfo::_MountVM_VCB4() - Getting VMInfo for VM [AUSLCDB07] with GUID:[42153c44-ee21-7ad7-ffa7-24125bc16fe4]
4548 1 04/16 12:02:13 ### ### GetVMInfoForVM --- VM Name:AUSLCDB07
4548 1 04/16 12:02:13 ### ### GetVMInfoForVM --- VM GUID:42153c44-ee21-7ad7-ffa7-24125bc16fe4
4548 1a18 04/16 12:02:44 19646 CVMWareInfo::_CreateVMSnapshot() - Creating Snapshot of VM [AUSLCDB07] Guid [42153c44-ee21-7ad7-ffa7-24125bc16fe4]
4548 1 04/16 12:11:38 ### ### Createsnapshot --- Successfully created Snapshot __GX_BACKUP__ snapshot-4528 from VM AUSLCDB07
4548 1a18 04/16 12:11:40 19646 CVMWareInfo::_MountVM_VCB4() - Connecting to VM [AUSLCDB07] config [[ISCSIVOL3] AUSLCDB07/AUSLCDB07.vmx] MoRef [vm-3181] snapshot [snapshot-4528] for disk access
4548 1a18 04/16 12:11:40 19646 CVMDiskInfo::Connect() - Selecting default transport mode: san:hotadd:nbd
4548 594 04/16 12:11:40 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Connect for thread 1a18
4548 594 04/16 12:11:41 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Connect for thread 1a18
4548 1a18 04/16 12:11:41 19646 CVMDiskInfo::Connect() - Connected to VM [AUSLCDB07] Guid [42153c44-ee21-7ad7-ffa7-24125bc16fe4]
4548 1a18 04/16 12:11:41 19646 CVMWareInfo::_VerifyChangeTrackingForDisk() - Verifying Change tracking on Disk [AUSLCDB07.vmdk]
4548 1a18 04/16 12:11:46 19646 CVMWareInfo::_MountVM_VCB4() - Opening Disk [[ISCSIVOL3] AUSLCDB07/AUSLCDB07-000010.vmdk] as [AUSLCDB07.vmdk]
4548 1a18 04/16 12:11:46 19646 CVMDiskInfo::OpenDisk() - Opening disk [AUSLCDB07.vmdk] on VM [AUSLCDB07] flags [ Readonly ]
4548 594 04/16 12:11:46 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Open for thread 1a18
4548 594 04/16 12:11:52 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Open for thread 1a18 Err=[0]
4548 1a18 04/16 12:11:52 19646 CVMDiskInfo::OpenDisk() - Opened to [AUSLCDB07] [AUSLCDB07.vmdk] using Transport mode: [nbd]
4548 1a18 04/16 12:11:52 19646 CVMWareInfo::_VerifyChangeTrackingForDisk() - Verifying Change tracking on Disk [AUSLCDB07_1.vmdk]
4548 1a18 04/16 12:11:56 19646 CVMWareInfo::_MountVM_VCB4() - Opening Disk [[ISCSIVOL3] AUSLCDB07/AUSLCDB07_1-000010.vmdk] as [AUSLCDB07_1.vmdk]
4548 1a18 04/16 12:11:56 19646 CVMDiskInfo::OpenDisk() - Opening disk [AUSLCDB07_1.vmdk] on VM [AUSLCDB07] flags [ Readonly ]
4548 594 04/16 12:11:56 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Open for thread 1a18
4548 594 04/16 12:12:00 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Open for thread 1a18 Err=[0]
4548 1a18 04/16 12:12:00 19646 CVMDiskInfo::OpenDisk() - Opened to [AUSLCDB07] [AUSLCDB07_1.vmdk] using Transport mode: [nbd]
4548 1a18 04/16 12:12:00 19646 CVMWareInfo::_MountVM_VCB4() - Opened 2 of 2 disks on VM AUSLCDB07
4548 1a18 04/16 12:12:00 19646 CVMWareInfo::_MountVM_VCB4() - Downloading Config files
4548 1a18 04/16 12:12:00 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/AUSLCDB07.vmxf?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmxf
4548 1a18 04/16 12:12:00 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/AUSLCDB07.nvram?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.nvram
4548 1a18 04/16 12:12:01 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/AUSLCDB07.vmsd?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmsd
4548 1a18 04/16 12:12:01 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/AUSLCDB07-aux.xml?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07-aux.xml
4548 1a18 04/16 12:12:02 19646 CVMWareInfo::_MountVM_VCB4() - Downloading Log files
4548 1a18 04/16 12:12:02 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/vmware-2.log?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-2.log
4548 1a18 04/16 12:12:02 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/vmware-1.log?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-1.log
4548 1a18 04/16 12:12:03 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/vmware-3.log?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-3.log
4548 1a18 04/16 12:12:03 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/vmware-4.log?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-4.log
4548 1a18 04/16 12:12:04 19646 CVMWareInfo::_DownloadConfigFile() - DOWNLOADING VM Config File https://auslcvc01.auslc.texasbar.com/folder/AUSLCDB07/vmware.log?dcPath=State%20Bar%20of%20Texas&dsName=ISCSIVOL3 to C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware.log
4548 1a18 04/16 12:12:05 19646 CVMWareInfo::MountVM() - Setting Mount Method VCB4
4548 1a18 04/16 12:12:05 19646 vsbkp::run() - Volumes/Disks from VM [AUSLCDB07] were mounted succesfully...
4548 1a18 04/16 12:12:05 19646 CVMWareInfo::_GetFullMountInfo_VCB4() - VM [AUSLCDB07] has 2 Disks
4548 1a18 04/16 12:12:08 19646 CVMInfo::_ValidateIndexName() - Validating index names
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07-aux.xml]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [130]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [AUSLCDB07-aux.xml]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [AUSLCDB07-aux.xml]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07-aux.xml]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.nvram]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [8684]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [AUSLCDB07.nvram]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [AUSLCDB07.nvram]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.nvram]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmsd]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [1047]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [AUSLCDB07.vmsd]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [AUSLCDB07.vmsd]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmsd]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmx]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [3750]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [AUSLCDB07.vmx]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [AUSLCDB07.vmx]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmx]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmxf]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [264]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [AUSLCDB07.vmxf]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [AUSLCDB07.vmxf]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)AUSLCDB07.vmxf]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)catalog]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [725]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [catalog]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [catalog]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)catalog]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-1.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [161172]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [vmware-1.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [vmware-1.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-1.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-2.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [150671]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [vmware-2.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [vmware-2.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-2.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-3.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [684420]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [vmware-3.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [vmware-3.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-3.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-4.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [1131197]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [vmware-4.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [vmware-4.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware-4.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [1368193]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [vmware.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [vmware.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [0]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [0]
4548 1a18 04/16 12:12:08 19646 vsbkp::backupConfigFile() - Backing up file [C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250(42153c44-ee21-7ad7-ffa7-24125bc16fe4)vmware.log]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info path = [AUSLCDB07.vmdk]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info FileSize = [42968862720]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info display name = [AUSLCDB07.vmdk]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup path = [AUSLCDB07.vmdk]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info backup type = [1]
4548 1a18 04/16 12:12:08 19646 vsBkpDiskConfig::getNextBkpObj() - Mount info file type = [18]
4548 1a18 04/16 12:12:08 19646 vsbkp::backup() - nBkpReqs = [20]
4548 1a18 04/16 12:12:08 19646 vsbkp::backup() - Disabling CRC Processing as change Id [52 76 a6 a5 63 55 de 44-87 db 52 cd 4b f3 6b 7e/390] is supplied
4548 1a18 04/16 12:12:08 19646 vsbkp::backup() - Using default extent size
4548 1a18 04/16 12:12:12 19646 ID=readdisk, Bytes Read = 396, Total time = 1.334567, Average = 0.000283, Samples = 1
4548 1a18 04/16 12:12:12 19646 vsbkp::backup() - Extent Size in sectors = [128]
4548 1a18 04/16 12:12:12 19646 vsbkp::backup() - Saved extent size [128] with app manager
4548 1a18 04/16 12:12:12 19646 vsbkp::WriteExtentSizeFile() - Creating extent size file C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResultsiDataAgentVirtualServerAgent2250vsidaEXTSZ_19646_(42153c44-ee21-7ad7-ffa7-24125bc16fe4)_(AUSLCDB07.vmdk)
4548 1a18 04/16 12:12:12 19646 vsbkp::backup() - Sending File Header Path:[42153c44-ee21-7ad7-ffa7-24125bc16fe4AUSLCDB07.vmdk] with size:[42968862720]
4548 1a18 04/16 12:12:12 19646 vsbkp::backup() - Backing up disk/volume [AUSLCDB07.vmdk]
4548 758 04/16 12:12:12 19646 vsbkp::archiveExtentProcessor() - Send volume or disk data to MA thread
4548 758 04/16 12:12:12 19646 vsbkp::archiveExtentProcessor() - PL_HOLE buffers will be sent for empty extents
4548 83c 04/16 13:53:57 19646 SdtNetLink::sendAll() - Network send failed: Connection reset by peer
4548 83c 04/16 13:53:57 19646 SdtBase::setLastErr: Setting last err [59][Network send failed: Connection reset by peer]
4548 758 04/16 13:53:57 ##### [PIPELAYER ] Failed to allocate SDT buffer. Probably, the socket was closed. SDT Error [Network send failed: Connection reset by peer]
4548 758 04/16 13:53:57 19646 vsArchive::allocateBuffer() - Pipeline buffer allocation failed
4548 758 04/16 13:53:57 19646 vsArchive::sendFileHeader() - vsArchive::sendFileHeader() failed, retCode = [6]
4548 758 04/16 13:53:57 19646 vsbkp::archiveExtentProcessor() - vsArchive::sendFileHeader failed. retCode [6]
4548 758 04/16 13:53:57 19646 vsbkp::archiveExtentProcessor() - Done...
4548 758 04/16 13:53:57 19646 vsbkp::archiveExtentProcessor() - 1400 PL_HOLE buffers were sent
4548 1a18 04/16 13:53:57 19646 ID=readCRC, Bytes Read = 0, Total time = 0.000000, Average = 0.000000, Samples = 0
4548 1a18 04/16 13:53:57 19646 ID=writePLBuffer, Bytes Read = 9111732224, Total time = 4.861523, Average = 1787.428711, Samples = 278068
4548 1a18 04/16 13:53:57 19646 ID=allocPLBuffer, Bytes Read = 17616163936, Total time = 552.072693, Average = 30.430927, Samples = 278068
4548 1a18 04/16 13:53:57 19646 ID=writeCRC, Bytes Read = 0, Total time = 0.000000, Average = 0.000000, Samples = 0
4548 1a18 04/16 13:53:57 19646 ID=calcCRC, Bytes Read = 0, Total time = 0.000000, Average = 0.000000, Samples = 0
4548 1a18 04/16 13:53:57 19646 ID=readdisk, Bytes Read = 9204793740, Total time = 816.639771, Average = 10.749385, Samples = 140455
4548 1a18 04/16 13:53:57 19646 CVMWareInfo::UnmountVM() - Unmount retry count from reg=[55899408] retCode=[0]
4548 1a18 04/16 13:53:57 19646 CVMWareInfo::_UnmountVM_VCB4() - Unmounting Disks for VM [AUSLCDB07]
4548 594 04/16 13:53:57 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Close for thread 1a18
4548 594 04/16 13:53:57 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Close for thread 1a18
4548 594 04/16 13:53:57 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Close for thread 1a18
4548 594 04/16 13:53:57 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Close for thread 1a18
4548 594 04/16 13:53:57 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Disconnect for thread 1a18
4548 594 04/16 13:53:57 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Disconnect for thread 1a18
4548 594 04/16 13:53:57 19646 CVMDiskInfo::_VixDiskLibThread() - Calling VixDiskLib_Cleanup for thread 1a18
4548 594 04/16 13:54:23 19646 CVMDiskInfo::_VixDiskLibThread() - Completed VixDiskLib_Cleanup for thread 1a18
4548 1a18 04/16 13:54:23 19646 CVMWareInfo::_UnmountVM_VCB4() - Removing Snapshot of VM [AUSLCDB07] Guid [42153c44-ee21-7ad7-ffa7-24125bc16fe4]
4548 1 04/16 13:54:23 ### ### RemoveSnapshot --- Removing Snapshot __GX_BACKUP__ snapshot-4528 from VM AUSLCDB07
4548 1 04/16 13:54:53 ### ### RemoveSnapshot --- Successfully removed Snapshot __GX_BACKUP__ snapshot-4528 from VM AUSLCDB07
4548 1a18 04/16 13:54:53 19646 CVMWareInfo::_UnmountVM_VCB4() - Successfuly removed Snapshot of VM [AUSLCDB07] Guid [42153c44-ee21-7ad7-ffa7-24125bc16fe4]
4548 1a18 04/16 13:54:53 19646 vsbkp::HandleVMComplete() - Error backing up VM [AUSLCDB07]
4548 1a18 04/16 13:54:53 19646 ICACHEDIR: job 0 creating 'C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResults2\019646'
4548 1648 04/16 13:54:53 19646 vsbkp::Wait() - Done processing VM AUSLCDB07
4548 1648 04/16 13:54:53 19646 vsbkp::BackupAllVM() - Closing archive file for backup object 0
4548 1648 04/16 13:54:53 19646 vsArchive::close() - Closing archive file...
4548 1648 04/16 13:54:53 19646 CCVAPipelayer::CloseArchiveFile() - Closing archive file[afilenum=43287] in BACKUP
4548 1648 04/16 13:54:53 ##### [PIPELAYER ] Data Pipe Is Down
4548 1648 04/16 13:54:53 19646 CCVAPipelayer::SendCommandToDSBackup() - Failed to allocate a command buffer
4548 1648 04/16 13:54:53 19646 CCVAPipelayer::CloseArchiveFile() - Unable to send CloseArchiveFile Command Buffer or DSBackup reported failure
4548 1648 04/16 13:54:53 19646 vsArchive::close() - Failed to close the archive file. retCode [-1]
4548 1648 04/16 13:54:53 19646 CVArchive::ClosePipeline() - Closing Pipeline
4548 1648 04/16 13:54:53 19646 CVArchive::ClosePipeline() - Reseting allocated stream
4548 1648 04/16 13:54:54 19646 CCVAPipelayer::ClosePipeline() - About to destroy Data Mover
4548 1648 04/16 13:54:54 ##### [PIPELAYER ] Data Pipe Is Down
4548 1648 04/16 13:54:54 19646 CCVAPipelayer::SendCommandToDSBackup() - Failed to allocate a command buffer
4548 1648 04/16 13:54:54 19646 CCVAPipelayer::ClosePipeline() - Failure sending datamover destroy
4548 1648 04/16 13:54:54 19646 CPipelayer::ShutdownPipeline() - pipeline has already been shutdown
4548 1648 04/16 13:54:54 19646 vsArchive::close() - Failed to close the pipeline. retCode [0]
4548 1648 04/16 13:54:54 19646 SdtBase::releaseRef: Going to delete the SdtBase object because the reference count has gone down to 0.
4548 1648 04/16 13:54:54 19646 Signature processing speed: Type [SHA512], [413.774613] GB/Hr, Bytes [3858656835], Time [31.266189] Sec(s)
4548 1648 04/16 13:54:54 19646 SdtNetLink::shutdown() - Performing graceful connection termination
4548 1648 04/16 13:54:54 19646 SdtNetLink::sendAll() - Network send failed: Connection reset by peer
4548 1648 04/16 13:54:54 19646 SdtNetLink::closeSocket() - Closing socket connection 732
4548 1648 04/16 13:54:54 19646 vsbkp::BackupAllVM() - Holding reservation on last stream
4548 1648 04/16 13:54:54 19646 vsbkp::BackupAllVM() - At least one of the backup threads had failures during the backup. Job will go in pending state
4548 1648 04/16 13:54:55 19646 ICACHEDIR: cleanUp C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResults cl=1, #Bl=0, rmOld=1, logEv=0, useAccTm=1, commCell=0, appNum=0
4548 1648 04/16 13:54:55 19646 CDIRARRAY: Sorting cache dirs, useAccessTime=1
4548 1648 04/16 13:54:55 19646 CDIRARRAY: Finished sorting cache dirs
4548 1648 04/16 13:54:55 19646 ICACHEDIR: removing all cache dirs in cacheFs C:Program FilesCommVaultSimpanaiDataAgentJobResultsCV_JobResults older than cutoff 1302375295 (currentTime = 1302980095, numDays=7, absCutoff=0, remove all old directories)
4548 1648 04/16 13:54:55 19646 ICACHEDIR: numBlocks=0, minFreePercent=10, freeBlocks=35946564, totBlocks=52321904, pad=976
4548 1648 04/16 13:54:55 19646 ICACHEDIR: cleanUp: Done cleaning because we have enough free blocks and disk free
4548 1648 04/16 13:54:55 19646 BKP CALLED COMPLETE (PHASE Status::FAIL), 19646. Token [19646:4:1]
4548 1aa4 04/16 13:54:55 19646 CVJobCtrlLog::unregisterProcess(): successfuly removed file [C:Program FilesCommVaultSimpanaBaseJobControl4.548]
__._,_.___
Reply to sender ([email]CSlack < at > TEXASBAR.COM?subject=Re%3A%20Random%20virtual%20servers%20fail%20during%20weekend%20full%20backups[/email]) | Reply to group ([email]commvault < at > yahoogroups.com?subject=Re%3A%20Random%20virtual%20servers%20fail%20during%20weekend%20full%20backups[/email]) | Reply via web post | Start a New Topic
Messages in this topic (1)
Recent Activity: Visit Your Group
Commvault Documentation here:
http://documentation.commvault.com/
MARKETPLACE
[url=http://global.ard.yahoo.com/SIG=15oomroek/M=493064.14543979.14365478.13298430/D=groups/S=1707277520:MKP1/Y=YAHOO/EXP=1303171095/L=f6276b7e-6a06-11e0-ac27-8f74edbcf1e0/B=IfqAVEoGYnM-/J=1303163895348340/K=Dbj7JhtX5wWmKiXoZ69Nzg/A=6060255/R=0/SIG=1194m4keh/*http://us.toolbar.yahoo.com/?.cpdl=grpj]Stay on top of your group activity without leaving the page you're on - Get the Yahoo! Toolbar now.[/url] if(window.yzq_d==null)window.yzq_d=new Object(); window.yzq_d['IfqAVEoGYnM-']='&U=13cu6bbse%2fN%3dIfqAVEoGYnM-%2fC%3d493064.14543979.14365478.13298430%2fD%3dMKP1%2fB%3d6060255%2fV%3d1'; [img]http://us.bc.yahoo.com/b?P=f6276b7e-6a06-11e0-ac27-8f74edbcf1e0&T=1cgbaf2gf%2fX%3d1303163895%2fE%3d1707277520%2fR%3dgroups%2fK%3d5%2fV%3d2.1%2fW%3dH%2fY%3dYAHOO%2fF%3d334552010%2fH%3dY29udGVudD0iR287V2lkZ2V0cztQb2RjYXN0cztNb2JpbGU7RmxpY2tyO0dyb3VwcztBdWN0aW9ucztTbWFsbF9CdXNpbmVzcztCcmllZmNhc2U7RmluYW5jZTsiIGRpc2FibGVzaHVmZmxpbmc9IjEiIHNlcnZlSWQ9ImY2Mjc2YjdlLTZhMDYtMTFlMC1hYzI3LThmNzRlZGJjZjFlMCIgc2l0ZUlkPSI0NDUyNTUxIiB0U3RtcD0iMTMwMzE2Mzg5NTMyNDM5MSIg%2fQ%3d-1%2fS%3d1%2fJ%3d27228962&U=13cu6bbse%2fN%3dIfqAVEoGYnM-%2fC%3d493064.14543979.14365478.13298430%2fD%3dMKP1%2fB%3d6060255%2fV%3d1[/img]
[url=http://global.ard.yahoo.com/SIG=15oh6ase0/M=493064.14543977.14365476.10835568/D=groups/S=1707277520:MKP1/Y=YAHOO/EXP=1303171095/L=f6276b7e-6a06-11e0-ac27-8f74edbcf1e0/B=IvqAVEoGYnM-/J=1303163895348340/K=Dbj7JhtX5wWmKiXoZ69Nzg/A=6260316/R=0/SIG=11bc8n8gt/*http://custom.yahoo.com/fibromyalgiazone/]Find useful articles and helpful tips on living with Fibromyalgia. Visit the Fibromyalgia Zone today![/url] if(window.yzq_d==null)window.yzq_d=new Object(); window.yzq_d['IvqAVEoGYnM-']='&U=13cngfmpc%2fN%3dIvqAVEoGYnM-%2fC%3d493064.14543977.14365476.10835568%2fD%3dMKP1%2fB%3d6260316%2fV%3d1'; [img]http://us.bc.yahoo.com/b?P=f6276b7e-6a06-11e0-ac27-8f74edbcf1e0&T=1ch852fpf%2fX%3d1303163895%2fE%3d1707277520%2fR%3dgroups%2fK%3d5%2fV%3d2.1%2fW%3dH%2fY%3dYAHOO%2fF%3d1919917547%2fH%3dY29udGVudD0iR287V2lkZ2V0cztQb2RjYXN0cztNb2JpbGU7RmxpY2tyO0dyb3VwcztBdWN0aW9ucztTbWFsbF9CdXNpbmVzcztCcmllZmNhc2U7RmluYW5jZTsiIGRpc2FibGVzaHVmZmxpbmc9IjEiIHNlcnZlSWQ9ImY2Mjc2YjdlLTZhMDYtMTFlMC1hYzI3LThmNzRlZGJjZjFlMCIgc2l0ZUlkPSI0NDUyNTUxIiB0U3RtcD0iMTMwMzE2Mzg5NTMyNDM5MSIg%2fQ%3d-1%2fS%3d1%2fJ%3d27228962&U=13cngfmpc%2fN%3dIvqAVEoGYnM-%2fC%3d493064.14543977.14365476.10835568%2fD%3dMKP1%2fB%3d6260316%2fV%3d1[/img]
Text-Only ([email]commvault-traditional < at > yahoogroups.com?subject=Change Delivery Format: Traditional[/email]), Daily Digest ([email]commvault-digest < at > yahoogroups.com?subject=Email Delivery: Digest[/email]) • Unsubscribe ([email]commvault-unsubscribe < at > yahoogroups.com?subject=Unsubscribe[/email]) • Terms of Use
.
[img]http://geo.yahoo.com/serv?s=97359714/grpId=7450851/grpspId=1707277520/msgId=4977/stime=1303163894/nc1=5191953/nc2=4507179/nc3=4025373[/img]
__,_._,___
