vcs错误日志，谁能帮忙诊断一下
Mar 5 08:17:43 oaap above message repeats 32 timesMar 5 08:17:43 oaap vmunix: mem: could not lock: 0x40fbda3Mar 5 08:17:51 oaap vmunix: mem: could not lock: 0x40fbdd8Mar 5 08:17:38 oaap vmunix: mem: could not lock: 0x40fbdbfMar 5 08:17:51 oaap above message repeats 32 timesMar 5 08:17:51 oaap vmunix: mem: could not lock: 0x40fbdd6Mar 5 08:17:42 oaap vmunix: mem: could not lock: 0x40fbdb3Mar 5 08:17:54 oaap above message repeats 32 timesMar 5 08:17:54 oaap vmunix: mem: could not lock: 0x40fbdd4Mar 5 08:17:55 oaap vmunix: mem: could not lock: 0x40fbdbbMar 5 08:17:51 oaap vmunix: mem: could not lock: 0x40fbdd8Mar 5 08:17:55 oaap AgentFramework[3688]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMVolDg) is exiting.Mar 5 08:17:51 oaap vmunix: mem: could not lock: 0x40fbdd6Mar 5 08:17:55 oaap above message repeats 32 timesMar 5 08:17:55 oaap AgentFramework[3690]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMVxconfigd) is exiting.Mar 5 08:17:54 oaap vmunix: mem: could not lock: 0x40fbdd4Mar 5 08:17:55 oaap above message repeats 32 timesMar 5 08:17:55 oaap AgentFramework[3686]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMCluster) is exiting.Mar 5 08:17:55 oaap AgentFramework[3684]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CFSfsckd) is exiting.Mar 5 08:17:55 oaap AgentFramework[3680]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Application) is exiting.Mar 5 08:17:55 oaap AgentFramework[3702]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Netlsnr) is exiting.Mar 5 08:17:55 oaap AgentFramework[3692]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(DiskGroup) is exiting.Mar 5 08:40:49 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 7 secMar 5 08:40:50 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 8 secMar 5 08:40:51 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 9 secMar 5 08:40:52 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 10 secMar 5 08:40:53 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 11 secMar 5 08:40:54 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 12 secMar 5 08:40:55 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 13 secMar 5 08:40:56 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 22944 inactive 14 secMar 5 08:40:57 oaap vmunix: GAB WARNING V-15-1-20058 Port h process 22944: heartbeat failed, killing processMar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20059 Port h heartbeat interval 15000 msec. Statistics:Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 0 ~ 3000 msec: 105751Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 3000 ~ 6000 msec: 0Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 6000 ~ 9000 msec: 0Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 9000 ~ 12000 msec: 0Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 12000 ~ 15000 msec: 0Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20088 System information:Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20089 number of cpu: 2Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20090 physical memory: 4164152 KMar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20091 free memory: 162448 KMar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20095 load average in 1 min: 0. 96Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20096 load average in 5 min: 1. 10Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20097 load average in 15 min: 1. 30Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20099 pageout rate: 213Mar 5 08:40:57 oaap vmunix: GAB INFO V-15-1-20041 Port h: client process failure: killing processMar 5 08:41:00 oaap Had[22944]: VCS WARNING V-16-1-51047 HAD Self Check: Excessive delay in the HAD heartbeat to GAB (10 seconds)Mar 5 08:41:00 oaap Had[22944]: VCS WARNING V-16-1-53034 HAD Signal SIGABRT receivedMar 5 08:41:00 oaap Had[22944]: VCS NOTICE V-16-1-53038 Beginning execution of the diagnostics scriptMar 5 08:41:12 oaap vmunix: GAB WARNING V-15-1-20035 Port h attempting to kill process due to client process failureMar 5 08:41:13 oaap vmunix: GAB INFO V-15-1-20032 Port h closedMar 5 08:41:13 oaap AgentFramework[22999]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(IP) is exiting.Mar 5 08:41:13 oaap AgentFramework[23001]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Mount) is exiting.Mar 5 08:41:13 oaap AgentFramework[22987]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CFSMount) is exiting.Mar 5 08:41:13 oaap AgentFramework[23009]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Volume) is exiting.Mar 5 08:41:13 oaap AgentFramework[23007]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Oracle) is exiting.Mar 5 08:41:13 oaap AgentFramework[24391]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Netlsnr) is exiting.Mar 5 08:41:13 oaap syslog[3618]: VCS ERROR V-16-1-11103 VCS exited. It will restartMar 5 08:41:23 oaap Had[6400]: VCS NOTICE V-16-1-53021 Diagnostics directory moved to /var/VRTSvcs/diag/had.1204677683, please check its contents and contact VERITAS SupportMar 5 08:41:23 oaap Had[6403]: VCS NOTICE V-16-1-10619 'HAD' starting on: oaapMar 5 08:41:23 oaap Had[6403]: VCS NOTICE V-16-1-10620 Waiting for local cluster configuration statusMar 5 08:41:23 oaap Had[6403]: VCS NOTICE V-16-1-10625 Local cluster configuration validMar 5 08:41:23 oaap Had[6403]: VCS NOTICE V-16-1-11034 Registering for cluster membershipMar 5 08:41:23 oaap Had[6403]: VCS NOTICE V-16-1-11035 Waiting for cluster membershipMar 5 08:41:28 oaap vmunix: GAB INFO V-15-1-20036 Port h gen 15f209 membership 01Mar 5 08:41:28 oaap Had[6403]: VCS INFO V-16-1-10077 Received new cluster membershipMar 5 08:41:28 oaap Had[6403]: VCS NOTICE V-16-1-10086 System (Node '0') is in Regular Membership - Membership: 0x3Mar 5 08:41:28 oaap Had[6403]: VCS NOTICE V-16-1-10086 System oaap (Node '1') is in Regular Membership - Membership: 0x3Mar 5 08:41:28 oaap Had[6403]: VCS NOTICE V-16-1-10075 Building from remote systemMar 5 08:41:32 oaap Had[6403]: VCS NOTICE V-16-1-10066 Entering RUNNING stateMar 5 08:41:32 oaap Had[6403]: VCS NOTICE V-16-1-50311 VCS Engine: running with security OFFMar 5 08:41:33 oaap Had[6403]: VCS ERROR V-16-1-13051 (oaap) Agent(CVMCluster) is exiting because another agent with process-id(24383) is already running for this typeMar 5 08:41:33 oaap Had[6403]: VCS ERROR V-16-1-13051 (oaap) Agent(CFSfsckd) is exiting because another agent with process-id(24381) is already running for this typeMar 5 08:41:33 oaap Had[6403]: VCS ERROR V-16-1-13051 (oaap) Agent(CVMVolDg) is exiting because another agent with process-id(24385) is already running for this typeMar 5 08:41:33 oaap Had[6403]: VCS ERROR V-16-1-13051 (oaap) Agent(Application) is exiting because another agent with process-id(24379) is already running for this typeMar 5 08:41:33 oaap Had[6403]: VCS ERROR V-16-1-13051 (oaap) Agent(CVMVxconfigd) is exiting because another agent with process-id(24387) is already running for this typeMar 5 08:41:33 oaap Had[6403]: VCS ERROR V-16-1-13051 (oaap) Agent(DiskGroup) is exiting because another agent with process-id(24389) is already running for this typeMar 5 08:41:37 oaap Had[6403]: VCS ERROR V-16-1-13051 (oaap) Agent(NIC) is exiting because another agent with process-id(23003) is already running for this typeMar 5 08:42:06 oaap vmunix: mem: could not lock: 0x40fbdf9Mar 5 08:42:07 oaap vmunix: mem: could not lock: 0x40fbde4Mar 5 08:42:10 oaap vmunix: mem: could not lock: 0x40fbd9bMar 5 08:42:12 oaap vmunix: mem: could not lock: 0x40fbdd2Mar 5 08:42:06 oaap vmunix: mem: could not lock: 0x40fbdf9Mar 5 08:42:14 oaap above message repeats 32 timesMar 5 08:42:14 oaap vmunix: mem: could not lock: 0x40fbde6Mar 5 08:42:15 oaap vmunix: mem: could not lock: 0x40fbdeaMar 5 08:42:22 oaap vmunix: mem: could not lock: 0x40fbddfMar 5 08:42:12 oaap vmunix: mem: could not lock: 0x40fbdd2Mar 5 08:42:23 oaap above message repeats 32 timesMar 5 08:42:23 oaap AgentFramework[24385]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMVolDg) is exiting.Mar 5 08:42:23 oaap AgentFramework[24381]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CFSfsckd) is exiting.Mar 5 08:42:24 oaap AgentFramework[24387]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMVxconfigd) is exiting.Mar 5 08:42:22 oaap vmunix: mem: could not lock: 0x40fbddfMar 5 08:42:24 oaap above message repeats 32 timesMar 5 08:42:24 oaap AgentFramework[24383]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMCluster) is exiting.Mar 5 08:42:24 oaap AgentFramework[23003]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(NIC) is exiting.Mar 5 08:42:24 oaap AgentFramework[24379]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Application) is exiting.Mar 5 08:42:24 oaap AgentFramework[24389]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(DiskGroup) is exiting.Mar 5 16:00:47 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 7 secMar 5 16:00:48 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 8 secMar 5 16:00:49 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 9 secMar 5 16:00:50 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 10 secMar 5 16:00:51 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 11 secMar 5 16:00:52 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 12 secMar 5 16:00:53 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 13 secMar 5 16:00:54 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 6403 inactive 14 secMar 5 16:00:55 oaap vmunix: GAB WARNING V-15-1-20058 Port h process 6403: heartbeat failed, killing processMar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20059 Port h heartbeat interval 15000 msec. Statistics:Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 0 ~ 3000 msec: 1916885Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 3000 ~ 6000 msec: 1Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 6000 ~ 9000 msec: 0Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 9000 ~ 12000 msec: 0Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 12000 ~ 15000 msec: 0Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20088 System information:Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20089 number of cpu: 2Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20090 physical memory: 4164152 KMar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20091 free memory: 338652 KMar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20095 load average in 1 min: 1. 00Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20096 load average in 5 min: 0. 91Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20097 load average in 15 min: 0. 83Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20099 pageout rate: 2Mar 5 16:00:55 oaap vmunix: GAB INFO V-15-1-20041 Port h: client process failure: killing processMar 5 16:01:10 oaap vmunix: GAB WARNING V-15-1-20035 Port h attempting to kill process due to client process failureMar 5 16:01:22 oaap Had[6403]: VCS WARNING V-16-1-51047 HAD Self Check: Excessive delay in the HAD heartbeat to GAB (10 seconds)Mar 5 16:01:22 oaap Had[6403]: VCS WARNING V-16-1-53034 HAD Signal SIGABRT receivedMar 5 16:01:22 oaap Had[6403]: VCS NOTICE V-16-1-53038 Beginning execution of the diagnostics scriptMar 5 16:01:26 oaap vmunix: GAB INFO V-15-1-20032 Port h closedMar 5 16:01:26 oaap AgentFramework[6435]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(IP) is exiting.Mar 5 16:01:26 oaap AgentFramework[7742]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(DiskGroup) is exiting.Mar 5 16:01:25 oaap vmunix: GAB WARNING V-15-1-20035 Port h attempting to kill process due to client process failureMar 5 16:01:26 oaap AgentFramework[7736]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMCluster) is exiting.Mar 5 16:01:26 oaap AgentFramework[7744]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(NIC) is exiting.Mar 5 16:01:27 oaap AgentFramework[6443]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Oracle) is exiting.Mar 5 16:01:27 oaap AgentFramework[6441]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Netlsnr) is exiting.Mar 5 16:01:27 oaap syslog[3618]: VCS ERROR V-16-1-11103 VCS exited. It will restartMar 5 16:01:37 oaap Had[7752]: VCS NOTICE V-16-1-53021 Diagnostics directory moved to /var/VRTSvcs/diag/had.1204704097, please check its contents and contact VERITAS SupportMar 5 16:01:37 oaap Had[7755]: VCS NOTICE V-16-1-10619 'HAD' starting on: oaapMar 5 16:01:37 oaap Had[7755]: VCS NOTICE V-16-1-10620 Waiting for local cluster configuration statusMar 5 16:01:38 oaap Had[7755]: VCS NOTICE V-16-1-10625 Local cluster configuration validMar 5 16:01:38 oaap Had[7755]: VCS NOTICE V-16-1-11034 Registering for cluster membershipMar 5 16:01:38 oaap Had[7755]: VCS NOTICE V-16-1-11035 Waiting for cluster membershipMar 5 16:01:43 oaap vmunix: GAB INFO V-15-1-20036 Port h gen 15f20b membership 01Mar 5 16:01:43 oaap Had[7755]: VCS INFO V-16-1-10077 Received new cluster membershipMar 5 16:01:43 oaap Had[7755]: VCS NOTICE V-16-1-10086 System (Node '0') is in Regular Membership - Membership: 0x3Mar 5 16:01:43 oaap Had[7755]: VCS NOTICE V-16-1-10086 System oaap (Node '1') is in Regular Membership - Membership: 0x3Mar 5 16:01:43 oaap Had[7755]: VCS NOTICE V-16-1-10075 Building from remote systemMar 5 16:01:47 oaap Had[7755]: VCS NOTICE V-16-1-10066 Entering RUNNING stateMar 5 16:01:47 oaap Had[7755]: VCS NOTICE V-16-1-50311 VCS Engine: running with security OFFMar 5 16:01:48 oaap Had[7755]: VCS ERROR V-16-1-13051 (oaap) Agent(Application) is exiting because another agent with process-id(7732) is already running for this typeMar 5 16:01:48 oaap Had[7755]: VCS ERROR V-16-1-13051 (oaap) Agent(CFSfsckd) is exiting because another agent with process-id(7734) is already running for this typeMar 5 16:01:49 oaap Had[7755]: VCS ERROR V-16-1-13051 (oaap) Agent(CFSMount) is exiting because another agent with process-id(6423) is already running for this typeMar 5 16:01:49 oaap Had[7755]: VCS ERROR V-16-1-13051 (oaap) Agent(CVMVolDg) is exiting because another agent with process-id(7738) is already running for this typeMar 5 16:01:49 oaap Had[7755]: VCS ERROR V-16-1-13051 (oaap) Agent(CVMVxconfigd) is exiting because another agent with process-id(7740) is already running for this typeMar 5 16:01:49 oaap Had[7755]: VCS ERROR V-16-1-13051 (oaap) Agent(Volume) is exiting because another agent with process-id(6445) is already running for this typeMar 5 16:01:49 oaap Had[7755]: VCS ERROR V-16-1-13051 (oaap) Agent(Mount) is exiting because another agent with process-id(6437) is already running for this typeMar 5 16:02:24 oaap vmunix: mem: could not lock: 0x40fbdd0Mar 5 16:02:25 oaap vmunix: mem: could not lock: 0x40fbdadMar 5 16:02:25 oaap vmunix: mem: could not lock: 0x40fbddfMar 5 16:02:28 oaap vmunix: mem: could not lock: 0x40fbde3Mar 5 16:02:24 oaap vmunix: mem: could not lock: 0x40fbdd0Mar 5 16:02:28 oaap above message repeats 31 timesMar 5 16:02:28 oaap vmunix: mem: could not lock: 0x40fbd8dMar 5 16:02:28 oaap vmunix: mem: could not lock: 0x40fbd8dMar 5 16:02:35 oaap above message repeats 32 timesMar 5 16:02:25 oaap vmunix: mem: could not lock: 0x40fbdadMar 5 16:02:35 oaap above message repeats 32 timesMar 5 16:02:25 oaap vmunix: mem: could not lock: 0x40fbddfMar 5 16:02:35 oaap above message repeats 32 timesMar 5 16:02:28 oaap vmunix: mem: could not lock: 0x40fbde3Mar 5 16:02:35 oaap above message repeats 32 timesMar 5 16:02:35 oaap vmunix: mem: could not lock: 0x40fbd93Mar 5 16:02:36 oaap vmunix: mem: could not lock: 0x40fbdfaMar 5 16:02:37 oaap vmunix: mem: could not lock: 0x40fbdaeMar 5 16:02:39 oaap vmunix: mem: could not lock: 0x40fbda2Mar 5 16:02:40 oaap vmunix: mem: could not lock: 0x40fbdeeMar 5 16:02:36 oaap vmunix: mem: could not lock: 0x40fbdfaMar 5 16:02:40 oaap above message repeats 32 timesMar 5 16:02:40 oaap AgentFramework[7740]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMVxconfigd) is exiting.Mar 5 16:02:40 oaap AgentFramework[7734]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CFSfsckd) is exiting.Mar 5 16:02:40 oaap AgentFramework[7738]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CVMVolDg) is exiting.Mar 5 16:02:41 oaap AgentFramework[6423]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(CFSMount) is exiting.Mar 5 16:02:41 oaap AgentFramework[6437]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Mount) is exiting.Mar 5 16:02:41 oaap AgentFramework[7732]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Application) is exiting.Mar 5 16:02:41 oaap AgentFramework[6445]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Volume) is exiting.Mar 5 16:10:10 oaap sshd[12613]: Accepted keyboard-interactive/pam for root from 10.1.40.70 port 1352 ssh2Mar 5 16:11:58 oaap sshd[13573]: Accepted password for oaadmin from 10.1.45.5 port 1099 ssh2Mar 5 16:11:58 oaap sshd[13573]: subsystem request for sftpMar 5 19:22:08 oaap ftpd[27790]: Data port : 20Mar 5 19:22:08 oaap ftpd[27790]: FTP server (Revision 1.1 Version wuftpd-2.6.1(PHNE_34306) Mon Mar 13 11:14:17 GMT 2006) ready.Mar 5 19:22:08 oaap ftpd[27790]: FTP LOGIN FROM 10.1.214.175 [10.1.214.175], oaadminMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 7 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 8 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 9 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 10 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 11 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 12 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 13 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20057 Port h process 7755 inactive 14 secMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20058 Port h process 7755: heartbeat failed, killing processMar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20059 Port h heartbeat interval 15000 msec. Statistics:Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 0 ~ 3000 msec: 905959Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 3000 ~ 6000 msec: 1Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 6000 ~ 9000 msec: 0Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 9000 ~ 12000 msec: 0Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20129 Port h: heartbeats in 12000 ~ 15000 msec: 0Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20088 System information:Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20089 number of cpu: 2Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20090 physical memory: 4164152 KMar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20091 free memory: 16844 KMar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20095 load average in 1 min: 1. 31Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20096 load average in 5 min: 1. 76Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20097 load average in 15 min: 1. 38Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20099 pageout rate: 4891Mar 5 19:29:25 oaap vmunix: GAB INFO V-15-1-20041 Port h: client process failure: killing processMar 5 19:29:25 oaap vmunix: GAB WARNING V-15-1-20035 Port h attempting to kill process due to client process failureMar 5 19:29:21 oaap Had[7755]: VCS WARNING V-16-1-51047 HAD Self Check: Excessive delay in the HAD heartbeat to GAB (10 seconds)Mar 5 19:29:21 oaap Had[7755]: VCS WARNING V-16-1-53034 HAD Signal SIGABRT receivedMar 5 19:29:29 oaap vmunix: GAB WARNING V-15-1-20035 Port h attempting to kill process due to client process failureMar 5 19:29:31 oaap vmunix: GAB INFO V-15-1-20032 Port h closedMar 5 19:29:34 oaap AgentFramework[9252]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Volume) is exiting.Mar 5 19:29:34 oaap AgentFramework[7790]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(DiskGroup) is exiting.Mar 5 19:29:34 oaap AgentFramework[9250]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Mount) is exiting.Mar 5 19:29:34 oaap AgentFramework[7792]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(IP) is exiting.Mar 5 19:29:34 oaap AgentFramework[7796]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(NIC) is exiting.Mar 5 19:29:34 oaap AgentFramework[7798]: VCS ERROR V-16-1-13120 Thread(1) Error receiving from the engine. Agent(Netlsnr) is exiting.Mar 5 19:29:39 oaap syslog[3618]: VCS ERROR V-16-1-11103 VCS exited. It will restartMar 5 19:30:07 oaap Had[1520]: VCS NOTICE V-16-1-53021 Diagnostics directory moved to /var/VRTSvcs/diag/had.1204716606, please check its contents and contact VERITAS SupportMar 5 19:29:58 oaap syslog[3618]: VCS ERROR V-16-1-11103 VCS exited. It will restartMar 5 19:30:22 oaap AgentFramework[9242]: VCS ERROR V-16-1-13027 Thread(4) Resource(cfsmount1) - monitor procedure did not complete within the expected time.Mar 5 19:30:22 oaap AgentFramework[9242]: VCS ERROR V-16-1-13210 Thread(4) Agent is calling clean for resource(cfsmount1) because 1 successive invocations of the monitor procedure did not complete within the expected time.Mar 5 19:30:23 oaap AgentFramework[9242]: VCS ERROR V-16-1-13068 Thread(4) Resource(cfsmount1) - clean completed successfully.Mar 5 19:30:34 oaap Had[1680]: VCS ERROR V-16-1-11009 Exiting: Another copy of VCS may be runningMar 5 19:30:36 oaap Had[1597]: VCS NOTICE V-16-1-10619 'HAD' starting on: oaap
