互联网服务 数据库server

双机切换后备机宕库

对数据库进行双机切换,备机接管成功后,过几分钟报断言宕库,触发双机切换,备机能正常拉起,当前HDR关系处于on状态。
备机日志:
00:44:00  Maximum server connections 0
00:45:59  Booting Language from module <>
00:45:59  Loading Module
01:00:05  Checkpoint Completed:  duration was 0 seconds.
01:00:05  Checkpoint loguniq 22990, logpos 0xbea32c, timestamp: 0x62af3d5d

01:00:05  Maximum server connections 9
01:08:20  Checkpoint Completed:  duration was 2 seconds.
01:08:20  Checkpoint loguniq 22991, logpos 0x832c, timestamp: 0x62af447d

01:08:20  Maximum server connections 9
01:09:40  Checkpoint Completed:  duration was 0 seconds.
01:09:40  Checkpoint loguniq 22991, logpos 0x12018, timestamp: 0x62af4572

01:09:40  Maximum server connections 9
01:09:41  DR: Receive error in thread dr_secrcv [id: 167]
01:09:41  ASF Echo-Thread Server: asfcode = -25582: oserr = 0: errstr = : Network connection is broken.

01:09:42  DR: Turned off on secondary server
01:09:50  Logical Recovery has reached the transaction cleanup phase.
01:09:50  Logical Recovery Complete.
          109642 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks

01:09:50  Logical Recovery Complete.
01:09:51  Quiescent Mode
01:09:51  Logical Log 22990 Complete, timestamp: 0x62af4575.
01:09:52  Checkpoint Completed:  duration was 0 seconds.
01:09:52  Checkpoint loguniq 22991, logpos 0x13018, timestamp: 0x62af4583

01:09:52  Maximum server connections 9
01:09:52  DR: Reservation of the last logical log for log backup turned on
01:09:52  DR: new type = standard
01:09:52  On-Line Mode
01:09:53  DR: new type = primary, secondary server name = gzvc3_server1_net
01:09:53  DR: Trying to connect to secondary server = gzvc3_server1_net
01:09:54  DR: Cannot connect to secondary server
01:09:54  DR: Turned off on primary server
01:09:56  (116) connection rejected - no calls allowed for cdraccept
01:10:26  (126) connection rejected - no calls allowed for cdraccept
01:11:12  (135) connection rejected - no calls allowed for cdraccept
01:12:11  (150) connection rejected - no calls allowed for cdraccept
01:13:27  (163) connection rejected - no calls allowed for cdraccept
01:14:03  DR: Primary server connected
01:14:03  DR: Secondary server needs failure recovery

01:14:05  DR: Sending log 22991 (current), size 100000 pages, 0.04 percent used
01:14:06  DR: Sending Logical Logs Completed
01:14:07  DR: Primary server operational
01:14:09  Checkpoint Completed:  duration was 2 seconds.
01:14:09  Checkpoint loguniq 22991, logpos 0x2f2b4, timestamp: 0x62af55bc

01:14:09  Maximum server connections 11
01:14:28  Assert Failed: semop: errno = 36

01:14:28  IBM Informix Dynamic Server Version 9.40.FC7XF  
01:14:28   Who: Session(0, @, 0, 0000000000000000)
                Thread(0, idle, 0, 14)
                File: mt.c Line: 1345
01:14:28  stack trace for pid 5391 written to /tellinshare/informix_tmp/af.ea2f3
01:14:28  Assert Failed: semop: errno = 36

01:14:28  IBM Informix Dynamic Server Version 9.40.FC7XF  
01:14:28   Who: Session(0, @, 0, 0000000000000000)
                Thread(0, idle, 0, 16)
                File: mt.c Line: 1345
01:14:28  stack trace for pid 5393 written to /tellinshare/informix_tmp/af.10a2f3
01:14:28  Out of virtual shared memory, cannot grow exception stack
01:14:28  ERROR: Exception recursion in afhandler (thread 0).
01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22

01:14:28  semctl: errno = 22


01:14:28  IBM Informix Dynamic Server Version 9.40.FC7XF   Software Serial Number AAA#B000000

01:14:28  Assert Failed: semop: errno = 36

01:14:28   Who: Session(0, @, 0, 0000000000000000)
                Thread(0, idle, 0, 16)
                File: mt.c Line: 1345
01:14:28  Stack for thread: 0 idle

base: 0x800000010022c7d8
  len:   32768
   pc: 0x0000000000000000
  tos: 0x800000010022db20
state: running
   vp: 16


af.10a2f3:
( 0)  0x40000000008a7408   legacy_hp_afstack + 0x258  [/opt/informix/bin/oninit]
( 1)  0x40000000008a6a5c   afstack + 0x5c  [/opt/informix/bin/oninit]
( 2)  0x40000000008a5cec   afhandler + 0x984  [/opt/informix/bin/oninit]
( 3)  0x40000000008a5354   afcrash_interface + 0x4c  [/opt/informix/bin/oninit]
( 4)  0x400000000086cfb8   P + 0x128  [/opt/informix/bin/oninit]
( 5)  0x4000000000870914   idle_processor + 0x5ac  [/opt/informix/bin/oninit]
( 6)  0x400000000087e334   startup + 0xd4  [/opt/informix/bin/oninit]
( 7)  0x400000000087e11c   resume + 0x10c  [/opt/informix/bin/oninit]

base: 0x800000010022c7d8
  len:   32768
   pc: 0x0000000000000000
  tos: 0x800000010022db20
state: running
   vp: 16


现在怀疑是初始共享内存太小,造成informix后续处理中共享内存不够,但运行了好几年平时切换没出现这个问题;各位大侠有啥见解?谢谢!
参与4

4 同行回答

hujinqian hujinqian 软件开发工程师 华润万家
有没有大牛出点思路。。。显示全部
有没有大牛出点思路。。。 收起
互联网服务 · 2013-07-31
浏览688
hujinqian hujinqian 软件开发工程师 华润万家
01:14:09  Maximum server connections 1101:14:28  Assert Failed: semop: errno = 36这个只是是错误的表象;注意到切到备机后CDR也没有enbaleconnection rejected - no calls allowed for cdraccept显示全部
01:14:09  Maximum server connections 11
01:14:28  Assert Failed: semop: errno = 36

这个只是是错误的表象;
注意到切到备机后CDR也没有enbale
connection rejected - no calls allowed for cdraccept 收起
互联网服务 · 2013-07-31
浏览680
hujinqian hujinqian 软件开发工程师 华润万家
回复 2# liaosnet 备机数据库挂了,才触发双机切换;主机日志:01:13:41  Warning: ONCONFIG dump directory (DUMPDIR) '/tellinshare/informix_tmp' has insecure permissions01:13:41  Event alarms enabled.  ALARMPROG = '/opt/informix/et...显示全部
回复 2# liaosnet
备机数据库挂了,才触发双机切换;

主机日志:
01:13:41  Warning: ONCONFIG dump directory (DUMPDIR) '/tellinshare/informix_tmp' has insecure permissions
01:13:41  Event alarms enabled.  ALARMPROG = '/opt/informix/etc/log_full.sh'
01:13:41  Booting Language from module <>
01:13:41  Loading Module
01:13:41  Booting Language from module <>
01:13:41  Loading Module
01:13:47  IBM Informix Dynamic Server Version 9.40.FC7XF   Software Serial Number AAA#B000000
01:13:57  IBM Informix Dynamic Server Initialized -- Shared Memory Initialized.

01:13:57  DR: Reservation of the last logical log for log backup turned on
01:13:57  Data replication type and state information reset. To start DR, use
          the 'onmode -d' command and wait for the pair to be operational,
          before shutting down the database server

01:13:57  Physical Recovery Started at Page (2:460584).
01:13:57  Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored.
01:13:58  Dataskip is now OFF for all dbspaces
01:13:58  Restartable Restore has been DISABLED
01:13:58  Recovery Mode
01:13:59  DR: Reservation of the last logical log for log backup turned off
01:13:59  DR: new type = secondary, primary server name = gzvc3_server2_net
01:13:59  DR: Trying to connect to primary server = gzvc3_server2_net
01:14:02  DR: Secondary server connected
01:14:03  DR: Secondary server needs failure recovery

01:14:03  DR: Failure recovery from disk in progress ...
01:14:04  Logical Recovery Started.
01:14:04  10 recovery worker threads will be started.
01:14:04  Dynamically allocated new virtual shared memory segment (size 8192KB)
01:14:04  Start Logical Recovery - Start Log 22991, End Log ?
01:14:04  Starting Log Position - 22991 0x12018
01:14:05  Checkpoint Completed:  duration was 0 seconds.
01:14:05  Checkpoint loguniq 22991, logpos 0x13018, timestamp: 0x62af557f

01:14:05  Maximum server connections 0
01:14:07  DR: Secondary server operational
01:14:09  Checkpoint Completed:  duration was 0 seconds.
01:14:09  Checkpoint loguniq 22991, logpos 0x2f2b4, timestamp: 0x62af56bb

01:14:09  Maximum server connections 0
01:14:19  Booting Language from module <>
01:14:19  Loading Module
01:14:28  DR: Receive error in thread dr_secrcv [id: 122]
01:14:28  ASF Echo-Thread Server: asfcode = -25582: oserr = 0: errstr = : Network connection is broken.

01:14:30  DR: Turned off on secondary server
01:14:38  Logical Recovery has reached the transaction cleanup phase.
01:14:38  Logical Recovery Complete.
          173 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks

01:14:38  Logical Recovery Complete.
01:14:39  Quiescent Mode
01:14:39  Checkpoint Completed:  duration was 0 seconds.
01:14:39  Checkpoint loguniq 22991, logpos 0x31018, timestamp: 0x62af7a64

01:14:39  Maximum server connections 9
01:14:39  DR: Reservation of the last logical log for log backup turned on
01:14:39  DR: new type = standard
01:14:40  On-Line Mode
01:14:40  CDR GC: catalog recovery begin
01:14:41  DR: new type = primary, secondary server name = gzvc3_server2_net
01:14:41  DR: Trying to connect to secondary server = gzvc3_server2_net
01:14:42  DR: Cannot connect to secondary server
01:14:42  DR: Turned off on primary server
01:14:42  CDR GC: catalog recovery complete
01:14:42  CDR queuer initialization complete
01:14:42  CDR NIF listening on asf://g_gzvc3
01:14:42  DDR Log Snooping - Snooping started in log 22991
01:14:42  CDR: Re-connected to server, id 3, name
01:20:25  DR: Primary server connected
01:20:25  DR: Secondary server needs failure recovery

01:20:27  DR: Sending log 22991 (current), size 100000 pages, 0.18 percent used
01:20:28  DR: Sending Logical Logs Completed
01:20:29  DR: Primary server operational
01:20:29  Checkpoint Completed:  duration was 0 seconds.
01:20:29  Checkpoint loguniq 22991, logpos 0xba018, timestamp: 0x62af8fdd

01:20:29  Maximum server connections 10
01:20:53  Checkpoint Completed:  duration was 0 seconds.
01:20:53  Checkpoint loguniq 22991, logpos 0xbf018, timestamp: 0x62af9418

01:20:53  Maximum server connections 10
01:20:53  Dynamically allocated new virtual shared memory segment (size 8192KB)
01:20:54  Level 0 Archive started on rootdbs, phylogdbs, erdbs, ersbs, logiclogdbs, workdbs
01:25:58  ER can not send replicated transactions due to HDR hang
01:30:06  ER resume transmission of ER/HDR replicated transactions
01:31:16  ER can not send replicated transactions due to HDR hang
01:34:43  ER resume transmission of ER/HDR replicated transactions
01:35:59  ER can not send replicated transactions due to HDR hang
01:43:13  ER resume transmission of ER/HDR replicated transactions
01:44:29  ER can not send replicated transactions due to HDR hang
01:44:34  ER resume transmission of ER/HDR replicated transactions
01:46:03  ER can not send replicated transactions due to HDR hang
01:47:40  ER resume transmission of ER/HDR replicated transactions 收起
互联网服务 · 2013-07-31
浏览757
liaosnet liaosnet 信息分析/架构师 gbasedbt.com
9.40的是没有DRAUTO参数的(或者说只有DRAUTO=0这一个设置),那么这个切换应该是系统集群的切换。。。如果备机没有进行HDR重建的话,你可能需要检查下产生以下的这个原因01:14:09  Maximum server connections 1101:14:28  Assert Failed: semop: errno = ...显示全部
9.40的是没有DRAUTO参数的(或者说只有DRAUTO=0这一个设置),那么这个切换应该是系统集群的切换。。。
如果备机没有进行HDR重建的话,你可能需要检查下产生以下的这个原因
01:14:09  Maximum server connections 11
01:14:28  Assert Failed: semop: errno = 36

这个看起来是似乎是数据库内存被干掉了。。 收起
IT咨询服务 · 2013-07-31
浏览672

提问者

hujinqian
软件开发工程师 华润万家
评论152

相关问题

相关资料

相关文章

问题状态

  • 发布时间:2013-07-31
  • 关注会员:0 人
  • 问题浏览:4255
  • 最近回答:2013-07-31
  • X社区推广