IT其它故障诊断
链路漂移问题
Ibmbch7989刀箱中，三台10.0.87.103、10.0.86.104、10.0.87.5刀片服务器连接DS5020存储。三台刀片安装oracle10.2.04 数据库，所有数据都通过B控制器数据传输，数据不通过A控制器传输。手工切到A上后，自动回切到B控制器，光纤线已经换过，103与104服务器为互备关系。5为单机模式。以下为基本信息。
BCH3WMSQF#lspath
Enabled hdisk0 sas0
Missing dac0 fscsi0
Missing dac1 fscsi0
Missing dac2 fscsi0
Missing dac3 fscsi1
Missing dac4 fscsi1
Missing dac5 fscsi1
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk3 fscsi0
Enabled hdisk4 fscsi0
Enabled dac8 fscsi0
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Enabled hdisk3 fscsi1
Enabled dac9 fscsi1
Enabled hdisk4 fscsi1
BCH3WMSQF#fget_config -Av
BCH3WMSQF#mpio_get_config -Av
Frame id 0:
Storage Subsystem worldwide name: 608e5002c129000004edede93
Controller count: 2
Partition count: 1
Partition 0:
Storage Subsystem Name = ''
hdisk LUN # Ownership User Label
hdisk1 0 B (non-preferred) aix_disk_ha
hdisk2 1 B (non-preferred) host1_data
hdisk3 2 B (preferred) host2_data
hdisk4 4 B (preferred) host2_rootvg_mirror
BCH3WMSQF#lspv
hdisk0 000a057ae6e746f3 rootvg active
hdisk1 000a057a26303127 heartbeatvg
hdisk2 000a057a26338f87 wmsqfvg active
hdisk3 000a057a2633c2fc wmsjnvg
hdisk4 000a057a26374225 rootvg active
BCH3WMSQF#lsdev -C |more
L2cache0 Available L2 Cache
aio0 Available Asynchronous I/O (Legacy)
ati0 Available 02-08 Native Display Graphics Adapter
cd0 Defined 2.1.2.3- USB DVD R/RW or RAM Drive
cd1 Defined 2.1.2.3- USB DVD-ROM Drive
dac0 Defined 03-08-01 DS3/4K PCM User Interface
dac1 Defined 03-08-01 DS3/4K PCM User Interface
dac2 Defined 03-08-01 DS3/4K PCM User Interface
dac3 Defined 03-09-01 DS3/4K PCM User Interface
dac4 Defined 03-09-01 DS3/4K PCM User Interface
dac5 Defined 03-09-01 DS3/4K PCM User Interface
dac6 Defined 03-08-01 1815 DS4800 Disk Array Controller
dac7 Defined 03-09-01 1815 DS4800 Disk Array Controller
dac8 Available 03-08-01 DS3/4K PCM User Interface
dac9 Available 03-09-01 DS3/4K PCM User Interface
en0 Available Standard Ethernet Network Interface
en1 Available Standard Ethernet Network Interface
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
et0 Defined IEEE 802.3 Ethernet Network Interface
et1 Defined IEEE 802.3 Ethernet Network Interface
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
fscsi0 Available 03-08-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 03-09-01 FC SCSI I/O Controller Protocol Device
fslv00 Defined Logical Volume
fslv01 Defined Logical Volume
fwdump Defined Logical Volume
gxme0 Defined Graphics Data Transfer Assist Subsystem
hd1 Defined Logical Volume
hd2 Defined Logical Volume
hd3 Defined Logical Volume
hd4 Defined Logical Volume
hd5 Defined Logical Volume
hd6 Defined Logical Volume
hd8 Defined Logical Volume
hd10opt Defined Logical Volume
hd9var Defined Logical Volume
hdisk0 Available 00-08-00 SAS Disk Drive
hdisk1 Available 03-08-01 MPIO DS5020 Disk
hdisk2 Available 03-08-01 MPIO DS5020 Disk
hdisk3 Available 03-08-01 MPIO DS5020 Disk
hdisk4 Available 03-08-01 MPIO DS5020 Disk
heartbeatvg Defined Volume Group
inet0 Available Internet Network Extension
iocp0 Defined I/O Completion Ports
iscsi0 Available iSCSI Protocol Device
jnloglv03 Defined Logical Volume
kbd0 Available 1.1- USB keyboard
kbd1 Defined USB keyboard
lft0 Available Low Function Terminal Subsystem
lg_dumplv Defined Logical Volume
lhea0 Available Logical Host Ethernet Adapter (l-hea)
lo0 Available Loopback Network Interface
loglv00 Defined Logical Volume
lv00 Defined Logical Volume
lvdd Available LVM Device Driver
mem0 Available Memory
mouse0 Available 1.1- USB mouse
nsmb0 Available N/A
pci0 Available PCI Bus
pci1 Available PCI Bus
pci2 Available PCI Bus
pci3 Available PCI Bus
posix_aio0 Defined Posix Asynchronous I/O
proc0 Available 00-00 Processor
proc2 Available 00-02 Processor
proc4 Available 00-04 Processor
proc6 Available 00-06 Processor
pty0 Available Asynchronous Pseudo-Terminal
qfloglv02 Defined Logical Volume
rcm0 Available Rendering Context Manager Subsystem
rootvg Defined Volume Group
sas0 Available 00-08-00 Controller SAS Protocol
sata0 Available 00-08-00 Controller SATA Protocol
ses0 Available 00-08-00 SAS Enclosure Services Device
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
sys0 Available System Object
sysplanar0 Available System Planar
usb0 Available USB System Software
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
vio0 Available Virtual I/O Bus
vsa0 Available LPAR Virtual Serial Adapter
vty0 Available Asynchronous Terminal
wmsjn01lv Defined Logical Volume
wmsjnbk01lv Defined Logical Volume
wmsjnvg Defined Volume Group
wmsqf01lv Defined Logical Volume
wmsqfbk01lv Defined Logical Volume
wmsqfvg Defined Volume Group
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#oslevel -r
5300-12
BCH3WMSQF#
BCH4WMSJN#lspath
Enabled hdisk0 sas0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk3 fscsi0
Enabled hdisk4 fscsi0
Enabled dac0 fscsi0
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Enabled hdisk3 fscsi1
Enabled hdisk4 fscsi1
Enabled dac1 fscsi1
BCH4WMSJN#lspv
hdisk0 000a059ae6ea6a72 rootvg active
hdisk1 000a057a26303127 heartbeatvg
hdisk2 000a057a26338f87 wmsqfvg
hdisk3 000a057a2633c2fc wmsjnvg active
hdisk4 000a059a263c3cd7 rootvg active
BCH4WMSJN#mpio_get_config -Av
Frame id 0:
Storage Subsystem worldwide name: 608e5002c129000004edede93
Controller count: 2
Partition count: 1
Partition 0:
Storage Subsystem Name = ''
hdisk LUN # Ownership User Label
hdisk1 0 B (non-preferred) aix_disk_ha
hdisk2 1 B (non-preferred) host1_data
hdisk3 2 B (preferred) host2_data
hdisk4 3 B (preferred) host1_rootvg_mirror
BCH4WMSJN#lsdev -C
L2cache0 Available L2 Cache
aio0 Available Asynchronous I/O (Legacy)
ati0 Available 02-08 Native Display Graphics Adapter
cd0 Defined 2.1.2.3 USB DVD R/RW or RAM Drive
cd1 Defined 2.1.1 USB DVD-COMBO Drive
cd2 Available 2.1.2.3- USB DVD-ROM Drive
dac0 Available 03-08-01 DS3/4K PCM User Interface
dac1 Available 03-09-01 DS3/4K PCM User Interface
en0 Available Standard Ethernet Network Interface
en1 Available Standard Ethernet Network Interface
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
et0 Defined IEEE 802.3 Ethernet Network Interface
et1 Defined IEEE 802.3 Ethernet Network Interface
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
fscsi0 Available 03-08-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 03-09-01 FC SCSI I/O Controller Protocol Device
fslv00 Defined Logical Volume
fslv01 Defined Logical Volume
fslv02 Defined Logical Volume
fwdump Defined Logical Volume
gxme0 Defined Graphics Data Transfer Assist Subsystem
hd1 Defined Logical Volume
hd2 Defined Logical Volume
hd3 Defined Logical Volume
hd4 Defined Logical Volume
hd5 Defined Logical Volume
hd6 Defined Logical Volume
hd8 Defined Logical Volume
hd10opt Defined Logical Volume
hd9var Defined Logical Volume
hdisk0 Available 00-08-00 SAS Disk Drive
hdisk1 Available 03-08-01 MPIO DS5020 Disk
hdisk2 Available 03-08-01 MPIO DS5020 Disk
hdisk3 Available 03-08-01 MPIO DS5020 Disk
hdisk4 Available 03-08-01 MPIO DS5020 Disk
heartbeatvg Defined Volume Group
inet0 Available Internet Network Extension
iocp0 Defined I/O Completion Ports
iscsi0 Available iSCSI Protocol Device
jnloglv03 Defined Logical Volume
kbd0 Available 1.1- USB keyboard
kbd1 Available USB keyboard
lft0 Available Low Function Terminal Subsystem
lg_dumplv Defined Logical Volume
lhea0 Available Logical Host Ethernet Adapter (l-hea)
lo0 Available Loopback Network Interface
loglv00 Defined Logical Volume
lv00 Defined Logical Volume
lvdd Available LVM Device Driver
mem0 Available Memory
mouse0 Available 1.1- USB mouse
nsmb0 Available N/A
pci0 Available PCI Bus
pci1 Available PCI Bus
pci2 Available PCI Bus
pci3 Available PCI Bus
posix_aio0 Defined Posix Asynchronous I/O
proc0 Available 00-00 Processor
proc2 Available 00-02 Processor
proc4 Available 00-04 Processor
proc6 Available 00-06 Processor
pty0 Available Asynchronous Pseudo-Terminal
qfloglv02 Defined Logical Volume
rcm0 Available Rendering Context Manager Subsystem
rootvg Defined Volume Group
sas0 Available 00-08-00 Controller SAS Protocol
sata0 Available 00-08-00 Controller SATA Protocol
ses0 Available 00-08-00 SAS Enclosure Services Device
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
sys0 Available System Object
sysplanar0 Available System Planar
usb0 Available USB System Software
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
vio0 Available Virtual I/O Bus
vsa0 Available LPAR Virtual Serial Adapter
vty0 Available Asynchronous Terminal
wmsjn01lv Defined Logical Volume
wmsjnbk01lv Defined Logical Volume
wmsjnvg Defined Volume Group
wmsqf01lv Defined Logical Volume
wmsqfbk01lv Defined Logical Volume
wmsqfvg Defined Volume Group
BCH4WMSJN#oslevel -s
5300-12-01-1016
BCH5DQDC#lspath
Enabled hdisk0 sas0
Missing dac4 fscsi0
Missing dac5 fscsi1
Missing dac6 fscsi0
Missing dac7 fscsi1
Failed hdisk1 fscsi0
Enabled hdisk1 fscsi1
Failed hdisk5 fscsi0
Enabled hdisk5 fscsi1
BCH5DQDC#mpio_get_config -Av
Frame id 0:
Storage Subsystem worldwide name: 608e5002c129000004edede93
Controller count: 2
Partition count: 1
Partition 0:
Storage Subsystem Name = ''
hdisk LUN # Ownership User Label
hdisk1 6 B (non-preferred) host3_data
hdisk5 5 B (preferred) host3_rootvg_mirror
BCH5DQDC#lsdev -Cc adapter |more
ati0 Available 02-08 Native Display Graphics Adapter
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
lhea0 Available Logical Host Ethernet Adapter (l-hea)
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
vsa0 Available LPAR Virtual Serial Adapter
BCH5DQDC#lsdev -C |more
L2cache0 Available L2 Cache
aio0 Available Asynchronous I/O (Legacy)
ati0 Available 02-08 Native Display Graphics Adapter
cd0 Defined 0.1.2.3 USB DVD R/RW or RAM Drive
cd1 Available 2.1.2.3- USB DVD-ROM Drive
dac0 Defined 03-08-01 1814 DS4700 Disk Array Controller
dac1 Defined 03-08-01 1815 DS4800 Disk Array Controller
dac2 Defined 03-09-01 1814 DS4700 Disk Array Controller
dac3 Defined 03-09-01 1815 DS4800 Disk Array Controller
dac4 Defined 03-08-01 DS3/4K PCM User Interface
dac5 Defined 03-09-01 DS3/4K PCM User Interface
dac6 Defined 03-08-01 DS3/4K PCM User Interface
dac7 Defined 03-09-01 DS3/4K PCM User Interface
dar0 Defined 1814 DS4700 Disk Array Router
dar1 Defined 1815 DS4800 Disk Array Router
dqdc01lv Defined Logical volume
dqdcbk01lv Defined Logical volume
dqdclog01lv Defined Logical volume
dqdcvg Defined Volume group
en0 Available Standard Ethernet Network Interface
en1 Available Standard Ethernet Network Interface
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
et0 Defined IEEE 802.3 Ethernet Network Interface
et1 Defined IEEE 802.3 Ethernet Network Interface
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
fscsi0 Available 03-08-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 03-09-01 FC SCSI I/O Controller Protocol Device
fwdump Defined Logical volume
gxme0 Defined Graphics Data Transfer Assist Subsystem
hd1 Defined Logical volume
hd2 Defined Logical volume
hd3 Defined Logical volume
hd4 Defined Logical volume
hd5 Defined Logical volume
hd6 Defined Logical volume
hd8 Defined Logical volume
hd10opt Defined Logical volume
hd9var Defined Logical volume
hdisk0 Available 00-08-00 SAS Disk Drive
hdisk1 Available 03-08-01 MPIO DS5020 Disk
hdisk5 Available 03-08-01 MPIO DS5020 Disk
inet0 Available Internet Network Extension
iocp0 Defined I/O Completion Ports
iscsi0 Available iSCSI Protocol Device
kbd0 Available 1.1- USB keyboard
kbd1 Available 1.2- USB keyboard
lft0 Available Low Function Terminal Subsystem
lg_dumplv Defined Logical volume
lhea0 Available Logical Host Ethernet Adapter (l-hea)
lo0 Available Loopback Network Interface
loglv00 Defined Logical volume
lvdd Available LVM Device Driver
mem0 Available Memory
mouse0 Available 1.1- USB mouse
nsmb0 Available N/A
paging00 Defined Logical volume
pci0 Available PCI Bus
pci1 Available PCI Bus
pci2 Available PCI Bus
pci3 Available PCI Bus
posix_aio0 Defined Posix Asynchronous I/O
proc0 Available 00-00 Processor
proc2 Available 00-02 Processor
proc4 Available 00-04 Processor
proc6 Available 00-06 Processor
pty0 Available Asynchronous Pseudo-Terminal
rcm0 Available Rendering Context Manager Subsystem
rmt0 Defined 03-08-01 LTO Ultrium Tape Drive (FCP)
rmt1 Defined 03-08-01 LTO Ultrium Tape Drive (FCP)
rmt2 Defined 03-08-01 LTO Ultrium Tape Drive (FCP)
rootvg Defined Volume group
sas0 Available 00-08-00 Controller SAS Protocol
sata0 Available 00-08-00 Controller SATA Protocol
ses0 Available 00-08-00 SAS Enclosure Services Device
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
sys0 Available System Object
sysplanar0 Available System Planar
u01 Defined Logical volume
usb0 Available USB System Software
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
usbms0 Defined 2.3.2.1 USB Mass Storage
vio0 Available Virtual I/O Bus
vsa0 Available LPAR Virtual Serial Adapter
vty0 Available Asynchronous Terminal
BCH5DQDC#
BCH5DQDC#
BCH5DQDC#lspath
Enabled hdisk0 sas0
Missing dac4 fscsi0
Missing dac5 fscsi1
Missing dac6 fscsi0
Missing dac7 fscsi1
Failed hdisk1 fscsi0
Enabled hdisk1 fscsi1
Failed hdisk5 fscsi0
Enabled hdisk5 fscsi1
BCH5DQDC#lsattr -El fcs0
bus_intr_lvl 273 Bus interrupt level False
bus_io_addr 0xff800 Bus I/O address False
bus_mem_addr 0xfff7e000 Bus memory address False
init_link auto INIT Link flags True
intr_priority 3 Interrupt priority False
lg_term_dma 0x800000 Long term DMA True
link_speed auto Link Speed Setting True
max_xfer_size 0x100000 Maximum Transfer Size True
num_cmd_elems 200 Maximum number of COMMANDS to queue to the adapter True
pref_alpa 0x1 Preferred AL_PA True
sw_fc_class 2 FC Class for Fabric True
BCH5DQDC#lsattr -El fcs1
bus_intr_lvl 274 Bus interrupt level False
bus_io_addr 0xffc00 Bus I/O address False
bus_mem_addr 0xfff7f000 Bus memory address False
init_link auto INIT Link flags True
intr_priority 3 Interrupt priority False
lg_term_dma 0x800000 Long term DMA True
link_speed auto Link Speed Setting True
max_xfer_size 0x100000 Maximum Transfer Size True
num_cmd_elems 200 Maximum number of COMMANDS to queue to the adapter True
pref_alpa 0x1 Preferred AL_PA True
sw_fc_class 2 FC Class for Fabric True
BCH5DQDC#lsattr -El hdisk5
PCM PCM/friend/otherapdisk Path Control Module False
PR_key_value none Persistant Reserve Key Value True
algorithm fail_over Algorithm True
autorecovery no Path/Ownership Autorecovery True
clr_q no Device CLEARS its Queue on error True
cntl_delay_time 0 Controller Delay Time True
cntl_hcheck_int 0 Controller Health Check Interval True
cntl_hcheck_int 0 Controller Health Check Interval True
dist_err_pcnt 0 Distributed Error Percentage True
dist_tw_width 50 Distributed Error Sample Time True
hcheck_cmd inquiry Health Check Command True
hcheck_interval 60 Health Check Interval True
hcheck_mode nonactive Health Check Mode True
location Location Label True
lun_id 0x5000000000000 Logical Unit Number ID False
max_transfer 0x40000 Maximum TRANSFER Size True
node_name 0x20040080e52c14fa FC Node Name False
pvid 0004264a46390f930000000000000000 Physical volume identifier False
q_err yes Use QERR bit True
q_type simple Queuing TYPE True
queue_depth 10 Queue DEPTH True
reassign_to 120 REASSIGN time out value True
reserve_policy single_path Reserve Policy True
rw_timeout 30 READ/WRITE time out value True
scsi_id 0x10000 SCSI ID False
start_timeout 60 START unit time out value True
unique_id 3E21360080E50002C1290000004924EEAB4120F1814 FAStT03IBMfcp Unique device identifier False
ww_name 0x20140080e52c14fa FC World Wide Name False
BCH5DQDC#lspv
hdisk0 0004264abc5e4a2b rootvg active
hdisk1 0004264a4639d4e1 dqdcvg active
hdisk5 0004264a46390f93 rootvg active
BCH5DQDC#lsattr -El hdisk1
PCM PCM/friend/otherapdisk Path Control Module False
PR_key_value none Persistant Reserve Key Value True
algorithm fail_over Algorithm True
autorecovery no Path/Ownership Autorecovery True
clr_q no Device CLEARS its Queue on error True
cntl_delay_time 0 Controller Delay Time True
cntl_hcheck_int 0 Controller Health Check Interval True
cntl_hcheck_int 0 Controller Health Check Interval True
dist_err_pcnt 0 Distributed Error Percentage True
dist_tw_width 50 Distributed Error Sample Time True
hcheck_cmd inquiry Health Check Command True
hcheck_interval 60 Health Check Interval True
hcheck_mode nonactive Health Check Mode True
location Location Label True
lun_id 0x6000000000000 Logical Unit Number ID False
max_transfer 0x40000 Maximum TRANSFER Size True
node_name 0x20040080e52c14fa FC Node Name False
pvid 0004264a4639d4e10000000000000000 Physical volume identifier False
q_err yes Use QERR bit True
q_type simple Queuing TYPE True
queue_depth 10 Queue DEPTH True
reassign_to 120 REASSIGN time out value True
reserve_policy single_path Reserve Policy True
rw_timeout 30 READ/WRITE time out value True
scsi_id 0x10000 SCSI ID False
start_timeout 60 START unit time out value True
unique_id 3E21360080E50002C14FA000004B34EEAB6940F1814 FAStT03IBMfcp Unique device identifier False
ww_name 0x20140080e52c14fa FC World Wide Name False
BCH5DQDC#
初步断定链路问题。
BCH3WMSQF#lspath
Enabled hdisk0 sas0
Missing dac0 fscsi0
Missing dac1 fscsi0
Missing dac2 fscsi0
Missing dac3 fscsi1
Missing dac4 fscsi1
Missing dac5 fscsi1
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk3 fscsi0
Enabled hdisk4 fscsi0
Enabled dac8 fscsi0
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Enabled hdisk3 fscsi1
Enabled dac9 fscsi1
Enabled hdisk4 fscsi1
BCH3WMSQF#fget_config -Av
BCH3WMSQF#mpio_get_config -Av
Frame id 0:
Storage Subsystem worldwide name: 608e5002c129000004edede93
Controller count: 2
Partition count: 1
Partition 0:
Storage Subsystem Name = ''
hdisk LUN # Ownership User Label
hdisk1 0 B (non-preferred) aix_disk_ha
hdisk2 1 B (non-preferred) host1_data
hdisk3 2 B (preferred) host2_data
hdisk4 4 B (preferred) host2_rootvg_mirror
BCH3WMSQF#lspv
hdisk0 000a057ae6e746f3 rootvg active
hdisk1 000a057a26303127 heartbeatvg
hdisk2 000a057a26338f87 wmsqfvg active
hdisk3 000a057a2633c2fc wmsjnvg
hdisk4 000a057a26374225 rootvg active
BCH3WMSQF#lsdev -C |more
L2cache0 Available L2 Cache
aio0 Available Asynchronous I/O (Legacy)
ati0 Available 02-08 Native Display Graphics Adapter
cd0 Defined 2.1.2.3- USB DVD R/RW or RAM Drive
cd1 Defined 2.1.2.3- USB DVD-ROM Drive
dac0 Defined 03-08-01 DS3/4K PCM User Interface
dac1 Defined 03-08-01 DS3/4K PCM User Interface
dac2 Defined 03-08-01 DS3/4K PCM User Interface
dac3 Defined 03-09-01 DS3/4K PCM User Interface
dac4 Defined 03-09-01 DS3/4K PCM User Interface
dac5 Defined 03-09-01 DS3/4K PCM User Interface
dac6 Defined 03-08-01 1815 DS4800 Disk Array Controller
dac7 Defined 03-09-01 1815 DS4800 Disk Array Controller
dac8 Available 03-08-01 DS3/4K PCM User Interface
dac9 Available 03-09-01 DS3/4K PCM User Interface
en0 Available Standard Ethernet Network Interface
en1 Available Standard Ethernet Network Interface
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
et0 Defined IEEE 802.3 Ethernet Network Interface
et1 Defined IEEE 802.3 Ethernet Network Interface
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
fscsi0 Available 03-08-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 03-09-01 FC SCSI I/O Controller Protocol Device
fslv00 Defined Logical Volume
fslv01 Defined Logical Volume
fwdump Defined Logical Volume
gxme0 Defined Graphics Data Transfer Assist Subsystem
hd1 Defined Logical Volume
hd2 Defined Logical Volume
hd3 Defined Logical Volume
hd4 Defined Logical Volume
hd5 Defined Logical Volume
hd6 Defined Logical Volume
hd8 Defined Logical Volume
hd10opt Defined Logical Volume
hd9var Defined Logical Volume
hdisk0 Available 00-08-00 SAS Disk Drive
hdisk1 Available 03-08-01 MPIO DS5020 Disk
hdisk2 Available 03-08-01 MPIO DS5020 Disk
hdisk3 Available 03-08-01 MPIO DS5020 Disk
hdisk4 Available 03-08-01 MPIO DS5020 Disk
heartbeatvg Defined Volume Group
inet0 Available Internet Network Extension
iocp0 Defined I/O Completion Ports
iscsi0 Available iSCSI Protocol Device
jnloglv03 Defined Logical Volume
kbd0 Available 1.1- USB keyboard
kbd1 Defined USB keyboard
lft0 Available Low Function Terminal Subsystem
lg_dumplv Defined Logical Volume
lhea0 Available Logical Host Ethernet Adapter (l-hea)
lo0 Available Loopback Network Interface
loglv00 Defined Logical Volume
lv00 Defined Logical Volume
lvdd Available LVM Device Driver
mem0 Available Memory
mouse0 Available 1.1- USB mouse
nsmb0 Available N/A
pci0 Available PCI Bus
pci1 Available PCI Bus
pci2 Available PCI Bus
pci3 Available PCI Bus
posix_aio0 Defined Posix Asynchronous I/O
proc0 Available 00-00 Processor
proc2 Available 00-02 Processor
proc4 Available 00-04 Processor
proc6 Available 00-06 Processor
pty0 Available Asynchronous Pseudo-Terminal
qfloglv02 Defined Logical Volume
rcm0 Available Rendering Context Manager Subsystem
rootvg Defined Volume Group
sas0 Available 00-08-00 Controller SAS Protocol
sata0 Available 00-08-00 Controller SATA Protocol
ses0 Available 00-08-00 SAS Enclosure Services Device
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
sys0 Available System Object
sysplanar0 Available System Planar
usb0 Available USB System Software
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
vio0 Available Virtual I/O Bus
vsa0 Available LPAR Virtual Serial Adapter
vty0 Available Asynchronous Terminal
wmsjn01lv Defined Logical Volume
wmsjnbk01lv Defined Logical Volume
wmsjnvg Defined Volume Group
wmsqf01lv Defined Logical Volume
wmsqfbk01lv Defined Logical Volume
wmsqfvg Defined Volume Group
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#
BCH3WMSQF#oslevel -r
5300-12
BCH3WMSQF#
BCH4WMSJN#lspath
Enabled hdisk0 sas0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk3 fscsi0
Enabled hdisk4 fscsi0
Enabled dac0 fscsi0
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Enabled hdisk3 fscsi1
Enabled hdisk4 fscsi1
Enabled dac1 fscsi1
BCH4WMSJN#lspv
hdisk0 000a059ae6ea6a72 rootvg active
hdisk1 000a057a26303127 heartbeatvg
hdisk2 000a057a26338f87 wmsqfvg
hdisk3 000a057a2633c2fc wmsjnvg active
hdisk4 000a059a263c3cd7 rootvg active
BCH4WMSJN#mpio_get_config -Av
Frame id 0:
Storage Subsystem worldwide name: 608e5002c129000004edede93
Controller count: 2
Partition count: 1
Partition 0:
Storage Subsystem Name = ''
hdisk LUN # Ownership User Label
hdisk1 0 B (non-preferred) aix_disk_ha
hdisk2 1 B (non-preferred) host1_data
hdisk3 2 B (preferred) host2_data
hdisk4 3 B (preferred) host1_rootvg_mirror
BCH4WMSJN#lsdev -C
L2cache0 Available L2 Cache
aio0 Available Asynchronous I/O (Legacy)
ati0 Available 02-08 Native Display Graphics Adapter
cd0 Defined 2.1.2.3 USB DVD R/RW or RAM Drive
cd1 Defined 2.1.1 USB DVD-COMBO Drive
cd2 Available 2.1.2.3- USB DVD-ROM Drive
dac0 Available 03-08-01 DS3/4K PCM User Interface
dac1 Available 03-09-01 DS3/4K PCM User Interface
en0 Available Standard Ethernet Network Interface
en1 Available Standard Ethernet Network Interface
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
et0 Defined IEEE 802.3 Ethernet Network Interface
et1 Defined IEEE 802.3 Ethernet Network Interface
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
fscsi0 Available 03-08-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 03-09-01 FC SCSI I/O Controller Protocol Device
fslv00 Defined Logical Volume
fslv01 Defined Logical Volume
fslv02 Defined Logical Volume
fwdump Defined Logical Volume
gxme0 Defined Graphics Data Transfer Assist Subsystem
hd1 Defined Logical Volume
hd2 Defined Logical Volume
hd3 Defined Logical Volume
hd4 Defined Logical Volume
hd5 Defined Logical Volume
hd6 Defined Logical Volume
hd8 Defined Logical Volume
hd10opt Defined Logical Volume
hd9var Defined Logical Volume
hdisk0 Available 00-08-00 SAS Disk Drive
hdisk1 Available 03-08-01 MPIO DS5020 Disk
hdisk2 Available 03-08-01 MPIO DS5020 Disk
hdisk3 Available 03-08-01 MPIO DS5020 Disk
hdisk4 Available 03-08-01 MPIO DS5020 Disk
heartbeatvg Defined Volume Group
inet0 Available Internet Network Extension
iocp0 Defined I/O Completion Ports
iscsi0 Available iSCSI Protocol Device
jnloglv03 Defined Logical Volume
kbd0 Available 1.1- USB keyboard
kbd1 Available USB keyboard
lft0 Available Low Function Terminal Subsystem
lg_dumplv Defined Logical Volume
lhea0 Available Logical Host Ethernet Adapter (l-hea)
lo0 Available Loopback Network Interface
loglv00 Defined Logical Volume
lv00 Defined Logical Volume
lvdd Available LVM Device Driver
mem0 Available Memory
mouse0 Available 1.1- USB mouse
nsmb0 Available N/A
pci0 Available PCI Bus
pci1 Available PCI Bus
pci2 Available PCI Bus
pci3 Available PCI Bus
posix_aio0 Defined Posix Asynchronous I/O
proc0 Available 00-00 Processor
proc2 Available 00-02 Processor
proc4 Available 00-04 Processor
proc6 Available 00-06 Processor
pty0 Available Asynchronous Pseudo-Terminal
qfloglv02 Defined Logical Volume
rcm0 Available Rendering Context Manager Subsystem
rootvg Defined Volume Group
sas0 Available 00-08-00 Controller SAS Protocol
sata0 Available 00-08-00 Controller SATA Protocol
ses0 Available 00-08-00 SAS Enclosure Services Device
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
sys0 Available System Object
sysplanar0 Available System Planar
usb0 Available USB System Software
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
vio0 Available Virtual I/O Bus
vsa0 Available LPAR Virtual Serial Adapter
vty0 Available Asynchronous Terminal
wmsjn01lv Defined Logical Volume
wmsjnbk01lv Defined Logical Volume
wmsjnvg Defined Volume Group
wmsqf01lv Defined Logical Volume
wmsqfbk01lv Defined Logical Volume
wmsqfvg Defined Volume Group
BCH4WMSJN#oslevel -s
5300-12-01-1016
BCH5DQDC#lspath
Enabled hdisk0 sas0
Missing dac4 fscsi0
Missing dac5 fscsi1
Missing dac6 fscsi0
Missing dac7 fscsi1
Failed hdisk1 fscsi0
Enabled hdisk1 fscsi1
Failed hdisk5 fscsi0
Enabled hdisk5 fscsi1
BCH5DQDC#mpio_get_config -Av
Frame id 0:
Storage Subsystem worldwide name: 608e5002c129000004edede93
Controller count: 2
Partition count: 1
Partition 0:
Storage Subsystem Name = ''
hdisk LUN # Ownership User Label
hdisk1 6 B (non-preferred) host3_data
hdisk5 5 B (preferred) host3_rootvg_mirror
BCH5DQDC#lsdev -Cc adapter |more
ati0 Available 02-08 Native Display Graphics Adapter
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
lhea0 Available Logical Host Ethernet Adapter (l-hea)
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
vsa0 Available LPAR Virtual Serial Adapter
BCH5DQDC#lsdev -C |more
L2cache0 Available L2 Cache
aio0 Available Asynchronous I/O (Legacy)
ati0 Available 02-08 Native Display Graphics Adapter
cd0 Defined 0.1.2.3 USB DVD R/RW or RAM Drive
cd1 Available 2.1.2.3- USB DVD-ROM Drive
dac0 Defined 03-08-01 1814 DS4700 Disk Array Controller
dac1 Defined 03-08-01 1815 DS4800 Disk Array Controller
dac2 Defined 03-09-01 1814 DS4700 Disk Array Controller
dac3 Defined 03-09-01 1815 DS4800 Disk Array Controller
dac4 Defined 03-08-01 DS3/4K PCM User Interface
dac5 Defined 03-09-01 DS3/4K PCM User Interface
dac6 Defined 03-08-01 DS3/4K PCM User Interface
dac7 Defined 03-09-01 DS3/4K PCM User Interface
dar0 Defined 1814 DS4700 Disk Array Router
dar1 Defined 1815 DS4800 Disk Array Router
dqdc01lv Defined Logical volume
dqdcbk01lv Defined Logical volume
dqdclog01lv Defined Logical volume
dqdcvg Defined Volume group
en0 Available Standard Ethernet Network Interface
en1 Available Standard Ethernet Network Interface
ent0 Available Logical Host Ethernet Port (lp-hea)
ent1 Available Logical Host Ethernet Port (lp-hea)
et0 Defined IEEE 802.3 Ethernet Network Interface
et1 Defined IEEE 802.3 Ethernet Network Interface
fcs0 Available 03-08 FC Adapter
fcs1 Available 03-09 FC Adapter
fscsi0 Available 03-08-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 03-09-01 FC SCSI I/O Controller Protocol Device
fwdump Defined Logical volume
gxme0 Defined Graphics Data Transfer Assist Subsystem
hd1 Defined Logical volume
hd2 Defined Logical volume
hd3 Defined Logical volume
hd4 Defined Logical volume
hd5 Defined Logical volume
hd6 Defined Logical volume
hd8 Defined Logical volume
hd10opt Defined Logical volume
hd9var Defined Logical volume
hdisk0 Available 00-08-00 SAS Disk Drive
hdisk1 Available 03-08-01 MPIO DS5020 Disk
hdisk5 Available 03-08-01 MPIO DS5020 Disk
inet0 Available Internet Network Extension
iocp0 Defined I/O Completion Ports
iscsi0 Available iSCSI Protocol Device
kbd0 Available 1.1- USB keyboard
kbd1 Available 1.2- USB keyboard
lft0 Available Low Function Terminal Subsystem
lg_dumplv Defined Logical volume
lhea0 Available Logical Host Ethernet Adapter (l-hea)
lo0 Available Loopback Network Interface
loglv00 Defined Logical volume
lvdd Available LVM Device Driver
mem0 Available Memory
mouse0 Available 1.1- USB mouse
nsmb0 Available N/A
paging00 Defined Logical volume
pci0 Available PCI Bus
pci1 Available PCI Bus
pci2 Available PCI Bus
pci3 Available PCI Bus
posix_aio0 Defined Posix Asynchronous I/O
proc0 Available 00-00 Processor
proc2 Available 00-02 Processor
proc4 Available 00-04 Processor
proc6 Available 00-06 Processor
pty0 Available Asynchronous Pseudo-Terminal
rcm0 Available Rendering Context Manager Subsystem
rmt0 Defined 03-08-01 LTO Ultrium Tape Drive (FCP)
rmt1 Defined 03-08-01 LTO Ultrium Tape Drive (FCP)
rmt2 Defined 03-08-01 LTO Ultrium Tape Drive (FCP)
rootvg Defined Volume group
sas0 Available 00-08-00 Controller SAS Protocol
sata0 Available 00-08-00 Controller SATA Protocol
ses0 Available 00-08-00 SAS Enclosure Services Device
sissas0 Available 00-08 PCI-X266 Planar 3Gb SAS Adapter
sys0 Available System Object
sysplanar0 Available System Planar
u01 Defined Logical volume
usb0 Available USB System Software
usbhc0 Available 01-08 USB Host Controller (33103500)
usbhc1 Available 01-09 USB Host Controller (33103500)
usbhc2 Available 01-0a USB Enhanced Host Controller (3310e000)
usbms0 Defined 2.3.2.1 USB Mass Storage
vio0 Available Virtual I/O Bus
vsa0 Available LPAR Virtual Serial Adapter
vty0 Available Asynchronous Terminal
BCH5DQDC#
BCH5DQDC#
BCH5DQDC#lspath
Enabled hdisk0 sas0
Missing dac4 fscsi0
Missing dac5 fscsi1
Missing dac6 fscsi0
Missing dac7 fscsi1
Failed hdisk1 fscsi0
Enabled hdisk1 fscsi1
Failed hdisk5 fscsi0
Enabled hdisk5 fscsi1
BCH5DQDC#lsattr -El fcs0
bus_intr_lvl 273 Bus interrupt level False
bus_io_addr 0xff800 Bus I/O address False
bus_mem_addr 0xfff7e000 Bus memory address False
init_link auto INIT Link flags True
intr_priority 3 Interrupt priority False
lg_term_dma 0x800000 Long term DMA True
link_speed auto Link Speed Setting True
max_xfer_size 0x100000 Maximum Transfer Size True
num_cmd_elems 200 Maximum number of COMMANDS to queue to the adapter True
pref_alpa 0x1 Preferred AL_PA True
sw_fc_class 2 FC Class for Fabric True
BCH5DQDC#lsattr -El fcs1
bus_intr_lvl 274 Bus interrupt level False
bus_io_addr 0xffc00 Bus I/O address False
bus_mem_addr 0xfff7f000 Bus memory address False
init_link auto INIT Link flags True
intr_priority 3 Interrupt priority False
lg_term_dma 0x800000 Long term DMA True
link_speed auto Link Speed Setting True
max_xfer_size 0x100000 Maximum Transfer Size True
num_cmd_elems 200 Maximum number of COMMANDS to queue to the adapter True
pref_alpa 0x1 Preferred AL_PA True
sw_fc_class 2 FC Class for Fabric True
BCH5DQDC#lsattr -El hdisk5
PCM PCM/friend/otherapdisk Path Control Module False
PR_key_value none Persistant Reserve Key Value True
algorithm fail_over Algorithm True
autorecovery no Path/Ownership Autorecovery True
clr_q no Device CLEARS its Queue on error True
cntl_delay_time 0 Controller Delay Time True
cntl_hcheck_int 0 Controller Health Check Interval True
cntl_hcheck_int 0 Controller Health Check Interval True
dist_err_pcnt 0 Distributed Error Percentage True
dist_tw_width 50 Distributed Error Sample Time True
hcheck_cmd inquiry Health Check Command True
hcheck_interval 60 Health Check Interval True
hcheck_mode nonactive Health Check Mode True
location Location Label True
lun_id 0x5000000000000 Logical Unit Number ID False
max_transfer 0x40000 Maximum TRANSFER Size True
node_name 0x20040080e52c14fa FC Node Name False
pvid 0004264a46390f930000000000000000 Physical volume identifier False
q_err yes Use QERR bit True
q_type simple Queuing TYPE True
queue_depth 10 Queue DEPTH True
reassign_to 120 REASSIGN time out value True
reserve_policy single_path Reserve Policy True
rw_timeout 30 READ/WRITE time out value True
scsi_id 0x10000 SCSI ID False
start_timeout 60 START unit time out value True
unique_id 3E21360080E50002C1290000004924EEAB4120F1814 FAStT03IBMfcp Unique device identifier False
ww_name 0x20140080e52c14fa FC World Wide Name False
BCH5DQDC#lspv
hdisk0 0004264abc5e4a2b rootvg active
hdisk1 0004264a4639d4e1 dqdcvg active
hdisk5 0004264a46390f93 rootvg active
BCH5DQDC#lsattr -El hdisk1
PCM PCM/friend/otherapdisk Path Control Module False
PR_key_value none Persistant Reserve Key Value True
algorithm fail_over Algorithm True
autorecovery no Path/Ownership Autorecovery True
clr_q no Device CLEARS its Queue on error True
cntl_delay_time 0 Controller Delay Time True
cntl_hcheck_int 0 Controller Health Check Interval True
cntl_hcheck_int 0 Controller Health Check Interval True
dist_err_pcnt 0 Distributed Error Percentage True
dist_tw_width 50 Distributed Error Sample Time True
hcheck_cmd inquiry Health Check Command True
hcheck_interval 60 Health Check Interval True
hcheck_mode nonactive Health Check Mode True
location Location Label True
lun_id 0x6000000000000 Logical Unit Number ID False
max_transfer 0x40000 Maximum TRANSFER Size True
node_name 0x20040080e52c14fa FC Node Name False
pvid 0004264a4639d4e10000000000000000 Physical volume identifier False
q_err yes Use QERR bit True
q_type simple Queuing TYPE True
queue_depth 10 Queue DEPTH True
reassign_to 120 REASSIGN time out value True
reserve_policy single_path Reserve Policy True
rw_timeout 30 READ/WRITE time out value True
scsi_id 0x10000 SCSI ID False
start_timeout 60 START unit time out value True
unique_id 3E21360080E50002C14FA000004B34EEAB6940F1814 FAStT03IBMfcp Unique device identifier False
ww_name 0x20140080e52c14fa FC World Wide Name False
BCH5DQDC#
初步断定链路问题。