NetApp FAS2040控制器被接管问题

请教一下各位同行,目前小弟这边某个单位有一台存储NetApp FAS2040的控制器B目前处于被接管状态,目前控制器B可能已经宕机了,使用console口也无法连上,由于本人对NetApp这种品牌的存储不是很熟悉,以下为在目前A控截取的配置和日志信息,希望各位同行能够指点指点,谢谢!

zsdaj1(takeover)> environment status

Voltage ok

Temperature: Sensor Chassis Temp Bot failed

Power Supplies OutVoltage ok

Battery ok

Power Supply 1 ok

Power Supply 2 ok

        Environment for channel 0a

        Number of shelves monitored: 1  enabled: yes

        Environmental failure on shelves on this channel? no

        Channel: 0a

        Shelf: 1

        SES device path: local access: 0a.15

        Module type: AT-FCX; monitoring is active

        Shelf status: normal condition

        SES Configuration, via loop id 15 in shelf 1:

         logical identifier=0x50050cc0021fdd8d

         vendor identification=XYRATEX

         product identification=DS14-Mk2-AT

         product revision level=3838

        Vendor-specific information:

         Product Serial Number: OPS8248721FDD8D

         Optional Settings: 0x00

        Status reads attempted: 5931354; failed: 0

        Control writes attempted: 17326; failed: 0

        Shelf bays with disk devices installed:

          6, 5, 4, 3, 2, 1, 0

          with error: none

        Power Supply installed element list: 1, 2; with error: none

        Power Supply information by element:

          [1] Serial number: PMA944430108297  Part number:

              Type: HE Power Reset Capable (86)

              Firmware version:   Swaps: 0

          [2] Serial number: PMA944430108293  Part number:

              Type: HE Power Reset Capable (86)

              Firmware version:   Swaps: 0

          Auto power reset enabled: no

        Cooling Unit installed element list: 1, 2; with error: none

        Temperature Sensor installed element list: 1, 2, 3; with error: none

        Shelf temperatures by element:

          [1] 20 C (68 F) (ambient)  Normal temperature range

          [2] 38 C (100 F)  Normal temperature range

          [3] 34 C (93 F)  Normal temperature range

        Temperature thresholds by element:

          [1] High critical: 50 C (122 F); high warning 40 C (104 F)

              Low critical:  0C (32 F); low warning 10 C (50 F)

          [2] High critical: 63 C (145 F); high warning 53 C (127 F)

              Low critical:  0C (32 F); low warning 10 C (50 F)

          [3] High critical: 63 C (145 F); high warning 53 C (127 F)

              Low critical:  0C (32 F); low warning 10 C (50 F)

        ES Electronics installed element list: 1, 2; with error: none

        ES Electronics reporting element: 1

        ES Electronics information by element:

          [1] Serial number: IMS82899006440B  Part number:

              CPLD version: 24  Swaps: 0

          [2] Serial number: IMS82899006441A  Part number:

              CPLD version: 24  Swaps: 0

        Shelf mapping (shelf-assigned addresses) for channel 0a:

          Shelf   1: XXX XXX XXX XXX XXX XXX XXX  22  21  20  19  18  17  16

        Environment for channel 0c

        Number of shelves monitored: 1  enabled: yes

        Environmental failure on shelves on this channel? yes

        Channel: 0c

        Shelf: 0

        SES device path: local access: 0c.00.99

        Module type: ESAS; monitoring is active

        Shelf status: unrecoverable condition

        SES Configuration, shelf 0:

         logical identifier=0x500c0ff00d0ec23c

         vendor identification=NETAPP  

         product identification=DS12-ESAS

         product revision level=0505

        Vendor-specific information:

         Product Serial Number: NTAPLGH-09460D0EC2              

        Status reads attempted: 5931366; failed: 0

        Control writes attempted: 16889; failed: 0

        Shelf bays with disk devices installed:

          11, 9, 7, 5, 3, 1

          with error: none

        Power Supply installed element list: 1, 2; with error: none

        Power Supply information by element:

          [1] Serial number: NTAPDNH-0947NW459U  Part number:

              Type:

              Firmware version: Y140  Swaps: 0

          [2] Serial number: NTAPDNH-0810NW32P3  Part number:

              Type:

              Firmware version: Y140  Swaps: 0

        Voltage Sensor installed element list: 1, 2, 3, 4, 5, 6; with error: none

        Shelf voltages by element:

          [1] 12.10 Volts Normal voltage range

          [2] 5.40 Volts Normal voltage range

          [3] 3.540 Volts Normal voltage range

          [4] 12.130 Volts Normal voltage range

          [5] 5.60 Volts Normal voltage range

          [6] 3.540 Volts Normal voltage range

        Current Sensor installed element list: 1, 2, 3, 4; with error: none

        Shelf currents by element:

          [1] 3600 mA Normal current range

          [2] 450 mA Normal cuACP must be disabled and reenabled, using the acp.enabledrrent range

option,

before this change takes effect.

ACP must be disabled and reenabled, using the acp.enabled option,

before this change takes effect.

ACP must be disabled and reenabled, using the acp.enabled option,

before this change takes effect.

          [3] 3720 mA Normal current range

          [4] 360 mA Normal current range

        Cooling Unit installed element list: 1, 2; with error: none

        Cooling Units by element:

          [1] 5530 RPM

          [2] 5510 RPM

        Temperature Sensor installed element list: 1, 2, 3, 4; with error: 2

        Shelf temperatures by element:

          [1] 27 C (80 F)  Normal temperature range

          [2] Unavailable

          [3] 29 C (84 F)  Normal temperature range

          [4] 26 C (78 F)  Normal temperature range

        Temperature thresholds by element:

          [1] High critical: 62 C (143 F); high warning 54 C (129 F)

              Low critical:  0C (32 F); low warning 10 C (50 F)

          [2] High critical: 62 C (143 F); high warning 54 C (129 F)

              Low critical:  0C (32 F); low warning 10 C (50 F)

          [3] High critical: 62 C (143 F); high warning 55 C (131 F)

              Low critical:  0C (32 F); low warning 10 C (50 F)

          [4] High critical: 62 C (143 F); high warning 55 C (131 F)

              Low critical:  0C (32 F); low warning 10 C (50 F)

        ES Electronics installed element list: 1, 2; with error: 1, 2

        ES Electronics reporting element: 1

        SAS Expander Module installed element list: 1, 2; with error: 2

        SAS Expander master module: 1

        Shelf mapping (shelf-assigned addresses) for channel 0c:

          Shelf   0:  11 XXX   9 XXX   7 XXX   5 XXX   3 XXX   1 XXX

zsdaj1(takeover)>

zsdaj1(takeover)>

zsdaj1(takeover)>

zsdaj1(takeover)> rdfile /etc/message

/etc/message: No such file or directory

zsdaj1(takeover)> rdfile /etc/messages

Sun Dec 25 00:00:00 CST [zsdaj1 (takeover): kern.log.rotate:notice]: System zsdaj1 (ID 0135071996) is running NetApp Release 7.3.3

Sun Dec 25 00:00:00 CST [zsdaj1 (takeover): kern.log.rotate:notice]: System zsdaj2 (ID 0135071975) is running NetApp Release 7.3.3

Sun Dec 25 00:00:01 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol4: skipping creation of nightly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 00:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32543 minute(s)

Sun Dec 25 00:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32543 minutes

Sun Dec 25 00:00:03 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol1: skipping creation of nightly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 01:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   1:00am up 550 days, 15:47 595060926 NFS ops, 126087 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455408 iSCSI ops

Sun Dec 25 01:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 01:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32603 minute(s)

Sun Dec 25 01:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32603 minutes

Sun Dec 25 01:00:03 CST [zsdaj1 (takeover): raid.rg.scrub.start:notice]: local:/aggr0/plex0/rg0: starting scrub

Sun Dec 25 01:00:04 CST [zsdaj2/zsdaj1: raid.rg.scrub.start:notice]: partner:/aggr0/plex0/rg0: starting scrub

Sun Dec 25 01:00:04 CST [zsdaj1 (takeover): raid.rg.scrub.start:notice]: local:/aggr1/plex0/rg0: starting scrub

Sun Dec 25 02:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   2:00am up 550 days, 16:47 595060936 NFS ops, 126087 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455456 iSCSI ops

Sun Dec 25 02:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 02:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32663 minute(s)

Sun Dec 25 02:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32663 minutes

Sun Dec 25 02:10:00 CST [zsdaj1 (takeover): raid.rg.scrub.done:notice]: local:/aggr0/plex0/rg0: scrub completed in 1:09:56.58

Sun Dec 25 02:10:00 CST [zsdaj1 (takeover): raid.rg.scrub.summary.pi:notice]: Scrub found 0 parity inconsistencies in /aggr0/plex0/rg0.

Sun Dec 25 02:10:00 CST [zsdaj1 (takeover): raid.rg.scrub.summary.cksum:notice]: Scrub found 0 checksum errors in /aggr0/plex0/rg0.

Sun Dec 25 02:10:00 CST [zsdaj1 (takeover): raid.rg.scrub.summary.media:notice]: Scrub found 0 media errors in /aggr0/plex0/rg0.

Sun Dec 25 02:25:12 CST [zsdaj1 (takeover): raid.rg.scrub.done:notice]: partner:/aggr0/plex0/rg0: scrub completed in 1:25:08.44

Sun Dec 25 02:25:12 CST [zsdaj1 (takeover): raid.rg.scrub.summary.pi:notice]: Scrub found 0 parity inconsistencies in /aggr0/plex0/rg0.

Sun Dec 25 02:25:12 CST [zsdaj1 (takeover): raid.rg.scrub.summary.cksum:notice]: Scrub found 0 checksum errors in /aggr0/plex0/rg0.

Sun Dec 25 02:25:12 CST [zsdaj1 (takeover): raid.rg.scrub.summary.media:notice]: Scrub found 0 media errors in /aggr0/plex0/rg0.

Sun Dec 25 03:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   3:00am up 550 days, 17:47 595060936 NFS ops, 126111 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455504 iSCSI ops

Sun Dec 25 03:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 03:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32723 minute(s)

Sun Dec 25 03:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32723 minutes

Sun Dec 25 04:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   4:00am up 550 days, 18:47 595060936 NFS ops, 126111 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455552 iSCSI ops

Sun Dec 25 04:00:01 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 04:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32783 minute(s)

Sun Dec 25 04:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32783 minutes

Sun Dec 25 05:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   5:00am up 550 days, 19:47 595060936 NFS ops, 126111 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455600 iSCSI ops

Sun Dec 25 05:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 05:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32843 minute(s)

Sun Dec 25 05:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32843 minutes

Sun Dec 25 06:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   6:00am up 550 days, 20:47 595060936 NFS ops, 126135 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455648 iSCSI ops

Sun Dec 25 06:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 06:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32903 minute(s)

Sun Dec 25 06:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32903 minutes

Sun Dec 25 06:59:50 CST [zsdaj1 (takeover): raid.rg.scrub.suspended:notice]: local:/aggr1/plex0/rg0: scrub suspended at stripe 126063936 after 5:59:45.35

Sun Dec 25 06:59:50 CST [zsdaj1 (takeover): raid.rg.scrub.summary.pi:notice]: Scrub found 0 parity inconsistencies in /aggr1/plex0/rg0.

Sun Dec 25 06:59:50 CST [zsdaj1 (takeover): raid.rg.scrub.summary.cksum:notice]: Scrub found 0 checksum errors in /aggr1/plex0/rg0.

Sun Dec 25 06:59:50 CST [zsdaj1 (takeover): raid.rg.scrub.summary.media:notice]: Scrub found 0 media errors in /aggr1/plex0/rg0.

Sun Dec 25 06:59:50 CST [zsdaj1 (takeover): raid.scrub.suspended:notice]: Disk scrub suspended.

Sun Dec 25 07:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   7:00am up 550 days, 21:47 595060950 NFS ops, 126135 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455696 iSCSI ops

Sun Dec 25 07:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 07:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 32964 minute(s)

Sun Dec 25 07:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 32963 minutes

Sun Dec 25 08:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   8:00am up 550 days, 22:47 595060974 NFS ops, 126159 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455744 iSCSI ops

Sun Dec 25 08:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 08:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33024 minute(s)

Sun Dec 25 08:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33023 minutes

Sun Dec 25 08:00:46 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol4: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 08:00:46 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol1: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 09:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   9:00am up 550 days, 23:47 595060998 NFS ops, 126159 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455792 iSCSI ops

Sun Dec 25 09:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 09:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33084 minute(s)

Sun Dec 25 09:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33083 minutes

Sun Dec 25 10:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  10:00am up 551 days, 47 mins, 595061022 NFS ops, 126159 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455840 iSCSI ops

Sun Dec 25 10:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 10:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33144 minute(s)

Sun Dec 25 10:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33143 minutes

Sun Dec 25 11:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  11:00am up 551 days,  1:47 595061046 NFS ops, 126183 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455888 iSCSI ops

Sun Dec 25 11:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 11:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33204 minute(s)

Sun Dec 25 11:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33203 minutes

Sun Dec 25 12:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  12:00pm up 551 days,  2:47 595061070 NFS ops, 126183 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455936 iSCSI ops

Sun Dec 25 12:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 12:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33264 minute(s)

Sun Dec 25 12:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33263 minutes

Sun Dec 25 12:00:30 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol4: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 12:00:30 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol1: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 13:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   1:00pm up 551 days,  3:47 595061094 NFS ops, 126183 CIFS ops, 292 HTTP ops, 0 FCP ops, 43455984 iSCSI ops

Sun Dec 25 13:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 13:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33324 minute(s)

Sun Dec 25 13:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33323 minutes

Sun Dec 25 14:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   2:00pm up 551 days,  4:47 595061118 NFS ops, 126207 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456032 iSCSI ops

Sun Dec 25 14:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 14:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33384 minute(s)

Sun Dec 25 14:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33383 minutes

Sun Dec 25 15:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   3:00pm up 551 days,  5:47 595061142 NFS ops, 126207 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456080 iSCSI ops

Sun Dec 25 15:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 15:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33444 minute(s)

Sun Dec 25 15:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33443 minutes

Sun Dec 25 16:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   4:00pm up 551 days,  6:47 595061166 NFS ops, 126231 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456128 iSCSI ops

Sun Dec 25 16:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 16:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33504 minute(s)

Sun Dec 25 16:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33503 minutes

Sun Dec 25 16:00:31 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol4: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 16:00:31 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol1: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 17:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   5:00pm up 551 days,  7:47 595061190 NFS ops, 126231 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456176 iSCSI ops

Sun Dec 25 17:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 17:00:00 CST [zsdaj1 (takeover): asup.general.reminder:info]: Autosupport is not configured to send to NetApp. Enabling Autosupport can significantly speed problem determination and resolution should a problem occur on your system. For further information on Autosupport, please see: http://now.netapp.com/autosupport/

Sun Dec 25 17:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33564 minute(s)

Sun Dec 25 17:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33563 minutes

Sun Dec 25 18:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   6:00pm up 551 days,  8:47 595061212 NFS ops, 126231 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456224 iSCSI ops

Sun Dec 25 18:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 18:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33624 minute(s)

Sun Dec 25 18:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33623 minutes

Sun Dec 25 19:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   7:00pm up 551 days,  9:47 595061236 NFS ops, 126255 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456272 iSCSI ops

Sun Dec 25 19:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 19:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33684 minute(s)

Sun Dec 25 19:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33683 minutes

Sun Dec 25 20:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   8:00pm up 551 days, 10:47 595061260 NFS ops, 126255 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456320 iSCSI ops

Sun Dec 25 20:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 20:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33744 minute(s)

Sun Dec 25 20:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33743 minutes

Sun Dec 25 20:00:31 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol4: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 20:00:31 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol1: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Sun Dec 25 21:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   9:00pm up 551 days, 11:47 595061284 NFS ops, 126279 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456368 iSCSI ops

Sun Dec 25 21:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 21:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33804 minute(s)

Sun Dec 25 21:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33803 minutes

Sun Dec 25 22:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  10:00pm up 551 days, 12:47 595061308 NFS ops, 126279 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456416 iSCSI ops

Sun Dec 25 22:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 22:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33864 minute(s)

Sun Dec 25 22:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33863 minutes

Sun Dec 25 23:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  11:00pm up 551 days, 13:47 595061332 NFS ops, 126303 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456464 iSCSI ops

Sun Dec 25 23:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Sun Dec 25 23:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33924 minute(s)

Sun Dec 25 23:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33923 minutes

Mon Dec 26 00:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  12:00am up 551 days, 14:47 595061366 NFS ops, 126303 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456512 iSCSI ops

Mon Dec 26 00:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 00:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 33984 minute(s)

Mon Dec 26 00:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 33983 minutes

Mon Dec 26 00:00:15 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol4: skipping creation of nightly.0 snapshot (Snapshot operation failed: No space left on device.)

Mon Dec 26 00:00:17 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol1: skipping creation of nightly.0 snapshot (Snapshot operation failed: No space left on device.)

Mon Dec 26 01:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   1:00am up 551 days, 15:47 595061394 NFS ops, 126303 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456560 iSCSI ops

Mon Dec 26 01:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 01:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34044 minute(s)

Mon Dec 26 01:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34044 minutes

Mon Dec 26 02:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   2:00am up 551 days, 16:47 595061404 NFS ops, 126327 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456608 iSCSI ops

Mon Dec 26 02:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 02:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34104 minute(s)

Mon Dec 26 02:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34104 minutes

Mon Dec 26 03:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   3:00am up 551 days, 17:47 595061404 NFS ops, 126327 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456656 iSCSI ops

Mon Dec 26 03:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 03:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34164 minute(s)

Mon Dec 26 03:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34164 minutes

Mon Dec 26 04:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   4:00am up 551 days, 18:47 595061404 NFS ops, 126351 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456704 iSCSI ops

Mon Dec 26 04:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 04:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34224 minute(s)

Mon Dec 26 04:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34224 minutes

Mon Dec 26 05:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   5:00am up 551 days, 19:48 595061404 NFS ops, 126351 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456752 iSCSI ops

Mon Dec 26 05:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 05:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34284 minute(s)

Mon Dec 26 05:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34284 minutes

Mon Dec 26 06:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   6:00am up 551 days, 20:48 595061404 NFS ops, 126351 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456800 iSCSI ops

Mon Dec 26 06:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 06:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34344 minute(s)

Mon Dec 26 06:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34344 minutes

Mon Dec 26 07:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   7:00am up 551 days, 21:48 595061418 NFS ops, 126375 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456848 iSCSI ops

Mon Dec 26 07:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 07:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34404 minute(s)

Mon Dec 26 07:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34404 minutes

Mon Dec 26 08:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   8:00am up 551 days, 22:48 595061442 NFS ops, 126375 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456896 iSCSI ops

Mon Dec 26 08:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 08:00:00 CST [zsdaj1 (takeover): wafl.snap.create.skip.reason:notice]: vol4: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Mon Dec 26 08:00:00 CST [zsdaj1 (takeover): wafl.snap.create.skip.rl1: skipping creation of hourly.0 snapshot (Snapshot operation failed: No space left on device.)

Mon Dec 26 08:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34464 minute(s)

Mon Dec 26 08:00:02 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34464 minutes

Mon Dec 26 09:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:   9:00am up 551 days, 23:48 595061466 NFS ops, 126399 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456944 iSCSI ops

Mon Dec 26 09:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 09:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34524 minute(s)

Mon Dec 26 09:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34524 minutes

Mon Dec 26 10:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  10:00am up 552 days, 48 mins, 595061490 NFS ops, 126399 CIFS ops, 292 HTTP ops, 0 FCP ops, 43456992 iSCSI ops

Mon Dec 26 10:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 10:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34584 minute(s)

Mon Dec 26 10:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down for 34584 minutes

Mon Dec 26 11:00:00 CST [zsdaj1 (takeover): kern.uptime.filer:info]:  11:00am up 552 days,  1:48 595061514 NFS ops, 126399 CIFS ops, 292 HTTP ops, 0 FCP ops, 43457040 iSCSI ops

Mon Dec 26 11:00:00 CST [zsdaj1 (takeover): monitor.shelf.fault:CRITICAL]: Fault reported on disk storage shelf attached to channel 0c. Please check fans, power supplies, disks, and temperature sensors.

Mon Dec 26 11:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyRVnag:error]: Cluster Interconnect sessions with partner have been DOWN for 34644 minute(s)

Mon Dec 26 11:00:03 CST [zsdaj1 (takeover): cf.ic.hourlyNicDownTime:info]: Interconnect adapter link #0 has been down fzsdaj1(takeover)>

zsdaj1(takeover)>

zsdaj1(takeover)>

参与18

4同行回答

AcdanteAcdante  技术总监 , SHFY
cf  status 查看一下A/B 控状态,检查一下存储是否有硬盘故障或者其他硬件故障。cf giveback看看是否有报错。显示全部

cf  status 查看一下A/B 控状态,检查一下存储是否有硬盘故障或者其他硬件故障。cf giveback看看是否有报错。

收起
互联网服务 · 2017-01-03
浏览10420
  • 先生,您好,今天用cf giveback拉过一次,但是还是不能接管回来,错误日志已经截取出来
    2017-01-23
  • 怎么样你的问题解决了没?怎么处理好的?
    2018-10-26
liuziyi0123liuziyi0123  系统工程师 , 中移系统集成有限公司
zsdaj1> cf statuszsdaj2 may be down, takeover disabled because of reason (waiting for partner to recover)zsdaj1 has disabled takeover by zsdaj2 (unsynchronized log)VIA Interconnect is down (link down).已经写的很清楚了,直接去第二个节点看看状态。...显示全部

zsdaj1> cf statuszsdaj2 may be down, takeover disabled because of reason (waiting for partner to recover)zsdaj1 has disabled takeover by zsdaj2 (unsynchronized log)VIA Interconnect is down (link down).

已经写的很清楚了,直接去第二个节点看看状态。

收起
系统集成 · 2017-02-07
浏览10600
草榴君草榴君  网络工程师 , 某某科技公司
zsdaj1(takeover)> cf givebackPartner not waiting for giveback, giveback cancelled.To do a giveback without checking for partner readiness, please either set option \"cf.giveback.check.partner\" to \"off\" before doing \"cf giveback\" again, or do \"c...显示全部

zsdaj1(takeover)> cf giveback

Partner not waiting for giveback, giveback cancelled.

To do a giveback without checking for partner readiness, please either set option \"cf.giveback.check.partner\" to \"off\" before doing \"cf giveback\" again, or do \"cf giveback -f\".

The first choice disables checking for all future \"cf giveback\", until it\'s turned back to \"on\". The second choice is good for this giveback only.

zsdaj1(takeover)>

zsdaj1(takeover)> cf giveback -f

zsdaj1(takeover)> Mon Jan 23 10:42:35 CST [zsdaj1 (takeover): cf.misc.operatorGiveback:info]: Cluster monitor: giveback -f initiated by operator

Mon Jan 23 10:42:35 CST [zsdaj1: cf.fm.givebackStarted:warning]: Cluster monitor: giveback started

CIFS partner server is shutting down...

CIFS partner server has shut down...

Mon Jan 23 10:42:36 CST [zsdaj2/zsdaj1: fcp.service.shutdown:info]: FCP service shutdown

Mon Jan 23 10:42:38 CST [zsdaj1: cf.rsrc.transitTime:notice]: Top Giveback transit times raid=1386, wafl=480 {forget=172, finish=125, giveback_sync=114, sync_clean=68, vol_refs=1, mark_abort=0, wait_offline=0, wait_create=0, abort_scans=0, drain_msgs=0}, wafl_gb_sync=250, sanown_replay=176, ndmpd=96, registry_giveback=38, iscsimgt=19, snapvault=17, nfsd=13, java=8

Mon Jan 23 10:42:38 CST [zsdaj1: asup.msg.giveback.delayed:info]: giveback AutoSupport delayed 5 minutes (until after the giveback process is complete).

Mon Jan 23 10:42:38 CST [zsdaj1: cf.fm.givebackComplete:warning]: Cluster monitor: giveback completed

Mon Jan 23 10:42:38 CST [zsdaj1: cf.fm.givebackDuration:warning]: Cluster monitor: giveback duration time is 3 seconds

Mon Jan 23 10:42:38 CST [zsdaj1: cf.fsm.stateTransit:warning]: Cluster monitor: TAKEOVER --> UP

Mon Jan 23 10:42:38 CST [zsdaj1: cf.fsm.takeoverByPartnerDisabled:notice]: Cluster monitor: takeover of zsdaj1 by zsdaj2 disabled (unsynchronized log)

Mon Jan 23 10:42:43 CST [zsdaj1: cf.fsm.partnerNotResponding:notice]: Cluster monitor: partner not responding

Mon Jan 23 10:42:52 CST [zsdaj1: ha.takeoverImpNotDef:warning]: Takeover of the partner node is impossible due to reason waiting for partner to recover.

zsdaj1>

zsdaj1>  

zsdaj1> cf status

zsdaj2 may be down, takeover disabled because of reason (waiting for partner to recover)

zsdaj1 has disabled takeover by zsdaj2 (unsynchronized log)

VIA Interconnect is down (link down).

zsdaj1> cf monitor

  current time: 23Jan2017 10:44:59

  UP 00:02:21, partner \'zsdaj2\', cluster monitor enabled

  VIA Interconnect is down (link down), takeover capability off-line (waiting for partner to recover)

  takeover by partner off-line (unsynchronized log)

  giveback (23Jan2017 10:42:38), waiting for partner

zsdaj1>

zsdaj1>

收起
系统集成 · 2017-01-23
浏览12322
xujie1stxujie1st  IT顾问 , 华讯网络存储
cf monitor 显示全部

cf monitor

收起
系统集成 · 2017-01-03
浏览10096

提问者

草榴君
网络工程师某某科技公司
擅长领域: 存储灾备软件定义存储

相关问题

相关资料

相关文章

问题状态

  • 发布时间:2017-01-02
  • 关注会员:5 人
  • 问题浏览:16881
  • 最近回答:2017-02-07
  • X社区推广