Home

Sun StorEdge SAN 4.0 Release Field Troubleshooting Guide

Contents

1. Switch 0 Sun Enterprise 420 1 3 Sun StorEdge T3 partner pairs Host Adapter 5 6 Host Adapter 7 8 Et Sun Enterprise 3500 Switch 1 1 2 Host Adapter 3 4 3 6 Sun S A Host Adapter un StorEdge A5209 Array 7 8 IBA DS EN IBB FIGURE 2 4 Two Hosts Connected to Sun StorEdge T3 Array Partner Group Each Host with Separate Non shared Storage Note You must enable Sun StorEdge Traffic Manager software for failover across multiple hosts to function The mp_support on the Sun StorEdge T3 array should be set to mpxio Sun StorEdge Traffic Manager Software Chapter 2 Configurations 29 30 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 CHAPTER 3 Diagnostics This chapter provides an overview of the tools you can use to monitor diagnose troubleshoot and gather information on the Sun StorEdge SAN 4 0 Release and on the Sun StorEdge Network Fibre Channel Switch 16 Detailed installation and configuration information can be found in the respective documentation of the tools This chapter contains the following sections a Diagnostic Tools on page 32 a Storage Automated Diagnostic Environment Version 2 1 on page 32 a Sun Explorer Data Co
2. ISL hops do not include the connections between hosts and switches or between switches and storage Rules for Adding and Removing Devices While the Hosts are Online You can add all initial and additional storage devices while the host is online In high availability configurations where alternative methods to reconstruct the data exist you can remove a device or path Host volume management or multi pathing software handles this device removal For non available configurations you must ensure that no host application is configured to use the device In the case of a fabric configuration name server zone you must unconfigure the device on the host This ensures that during the boot process the host does not attempt to probe this device to create device nodes You can add or remove a host without shutting down the SAN Chapter 2 Configurations 23 24 Configuration Examples Single Host Connected to One Storage Array FIGURE 2 1 shows one host connected through fiber optic cables to a Sun StorEdge T3 array enterprise configuration Host Switches Host Adapter Host Adapter Fibre optic cables Sun StorEdge T3 array partner pair FIGURE 2 1 Single Host Connected to One Sun StorEdge T3 Array Enterprise Configuration Sun StorEdge SAN 4 0 Release Field Troubleshoot
3. Configurations of this guide for supported hardware configurations Brocade Communications Systems Silkworm switch configurations and Sun switch configurations have the minimum software package requirements shown in TABLE B 1 Appendix B Brocade Communications Systems Switch Troubleshooting 83 TABLE B 1 SAN Supportability Matrix with Solaris 8 02 02 Update 7 or Later Bus Physical Required Sun Software Packages and Server Architecture HBAs Connection SAN 4 0 Brocade Patches Sun Enterprise 3x00 SBus X6757A 1 Gbyte FC Sun StorEdge Network Foundation d1 i SE NE ne eee X6727 A5 e SUNWsan PCI X6767A4 2 Gbyte FC e SUNWcfpl 5 UE e SUNWefplx Sun Fire 3800 X6748A6 1 Gbyte FC found at the Download Center 7 http www sun com storage Sun Re 2300 6800 X6748A Lee re san Sun StorEdge SAN 4 0 PCI X6799A 1 Gbyte FC release Software Firmware X6727A Upgrades and Documentation X6767A 2 Gbyte EC login license agreement X6768A TRENS Solaris 8 SUNWcfpl x and SUNWsan packages or Sun Fire 15k 12k PCI X6799A 1 Gbyte FC e Solaris 9 SUNWcfpl x and E4x0 E2x0 SF480 X6727A SUNWsan packages SF280R V880 SB1000 SB2000 X6767A 2 Gbyte FC a X6768A Sun StorEdge Traffic Manager Netra 1125 and 140X 1 Sun StorEdge SBus Dual Fibre Channel Host Bus Adapter Ivory 2 Sun StorEdge PCI Single Fibre Channel Network Adapter Amber 3 Sun StorEdge PCI Dual Fibre Channel Network Adapter Crystal 4 Sun StorEdge 2G
4. Hosts on page 13 Storage Arrays on page 14 Host Bus Adapters on page 15 Software Packages and Patches on page 16 Switches on page 18 a Switch Port Types on page 19 m Zones on page 21 m Configuration Guidelines on page 22 m Configuration Examples on page 24 Supported Hardware In a single switch configuration the switch is connected to the host through a fiber optic cable to a Sun StorEdge PCI Fibre Channel Network Adapter The other ports of the switch are connected to storage devices through a fiber optic cable In a cascaded configuration two switches are connected together by way of Inter Switch Links ISL A name server zone can span both switches TABLE 2 1 Supported Hardware Model Part Number or System Code Description T3BES RR 22 Sun StorEdge T3 and T3 arrays 655R5 T3BWG RR 11 327R5 3910 3960 Sun StorEdge 39x0 storage series 6910 6960 Sun StorEdge 69x0 storage series 9910 9960 Sun StorEdge 99x0 storage series X6799A Sun StorEdge PCI Single Fibre Channel Network Adapter X6727A Sun StorEdge PCI Dual Fibre Channel Network Adapter X6748A Sun StorEdge cPCI Dual Fibre Channel Network Adapter X6757A Sun StorEdge SBus Dual Fibre Channel Host Bus Adapter X6767A Sun StorEdge 2G FC PCI Single Channel Network Adapter X6768A Sun StorEdge 2G FC PCI Dual Channel Network Adapter XSFP SW 2Gb Short wave SFP up to 300 meters XSFP LW 2Gb Long wave
5. Kernel 5 4 Fabric OS v2 6 0 Made on Tue Jan 15 15 10 28 PST 2002 Flash Tue Jan 15 15 12 04 PST 2002 BootProm Thu Jun 17 15 20 39 PDT 1999 26 25 26 25 27 Centigrade 78 77 78 77 80 Fahrenheit Power Supply 1 is absent 90 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 CODE EXAMPLE B 2 switchshow Example Output diagl67 admin gt switchshow switchName diag167 switchType 3 4 switchState Online switchMode Native switchRole Subordinate switchDomain i switchld fffc01 switchWwn 10 00 00 60 69 20 le fc switchBeacon OFF Zoning ON Main port 0 sw Online E Port 10 00 00 60 69 10 71 25 diagl64 upstream port 1 No Module port 2 sw Online F Port 21 01 00 e0 8b 23 61 f9 port 3 No Module port 4 No Module port 5 No Module port 6 sw Online E Port 10 00 00 60 69 10 71 25 diagl64 port 7 sw Online F Port 21 00 00 e0 8b 03 61 f9 CODE EXAMPLE B 3 qlshow Example Output diagl67 admin gt qlshow Self 10 00 00 60 69 20 le fc domain 1 State Master Scope single AL_PA bitmap 30000000 00000000 00000000 00000000 Local AL_PAs not available Local looplet states Member L 3 4 Online Re Looplet 1 offline Looplet 3 offline Looplet 4 offline Appendix B Brocade Communications Systems Switch Troubleshooting 91 CODE EXAMPLE B 4 diagShow Example Output diagl67 admin gt diagshow nTicks 0 M
6. Revision 0200 Serial Num Unsupported Unformatted capacity 119514 500 MBytes Write Cache Enabled Read Cache Enabled Minimum prefetch 0x0 Maximum prefetch 0x0 Device Type Disk device Path s dev rdsk c3t50020F23000068CCd0s2 devices pci 9 600000 pci 2 SUNW qlc 5 fpl0 0 ssd w50020f23000068cc 0 c raw DEVICE PROPERTIES for disk 50020 23000068cc Status Port B O K Vendor SUN Product ID T300 WWN Node 50020f20000068cc WWN Port B 50020f23000068cc Revision 0200 Serial Num Unsupported Unformatted capacity 119514 500 MBytes Write Cache Enabled Read Cache Enabled Minimum prefetch 0x0 Maximum prefetch 0x0 Device Type Disk device Path s dev rdsk c3t50020F23000068CCd1s2 devices pci 9 600000 pci 2 SUNW qlc 5 fp0 0 ssd w50020f23000068cc 1 c raw The primary path is now restored as the ONLINE path and I O is again using this path As a final check look to the Storage Automated Diagnostic Environment version 2 1 topology The ports that were in error are now green and the mpx error is green as well as shown in FIGURE B 9 118 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Storage Automated Diagnostic Environment Monitor EChrEm Manage Diagnostic Tests AMIE ReNt tel dla EEIen oraa Mere ks Host san MASTER Filter None f co Help Clear Search Topology Help sw 67 131 Switch2 16 Switch2 16 sw 67 101 Sw 67 183
7. nl en Switch2 16 Switch2 16 dakloop V880DISK br 67 164 a LME v JA t3 t3 67 166 a A LMP vA t3b Brocade 16 sw 67 128 Sw 67 127 Switch2 16 Switch2 16 EFELCEETEE 2 After having selectec functions are availak 1 Clicking in the mic specific component o the status at the bot 2 Right clicking the a zoom menu 3 Right clicking on menu of functions av 4 Right clicking on i of functions availabl 5 Holding the Shift objects allows to sele can be used to mover same time 6 After resizing the must be selected to r FIGURE B 9 Storage Automated Diagnostic Environment Version 2 1 Test from Topology Window Appendix B Brocade Communications Systems Switch Troubleshooting 119 120 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 APPENDIX C Brocade Communications Systems Error Messages This appendix explains the error message format and possible errors and contains the following topics m Error Message Formats on page 122 m Diagnostic Error Message Formats on page 123 121 Error Message Formats There are two error message formats depending on whether you are gathering information from the front panel or via Telnet The front panel shows an abbreviated message and by way of Telnet displays the entire error message In all cases the last error encountered is the first error displayed
8. 20000003d53d3493930006a222 multipath status degraded path pci 1f 2000 SUNW qlc 1 fpt0 0 fp4 to address Sep 13 779286 50020 23000003d5 13 05 36 WWN 50020 kern info scsi_v l is offline 23000003d5 diag226 Central Sun COM mpxio hci ssd g60020 20000003d53d349365000c1691 multipath status degraded path pci 1f 2000 SUNW qlc 1 fpt0 0 fp4 to ssd0 ssdl ssd2 ssd3 ID target target address 50020f2300000345 0 is offline Site FSDE LAB Broomfield CO Source diag226 central sun com Severity Warning Actionable Category HOST Deviceld host diag226 central sun com EventType AlarmEvent M hba EventCode 7 5 20 EventTime 2002 09 13 13 06 49 DESCRIPTION status of hba devices pci 1f 2000 SUNW qlc 1 fp 0 0 devctl on diag226 central sun com changed from CONNECTED to NOT CONNECTED INFORMATION monitors changes in the output of luxadm e port Found path to 20 HBA ports devices sbus 2 0 SUNW socal d 10000 0 NOT CONNE CTED RECOMME ND ED ACTION use luxadm e port to confirm hba status continued verify if all paths are working Chapter 4 Troubleshooting Example 51 continuation Site FSDE LAB Broomfield CO Source diag226 central sun com Severity Error Actionable Category SWITCH2 Deviceld switch2 100000c0dd00bfda EventType
9. Configuration Guidelines Switches For high availability applications configure two sets of switches in parallel Zones and Arrays Sun StorEdge T3 arrays support name server zones or zones in which a host has made a point to point Fabric connection to a switch and the Sun StorEdge T3 array is attached to a TL port Do not mix different arrays in the same zone A single zone can contain only Sun StorEdge 3900 arrays or only Sun StorEdge T3 arrays You may configure a minimum of one port per zone For example a 16 port switch can have a maximum of 16 zones 22 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Zones and Storage You can dynamically add storage to a port based or WWN based zone using cfgadm procedures for the Sun StorEdge T3 arrays This requires the Sun StorEdge T3 and T3 arrays to be connected as TL or Fabric devices TABLE 2 11 Arrays Zones and Initiators Array Maximum Arrays Zone Maximum Initiators Zone Sun StorEdge T3 252 252 Sun StorEdge T3 arrays in a work 252 array group or 126 Sun StorEdge T3 arrays in an enterprise configuration Cascading Rules a Hub to switch connectivity is not supported m If 1 and 2 gigabit switches are used together a maximum of 16 switches can be cascaded a If only 2 gigabit switches are used a maximum of 64 switches can be cascaded a The maximum distance is 10 kilometers m Any number of ISL hops can be used between two switches
10. Functional i Insert a NEW FC Cable into brocade 1000006069201 efc H i br 67 167 port 2 Continue Isolation qlctest started on hba port i qictest completed successfully Suspect ORIGINAL FC Cable from brocade 1000006069201 efc i br 67 167 port 2 Retest to verify FRU replacement linktest completed on FC interconnect hba to brocade E E S FIGURE B 8 Continued Link Test Example Results 116 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 6 Verify the fix a Check the cfgadm output to see if the device appears back in the fabric CODE EXAMPLE B 10 cfgadm Output cfgadm al cs c3 c4 c5 c5 c5 fc fabric 50020f23000068cc disk fc private f fabri 210000e08b05041c unknown 50020f2300004331 disk The c3 device is connected connected connected connected connected connected connected configured configured unconfigured configured unconfigured configured unknown unusable unknown unknown unknown unknown b Check the status of the device with the luxadm failover command Appendix B Brocade Communications Systems Switch Troubleshooting 117 luxadm failover primary home mckenney ws storade2 2 StorTools tests discover luxadm display 50020 23000068cc DEVICE PROPERTIES for disk 50020f23000068cc Status Port A OKs Vendor SUN Product ID T300 WWN Node 50020 20000068cc WWN Port A 50020 23000068cc
11. Response SSRR HTTP and SNMP Providers or email m Support for direct attached storage DAS and storage area networks SANs Storage Automated Diagnostic Environment Version 2 1 Functions For each device the Storage Automated Diagnostic Environment version 2 1 performs the following functions 1 Sends the information by way of a discovery event to the system administrator through an interface with the transport mechanisms Note The first access to a device yields a discovery event that collects all the information about that device plus other events for other preconfigured devices that may be generated by health monitors 2 Reads the proper var adm messages files finds relevant entries and reports them as events through the local email notification mechanism if configured 3 Connects to Sun StorEdge T3 and T3 array storage devices directly through in band data paths and out of band management paths 4 Reads the device s configuration and state information stores it locally in the cache compares the results of the last run and transmits the differences 5 Reads threshold information and reports errors when the frequency threshold reaches predefined levels Chapter 3 Diagnostics 33 34 Storage Automated Diagnostic Environment Version 2 1 Agent Functionality The Storage Automated Diagnostic Environment version 2 1 remotely monitors Sun network storage devices The Storage Automated Diagnostic Environ
12. Up to 32 messages are held in a buffer If the 32 message limit is exceeded the messages are overwritten in a first in first out sequence Note Error messages are stored in volatile RAM and are lost whenever power is removed from the switch Access the error message log to view error messages before removing power Front Panel Message Formats The Brocade Silkworm switch s front panel displays error messages The first line includes the error s date and time The beginning of each second line on the front panel display starts with the module name error name and the severity level 1 The possible values are a 1 critical m 2 error m 3 warning m 4 informational a 5 debug Note If the same error occurs within the same module but on different ports the number of occurrences for that message is incremented in brackets up to 999 and the error number is not incremented that is this error though it may occur 999 times occupies one message in the 32 message buffer 122 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 To Display Error Messages from the Front Panel From the front panel select the Status menu Select Error Log Scroll through the error log If no errors are encountered the panel displays No Error Diagnostic Error Message Formats If any port fails during a diagnostic test it is marked BAD in the status display To retest a port that has been
13. 0 Release Field Troubleshooting Guide October 2002 Switch Port Types New Sun StorEdge SAN 4 0 Release Port Types The Sun StorEdge SAN 4 0 release port types now follow industry standards E_Ports replace T_Ports for switch to switch connections G_ and GL_Ports automatically configure to F_ FL_ or E_Ports upon device detection Private loop devices that require SL ports can not connect to the new switches The 2 Gbit Sun StorEdge network adapters in this release will recognize the private loop arrays as fabric devices when they are connected with TL_Ports or L_Ports Sun StorEdge and Brocade Communications Systems Port Descriptions and Differences TABLE 2 9 Sun StorEdge and Brocade Communications Systems Port Descriptions Port Nomenclature Function E_Port Expansion or inter switch port A type of switch port that can be connected to an E_Port of another switch to in effect create a cascading interswitch link ISL F_Port Fabric port A fabric port that is point to point only not loop capable and used to connect N_Ports to the switch FL_Port Fabric loop port A fabric port that is loop capable and used to connect NL_Ports to the switch G_Port Generic port This port can automatically configure as either an E_Port or an F_Port A port is defined as a G_Port when it is not yet fully connected or has not yet assumed a specific function in the fabric GL_Port Generic loop port This port can automatically configure as
14. 2 1 email alert Chapter 4 Troubleshooting Example 47 S S S C You requested the following events be forwarded to you from diag221 central sun com ite FSDE LAB Broomfield CO ource diag156 central sun com everity Warning ategory T3 Deviceld t3 sci sj 370 3990 01 d0 000981 nn an ventType LogEvent warning EventCode E O S D ventTime 2002 09 13 14 08 05 ESCRIPTION 1 warning s found in logfile of t3b2 ETAILS ep 13 20 15 41 t3b2 MNXT 2 W u2ctr starting lun 0 failover S S S C ite FSDE LAB Broomfield CO ource diag226 central sun com everity Warning ategory MESSAGE DeviceId message diag226 central sun com E a ventType LogEvent driver SSD_WARN EventCode 9 20 330 E H a as P 1 ol Tx ventTime 2002 09 13 13 06 26 ESCRIPTION Found 1 driver SSD_WARN warnings s in logfile var adm messages on diag226 central sun com id 80fee746 FORMATION hese warnings could indicate a faulty link ROBABLE CAUSE his could indicate a marginal or failing component or disk drive ECOMMENDED ACTION Run the appropriate disk test Diagnostic to isloate the failing drive 2 The messages report the device that is posting the errors and the full path continued 48 Sun StorEdge SAN 4 0 Release Field Troubl
15. 3 Right clicking on an object will present a menu of functions available for that object 4 Right clicking on a link will present a menu of functions available for that link 5 Holding the Shift button while selecting objects allows to select multiple objects This can be used to move multiple objects at the same time 6 After resizing the windows the GO button must be selected to refresh the topology view T E Save XY Graphics On Layout Horizontal Links Off FIGURE 3 5 Storage Automated Diagnostic Environment Test from Topology Window with Background Reduced to 66 38 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Storage Automated Diagnostic Environment Diagnostic Tests Test from Topo Test from list Test Manager Set Defaults Test Archive isa 175 Brocade 64 50020f2300006ae8 43 isa 175 sir mi 370 3990 01 e f0 028006 monitored by i ise Save X Graphics On Layout Horizontal Links offf Home Help Logout ROOT 2 1 B3 003 He Topology Help After having selected a topology several functions are available in the graphical view 1 Clicking in the middle of an object or in a specific component of an object will display the status at the bottom of the page 2 Right clicking the background will present a Zoom menu 3 Right clicking on an object will present a menu of functions available for that object
16. 4 0 release switches are allowed to be cascaded together by using E_Ports This cascading is allowed with either a shortwave or longwave Small Form Factor Pluggable SFP 2 gigabit transceiver The use of shortwave SFPs allows a higher port count in a local configuration The use of longwave SFPs and long haul fiber optics allows users to reach geographically separated storage and servers perhaps for disaster recovery purposes The following limitations exist for cascading with the Sun STorEdge SAN 4 0 release a If 1 and 2 gigabit switches are used together a maximum of 16 switches can be cascaded a If only 2 gigabit switches are used a maximum of 64 switches can be cascaded m The maximum distance is 10 kilometers m Any number of ISL hops can be used between two switches ISL hops do not include the connections between hosts and switches or between switches and storage a A maximum of 8 switches with 7 ISL links between the switches can be cascaded in a linear fashion Chapter 1 Introduction 7 8 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 CHAPTER 2 Configurations This chapter contains information and instructions for configuring your Sun StorEdge Network Fibre Channel Switch 16 with one or more hosts and storage This chapter contains the following sections ma Supported Hardware on page 10 m Supported Configurations on page 12 Operating Environments on page 12
17. 5 Test Result Details with Remedy Request AppendixB Brocade Communications Systems Switch Troubleshooting 113 The Link Test then runs the HBA Test again This time the HBA Test succeeds and you are requested to reconnect the loopback cable into the HBA as shown in FIGURE B 6 Netscape eee O tdiag229 central sun com brocade 1000006069201efc 2 unning on diag229 central sun com ilinktest started on FC interconnect fp to brocade iglctest started on hba port 07 11 02 10 49 35 diag229 Central Sun COM MSGID 6028 iglctest port_online FATAL ERROR Didn t detect loop as being online and user selected external loopback option i Return code from checking path devices pci 9 600000 pci 2 SUNW qlc 5 fp 0 0 deuct was 1131337 _qictest failed Remove FC Cable from hba devices pci 9 600000 pci 2 SUNW qlc S fp o 0 devctl Insert FC Loopback Cable into hba i devices pci 9 600000 pci 2 SUNW qlc S fp o 0 devctl Continue Isolation iqictest started on hba port qictest completed successfully Remove FC Loopback Cable from hba devices pci 9 600000 pci 2 SUNW qlc 5 fp o 0 devctl Restore ORIGINAL FC Cable into hba devices pci 9 600000 pci 2 SUNW qlc 5 fp o 0 devctl ORIGINAL hba _ devices pci 9 600000 pci 2 SUNW qlc 5 fp o 0 devctl is i Functional i Remove FC Cable from brocade 1000006069201 efc br 67 167 iport 2 i Insert FC Loopback Cable into brocade 100000606920
18. Automated Diagnostic Environment Test from Topology Window with Background Reduced to 66 38 Storage Automated Diagnostic Environment Test from Topology Window with Background Reduced to 66 and Components Arranged for Viewing 39 Troubleshooting Example Viewed with Storage Automated Diagnostic Environment Version 2 1 44 Troubleshooting Example View 2 53 Troubleshooting Example View 3 56 Brocade Webtools GUI 97 Storage Automated Diagnostic Environment Version 2 1 Test from Topology Window 104 Storage Automated Diagnostic Environment Alert 107 Storage Automated Diagnostic Environment version 2 1 Link Test Display 112 vii viii GURE B 5 GURE B 6 GURE B 7 GURE B 8 GURE B 9 Test Result Details with Remedy Request 113 Test Result Details Showing a Successful Test 114 Continued Link Test Example Results 115 Continued Link Test Example Results 116 Storage Automated Diagnostic Environment Version 2 1 Test from Topology Window 119 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE 1 1 TABLE 2 1 TABLE 2 2 TABLE 2 3 TABLE 2 4 TABLE 2 5 TABLE 2 6 TABLE 2 7 TABLE 2 8 TABLE 2 9 TABLE 2 10 TABLE 2 11 TABLE A 1 TABLE A 2 TABLE B 1 TABLE B 2 TABLE B 3 TABLE B 4 TABLE B 5 Tables Comparison of the SAN 3 0 and SAN 4 0 Releases 3 Supported Hardware 10 Sun StorEdge SAN 4 0 Release Sun Operating Environment Compatibility Matrix 12 Sun Sto
19. LOG_CRITICAL Switch overheated Switch overheated Fan failure Fan failure Contact customer support Contact customer support FANS 4_ FAILED LOG_CRITICAL FANS 5_FAILED LOG_CRITICAL Switch overheated Switch overheated Fan failure Fan failure Contact customer support Contact customer support FANS 6_FAILED LOG_CRITICAL POWER 1_FAILED LOG_CRITICAL Switch overheated Switch power failure Fan failure Power supply failure Contact customer support Contact customer support POWER 2_FAILED LOG_CRITICAL Switch power failure Power supply failure Contact customer support FCIU IUBAD L S Invalid IU OS error Contact customer support FCIU IUCOUNT L S Total number of Us OS error Contact customer Count lt 0 support FCPH EXCHBAD L S Bad exchange OS error Contact customer support FCPH EXCHFREE L S Unable to free an exchange OS error Contact customer support MQ QWRITE L M Message queue overflow Task blocked Contact customer support MQ QREAD L M Message queue unread OS error Contact customer support MQ MSGTYPE E M Unknown message type OS error Contact customer support SEMA SEMGIVE L M Unable to give a semaphore OS error Contact customer support SEMA SEMTAKE L M Unable to take a semaphore OS error Contact customer support SEMA SEMFLUSH L M Unable to flush a semaphore OS error Contact customer support PA
20. SFP up to 10 km with no modifications to the switch or up to 40 km with modifications to the switch port buffer credits X973A 2 meter fiber optic cable SC SC X9715A 5 meter fiber optic cable SC SC X978A 15 meter fiber optic cable SC SC X9720A SC SC cable coupler 10 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE 2 1 Supported Hardware Continued Model Part Number or System Code Description X9721A 0 4 meter fiber cable LC SC X9722A 2 meter fiber cable LC SC X9723A 5 meter fiber cable LC SC X9724A 15 meter fiber cable LC SC X9732a 2 meter fiber cable LC LC X9733a 5 meter fiber cable LC LC X9734a 15 meter fiber cable LC LC 1 You must use a long wave SFP and corresponding long wave fiber cable if you cascade more than 500 meters Chapter 2 Configurations 11 12 Supported Configurations To support a high availability environment use these configurations to ensure switch redundancy See the example diagrams in this chapter for more information on the supported configurations Operating Environments TABLE 2 2 Sun StorEdge SAN 4 0 Release Sun Operating Environment Compatibility Matrix Operating Environment Version Notes Sun Solaris 2 6 Not supported Sun Solaris 7 Not supported Sun Solaris 8 02 02 Update 7 or later Sun Solaris 9 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Hosts TABLE 2 3 Sun StorEdge SAN 4 0 R
21. StateChangeEvent M port 0 EventCode 12 26 35 EventTime 2002 09 13 13 06 35 DESCRIPTION port 0 in SWITCH2 sw 67 84 ip 172 20 67 84 is now Not Available state changed from online to offline INFORMATION A port on the switch2 has logged out of the fabric and gone offline ECOMMENDED ACTION Verify cables GBICs and connections along Fibre Channel path Check SAN Topology GUI to identify failing segment of the data path Verify correct FC switch2 configuration NN H DW From the messages above it is apparent that the following events occurred m The u2ct1r took control of LUN 0 on t3b2 m SSD and SCSI warnings were seen on host diag226 m Sun StorEdge Traffic Manager Software has degraded the paths to a device with WWN 50020 23000003d5 One HBA went from CONNECTED to NOT CONNECTED a Port 0 on a Sun StorEdge 2 Gb FC switch ip 172 20 67 84 went offline 52 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Determine the Extent of the Problem Use the topology display of the Storage Automated Diagnostic Environment version 2 1 to see if any problems are shown An example is shown in FIGURE 4 2 Aber harg selected n DOTE sewers iaeia ew Brihat i Bid SRE viens CA Cheb i Che m tis of a D gi ih d corne gian pheri ad caphr dik mai at ie Benen at thes pagt Rigtt tieling PE Mgr Al presari m Corer TETE 2 Fogh cliceng on
22. Sun StorEdge devices Reinstall the package using the following command pkgadd d Run ras_install to enable the cron and to configure the agent as master or slave a master agent acts as a collection point for events originating in other slave agents Upgrade the master agent first Appendix A Brocade Communications Systems Upgrades and Installations 79 5 Check your SAN Management host to verify the version of the Storage Automated Diagnostic Environment version 2 1 installed pkginfo 1 SUNWstade 80 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 APPENDIX B Brocade Communications Systems Switch Troubleshooting This appendix provides basic guidelines that you can use to isolate problems found in a configuration using Brocade Communications Systems Inc Silkworm switches It assumes you have been trained on all the components such as storage and switches that make up the configuration The scope of this appendix is to highlight the differences of troubleshooting with a Brocade Silkworm configuration to that of a configuration that contains the current Sun StorEdge Network Fibre Channel family of switches Current support is limited to diagnosing failures down to the FRU level In Sun s support model the entire Silkworm switch is considered a FRU Many of Brocade s internal diagnostics and messages while useful for depot or Root Cause Analysis situations are not ultimately r
23. Troubleshooting Case Study 103 Configuration 103 Storage Automated Diagnostic Environment Version 2 1 Topology 104 Brocade Communications Systems Error Messages 121 Error Message Formats 122 Front Panel Message Formats 122 v To Display Error Messages from the Front Panel 123 Diagnostic Error Message Formats 123 Converting Sun FC Switches Fibre Channel Addresses 139 Converting a Fabric Address into Fabric ID Chassis ID ASIC Port and AL_PA 140 Example 141 Contents vii viii Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 GURE 1 1 GURE 2 1 GURE 2 2 GURE 2 3 GURE 2 4 GURE 3 1 GURE 3 2 GURE 3 3 GURE 3 4 GURE 3 5 GURE 3 6 GURE 4 1 GURE 4 2 GURE 4 3 GURE B 1 GURE B 2 GURE B 3 GURE B 4 Figures Switch and Interconnections 2 Single Host Connected to One Sun StorEdge T3 Array Enterprise Configuration 24 Single Host Connected to Multiple Sun StorEdge T3 Array Enterprise Configurations 26 Two Hosts Connected to Four Sun StorEdge T3 Array Enterprise Configurations 28 Two Hosts Connected to Sun StorEdge T3 Array Partner Group Each Host with Separate Non shared Storage 29 Storage Automated Diagnostic Environment Version 2 1 Home Window 32 Storage Automated Diagnostic Environment Diagnose Tab Selected 35 Storage Automated Diagnostic Environment Diagnostic Tests Window 36 Storage Automated Diagnostic Environment Test from Topology Window 37 Storage
24. displayed 2 Under SunSolve Contents click Product Patches 3 Under Patch Analysis Tools click PatchPro 4 Click Solaris Recommended Patch Cluster The PATCHPRO Interactive menu is displayed 5 Select all the appropriate features of your system in the following areas of the menu m Operating System Release a Platform 6 Click Generate Patch List Y To generate the most recent patch list for a specific Sun StorEdge SAN 4 0 Release Configuration 1 Access the SunSolve web site http sunsolve Sun COM The SUNSOLVE ONLINE menu is displayed 2 Under SunSolve Contents click Product Patches 3 Under Patch Analysis Tools click PatchPro 4 Click Network Storage Products The PATCHPRO Interactive menu is displayed 5 Select all the appropriate features of your system in the following areas of the menu a OS Release Platform m Disk Array a Tape Libraries 16 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Disk Drives a m Tape Drives m Switches and HBAs m SAN Products Brocade SAN Release m Software 6 Click Generate Patch List Unbundled Software For a list of unbundled software refer to TABLE 2 7 TABLE 2 7 Unbundled Software Package Minimum Revision Minimum Patch if any JAVA SDK JDK 1 3 02 StorageTek 9840 1 28 126 Instant Image 3 0 SNDR 3 0 Alternate Pathing 2 3 1 110722 01 110432 04 Sun Enterprise 3 2 28 103346 29 3x00 4x00 5x00 6x00 Flash Prom Sun
25. either an E_Port F_Port or an FL_Port A port is defined as a G_Port when it is not yet fully connected or has not yet assumed a specific function in the fabric Chapter 2 Configurations 19 TABLE 2 10 Differences Between Sun StorEdge and Brocade Port Communications Systems Port Nomenclature Sun StorEdge Port Brocade Port Function TL_Port L_Port Translated loop port Loop port This port enables private devices to communicate with fabric or public devices In the Brocade switch this address translation is automatic In Sun StorEdge switches the private device must be configured on a TL_Port N A U_Port Universal Port This port can operate as an E_Port F_Port or FL_Port A port is defined as a U_Port when it is not yet fully connected or has not yet assumed a specific function in the fabric 20 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Zones Zoning allows the user to divide the switch ports into zones for more efficient and secure communication among functionally grouped nodes There are several types of zones and a port may be defined in any No port can be in all zone types simultaneously Name Server Zones Name server zones allow the division of the fabric one or more Switch chassis into as many as 256 fabric wide zones each name server zone defines which ports or devices receive name server information as defined by the FC GS3 document Overlapping Zones The new Sun StorEdge S
26. la recherche et le d veloppement du concept des interfaces d utilisation visuelle ou graphique pour l industrie de l informatique Sun d tient une licence non exclusive de Xerox sur l interface d utilisation graphique Xerox cette licence couvrant galement les licenci s de Sun qui mettent en place l interface d utilisation graphique OPEN LOOK et qui en outre se conforment aux licences crites de Sun CETTE PUBLICATION EST FOURNIE EN L ETAT ET AUCUNE GARANTIE EXPRESSE OU IMPLICITE N EST ACCORDEE Y COMPRIS DES GARANTIES CONCERNANT LA VALEUR MARCHANDE L APTITUDE DE LA PUBLICATION A REPONDRE A UNE UTILISATION PARTICULIERE OU LE FAIT QU ELLE NE SOIT PAS CONTREFAISANTE DE PRODUIT DE TIERS CE DENI DE GARANTIE NE S APPLIQUERAIT PAS DANS LA MESURE OU IL SERAIT TENU JURIDIQUEMENT NUL ET NON AVENU Ory Please A 8 Recycle es Adobe PostScript Contents Preface xi Introduction 1 Document Scope 2 New Features of the Sun StorEdge SAN 4 0 Release 3 Cascading Switches E_Ports 7 Configurations 9 Supported Hardware 10 Supported Configurations 12 Operating Environments 12 Hosts 13 Host Operating Environment Rules 14 Storage Arrays 14 Array Storage Rules 15 Host Bus Adapters 15 Software Packages and Patches 16 v To generate the most recent patch list for a Sun Solaris Release 16 v To generate the most recent patch list for a specific Sun StorEdge SAN 4 0 Release Configuration 16 Unbundled Software 17 Switches 18 Switch
27. off Home Help Logout ROOT 2 1 B3 003 Topology Help After having selected a topology several functions are available in the graphical view 1 Clicking in the middle of an object or in a specific component of an object will display the status at the bottom of the page 2 Right clicking the background will present a Zoom menu 3 Right clicking on an object will present a menu of functions available for that object 4 Right clicking on a link will present a menu of functions available for that link 5 Holding the Shift button while selecting objects allows to select multiple objects This can be used to move multiple objects at the same time 6 After resizing the windows the GO button must be selected to refresh the topology view FIGURE 3 4 Storage Automated Diagnostic Environment Test from Topology Window Chapter 3 Diagnostics 37 Storage Automated Diagnostic Environment Home Help Logout Q SUN ROOT 2 1 B3 003 Diagnostic Tests Topatogy Help RO EE Host san S N 1 Filter None Go Hel g Test from list After having selected a topology Test Manager E g nan au several functions are available in the Set Defaults 4 graphical view Test Archive D 1 Clicking in the middle of an object pm 4 or in a specific component of an object will display the status at the bottom of the page 2 Right clicking the background will E present a zoom menu Ultra Enterprise
28. on all peet y neu canons P farun pisect a rue fiching on a Brh wii presenta fret side oc nannies For Et Br a Henig Chet ho bunan aiir sidi Bird chars a da select nue thari Thu Sn be red a rede miele DE pa tte eye Gore W Aier reste the aineis me En Dunas min be satiti a ra ThE ternlagy iew OUT ba rs icc Thermal ret FIGURE 4 2 Troubleshooting Example View 2 From FIGURE 4 2 it can be seen that the error is only affecting a single path This can be confirmed by using the cfgadm command Chapter 4 Troubleshooting Example 53 1 Issue the cfgadm al command to display the state and condition of all hardware attachment points cfgadm al Ap_Id Type Receptacle Occupant Condition cO scsi bus connected configured unknown c0 dsk c0t0d0 disk connected configured unknown c0 dsk c0t1d0 disk connected configured unknown cl scsi bus connected configured unknown cl dsk c1t6d0 CD ROM connected configured unknown c2 fc connected unconfigured unknown c3 fc connected unconfigured unknown c4 fc private connected unconfigured unknown cS fc connected unconfigured unknown c6 fc fabric connected configured unknown c6 50020f2300000345 disk connected configured unusable c7 fc fabric connected configured unknown c7 50020f23000003c5 disk connected configured unknown c8 fc connected unconfigured unknown The cfgadm output indicates that the c6 50020f230000003d5 device is unusable but the c7 50020 23000
29. page 47 Determine the Error on page 47 Determine the Extent of the Problem on page 53 Check the Array Status on page 55 Check the Switch Status on page 56 Test the FRUs on page 57 Verify the Fix on page 61 43 Example Configuration The troubleshooting example has the following configuration One Enterprise 450 Workgroup Server Solaris 9 update 1 with all relevant Sun StorEdge SAN 4 0 Release patches and packages Two Sun StorEdge T3 arrays in an enterprise configuration 1 LUN per array Two Sun StorEdge 2 Gbyte Fibre Channel switches One single port 2 Gbyte HBA and one dual port 2 Gbyte HBA Storage Automated Diagnostic Environment version 2 1 with patch 113230 01 The setup example high level topology is displayed in FIGURE 4 1 Diash Topology Help der harg secte p 90e SEE Mere fe n GARE i DIE el rade 1 Chek i thi be Of mr eT d iA i spasie composent al an object wil isphyy a mataa ar he benon aia pige 2 Pige cing PE backed ll presari N TETR TETI 1 gh cicieng on mn ripari wi prene y ret arka Babe Peo ie d Righe ciching on a Bi wl presenta rats rec avai For hae tk a Hisring thet Sn bunar late selecting pijaci kes to select nubile bojati Thu fan ba ied 6 baie pe Ge mihe ane tre 4 ter rasin the niques tu KAT DUNS ant Le sheer a reesh E Eye ES FIGURE 4 1 Troubleshooting Example Viewed with Storage Automated Diagnostic
30. patchadd 111096 03 9 Install qlc driver patch patchadd 111097 07 70 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 10 11 12 13 14 15 Install luxadm liba5k and lib_fc patch patchadd 111413 07 Install cfgadm plug in library patch patchadd 111846 03 Update MANPATH to access cfgadm_fp 1M man page For sh or ksh type MANPATH opt SUNWsan man MANPATH export MANPATH For csh type setenv MANPATH opt SUNWsan man SMANPATH Install the Storage Automated Diagnostic Environment package SUNWstade pkgadd d SUNWstade Install the Storage Automated Diagnostic Environment Brocade patch patchadd 112580 01 Reboot the system For each of the storage devices upgrade the software firmware or configuration After the above steps you can leverage additional features provided by Brocade Silkworm 2400 8 port 2800 16 port 3800 16 port and 12000 32 64 128 port or m Sun StorEdge Traffic Manager functionality additional fabric zones additional initiators per zone host fabric connectivity cascaded switch configurations Quickloop zones Appendix A Brocade Communications Systems Upgrades and Installations 71 Installing Firmware on Brocade Communications Systems Silkworm Switches v To Download Firmware from the Brocade Web Site You can locate and download Brocade firmware on a special website provided by Brocad
31. port output m Storage Automated Diagnostic Environment version 2 1 Topology error display a Multipathing information Sun StorEdge Traffic Manager and VxDMP Note The information gathered here will determine which subsection to focus your attention Host to Switch Switch to Switch cascaded or Switch to Storage Check Array Status m Open a telnet session to the Sun StorEdge T3 array m Refer to the luxadm display output for Sun StorEdge A5200 arrays m Raid Manager Healthcheck for the Sun StorEdge A3500FC arrays a Storage Automated Diagnostic Environment version 2 1 instrumentation reports LED status m Explorer T3Extractor output Check Switch Status Explorer output support Show output m WebTools GUI a LED Status m Storage Automated Diagnostic Environment version 2 1 instrumentation reports m Port Modes F L E online offline m Nameserver Information nsshow nsallshow Appendix B Brocade Communications Systems Switch Troubleshooting 101 5 Start Testing FRUS m Storage Automated Diagnostic Environment version 2 1 tests such as the brocadetest 1M gictest 1M t3test 1M linktest 1M and a5ktest 1M m Brocade CLI tests loopPortTest spinFab crossPortTest m Sun StorEdge T3 Array tests such as T30FDG 1M m Sun StorEdge A3500FC arrays Healthcheck Note The conclusion of these tests isolate the problem to a FRU to be replaced Follow the appropriate hardware manual for proper FRU replac
32. run the diagnostic test from the Storage Automated Diagnostic Environment home window you can easily access test configuration control and results using the buttons in the dialog boxes The test parameter options however are unique for each test and are illustrated in the individual sections with each test in this chapter Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 v To Access the Diagnostic Tests 1 Click the Diagnose tab in the Storage Automated Diagnostic Environment home window Three links are then displayed below the tab as shown in FIGURE 3 2 Home Help Logout ROOT 2 1 B3 00 Home Help Site Map Welcome to the Storage Automated Diagnostic Environment This site can be used to configure agents monitor and diagnose Sun storage products Configuration Summary Alert Summary Site Info NSTE Newark Categories Installation 2 hosts 6 devices Brocade switch Notification None Host Email 0 Sun T3 Last Event 2002 06 28 11 05 41 Basic Installation Steps Basic Steps in popup Review Discover Hosts Devices Copyright 2002 Sun Microsystems Inc All rights reserved Use is subject to license terms Third party software including font technology is copyrighted and licensed from Sun suppliers Portions may be derived from Berkeley BSD systems licensed from U of CA Sun Sun Microsystems the Sun logo and Sun StorEdge are trademarks or registered tradem
33. the Sun StorEdge Network 2Gb Switch 16 SANbox2 Management Manual This manual can be found with the following steps 1 Access the SAN Solutions web site http www sun com products n solutions hardware docs Network_Storage_Solutions SAN index html The SAN Solutions menu is displayed 2 Click Other Documentation 3 Click Sun StorEdge tm Network 2Gb Switch 16 SANbox2 Management Manual See Section 4 Managing Ports qlictest Test If you are running the Storage Automated Diagnostic Environment version 2 1 application you can also run the Sun StorEdge PCI Dual Fibre Channel Host Adapter Board Test qlctest which might increase the following counters if the test is run while the HBA is connected to the switch In frames a Out frames m Link failure m Sync losses 100ms a Invalid tx words rec a LIP total received m LIP F7F7 m LIP F8F7 AL Init Attempts m Sync Loss a LIP during Init 42 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 CHAPTER 4 Troubleshooting Example In this section a troubleshooting example is shown with a SAN 4 0 configured with Sun StorEdge 2 Gbyte FC switches and two Sun StorEdge T3 arrays in an enterprise configuration This chapter contains the following sections a Example Configuration on page 44 a Example Assumptions on page 45 a Troubleshooting Outline on page 45 m Troubleshooting Example of a Host to Switch Error on
34. wie tS 4 Right clicking or dakloop of functions availak CLEEEETTLEETIrF diag229 Switch2 16 5 Holding the Shift m objects allows to se Cel H can be used to move V880DISK CMP Val same time br 67 1647 3 oh Pa 14A 6 After resizing the br 67 138 D must be selected to F fP T Brocade 16 Brocade 16 t3 67 166 BEEBEEEEES pi E E A A A a E t s LS br 67 137 a Bago vay CEET FFE tb Brocade 8 Brocade 16 O Ports highlighted by the color red are circled From the topology notice the HBA and port two of the first switch have errors Note From this Topology view concentrate on the link between the HBA and the switch port 2 AppendixB Brocade Communications Systems Switch Troubleshooting 109 3 Check the status of the array port ulpl ulpl u2pl u2pl targetid addr_type lun 1 al 2 2 hard 0 hard al hard 0 hard 1 diag168 Central Sun COM etc lt 18 gt port listmap volume diag169ulvi diagl69u2v1 diagl69ulvl diagl69u2v1 All LUNs have failed over to the ul controller 4 Check the status of the switch using switchshow switc switc switc switc switc switc switc switc switc port port port port port port port port hN hT hI hW YA oO PWD ame ype hState hMode hRole hDomain d wn hBeacon Zoning 0 upstream 1s SW Sw diagl67 admin gt switchshow diag167 3 4 Online Native
35. with the test that caused the error and the name of the error Look up the complete definition of the error name and the actions that will correct the error in TABLE C 3 TABLE C 2 Error Message Codes Defined Error Number Test Name Error Name 0001 n a DIAG CLEAR_ERR 0004 n a DIAG POST_SKIPPED OB15 sramRetentionTest DIAG REGERR 0B16 DIAG REGERR_UNRST OBOF DIAG BUS_TIMEOUT 1F25 cmemRetentionTest DIAG LCMRS 1F26 DIAG LCMTO 1F27 DIAG LCMEM 0110 ramTest DIAG MEMORY 0111 DIAG MEMSZ 0112 DIAG MEMNULL 0415 portRegTest DIAG REGERR 0416 DIAG REGERR_UNRST 040F DIAG BUS_TIMEOUT 124 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE C 2 Error Number Error Message Codes Defined Continued Test Name Error Name 1020 centralMemoryTest DIAG CMBISRTO 1021 DIAG CMBISRF 1025 DIAG LCMRS 1026 DIAG LCMTO 1027 DIAG LCMEM 1028 DIAG LCMEMTX 1029 DIAG CMNOBUF 102A DIAG CMERRTYPE 102B DIAG CMERRPTN 102C DIAG INTNOTCLR 1030 DIAG BADINT 106F DIAG TIMEOUT 2030 cmiTest DIAG BADINT 2031 DIAG INTNIL 2032 DIAG CMISA1 2033 DIAG CMINOCAP 2034 DIAG CMIINVCAP 2035 DIAG CMIDATA 2036 DIAG CMICKSUM 223B camTest DIAG CAMINIT 223C DIAG CAMSID Appendix C Brocade Communications Systems Error Messages 125 TABLE C 2 Error Message Codes Defined Continued Error Number Test Name Error Name 2640 portLoopbackTest DIAG ERRSTAT ENCIN 2641 DIAG ERRSTAT CRC 2642 DIAG ERRSTAT TRUNC 2643 DIAG E
36. 0 centralMemoryTest cmiTest DIAG BUS_TIMEOUT ASIC register or ASIC SRAM Err 0BOF portRegTest sramRetentionTest 4040F DIAG CAMINIT Port failed to initialize due to Err 223B camTest e Port is not active Description when not expecting one did not respond to an ASIC data access one of the following reasons e Switch not disabled e Diagnostic queue absent e Malloc failed e Chip is not present e Port is not in loopback mode Probable Cause ASIC failure ASIC failure Software operational setup error or mainboard failure 128 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Action Replace mainboard assembly Replace mainboard assembly Retry reboot or replace mainboard assembly TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action DIAG CAMSID ASIC failed SID NO ASIC failure Replace mainboard Err 223C translation test assembly camTest DIAG CLEAR_ERR Port s diag error flag OK or Information only None required Err 0001 BAD is cleared DIAG CMBISRF ASIC s Central Memory ASIC failure Replace mainboard Err 1021 SRAMs did not complete the assembly centralMemoryTest BISR within the timeout period DIAG CMBISRTO Err 1020 centralMemoryTest ASIC s Central Memory SRAMs did not complete the BISR within the timeout period ASIC failure Replace mainboard assembly DIAG CMERRPTN Err
37. 0 2647 3047 3840 3847 portLoobackTest crossPortTest spinSilk 3040 DIAG INIT Err 264F 304F 384F portLoopbackTest crossPortTest spinSilk Port Error Statistics counter is non zero meaning an error was detected when receiving frames One of the following status errors occurred e Enc_in Encoding error inside frame CRC err Cyclic redundancy check on frame failed TruncFrm Truncated frame e FrmTooLong Frame too long e BadEOF Bad end of file Enc_out Encoding error outside frame e BadOrdSet Bad symbol on fiber optic cable e DiscC3 Discarded Class 3 frames Port failed to go active in the loopback mode requested ASIC mainboard SFP module or fiber cable failure ASIC mainboard SFP module or fiber cable failure Replace mainboard assembly SFP module or fiber cable Replace mainboard assembly SFP module or fiber cable DIAG INTNIL ASIC failed to get a CMI ASIC failure Replace mainboard Err 2031 error interrupt assembly cmiTest DIAG INTNOTCLR The interrupt bit could not be ASIC failure Replace mainboard Err 102C cleared assembly centralMemoryTest DIAG LCMEM Data read from the Central ASIC failure Replace mainboard Err 1027 Memory location did not assembly centralMemoryTest match data previously cmemRetentionTest written into the same location 130 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TAB
38. 0 hardware It provides information and pointers to additional documentation you may need for installing configuring and using the configuration The book is intended for use by Sun Service Engineers who have a good understanding of the product The Appendices found in this guide explain how to diagnose and troubleshoot Brocade Communications Systems Inc Silkworm switches Using UNIX Commands This document may not contain information on basic UNIX commands and procedures such as shutting down the system booting the system and configuring devices See one or more of the following for this information m Solaris Handbook for Sun Peripherals m AnswerBook2 online documentation for the Solaris operating environment m Other software documentation that you received with your system xi Typographic Conventions Typeface AaBbCc123 AaBbCc123 AaBbCc123 Meaning The names of commands files and directories on screen computer output What you type when contrasted with on screen computer output Book titles new words or terms words to be emphasized Command line variable replace with a real name or value Shell Prompts Shell Examples Edit your login file Use 1s 2 You have mail a to list all files S su Password Read Chapter 6 in the User s Guide These are called class options You must be superuser to do this To delete a file type rm filename Promp
39. 0003c5 device is ok 2 Issue the luxadm e port command to query the status of the host ports using the expert mode e luxadm e port Found path to 2 HBA ports devices pci 1f 2000 SUNNW qlc 1 fp 0 0 devetl NOT CONNECTED devices pci 4 2000 SUNW qlc 1 fp 0 0 devctl CONNECTED The luxadm e port output shows that one of the HBAs has been affected This leads to the conclusion that we have a single path problem most likely affecting the HBA to switch link between devices pci 1f 2000 SUNW qlc 1 fp 0 0 and port 0 of one switch 54 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Check the Array Status 1 Telnet to the affected Sun StorEdgeg T3 array t3b2 in this example 2 Issue the fru stat command to status the FRUs t3b2 lt 2 gt fru stat CTLR STATUS STATE ROLE PARTNER TEMP ulctr ready enabled master u2ctr 41 35 u2ctr ready enabled alt master ulctr 3 90 3 Issue the port list command to status the controllers t3b2 lt 3 gt port list port targetid addr_type status host wwn ulpl 4 hard online sun 50020 23000003d5 u2pl D hard online sun 50020f23000003c5 4 Issue the port listmap command to determine the LUN mapping t3b2 lt 4 gt port listmap port targetid addr_type lun volume owner access ulpl 4 hard 0 voll u2 primary ulpl 4 hard 1 voll u2 primary ulpl 4 hard 4 voll u2 primary ulpl 4 hard 2 vol2 u2 failo
40. 1 efc i br 67 167 port 2 ontinue Isolation I EL FIGURE B 6 Test Result Details Showing a Successful Test 114 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 The Link Test new runs the Switch Port Test In this example the Switch Port Test passes The Link Test then requests you to insert a new fiber cable between the HBA and the Brocade switch port as shown in FIGURE B 7 NOISE ARS i Inser oopbac devices pci o 600000 pci 2 SUNW qic S fp o 0 devctl Continue Isolation iqictest started on hba port glctest completed successfully Remove FC Loopback Cable from hba devices pci 9 600000 pci 2 SUNW qlc S fp O O devctl Restore ORIGINAL FC Cable into hba devices pci 9 600000 pci 2 SUNW gqlc 5 fp o 0 devctl ORIGINAL hba devices pci 9 600000 pci 2 SUNW qlc 5 fp o 0 devctl is Functional Remove FC Cable from brocade 1000006069201 efc br 67 167 port 2 Insert FC Loopback Cable into brocade 1000006069201 efc i br 67 167 port 2 Continue Isolation ilinktest Pattern option unsupported and ignored for this device brocadetest started on brocade 1000006069201efc port 2 ae ae ae ae fe fe fe ae fe of of oe oe oe oe oe oe oa aaa ae ee fe af a oe Detected possible bad Power supply Power Supply 1 is absent ae se a a a of a a ae a oe a oe a ae a ae a a a a ak a ae e ae a oe ae ae ae a ae ae ibrocadetest completed successfully Remove FC Loopback Cabl
41. 4 Right clicking on a link will present a menu of functions available for that link 5 Holding the Shift button while selecting objects allows to select multiple objects This can be used to mova multiple objects at the same ime 6 After resizing the windows the GO button must be selected to refresh the topology view FIGURE 3 6 Storage Automated Diagnostic Environment Test from Topology Window with Background Reduced to 66 and Components Arranged for Viewing Chapter 3 Diagnostics 39 40 Sun Explorer Data Collector SUNWexplo and T3Extractor Both the Sun Explorer Data Collector and the T3Extractor are essential data gathering tools that are required for service calls or escalations Both are command line host based tools that collect pertinent information you need to see the complete picture of the host Visit the following websites for more information and to download these tools Explorer http eservices central knowledge products explorer T3Extractor http hes west nws products T3 tools html Note You can gather the same information by querying the Storage Automated Diagnostic Environment version 2 1 that you can gather using the sanbox API These methods are completely supported unlike command line sanbox API usage Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Diagnosing and Troubleshooting the Sun Switch For procedures for diagnosing and troubleshooting t
42. 67 127 sw 67 a Switch2 16 Switch2 16 Switch2 16 Switch2 16 1 sw 67 183 E FF 3 Switch2 16 V880DISK t3 diag Beng HE br 67 13 E a LMP Va t3 t3 67 166 CT 02 est other Links from ost diag229 central sun com a Al LIMP VTA t3b Brocade 16 FIGURE B 4 Storage Automated Diagnostic Environment version 2 1 Link Test Display The Link Test starts by running the HBA Test In this example the HBA Test fails The Link Test then requests you to insert a loopback cable into the HBA See FIGURE B 5 112 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Netscape GE Test Detail ST 1854 linktest Output Options Test List oct diago39 Serer sun com brocade 1000006069201 efe 2 pE A EAA A PASS 1of1 i running on diag229 central sun com ilinktest started on FC interconnect fp to brocade iglctest started on hba port 07 11 02 10 49 35 diag229 Central Sun COM MSGID 6028 glctest port_online FATAL ERROR Didn t detect loop as being online and user selected external loopback option Return code from checking path devices pci 9 600000 pci 2 SUNW qlcaS fp 0 0 deuct l was 1131337 iqictest failed Remove FC Cable from hba devices pci 9 600000 pci 2 SUNW qlc s fp 0 0 devctl Insert FC Loopback Cable into hba i devices pci g 200009 Pere Suni qlc 5S fp o 0 devctl Continue Isolation Stop Test E FIGURE B
43. AN 4 0 release now supports WWN based zones as well as port based zones Port based and WWN based zones can overlap When creating overlapping NS zones one or more switch ports is in at least two zones When a port is in multiple zones one host or storage device attached to a switch port to be a member of many zones and resources can be shared If a resource is shared in multiple zones it can be made available to multiple zones by using overlapping zones When connecting multiple switches zones can help manage the complexity of sharing resources For example you can use port zoning to make all the disks of a Sun StorEdge T3 array belong to the same zone in a SAN Alternately you can share the resources of the array among several NS zones Refer to vendor specific switch documentation to determine the maximum number of zones you can have in a configuration Zone nesting where zones exist inside other zones is also possible Chapter 2 Configurations 21 Zoning Rules A minimum of one switch port per zone A maximum of 16 zones per 16 port switch A maximum of 30 zones for cascading 16 port to 16 port switches Port based and world wide name WWN based zoning is supported Server and storage may be in the same name server zone across ISLs on separate switches This enables you to have servers at a recovery site It also means you can have local and remote storage in the same zone so that storage can be mirrored at both locations
44. Brocade ZONING User s Guide Version 3 0 Brocade WEB TOOLs User s Guide Version 3 0 Part Number 816 4470 816 4472 816 4469 806 5513 816 5246 N A N A 816 0842 875 3264 816 5285 875 3263 53 0000127 03 53 0001576 03 53 0000135 03 53 0000130 03 Preface xiii Arrays Host Bus Adapters Tools Storage Cabinet TABLE P 1 Latest information Safety information Documentation information Installation User information Installation Sun StorEdge Traffic Manager Diagnostics Sun Cluster Solaris Volume Manager installation RAID Rackmount information Sun StorEdge T3 Array 2 1 Firmware Release Notes Sun StorEdge T3 Array Regulatory Safety Compliance Manual Sun StorEdge T3 Array Start Here Sun StorEdge T3 and T3 Array Site Preparation Guide Sun StorEdge T3 Array Disk Tray Installation Task Map Sun StorEdge T3 Array Installation and Configuration Manual Sun StorEdge T3 Array Administrator s Manual Sun StorEdge PCI Single Fibre Channel Network Adapter Installation Guide Sun StorEdge PCI Dual Fibre Channel Host Adapter Installation Guide Sun StorEdge CompactPCI Dual Fibre Channel Network Adapter Installation and User s Guide Sun StorEdge SBus Dual Fibre Channel Host Adapter Release Notes Sun StorEdge 2G FC PCI Single Channel Network Adapter Installation Guide Sun StorEdge 2G FC PCI Double Channel Network Adapter Installation G
45. Crystal 4 Sun StorEdge 2G FC PCI Single Channel Network Adapter Amber 2 5 Sun StorEdge 2G FC PCI Dual Channel Network Adapter Crystal 2 6 Sun StorEdge cPCI Dual Fibre Channel Network Adapter Diamond Chapter 2 Configurations 13 Host Operating Environment Rules a All hosts in a zone must be running Solaris 8 Release 4 01 operating environment with all appropriate patches installed a Mixing PCI Dual Fibre Channel Network Adapter and PCI single Fibre Channel Network Adapter HBAs in the same switch zone is supported a Mixing an Sbus host with a PCI card and PCI hosts within the same zone is supported You must be using PCI dual Fibre Channel Network Adapter and PCI single Fibre Channel Network Adapter HBAs Storage Arrays TABLE 2 4 Sun StorEdge SAN 4 0 Release Storage Array Compatibility Matrix Firmware Levels for Storage Version 1 17b and 1 18 controller Notes Translated loop TL switch mode Sun StorEdge T3 array Sun StorEdge T3 array Sun StorEdge 39x0 array Sun StorEdge 69x0 array Sun StorEdge 9960 amp 9910 arrays firmware 2 1 controller firmware 2 0 and 2 1 TL fabric switch mode TL fabric switch mode Requires switch hardware or firmware upgrade to use SAN 4 0 capabilities Sun StorEdge 9980 amp 9970 arrays 14 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Array Storage Rules The following tables specify the supported features of the Sun StorEdge T3 arra
46. Environment Version 2 1 44 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Example Assumptions The troubleshooting example has the following assumptions a The latest patches firmware and packages are installed and running No host based volume management software installed m The two switches are zoned such that they present two isolated paths from the HBAs through the ISL links to the Sun StorEdge T3 arrays m Each HBA has physical connectivity to only one Sun StorEdge T3 arrays m The Storage Automated Diagnostic Environment version 2 1 is configured to automatically send email alert messages to the root user email account Troubleshooting Outline This section lists the broad steps on how to approach a SAN problem It lays out a methodical approach and lists various tools and resources available at each step Using the Storage Automated Diagnostic Environment version 2 1 for monitoring vastly decreases the time consuming process of narrowing down the problem Determine the error a Storage Automated Diagnostic Environment version 2 1 alert email m var adm messages m Application specific errors Determine the extent of the problem m Storage Automated Diagnostic Environment version 2 1 topology or device monitoring view m cfgadm al command output m luxadm e port command output ma Multipathing information Note The information gathered at this point determines the subsection
47. FC PCI Single Channel Network Adapter Amber 2 5 Sun StorEdge 2G FC PCI Dual Channel Network Adapter Crystal 2 6 Sun StorEdge cPCI Dual Fibre Channel Network Adapter Diamond Software as part of Sun StorEdge Network Foundation Software Storage Automated Diagnostic Environment 2 1 To find all required patches http sunsolve Sun COM Product Patches PatchPro Network Storage Products or e Solaris Recommended Patch Cluster Describe your system then click Generate Patch List 84 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE B 2 Disk Array Supportability Matrix with Solaris 8 02 02 Update 7 or Later Dynamic addition of target to a zone Disk Arrays Disk Firmware Add First Additional T3A WG ES 1 18 Yes Yes T3B WG ES 2 1 Yes Yes TABLE B 3 Fibre Channel Switch Supportability Matrix with Solaris 8 02 02 Update 7 or Later FC Switches Firmware Switch Software Licenses Brocade Silkworm v2 6 0c Fabric OS Zoning Quickloop 2400 v2 6 0c Webtools Brocade Silkworm v2 6 0c Fabric OS Zoning Quickloop 2800 v2 6 0c Webtools Brocade Silkworm v3 0 2c Fabric OS Zoning Quickloop 38002 v3 0 2c Webtools Brocade Silkworm v4 0 0a Fabric OS Zoning Quickloop 12000 v4 0 0a Webtools 1 Brocade Silkworm 2400 2800 and 3800 FC Switches may be intermixed Interoperability with other vendor switches is not supported at this time 2 Brocade Silkworm 3800 FC Switch
48. Fire 5 11 6 111346 02 3800 4800 4810 6800 Flash Prom E450 Flash Prom 3 22 0 106122 09 E250 Flash Prom 3 22 0 106530 06 E420R Flash Prom 3 29 0 109082 04 Note The packages and or patches listed in TABLE 2 7 may not be present in all configurations Chapter 2 Configurations 17 TABLE 2 8 Sun StorEdge SAN 4 0 Release Optional Software Packages Compatibility Matrix Optional Software Packages Sun Cluster VERITAS Cluster Support VERITAS File System VERITAS Volume Manager VxVM Support includes VERITAS DMP Solstice DiskSuite StorTools Storage Automated Diagnostic Environment Sun StorEdge Network Storage Agent Sun StorEdge Network Data Replicator Sun StorEdge Component Manager VERITAS NetBAckup Solstice Backup Sun StorEdge Instant Image On Demand Node Creation Version upgrade 3 0 3 4 3 4 3 2 4 2 1 4 2 2 1 2 1 3 0 2 2 3 4 6 0b 3 0 SUNWcfpl VERSION 11 8 0 REV 2001 07 14 21 42 SUNWcfplx VERSION 11 8 0 REV 2001 07 14 21 42 Notes Update 2 See SunSolve for the latest patches Extra functionality for V880 See SunSolve for the latest patches See SunSolve for the latest patches See SunSolve for the latest patches See SunSolve for the latest patches See SunSolve for the latest patches See SunSolve for the latest patches Switches For high availability configure the Sun StorEdge Network FC Switch 16 switch in parallel 18 Sun StorEdge SAN 4
49. IGURE 4 3 indicates that the problem is that the switch Port 0 has gone offline It also shows that the only other device that is affected is the host This indicates a host switch connection problem 56 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Test the FRUs The following FRUs exist in the host to switch link a Switch or switch port a Switch side SFP a Cable a Host HBA To isolate the cause perform one of the following options with the Storage Automated Diagnostics Environment m The switchtest in combination with the glctest m The linktest Storage Automated Diagnostics Environment switchtest and glctest Tests Remove one end of the cable of the HBA switch link Insert loopback plug into the HBA Run the glctest a If the test fails replace HBA and re run the qictest m If the test passes continue below Insert loopback plug into Switch SFP Port Run the switchtest a If the test passes most likely problem is cable m If the test fails continue below Replace SFP and re run the switchtest m If the test passes the most likely problem was SFP connector m If the test fails the most likely problem is the switch port or the entire switch Chapter 4 Troubleshooting Example 57 Storage Automated Diagnostics Environment linktest Test Output running on diag221 central sun com linktest started on FC interconnect fp to switch2 qictest started on hba port glctest called with opt
50. In FIGURE B 2 a Sun StorEdge T3 array enterprise configuration is connected to a cascaded switch In another possible configuration two separate switches can be used to eliminate a single point of failure Storage Automated Diagnostic Environment Monitor nostic Tests SMPiiselam a al rel alate Ml F telaleraia fem Role bs Host san MASTER Filter None t col Ssw 67 131 cw 67 128 5w 67 127 Switch2 16 Switch2 16 Switch2 16 sw 67 101 sw 67 183 aos dakloop ea Fa TREE TEE F FEJT F JP IT Switch2 16 Switch2 16 V880DISK br 67 164 Brocade 16 a LMP vA t3b Brocade 8 Brocade 16 Help Clear Search Topology Help After having selectec functions are availak 1 Clicking in the mic specific component o the status at the bot 2 Right clicking the a zoom menu 3 Right clicking oni menu of functions av 4 Right clicking on i of functions availabl 5 Holding the Shift objects allows to sele can be used to mover same time 6 After resizing the must be selected to r FIGURE B 2 Storage Automated Diagnostic Environment Version 2 1 Test from Topology Window 104 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 1 Discover the Error using Storage Automated Diagnostic Environment Alerts as shown in FIGURE B 3 Site Lab Broom Source diag229 central sun com Severity Error Actionable Category BROCADE Devic
51. LC cable 4 local host attachment 3 storage attachment 3 long wave SFP 3 tranceiver 3 loop port 4 maximum switch count 3 mesh configuration 3 multipathing support 5 N name server port based zones 4 WWN based zones 4 zoning 4 nested zoning 4 network adapters 6 NS zoning 4 Oo operating environment required Solaris release 14 overlapping zones 4 P packages supported 16 partial fabric support 3 patches downloading using Sunsolve 16 supported 16 port based zones 4 ports T cascading 7 preface using UNIX commands xi R related documentation AnswerBook xi Solaris Handbook for Sun Peripherals xi rules adding and removing devices 23 cascading 23 zoning 22 148 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 S SC LC cable 4 SC SC cable 4 Segmented Loop zoning 4 shell prompts xii SL port 4 zoning 4 Small Form Factor Pluggable tranceivers 4 software unbundled supported 17 storage device attachment 3 storage devices supported 6 StorEdge Traffic Manager tool 5 Sun StorEdge T3 arrays 6 SunCluster 3 0 5 supported configurations 3 switch configuration guidelines 22 connection of 10 management tools 5 switch counters role in troubleshooting 41 rules when viewing 41 switch port types 19 T third party compatability 6 switch capability 6 TL port 4 tools diagnostic 31 topologies supported 3 tranceivers 3 tr
52. LE A 1 TABLE A 1 Software Download Sites Software Downloading Web Site packages and http www sun com storage san documentation patches http sunsolve sun com To Verify Successful Patch Downloads Use one of the following three utilities to obtain the checksum value of the patch you downloaded CODE EXAMPLE A 1 Solaris usr bin sum Utility usr bin sum 108982 09 zip 2010 880 108982 09 zip usr bin sum r 108982 09 zip 63160 880 108982 09 zip Note The sum utility can also be located in the usr ucb directory Appendix A Brocade Communications Systems Upgrades and Installations 67 CODE EXAMPLE A 2 Example of GNU md5sum Utility md5sum 108982 09 zip 1297fcd385f618c726489c 6c7f57c900 108982 09 zip Download the GNU md5sum utility from http www sunfreeware com or from http sunsolve Sun com md5 md5 tar z 2 Compare the checksum value that is displayed to the patch checksum value given at the checksum File link http sunsolve Sun com If the values are identical the patches were properly downloaded Note The checksum file at http sunsolve Sun com is approximately 614 Kbytes 68 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Installing the Software TABLE A 2 lists the required software packages and patches installation sequence TABLE A 2 Software Installation Sequence Order No Patch or Package Software 1 Solaris 8 Solaris 8 02 02 Upd
53. LE C 3 Message Diagnostic Error Messages Continued Description Probable Cause Action DIAG LCMEMTX Err 1r27 1028 Central Memory transmit path failure ASIC 1 failed to read ASIC 2 via the transmit mainboard failure Replace mainboard assembly centralMemoryTest path DIAG LCMRS Central Memory Read Short ASIC failure Replace mainboard Err 1F25 1025 M bytes requested but got assembly centralMemoryTest less than M bytes cmemRetentionTest DIAG LCMTO Central Memory Timeout ASIC failure Replace mainboard Err 1F267 1026 Data transfer initiated did assembly centralMemoryTest not complete within the cmemRetentionTest timeout period DIAG MEMNULL Test failed to malloc mainboard failure Replace mainboard Err 0112 assembly ramTest DIAG MEMSZ Memory size to be tested is mainboard failure Replace mainboard Err 0111 less than or equal to zero assembly ramTest DIAG MEMORY Data read from RAM location CPU RAM failure Replace mainboard Err 0110 did not match previously assembly or DRAM ramTest written data into same module DIAG PORTABSENT Err 2670 3070 portLoopbackTest crossPortTest spinSilk DIAG PORTDIED Err 265F 305F portLoopbackTest crossPortTest spinSilk location Port is not present Port was in loopback mode and then went inactive ASIC or mainboard failure ASIC SFP module or fiber cable failure Replace mainboard assembly Replace mainboard assembly SFP
54. NIC TASKSPAWN Task creation failed OS error Contact customer LOG_PANIC 134 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 support TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action PANIC SEMCREATE Semaphore creation failed OS error Contact customer LOG_PANIC support PANIC SEMDELETE Semaphore OS error Contact customer LOG_PANIC support PANIC QCREATE Message queuer failed OS error Contact customer LOG_PANIC support PANIC QDELETE Message queuer deletion OS error Contact customer LOG_PANIC failed support PANIC MALLOC Memory allocation failed OS error Contact customer LOG_PANIC support PANIC FREE LOG_PANIC Memory free failed OS error Contact customer support PANIC INCONSISTENT Data out of sync OS error Contact customer LOG_PANIC support PANIC INTCONTEXT Data out of sync OS error Contact customer LOG_PANIC support PANIC ZOMTIMSET Attempt to set a zombie timer OS error Contact customer LOG_PANIC support PANIC ZOMTIMKILL Zombie timer destroyed OS error Contact customer LOG_PANIC support PANIC FREETIMRLSD Free timer released OS error Contact customer LOG_PANIC support PANIC TIMEUSECNT Timer use count exceeded OS error Contact customer LOG_PANIC support PANIC LSDB_CKSUM Link State Database OS error Contact customer LOG_PANIC checksum failed support SYS NOMEM No memory OS err
55. NS amp SUN microsystems Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide Sun Microsystems Inc 4150 Network Circle Santa Clara CA 95054 U S A 650 960 1300 Part No 816 6580 11 October 2002 Revision A Send comments about this document to docfeedback sun com Copyright 2002 Sun Microsystems Inc 4150 Network Circle Santa Clara CA 95054 USA All rights reserved This product or document is protected by copyright and distributed under licenses restricting its use copying distribution and decompilation No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors if any Third party software including font technology is copyrighted and licensed from Sun suppliers Parts of the product may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark in the U S and other countries exclusively licensed through X Open Company Ltd For Netscape Communicator the following notice applies Copyright 1995 Netscape Communications Corporation All rights reserved Sun Sun Microsystems the Sun logo AnswerBook2 docs sun com Sun StorEdge network FC switch 8 and Solaris are trademarks registered trademarks or service marks of Sun Microsystems Inc in the U S and other countries All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC Internatio
56. Once the IP address is configured the switch is to be accessed via telnet or the WebTools GUI See the Brocade Silkworm 2400 Hardware Reference Manual for further serial port details The Front Panel access method on the 2800 switch can be used to run most commands that the switch supports However the screen is limited in size and messages are restricted to one or two lines of output Once the IP addressed is configured through the front panel further switch setup and diagnostics can be run via a telnet connection or the WebTools GUI See the Brocade Silkworm 2800 Hardware Reference Manual for more details on the front panel operation WebTools GUI The WebTools GUI see FIGURE B 1 is a separately licensed feature All Brocade switches that are sold by Sun Professional Services should come with the license pre installed You can access the WebTools GUI with a standard web browser Netscape or Microsoft Internet Explorer with a Java Plug in by pointing the browser to http lt ip_address_of_switch gt Note The Java Plug in that is supplied with Solaris 8 02 02 Update 7 is required To Verify the Web License type the following admin gt licenseshow SeRdQeQSbzT ESqsyY Web license Zoning license Quickloop license 96 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 fanescapen Fain View a Menus an er iiy r Bita FIGURE B 1 Brocade Webtools GUI See the Brocade Web
57. PA You will occasionally see messages like the following in var adm messages ar 7 10 06 18 vikings genunix ID 936769 kern info ssd6 is pci 8 700000 pci 3 SUNW qlc 4 fpl0 0 ssd w50020f2300009697 1 ar 7 10 06 18 vikings scsi ID 365881 kern info lt SUN T300 0117 cyl 34145 alt 2 hd 72 sec 128 gt ar 7 10 06 18 vikings genunix ID 408114 kern info pci 8 700000 pci 3 SUNW qlic 4 fp 0 0 ssd w50020f2300009697 1 ssd6 online ar 7 10 06 18 vikings scsi ID 799468 kern info ssd7 at fp0 name w50020f230 0009697 0 bus address 1084e4 ar 7 10 06 18 vikings genunix ID 936769 kern info ssd7 is pci 8 700000 pci 3 SUNW qlc 4 fpl0 0 ssd w50020f2300009697 0 ar 7 10 06 18 vikings scsi ID 365881 kern info lt SUN T300 0117 cyl 34145 alt 2 hd 56 sec 128 gt ar 7 10 06 18 vikings genunix ID 408114 kern info pci 8 700000 pci 3 SUNW qlc 4 fp 0 0 ssd w50020Ff2300009697 0 ssd7 online ar 7 10 06 20 vikings scsi ID 799468 kern info ssd8 at fpl name w50020f230 0000457 1 bus address 1044e8 Or you may see a luxadm e dump_map output like the following luxadm e dump_map devices pci 8 700000 pci 3 SUNW q1lc 4 fpe 0 0 devctl Pos Port_ID Hard_Addr Port WWN Node WWN Type 0 1084e4 1000e4 50020f2300009697 50020f 2000009697 0x0 Disk device 1 108000 0 210100e08b2366f9 200100e08b2366f9 Ox1f Unknown Type Host Bus Adapter 140 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide Oct
58. Port Types 19 New Sun StorEdge SAN 4 0 Release Port Types 19 Sun StorEdge and Brocade Communications Systems Port Descriptions and Differences 19 Zones 21 Name Server Zones 21 Overlapping Zones 21 Zoning Rules 22 Configuration Guidelines 22 Switches 22 Zones and Arrays 22 Zones and Storage 23 Cascading Rules 23 Rules for Adding and Removing Devices While the Hosts are Online 23 Configuration Examples 24 Single Host Connected to One Storage Array 24 Single Host Connected to Multiple Storage Arrays 25 Multihost 27 iv Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 3 Diagnostics 31 Diagnostic Tools 32 Storage Automated Diagnostic Environment Version 2 1 32 Storage Automated Diagnostic Environment Version 2 1 Functions 33 v To Access the Diagnostic Tests 35 Sun Explorer Data Collector SUNWexplo and T3Extractor 40 Explorer 40 T3Extractor 40 Diagnosing and Troubleshooting the Sun Switch 41 Using Switch Counter Information 41 glctest Test 42 Troubleshooting Example 43 Example Configuration 44 Example Assumptions 45 Troubleshooting Outline 45 Troubleshooting Example of a Host to Switch Error 47 Determine the Error 47 Determine the Extent of the Problem 53 Check the Array Status 55 Check the Switch Status 56 Test the FRUs 57 Storage Automated Diagnostics Environment switchtest and qlctest Tests 57 Storage Automated Diagnostics Environment linktest Test Output 58 Verify the Fix 61 Cont
59. RRSTAT 2LONG 2644 DIAG ERRSTAT BADEOF 2645 DIAG ERRSTAT ENCOUT 2646 DIAG ERRSTAT BADORD 2647 DIAG ERRSTAT DISCC3 264F DIAG INIT 265F DIAG PORT_DIED 266E DIAG DATA 266F DIAG TIMEOUT 2660 DIAG STATS FTX 2661 DIAG STATS FRX 2662 DIAG STATS C3FRX 2670 DIAG PORTABSENT 2671 DIAG XMIT 126 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE C 2 Error Message Codes Defined Continued Error Number Test Name Error Name 3040 crossPortTest DIAG ERRSTAT ENCIN 3041 DIAG ERRSTAT CTL 3042 DIAG ERRSTAT TRUNC 3043 DIAG ERRSTAT 2LONG 3044 DIAG ERRSTAT BADEOF 3045 DIAG ERRSTATENCOUT 3046 DIAG ERRSTAT BADORD 3047 DIAG ERRSTAT DISC3 304F DIAG INIT 305F DIAG PORTDIED 3060 DIAG STATS FTX 3061 DIAG STATS FRX 3062 DIAG STATS C3FRX 306E DIAG DATA 306F DIAG TIMEOUT 3070 DIAG PORTABSENT 3071 DIAG XMIT 3078 DIAG PORTWRONG Appendix C Brocade Communications Systems Error Messages 127 TABLE C 2 Error Message Codes Defined Continued Error Number Test Name Error Name 384F spinSilk DIAG INIT 385F DIAG PORTDIED 3840 DIAG ERRSTAT ENCIN 3841 DIAG ERRSTAT CRC 3842 DIAG ERRSTAT TRUNC 3843 DIAG ERRSTAT 2LONG 3844 DIAG ERRSTAT BADEOF 3845 DIAG ERRSTAT ENCOUT 3846 DIAG ERRSTAT BADORD 3847 DIAG ERRSTAT DISCC3 3870 DIAG PORTABSENT 3871 DIAG XMIT 3874 DIAG PORTSTOPPED TABLE C 3 Diagnostic Error Messages Message Port received an interrupt DIAG BADINT Err 1030 203
60. SW2 standard compliant switches WWN based zones supported on all switches Nested zoning supported but not required N A G_ and GL_ports supported for connections to arrays G_ and GL_ports automatically negotiate in inter switch connections to E_ports TL_ports should be manually configured for loop connections to storage devices Same Long wave and short wave Small Form factor Pluggable SFP 2 Gbit transceivers replace GBICs Long wave and short wave SC SC SC LC and LC LC cables supported TABLE 1 1 Feature Supported Switches Tools SAN 3 x Features Not Supported in SAN 4 x Switch hardware limited to Sun 1 Gbit 8 and 16 port switches SANbox switch management application manages the 1 Gbit switches with old firmware only N A SAN 3 x Features Included In SAN 4 x SAN 3 0 switches can be upgraded with the SAN 4 0 firmware If you do not upgrade the firmware the 1 Gbit switches can exist on the same host as the 2 Gbit switches but they can not connect to each other N A Multipathing and load balancing supported with the Sun StorEdge Traffic Manager application Chapter 1 Comparison of the SAN 3 0 and SAN 4 0 Releases Continued SAN 4 x New Features New 2 Gbit switches introduced New switch management tools are available See the vendor specific documentation for details Multipathing and load balancing through the Sun StorEdge Traff
61. Subject to Standard License Terms and Conditions Copyright 2002 Sun Microsystems Inc Tous droits r serv s Distribu par des licences qui en restreignent l utilisation Le logiciel d tenu par des tiers et qui comprend la technologie relative aux polices de caract res est prot g par un copyright et licenci par des fournisseurs de Sun Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie Sun Sun Microsystems le logo Sun et Sun StorEdge sont des marques de fabrique ou des marques d pos es de Sun Microsystems Inc aux Etats Unis et dans d autres pays FIGURE 3 1 Storage Automated Diagnostic Environment Version 2 1 Home Window 32 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 The Storage Automated Diagnostic Environment version 2 1 offers the following features A common web based user interface for device monitoring and diagnostics a Distributed test invocation by means of lists or topology You can run the tests through the Storage Automated Diagnostic Environment GUI or through the command line interface CLI m Topology grouping for multi level hosts and components a Alternate master support for redundancy m Revision checking Support for the Storage Service Processor and virtualization engine components of Sun StorEdge 3900 and 6900 series offerings a Remote notification through SRS SRS NetConnect Sun StorEdge Remote
62. Subordinate 1 fffc0l 10 00 00 60 69 20 OFF ON Main Online E Port No_Module No_Light No_Module No_Module No_Module Online E Port Online F Port sle fc 1020000260269 10271225 10 20 03 0 0 60769 1027 13 25 21 00 00 e0 8b 03 61 f9 owner ul ul ul ul access primary failover failover primary diagl64 diagl64 This switchshow output from the first switch confirms that port 2 has gone offline No other ports seem to be affected at this point 110 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 5 Use the Link Test to check the FRUs In the Switch to HBA link there are potentially four FRUs a HBA a Cable m Switch SFP m Switch chassis Note Before starting the Link Test you must enter the password for the Brocade switch in the configuration menu a Using the Storage Automated Diagnostic Environment version 2 1 right click on the box on the link that connects the HBA and switch port A pop up menu appears b From the menu click on Start Link Test The Link Test components are displayed on the right side of the window See FIGURE B 4 Appendix B Brocade Communications Systems Switch Troubleshooting 111 iagnostic Environment Home Help Logout lose ROOT 2 2 00 000 n Checking Diagnostic Tools N a Go Help Clear Search oo er one TEID SICAF I Scare Link Components sw 67 130 sw 67 128 sw
63. Tools User s Guide for more information on WebTools usage Note The rest of this guide will assume telnet usage Appendix B Brocade Communications Systems Switch Troubleshooting 97 Power On Self Test POST When the switch is powered up it runs a series of POST tests including m Dynamic RAM Test m Port Register Test a Central Memory Test CMI Connector Test a CAM Test a Port Loop Back Test POST behaves differently depending on boot method A power cycle power off and power on is considered a cold boot All other boots from a powered on state are considered warm boots POST execution per cold boot executes a longer version of the Memory Test POST execution per warm boot executes a shorter version of Memory Test Boot time with POST varies depending on boot method As the POST test successfully performs each test a message Passed is displayed via telnet on the front panel After the switch completes the POST the port module returns to a steady state from the flashing state shown during tests If a yellow port module light is displayed or is slowly flashing this indicates that the port is in a failed state Should the switch fail to complete POST the green power LED will be set to blink This indicates that the switch failed one of the initial stages of POST and that the CPU is not able to bring up the operating system Should this occur replace the switch 98 Sun StorEdge SAN 4 0 Release Fiel
64. ame user root File Name usr switch firmware var tmp v2 6 x Protocol RSHD or FTP rshd ftp Password 84776 3832 130980 csum 2ef6 loading to Fam dissidents ns WEETANG Chas OM sent dis hand il datent WET EIN Clash Less se tn wera wie eee eisai download complete oem240 admin gt fastboot 4 To download a firmware file from the host citadel using the account jdoe and the file home jdoe firmware type the following CODE EXAMPLE 4 2 RSHD Example sw5 admin gt firmwareDownload citadel jdoe home jdoe firmware 5 Reboot the switch Type fastboot Note It takes less than one minute for a fastboot that bypasses POST 6 Log back into the switch to verify the correct version as shown in CODE EXAMPLE A 4 CODE EXAMPLE A 4 Verification of Firmware Version oem240 admin gt version Kernel 5 3 1 Fabric OS v2 6 x Made on Wed Sep 19 13 05 15 PDT 2001 Flash Wed Sep 19 13 07 16 PDT 2001 BootProm Thu Jun 17 15 20 39 PDT 1999 Appendix A Brocade Communications Systems Upgrades and Installations 75 AN Upgrading the SAN This section contains topics about how to upgrade your SAN system to the latest version Downloading Patches and Packages Download all patches and packages to the host prior to beginning the upgrade procedure Verifying Upgrade Compliance Before starting the upgrade insure that your system is stable
65. and that all required software and patches are accessible Refer to TABLE B 1 on page 84 for the supportability matrix To Upgrade the Software If you have multiple hosts on your SAN you can upgrade them simultaneously or one at a time without affecting your SAN environment Hosts that are not being upgraded will not be affected during the upgrade You can upgrade the host software one host at a time or several hosts in parallel Caution Your system will be unavailable to users and the SAN during the upgrade procedure The order in which the SAN components should be upgraded is as follows Familiarize yourself with the required software components versions and patches Refer to Appendix B for the supportability matrix 2 Back up all data 76 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Volume Management If you are using VERITAS Volume Manager refer to the VERITAS Volume Manager Installation Guide for special instructions about upgrading your system There are several steps that need to be followed prior to your system upgrade Upgrade the Solaris Operating System To take advantage of full Fabric support for your SAN you must upgrade to at least Solaris 8 02 02 Update 7 For information on how to upgrade your systems refer to Solaris 8 Installation Supplement part number 806 5182 available at http docs sun com Sun StorEdge SAN 4 0 Release The packages on your system that wer
66. anslative loop 4 troubleshooting steps to use to approach a SAN problem 45 U UNIX commands use of xi V VERITAS Cluster Server 5 W websites for additional information 2 WWN based zones 4 Z zone name server 21 zones configuration guidelines 22 definition of 21 zoning 4 zoning rules 22 Index 149 150 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002
67. any multicast groups in use Reconfigure fabric or zones Remove some of the groups FABRIC BADILS LOG_WARNING FLASH BAD_MIRROR LOG_WARNING RPC SVC_EXIT RPC SVC_REG Bad ISL ELS size The system s flash memory has encountered an error An RPC service daemon has terminated prematurely or unexpectedly An RPC service daemon could not establish service for a particular protocol handler The ISL ELS payload is wrong OS error OS error OS error Contact customer support The system attempts to recover from its mirrored backup Contact customer support Contact customer support Contact customer support TEMP 1_FAILED LOG_WARNING TEMP 2_FAILED LOG_ERROR Switch overheated Switch overheated Fan failure Fan failure Contact customer support Contact customer support TEMP 3_FAILED LOG_CRITICAL TEMP 4_FAILED LOG_CRITICAL Switch overheated Switch overheated Fan failure Fan failure Contact customer support Contact customer support TEMP 5_FAILED LOG_CRITICAL FANS 1_FAILED LOG_WARNING Switch overheated Switch overheated Fan failure Fan failure Contact customer support Contact customer support Appendix C Brocade Communications Systems Error Messages 133 TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action FANS 2_FAILED LOG_ERROR FANS 3_FAILED
68. arks of Sun Microsystems Inc in the U S and other countries Federal Acquisitions Commercial Software Government Users Subject to Standard License Terms and Conditions Copyright 2002 Sun Microsystems Inc Tous droits r serv s Distribu par des licences qui en restreignent l utilisation Le logiciel d tenu par des tiers et qui comprend la technologie relative aux polices de caract res est prot g par un copyright et licenci par des fournisseurs de Sun Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie Sun Sun Microsystems le logo Sun et Sun StorEdge sont des marques de fabrique ou des marques d pos es de Sun Microsystems Inc aux Etats Unis et dans d autres pays FIGURE 3 2 Storage Automated Diagnostic Environment Diagnose Tab Selected 2 Click the Diagnostic Tests link Five tests are displayed as shown in FIGURE 3 3 Chapter 3 Diagnostics 35 Logo Storage Automated Diagnostic Environment Home Help ROOT 2 1 83 003 Qo SUN microsystems Monitor NIET UUEL Man Diagnostic Tests ELIA tutelle tte tee Et Test from Topo Test from list Diagnostic Tests STORE AVG ps Set Defaults i Test Archive i Test from list Execute test from a list of physical devices Diagnostic Tests Test from Topo Execute test from the Site Topology Test Manager Review and control diagnostic tests Set De
69. ate 7 or later 2 8_Recommended Solaris 8 Recommended and Security patch cluster 3 SUNWsan Sun StorEdge SAN Foundation Kit 4 SUNWcfpl cfgadm plug in 32 bit package 5 SUNWcfplx cfgadm plug in 64 bit package 6 111412 07 Sun StorEdge Traffic Manager 7 111095 07 cp fp fctl usoc drivers patch 8 111096 03 fcip driver patch 9 111097 07 qlc driver patch 10 111413 07 luxadm 1liba5k and libg_fc patch 11 111846 03 cfgadm plug in library patch 12 111847 04 SANWsan patch SAN Foundation Kit patch 13 SUNWstade Storage Automated Diagnostic Environment version 2 1 package Appendix A Brocade Communications Systems Upgrades and Installations 69 v To Install the Software Note These instructions are to install the Sun StorEdge Network Foundation Software 6 patch 1 Install Solaris 8 02 02 Update 7 or later 2 Install the latest Solaris 8 Recommended Security patch cluster See the README file for patch installation instructions and notes 3 Install the SUNWsan package pkgadd d SUNWsan 4 Install cfgadm plug in library packages SUNWcfp1 and SUNWcfp1x pkgadd d pkg location SUNWcfpl pkgadd d pkg location SUNWcfplx 5 Install the SAN Foundation Kit SUNWsan patch 111847 04 or higher if required 6 InstallSun StorEdge Traffic Manager patch 111412 07 patchadd 111412 07 7 Install fct1 fp fcp usoc driver patch 111095 xx patchadd 111095 07 8 Install fcip driver patch
70. ax 4473924 Diagnostics Status Tue Mar 19 14 04 30 2002 port 0 i 2 3 4 5 6 7 diags OK OK OK OK OK OK OK OK state UP DN UP DN DN DN UP UP pto 4086880 frTx 64382622 frRx 0 LLI_errs pt2 38616950 frTx 300398 frRx 12 LLI_errs pt6 28852033 frTx 235091315 frRx 111 LLI errs pt7 331090679 frTx 8930476 frRx 31l DLI errs Central Memory OK Total Diag Frames Tx 8318 Total Diag Frames Rx 8911 CODE EXAMPLE B 5 crossPortTest Example Output diagl67 admin gt crossporttest 1000 1 Running Cross Port Test The 1000 is the number of passes the 1 denotes singlePortAlso mode which allows the test to be run on a single port with a loopback connector plug inserted 92 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 CODE EXAMPLE B 6 loopPortTest Example Output diagl64 admin gt loopporttest 100 2 0x7e7eve7e 4 Configuring Loopback L port s back to normal L POrt Sister done Configuring L port 2 to Cable Loopback Port done Will use pattern 7e7e7e7 7e7e7e7 7e7e7e7 7e7e7e7 Running Loop Port Test passed Note Notes on loopPortTest m Syntax is loopporttest lt num_passes gt lt port gt lt user_pattern gt lt pattern_width gt m Only works on logged in L Ports m To test ports with Loopback connectors use crossPortTest CODE EXAMPLE B 7 spinFab Example Output diagl67 admin gt spinfab 1 0 0 spinFab0 running spinFab0 Complet
71. d Troubleshooting Guide October 2002 Removing Power Caution Error messages are stored in RAM and are lost when power is removed from the switch Capture and view the error log output and note any error messages before removing power Status and Activity Indicators Front Panel LED Port Indicators Front Panel LEDs Definition No light showing No light or signal carrier no module no cable for media interface LEDs Steady yellow Receiving light or signal but not yet online Slow yellow Disabled result of diagnostics or portDisable command Flashes every two seconds Fast2 yellow Error fault with port Flashes every 1 2 second Steady green Online connected with device Slow green Online but segmented loopback cable or incompatible switch flashes every two seconds Fast green Internal loopback diagnostics Flashes every 1 2 second Flickering green Online and frames flowing through port 1Slow 2 seconds interval 2Fast 1 2 second interval See the Brocade Silkworm Hardware Reference Manual for further details Appendix B Brocade Communications Systems Switch Troubleshooting 99 Initialization Steps At power on or reset the following steps occur 1 2 Preliminary POST diagnostics VxWorks operating system initialization Hardware initialization resets internal addresses assigned to ASICs serial port initialized front panel initialized Full POST test Universal Por
72. dd d pkg location SUNWcfp1x 78 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Software Installation For the Brocade Silkworm switch the GUI capability is available through the switch firmware and requires a Java enabled browser on the host Refer to Related Brocade Documentation in Appendix B for instructions on how to access Brocade documentation Note Once the packages have successfully installed follow steps 6 through 13 in To Install the Software on page 70 To Upgrade the Storage Automated Diagnostic Environment Version 2 1 Package For all upgrades you must first install the most recent Sun StorEdge Network Foundation Software patches Refer to To Install the Software on page 70 for installation instructions before installing the SUNWst ade package and the Brocade Communications Systems patch For detailed installation and usage instructions for the Storage Automated Diagnostic Environment version 2 1 refer to the Storage Automated Diagnostic Environment User s Guide Version 2 1 If your SAN Management host is not running the current version remove the existing package and install the latest version Remove the old package with the pkgrm command pkgrm SUNWstade Removing the initial installation does not erase the previous configuration information The cache and topology information of each device is also retained to maintain a consistent historical view of the
73. de October 2002 Multihost FIGURE 2 3 shows two hosts connected to four Sun StorEdge T3 array partner pairs FIGURE 2 4 shows two hosts connected to a Sun StorEdge T3 array Partner Group in which each host maintains separate non shared storage Note You can attach different storage types to the same switch so long as the storage devices are on different zones Each controller that is connected to a switch must have a unique loop ID Whenever you add a second controller to a switch make sure that the loop ID of the controller being connected is different from the loop ID of any other controller currently connected to the same switch Caution Ensure that the controller modules are not connected to the same switch Chapter 2 Configurations 27 Sun StorEdge T3 partner pairs Switches Host Host Adapter Host Adapter Host Host Adapter Host Adapter FIGURE 2 3 Two Hosts Connected to Four Sun StorEdge T3 Array Enterprise Configurations 28 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Note You must enable Sun StorEdge Traffic Manager software for failover across multiple hosts to function The mp_support on the Sun StorEdge T3 array should be set to mpxio Sun StorEdge Traffic Manager Software Sun StorEdge L180 or L700 FC Tape Library
74. dix B Brocade Communications Systems Switch Troubleshooting 107 2 Determine the extent of the problem using cfgadm al output CODE EXAMPLE B 9 cfgadm al output to check OS level fabric condition cfgadm al c3 fc fabric connected configured unknown c3 50020f23000068cc unavailable connected configured unusable c4 fc private connected unconfigured unknown gS fc fabric connected configured unknown c5 210000e08b05041c unknown connected unconfigured unknown c5 50020f2300004331 disk connected configured unknown The device on c3 has disappeared In addition the luxadm output of the Sun StorEdge T3 arrays shows the following luxadm display dev rdsk c6t60020F2000003EE53AAF7A09000DA257d0s2 luxadm display 50020f23000068cc Error Invalid pathname 50020f23000068cc 108 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Storage Automated Diagnostic Environment Monitor PERUA Manage Diagnostic Tests MM ReN t elle MR BIE tente auto Mele ks Host san MASTER Filter None cof Help Clear Search Topology Help After having selecte functions are availe 1 Clicking in them specific component the status at the bo 2 Right clicking th sw 67 121 a zoom menu Switch2 1 sw 67 130 sw 67 129 sw 67 128 a E sw 67 131 oe i Ffei FEIT En 3 Right clicking or menu of functions a FP Tr Switch2 16 a Switch2 16
75. e For example if a normal user named nancy is logged in she would edit the file home nancy rhosts 4 If you are using a UNIX system with Solaris installed check the etc nsswitch conf file to make sure the hosts lookup table is appropriately set Appendix A Brocade Communications Systems Upgrades and Installations 73 v To Install Firmware using FTP As an alternative to modifying the rhosts file you can use the ftp method which is explained below Note You can invoke the command without any parameters in which case you are prompted for input including the choice of whether to use ftp or rshd If you invoke the command with three parameters rshd is used If you invoke the command with four parameters ftp is used 1 From a UNIX system telnet into the switch and download the firmware with the firmwareDownload command firmwareDownload lt Your UNIX IP address gt lt Your UNIX Login user s name gt lt v2 4 1f gt lt FTP_password gt 2 To check the syntax type help firmwareDownload Note With version 2 1 and higher commands are not case sensitive 3 Check the syntax by typing firmwaredownload and following the screen prompts See CODE EXAMPLE A 3 for an FTP example 74 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 CODE EXAMPLE A 3 FTP Example oem240 admin gt firmwareDownload Server Name or IP Address host 10 32 99 29 User N
76. e The URL for the Brocade site is site is http www brocade com 1 Click the Partners link 2 Click the Brocade Partner Network link 3 Enter the Sun internal login Enter the Sun internal password 4 Under Services and Support click Firmware 5 Click the appropriate firmware version see TABLE B 3 6 Download the appropriate firmware version see TABLE B 3 UNIX version and the Readme txt file to your local host v To Install Firmware from UNIX Solaris Follow these steps 1 From the Brocade web site retrieve the switch firmware for example v2 6 x 2 Download the firmware into your root directory Note Since UNIX contains rshd and cat daemons you do not need to retrieve the rsh ZIP file 72 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 3 Log into the UNIX system as root and edit the following files a Type the IP address and the switch name into the etc hosts file vi etc hosts lt IP_address gt lt switch_name gt The output is displayed as in CODE EXAMPLE 4 1 CODE EXAMPLE 4 1 etc hosts file cat etc hosts Internet host table 10 4 50 208 iopswitch03 ebay 10 4 50 212 iopswitch08 ebay b Type the switch name into the rhosts file rhosts lt switch_name gt Note If you are logged in as a normal user and not as root the rhosts file is referred to the user s home directory rhosts fil
77. e from brocade 1000006069201 efc i br 67 167 port 2 FC brocade 1000006069201 efc br 67 167 and port 2 is Functional Insert a NEW FC Cable into brocade 1000006069201 efc br 67 167 port 2 Stop Test _ Output Options Test List Waiting Host diag229 central sun com i FIGURE B 7 Continued Link Test Example Results Appendix B Brocade Communications Systems Switch Troubleshooting 115 The Link Test then reruns the HBA Test This time the HBA Test passes and the Link Test indicates that the fiber cable is the suspected failure cause E Netscape ORIGINAL hba devices pci 9 600000 pci z SUNw qalc 5 fp 0 0 devctl is i Functional Remove FC Cable from brocade 1000006069201 efc br 67 167 iport 2 i Insert FC Loopback Cable into brocade 1000006069201 efc i i br 67 167 port 2 Continue Isolation i ilinktest Pattern option unsupported and ignored for this device brocadetest started on brocade 1000006069201 efc port 2 ae oes oe oe ae ae of of ae fe fe fe fe ae ae ae ae aka ooo oo oe of af fe af fe ae ae ak Detected possible bad Power supply Power Supply 1 is absent a a a oe ee a ae ae ae ae ae ae oe oe ae a ae a ae ae fe a a oe ae ae ae ae ae fe abe ae a brocadetest completed successfully Remove FC Loopback Cable from brocade 1000006069201 efc i br 67 167 port 2 FC brocade 1000006069201 efc br 67 167 and port 2 is
78. e previously used should be available To verify their availability use the pkginfo command pkg_name is the name of the package on which you need to obtain the information pkginfo 1 pkg_name Upgrade your SUNWsan package to Sun StorEdge SAN 4 0 Release Before you start check your system to see if it has been installed and if it is already up to date Use the pkginfo command to see if it has been installed pkginfo SUNWsan Appendix A Brocade Communications Systems Upgrades and Installations 77 The system returns system SUNWsan SAN Foundation Kit The output indicates that the SUNWsan package has already been installed If your system has the SUNWsan package installed use the showrev command to see if it is up to date showrev p grep 111847 The system returns Patch 111847 01 Obsoletes Requires Incompatibles Packages SUNWsan The showrev results line indicates that the SUNWsan package is already up to date If patch 111847 01 has not been installed install it using the pat chadd command patchadd patch location 111847 04 2 If your system does not have the SUNWsan package installed install the new SUNWsan package from your Sun StorEdge SAN 4 0 Release software pkgadd d pkg location SUNWsan cfgadm Plug in Library Packages 1 Install cfgadm plug in library packages SUNWcfp1 and SUNWcfp1x pkgadd d pkg location SUNWcfp1l pkgadd d pkg location SUNWcfp1x pkga
79. ed 1 megs status passed port 0 test status 0x00000000 passed Appendix B Brocade Communications Systems Switch Troubleshooting 93 CODE EXAMPLE B 8 nsShow Example Output diagl64 admin gt nsshow Type Pid Cos PortName NodeName TTL sec NL 0312e4 3750702 40 E423 2002008 34 26 50 02r 0E T2000 00 Sai 2c na FC4s FCP SUN T300 0118 Fabric Port Name 20 02 00 60 69 10 71 25 NL 031ee8 3 50 02 0f 23 00 00 3e e5 50 02 0f 20 00 00 3e e5 na FC4s FCP SUN T300 0118 Fabric Port Name 20 0e 00 60 69 10 71 25 The Local Name Server has 2 entries Note nsShow is a listing of WWNs of the devices connected to the switch 94 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Sun StorEdge and Brocade Communications Systems Port Descriptions and Differences TABLE B 5 Sun StorEdge and Brocade Communications Systems Port Descriptions Port Nomenclature Function E_Port Expansion or inter switch port A type of switch port that can be connected to an E_Port of another switch to in effect create a cascading interswitch link ISL F_Port Fabric port A fabric port that is point to point only not loop capable and used to connect N_Ports to the switch FL_Port Fabric loop port A fabric port that is loop capable and used to connect NL_Ports to the switch G_Port Generic port This port can automatically configure as either an E_Port or an F_Port A port is defined a
80. el switch a port that supports an N_Port A Fibre Channel port in a point to point or Fabric connection FL_Port Ona Fibre Channel switch a port that supports Arbitrated Loop devices G_Port A generic port that can automatically configure as either an E_Port or a F_Port GL_Port A generic loop port can automatically configure as an E_Port F_Port or a FL_Port L_Port A loop port that enables private devices to communicate with fabric or public devices NAS Network Attached Storage SNDR Sun StorEdge Network Data Replicator formerly Sun StorEdge Remote Dual Copy TL_Port A Translated Loop Port on the Sun StorEdge T3 array that enables private devices to communicate with fabric or public devices U_Port A universal port that can operate as an E_Port F_Port or FL_Port 145 Glossary Broadcast Zone Zone type used to filter broadcast traffic away from end nodes that cannot use or interpret it A port will broadcast to all ports in the same Broadcast Zone s in which the port is defined Broadcast zoning is primarily used for doing IP over Fibre Channel or when mixing IP and SCSI traffic on the switch These zones are not yet useful or interesting in Suns current SAN implementations Cascade Connection of two or more switches together to increase the number of available ports or to allow for increased distances between components of the SAN Fabric Fibre channel network built around one or more switches It is also common to refer to som
81. eld brocade 1000006069201efc EventType StateChangeEvent M port 2 EventCode 5 26 35 EventTime 2002 07 11 10 32 33 port 2 in BROCADE br 67 167 ip 172 20 67 167 is now Not Available state changed from online to offline INFORMATION A port on the switch has logged out of the fabric and gone offline RECOMMENDED ACTION 1 Verify cables GBICs and connections along Fibre Channel path Check SAN Topology GUI to identify failing segment of the data path Verify correct FC switch configuration Bm W N Verify port is enabled Site Lab Broom Source diag229 central sun com Severity Error Actionable Category MESSAGE Deviceld message diag229 central sun com EventType LogEvent driver QLC_LOOP_OFFLINE EventCode 9 20 315 EventTime 2002 07 11 10 32 45 Found 1 driver QOLC_ LOOP_ OFFLINE errors s in logfile var adm messages on diag229 central sun com id 80c61254 INFORMATION Found Loop OFFLINE message This could indicate that a fiber channel cable has been removed This could indicate troubles with a fiber channel loop This could also be caused by running the qlctest RECOMMENDED ACTION 1 Check to see if a fiber channel cable has been removed 2 Check for fiber channel errors 3 Check to see if the qlctest was running at time of the failure continued on next page Appendix B Brocade Communications Systems Switch Troubleshooting 105 continued from previous pa
82. elease Server Compatibility Matrix Bus Physical Required Sun Software Packages and Server Architecture HBAs Connection Patches Sun Enterprise 3x00 SBus X6757A 1 Gbyte FC Sun StorEdge Network Foundation 6x00 and 10000 i a ro Jon Jia re epee 60 oe tr X6727A3 6 oe e SUNWsan PCI X6767A4 2 Gbyte FC e SUNWcfpl 5 ROTORS SUNWefplx Sun Fire 3800 X6748A6 1 Gbyte FC found at the Download Center F http www sun com storage PERSON SE DORA Pores san gt Sun StorEdge SAN 4 0 PCI X6799A 1 Gbyte FC release Software Firmware X6727A Upgrades and Documentation gt X6767A 3 Ghvie EC login license agreement Peo e Solaris 8 SUNWcfpl x and X6768A SUNWsan packages or Sun Fire 15k 12k PCI X6799A 1 Gbyte FC e Solaris 9 SUNWcfpl x and E4x0 E2x0 SF480 X6727A SUNWsan packages SF280R V880 SB1000 B2000 X6767A 2 Gbyte FC X6768A Sun StorEdge Traffic Manager Netra 1125 and 140X Software installed as part of the Sun StorEdge Network Foundation Software Storage Automated Diagnostic Environment 2 1 To find all required patches http sunsolve Sun COM Product Patches PatchPro e Network Storage Products or Solaris Recommended Patch Cluster Describe your system then click Generate Patch List 1 Sun StorEdge SBus Dual Fibre Channel Host Bus Adapter Ivory 2 Sun StorEdge PCI Single Fibre Channel Network Adapter Amber 3 Sun StorEdge PCI Dual Fibre Channel Network Adapter
83. elevant to a Sun Service Engineer trying to isolate to a FRU This appendix contains the following topics a Related Documentation on page 82 a Supported Configurations on page 83 a Diagnostic Tools on page 87 m General Troubleshooting Procedures on page 101 a Troubleshooting Case Study on page 103 81 Related Documentation Brocade Communications Systems Documentation The following Brocade manuals are shipped on a CD with their related products Brocade Silkworm 2400 2800 Hardware Reference Manual Brocade Silkworm 3800 Hardware Reference Brocade Silkworm 12000 Hardware Reference Manual Brocade Fabric OS Reference Brocade Fabric OS Release Notes Brocade Fabric OS Procedures Guide Brocade WebTools User s Guide Brocade Zoning User s Guide Brocade QuickLoop User s Guide Sun Documentation The Sun StorEdge switch documents are referenced for overall configuration guidelines Sun StorEdge SAN 4 0 Release Installation Guide Sun StorEdge SAN 4 0 Release Configuration Guide Sun StorEdge SAN 4 0 Release Notes 82 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Supported Configurations The Brocade Communications Systems Silkworm switch configurations and the Sun StorEdge switch configurations follow the same rules for maximum number of initiators supported number of arrays per zone and other hardware specific information Refer to Chapter 2
84. ement procedures 6 Verify the fix a var adm messages path online multipath informational messages m Storage Automated Diagnostic Environment version 2 1 status a Sun StorEdge Traffic Manager or VxDMP to return the path to its normal state 102 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Troubleshooting Case Study The following case study illustrates a practical application of the steps outlined above This is only one way to approach the problem there may be others Note Knowledge and training on all components in a SAN are prerequisites before you attempt the procedures below In this test case the 1 0 load was generated using the dex disk exerciser to simulate customer load and the steps below allowed the I O to continue uninterrupted throughout the procedure Configuration a Sun Fire V880 m Solaris 8 02 02 Update 7 with all recommended and latest Sun StorEdge Network Foundation Software patches m Sun StorEdge T3 array Partner Pair with FW 1 18 m Brocade Silkworm 2400 and 2800 switches with v2 6 0 firmware m Storage Automated Diagnostic Environment version 2 1 with the latest patches Note The Storage Automated Diagnostic Environment version 2 1 was configured to send email alerts to a system administrator s email address Appendix B Brocade Communications Systems Switch Troubleshooting 103 Storage Automated Diagnostic Environment Version 2 1 Topology
85. ents v A Brocade Communications Systems Upgrades and Installations 65 Installing a New SAN 66 Required Software Components 66 Downloading Patches and Packages 67 v To Verify Successful Patch Downloads 67 Installing the Software 69 v To Install the Software 70 Installing Firmware on Brocade Communications Systems Silkworm Switches 72 v To Download Firmware from the Brocade Web Site 72 v To Install Firmware from UNIX Solaris 72 v To Install Firmware using FTP 74 Upgrading the SAN 76 Downloading Patches and Packages 76 Verifying Upgrade Compliance 76 v To Upgrade the Software 76 Volume Management 77 Sun StorEdge SAN 4 0 Release 77 cfgadm Plug in Library Packages 78 Software Installation 79 v To Upgrade the Storage Automated Diagnostic Environment Version 2 1 Package 79 B Brocade Communications Systems Switch Troubleshooting 81 Related Documentation 82 Supported Configurations 83 QuickLoop 87 Current Issues with the Storage Automated Diagnostic Environment Version 2 1 and Brocade Switches 87 vi Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Diagnostic Tools 87 Storage Automated Diagnostic Environment Version 2 1 and Brocade Switches 87 brocadetest 1M 88 Other Diagnostic Tools 89 Sun StorEdge and Brocade Communications Systems Port Descriptions and Differences 95 Accessing the Brocade Silkworm Switch 96 Power On Self Test POST 98 Removing Power 99 General Troubleshooting Procedures 101
86. es are supported in the 1 and 2 Gbyte mode by auto sensing Appendix B Brocade Communications Systems Switch Troubleshooting 85 TABLE B 4 Application Supportability Matrix with Solaris 8 02 02 Update 7 or Later Name Version Patches VERITAS Volume Manager 3 2 GA To find all VERITAS Volume Manager patches http sunsolve Sun COM Product Patches gt PatchPro Network Storage Products Then select e OS Release e Platform e Software Veritas Volume Manager Click Generate Patch List 1 Access the SunSolve web site http sunsolve Sun COM The SUNSOLVE ONLINE menu is displayed 2 Under SunSolve Contents click Product Patches 3 Under Patch Analysis Tools click PatchPro A Click Network Storage Product The PATCHPRO Interactive menu is displayed 5 Select all the appropriate features of your system in the following areas of the menu OS Release Platform Disk Array Tape Libraries Disk Drives Tape Drives Switches and HBAs SAN Products Brocade SAN Release Software 6 Click Generate Patch List 86 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 QuickLoop QuickLoop is a feature of the Brocade Silkworm switches that allows hosts with host bus adapters HBAs that are not fully Fabric aware to communicate with other devices attached to the switch In addition QuickLoop allows switches to replace hubs in a private loop environment QuickLoop is a separate
87. es received e CI3FrmRx number of Class 3 frames received DIAG TIMEOUT For portLoopbackTest and ASIC SFP module Replace mainboard Err 266F 306F 386F crossPortTest or fiber cable failure assembly SFP portLoopbackTest Port failed to receive frame module or fiber cable crossPortTest within timeout period centralMemoryTest For centralMemoryTest Port failed to detect an interrupt within the timeout period DIAG XMIT Port failed to transmit frame ASIC failure Replace mainboard Err 2271 2671 3071 assembly 3871 portLoopbackTest crossPortTest spinSilk camTest CONFIG CORRUPT The switch configuration information has become irrevocably corrupted OS error The system automatically resorts to the default configuration settings 132 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action CONFIG OVERFLOW The switch configuration OS error Contact customer information has grown too support large to be saved or has an invalid size CONFIG VERSION The switch has encountered OS error The system an unrecognized version of the switch configuration automatically resorts to the default configuration settings FABRIC SEGMENTED LOG_WARNING FABRIC NO_ALIASID LOG_WARNING Fabric segmented No free multicast alias e Incompatible fabric parameters and switches e Conflict zones Too m
88. eshooting Guide October 2002 continuation DETAILS Sep 13 13 04 57 WWN Received 6 SSD Warning message s on ssd2 in 14 mins threshold is 5 in 24hours Last Message diag226 Central Sun COM scsi ID 107833 kern warning WARNING scsi_vhci ssd g60020f 20000003d53d3493930006a222 ssd2 Site FSDE LAB Broomfield CO Source diag226 central sun com Severity Warning Category MESSAGE Deviceld message diag226 central sun com EventType LogEvent driver SCSI_TRAN_FAILED EventCode 9 20 318 EventTime 2002 09 13 13 06 26 DESCRIPTION Found 1 driver SCSI_TRAN_FAILED warnings s in logfile var adm messages on diag226 central sun com id 80fee746 H FORMATION he SCSI driver is posting warnings H TD ECOMMENDED ACTION 1 Check for further device specific errors in log files 2 Run the appropriate device test to find faulty FRU continued Chapter 4 Troubleshooting Example 49 continuation DETAILS Sep 13 13 04 57 WWN Received 12 SCSI transport failed message s in 14 mins threshold is 10 in 4hours Last Message diag226 Central Sun COM SCSI transport failed reason timeout retrying command Site FSDE LAB Broomfield CO Source diag226 central sun com Severity Warning Category MESSAGE Deviceld message diag226 central sun com EventType LogEve
89. ething as a Fabric device or being in Fabric mode When used in this context it simply means a public device capable of logging into a Fabric and having public loop characteristics as opposed to a private loop legacy device Hard Zones Hard Zones allow the division of the Fabric one or more Switch chassis into as many as 16 Fabric wide zones that define the ports that can communicate with each other A particular port may be placed in only one Hard Zone no overlapping Hard Zones If Hard Zones are enabled Name Server Zones and SL Zones will not communicate across defined Hard Zone boundaries Name Server Zones allow the division of the Fabric one or more Switch chassis into as many as 256 Fabric wide zones that define which ports or devices receive Name Server information If Hard Zones are enabled Name Server Zones will not communicate across defined Hard Zone boundaries Private Loop An Arbitrated Loop without a Fabric switch Public Loop An Arbitrated Loop attached to a Fabric switch Segmented Loop A set of ports that behave as one private loop Zone A set of ports and their connected devices zone that behave as a single private loop SL Zones on the switch allow the division of the Fabric one or more Switch chassis into Fabric wide zones that define the ports that can communicate with each other Zoning Zoning allows the user to divide the Fabric ports into zones for more efficient and secure communication among functiona
90. faults Set the default options for each available test Test Archive Review the results of archived tests FIGURE 3 3 Storage Automated Diagnostic Environment Diagnostic Tests Window You can run Storage Automated Diagnostic Environment diagnostic tests from the Test from Topo or from the Test from List links FIGURE 3 4 FIGURE 3 5 and FIGURE 3 6 show an example of selecting and modifying the Test from Topo link The functional tests are designed to test the target FRU and operate on in band or out of band data paths The Storage Automated Diagnostic Environment causes the test to be run on the appropriate Host Storage Automated Diagnostic Environment s implementation of diagnostic tests verify the operation of all the user selected components Tests are selected from a graphical view of the system s topology The Storage Automated Diagnostic Environment version 2 1 Graph view shows the physical topology of a system or merged system Using the Topology view you can select specific subtests and test options The monitoring status of devices and links appears both in the test topology view and in the list view 36 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Qo SUN microsystems Diagnostic Tests Test from Topo Test from list Test Manager Storage Automated Diagnostic Environment o Ultra Enterprise 5 J WE Save xv Graphics Onf Layout Horizontal Links
91. figured unknown The output of the cfgadm al command indicates that the device is back in the Fabric Note that both c6 50020 23000003d5 and c7 50020f23000003c5 are connected and configured Chapter 4 Troubleshooting Example 61 2 Issue the luxadm display command to the affected Sun StorEdge T3 array LUN Refer to the original Storage Automated Diagnostic Environment email alert for the LUN ID D luxadm display dev rdsk c9t60020F20000003D53D349365000C1691d0s2 EVICE PROPERTIES for disk dev rdsk c9t60020F20000003D53D349365000C1691d0s2 Status Port A O K Status Port B OK Vendor SUN Product ID T300 WWN Node 50020 20000003c5 WWN Port A 50020 23000003d5 WWN Port B 50020f23000003c5 Revision 0201 Serial Num Unsupported Unformatted capacity 51203 250 MBytes Write Cache Enabled Read Cache Enabled Minimum prefetch 0x0 Maximum prefetch 0x0 Device Type Disk device Path s dev rdsk c9t60020F20000003D53D349365000C1691d0s2 devices scsi_vhci ssd g60020f20000003d53d349365000c1691 c raw Controller devices pci l1lf 2000 SUNW qlc 1 fp 0 0 Device Address 50020 23000003d5 0 Class primary State STANDBY Controller devices pci 4 2000 SUNW glc 1 fpe0 0 Device Address 50020 23000003c5 0 Class secondary State ONLINE 62 The luxadm display command output indicates that both paths to the Sun StorEdge T3 array LUN are seen again Howe
92. ge Jul 11 10 31 12WWN Received 1 Loop Offline message s in 7 mins threshold is 1 in 5mins Last Message diag229 Central Sun COM qlc ID 686697 kern info NOTICE Qlogic qlc 4 Loop OFFLINE Site Lab Broom Source diag229 central sun com Severity Error Actionable Category HOST Deviceld host diag229 central sun com EventType AlarmEvent M lun T300 c3t50020F23000068CCd0s2 statusA EventCode 7 5 27 EventTime 2002 07 11 10 35 08 The state of lun T300 c3t50020F23000068CCd0s2 statusA on diag229 central sun com changed from 0 K to Missing target t3 t3 67 166 172 20 67 166 INFORMATION luxadm display reported a change in the port status of one of it s paths The agent then tries to find which enclosure this path corresponds to by reviewing it s database of T3 s and VE s luxadm display 2a00006022004188 DEVICE PROPERTIES for disk 2a00006022004188 Status Port A Ok xx x monitoring this field Vendor SUN Product ID SESSO1 WWN Node 2a00006022004188 WWN Port A 2b00006022004188 Revision 080D Serial Num Unsupported Unformatted capacity 241724 000 MBytes Write Cache Enabled Read Cache Enabled Minimum prefetch 0x0 Maximum prefetch 0x0 Device Type Disk device Path s dev rdsk c7t2B00006022004188d0s2 devices sbus 8 0 SUNW qlc 1 30000 fp 0 0 ssd w2b00006022004188 0 c raw continued on next page 106 Sun StorEdge SAN 4 0 Release Field Troubleshoo
93. he Sun StorEdge Network Fibre Channel Switch 16 see the Sun StorEdge Network 2Gb Switch 16 SANbox2 Installer s User s Manual This manual can be found with the following steps Access the SAN Solutions web site http www sun com products n solutions hardware docs Network_Storage_Solutions SAN index html The SAN Solutions menu is displayed Click Other Documentation Click Sun StorEdge tm Network 2Gb Switch 16 SANbox2 Installer s User s Manual See Section 4 Diagnostics Troubleshooting Using Switch Counter Information Switch counter information can be helpful in supporting troubleshooting the Sun StorEdge Network Fibre Channel Switch 16 Some general points to keep in mind when viewing switch counter information are m Quickly increasing counter values or abnormally high counter values may indicate a problem A LIP that occurs on one port in a zone propagates to all the ports that have devices attached to them in the same zone The LIP counter is incremented on all those ports m Normal activity can also increase counter values Counters increment on power cycles Note Switch Counter data should only be used as supporting data for diagnostics Do not use switch counter information as the primary source in the troubleshooting process Chapter 3 Diagnostics 41 Sun StorEdge Network Fibre Channel Switch 16 counter information can be called up by using the SANbox Manager application See
94. ic Manager application with SunCluster 3 0 or VERITAS Cluster Server Introduction 5 6 TABLE 1 1 Feature Host Bus Adapters HBAs Supported Storage Devices Third party Compatibility SAN 3 x Features Not Supported in SAN 4 x N A Sun StorEdge A5200 and A3500FC arrays supported N A SAN 3 x Features Included In SAN 4 x 1 Gbit host bus adapters supported include e Sun StorEdge PCI Dual Fibre Channel Network Adapter e Sun StorEdge PCI Single Fibre Channel Network Adapter e Sun StorEdge CPCI Dual Fibre Channel Network Adapter e Sun StorEdge SBus Dual Fibre Channel Network Adapter Sun StorEdge T3 and T3 arrays supported N A Comparison of the SAN 3 0 and SAN 4 0 Releases Continued SAN 4 x New Features Newly supported host bus adapters include e Sun Sun StorEdge 2G FC PCI Single Channel Network Adapter card e Sun StorEdge 2G FC PCI Dual Channel Network Adapter card New Sun StorEdge T3 array firmware is supported The Sun StorEdge 39x0 69x0 and 99x0 series are also supported Interoperability capability with FC SW2 mode on the new switches Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Cascading Switches E_Ports Note See TABLE 2 9 on page 19 and TABLE 2 10 on page 20 for a comparison of the port nomenclature differences between Sun StorEdge and Brocade Communications Systems Inc In the Sun StorEdge SAN
95. ing Guide October 2002 Single Host Connected to Multiple Storage Arrays FIGURE 2 2 shows a single host connected to multiple Sun StorEdge T3 array partner pairs Note You can attach different types of storage devices to the same switch as long as the storage devices are on different zones Each controller that is connected to a switch must have a unique loop ID Whenever you add a second controller to a switch make sure that the loop ID of the controller being connected is different from the loop ID of any other controller currently connected to the same switch Caution Make sure that the controller module of the array is split between two switches For example connect controller A to switch 1 and controller B to switch 2 Chapter 2 Configurations 25 Sun StorEdge T3 array partner pairs Host Switches Host Adapter Host Adapter oet FIGURE 2 2 Single Host Connected to Multiple Sun StorEdge T3 Array Enterprise Configurations 26 Sun StorEdge SAN 4 0 Release Field Troubleshooting Gui
96. ion 2 1 has incorporated the launching of various Brocade Silkworm switch diagnostic tests under one Storage Automated Diagnostic Environment version 2 1 test brocadetest 1M This test is launched within the Storage Automated Diagnostic Environment version 2 1 framework and determines the correct Brocade specific test to run depending on port type Example CLI brocadetest 1M opt SUNWstade Diags bin brocadetest v o dev 5 172 20 67 167 passwd password iterations 1000 Called with options dev 5 172 20 67 167 passwd xxxxxxx iterations 1000 Connect to 172 20 67 167 Opened 172 20 67 167 Logged into 172 20 67 167 Clear port errors send diagClearError 5 Port errors cleared port is in loopback mode Running command CrossPortTest 1000 1 ote You should only have a loopback on port 5 If you have more than one loopback installed this test may report false errors Test Passed Loopback took 34 seconds to run Fan 1 is OK speed is 8640 RPM Fan 2 is OK speed is 8760 RPM Fan 3 is OK speed is 8910 RPM Fan 4 is OK speed is 8820 RPM Fan 5 is OK speed is 8820 RPM Fan 6 is OK speed is 8820 RPM KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKK Detected possible bad Power supply Power Supply 1 is absent KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKK Power Supply 2 is OK Close 172 20 67 167 88 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Other Diagnostic Tools Brocade Silkworm switches a
97. ions dev devices pci 1f 2000 SUNW qlc 1 fp 0 0 devctl run_connect Yes selftest Disable mbox Disable checksum Disable ilb_10 Disable ilb Disable lb Enable iterations 100 xcnt 65536 selectpattern critical userpattern 0x7e7e7ee gqlctest Started Program Version is 4 0 1 Testing qlc0 device at devices pci l1lf 2000 SUNW qlc 1 fp 0 0 devctl OLC Subsystem ID 0x106 09 13 02 13 52 23 diag226 Central Sun COM MSGID 6028 qlctest port_online FATAL ERROR Didn t detect loop as being online and user selected external loopback option Return code from checking path devices pci l1lf 2000 SUNW qlc 1 fp 0 0 devctl was 131337 qictest failed error code 256 Remove FC Cable from hba devices pci l1lf 2000 SUNW qlc 1 fp 0 0 devctl Insert FC Loopback Cable into hba devices pci l1f 2000 SUNW qlc 1 fp 0 0 devctl Continue Isolation qictest started on hba port glctest called with options dev devices pci lf 2000 SUNW qlc 1 fp 0 0 devctl run_connect Yes selftest Disable mbox Disable checksum Disable ilb_10 Disable ilb Disable lb Enable iterations 100 xcnt 65536 selectpattern critical userpattern 0x7e7e7e7e gqlctest Started Program Version is 4 0 1 Testing qlc0 device at devices pci l1lf 2000 SUNW qlc 1 fp 0 0 devctl OLC Subsystem ID 0x106 QLC Adapter Chip Revision 1 Risc Revision 4 r Frame Buffer Revision 1287 Riscr
98. le 63 64 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 APPENDIX A Brocade Communications Systems Upgrades and Installations This appendix contains topics that describe how to install a new SAN system using Brocade Communications Systems Inc Silkworm switch Installing a New SAN on page 66 Downloading Patches and Packages on page 67 Installing the Software on page 69 Installing Firmware on Brocade Communications Systems Silkworm Switches on page 72 Upgrading the SAN on page 76 65 Installing a New SAN Required Software Components The following software components might be required for your particular SAN system Refer to the documentation for each individual product to insure proper installation Software Components a Sun StorEdge Traffic Manager This is available as a patch which can be installed on Solaris 8 release 02 02 Update 7 or later It should be installed with the latest revision of Sun StorEdge Network Foundation Software a Sun StorEdge Network Foundation Software This software is included with the Solaris upgrades for the FC switch product It includes the drivers to support switches management tools and storage devices a VERITAS Volume Manager VERITAS Volume Manager is a separately installed software product that provides host based storage management such a disk labeling mirroring striping and RAID 5 a Brocade Webtools Brocade s
99. le from switch2 100000c0dd00bfda sw 67 84 port 0 Restore ORIGINAL FC Cable into switch2 100000c0ad00bfda sw 67 84 port 0 Suspect ORIGINAL FC GBIC or SFP in switch2 100000c0ad00bfda sw 67 84 port 0 Retest to verify FRU replacement linktest completed on FC interconnect hba to switch2 Insert FC Loopback Cable into switch2 100000c0dd00bfda sw 67 84 60 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Verify the Fix The Storage Automated Diagnostics Environment has identified the SFP as the most likely suspect It suggests reconnecting the link and re running the linktest to verify the results You could also run the switchtest to stress the link with the number of test Fibre Channel frames 1 Issue the cfgadm al command cfgadm al Ap_Id Type Receptacle Occupant Condition co scsi bus connected configured unknown c0 dsk c0t0d0 disk connected configured unknown c0 dsk c0t1d0 disk connected configured unknown gi scsi bus connected configured unknown c1 dsk c1t6d0 CD ROM connected configured unknown C2 fc connected unconfigured unknown c3 Re connected unconfigured unknown c4 fc private connected unconfigured unknown cS fc connected unconfigured unknown c6 fc fabric connected configured unknown c6 50020f23000003d5 disk connected configured unknown e7 fc fabric connected configured unknown c7 50020f23000003c5 disk connected configured unknown c8 EC connected uncon
100. llector SUNWexplo and T3Extractor on page 40 a Diagnosing and Troubleshooting the Sun Switch on page 41 31 Diagnostic Tools Storage Automated Diagnostic Environment Version 2 1 The Storage Automated Diagnostic Environment version 2 1 is a host based online health and diagnostic monitoring tool for a storage area network SAN and direct attached storage DAS devices It can be configured to monitor on a 24 hour basis collecting information that enhances the reliability availability and serviceability RAS of the storage devices ROOT 2 1 Home Help Site Map Welcome to the Storage Automated Diagnostic Environment This site can be used to configure agents monitor and diagnose Sun storage products Configuration Summary Alert Summary Site Info NSTE Newark Categories Installation 2 hosts 6 devices Brocade switch Notification None Host Email 0 Sun T3 Last Event 2002 06 28 11 05 41 Basic Installation Steps Create Topology Copyright 2002 Sun Microsystems Inc All rights reserved Use is subject to license terms Third party software including font technology is copyrighted and licensed from Sun suppliers Portions may be derived from Berkeley BSD systems licensed from U of CA Sun Sun Microsystems the Sun logo and Sun StorEdge are trademarks or registered trademarks of Sun Microsystems Inc in the U S and other countries Federal Acquisitions Commercial Software Government Users
101. lly grouped nodes There are several types of zones and a port may be defined in any No port can be in all zone types simultaneously 146 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Index A adapters 6 arrays configuration guidelines 22 B backward compatability 5 C cable 4 LC LC 4 SC LC 4 SC SC 4 cascade limit 3 cascading rules 23 cluster support 5 configuration 3 cascaded limit 3 disaster tolerant 3 high level using Network Storage Agent 2 1 44 multihost 27 single host connected to multiple storage arrays 25 single host connected to one storage array 24 configuration examples 24 configuration guidelines 22 configurations 9 conventions typographic xii count cascade limit 3 hop limit 3 ISL limit 3 ISL link limit 3 long wave tranceiver limit 3 maximum switches 3 D diagnostic tool T3Extractor 40 disaster tolerant configuration 3 document purpose 1 scope 2 documentation accessing online xv F fabric 4 division of 21 fabric support 3 fault isolation examples of 43 setup requirements 44 switch to storage error 47 FC SW2 4 mode 6 147 Fibre Channel Fibre Channel arbitrated loop 4 firmware 5 G G_port 4 GBICs 4 GL_port 4 H hard zones 4 HBAs supported configurations 15 host local attachment 3 host bus adapter 6 interconnections 2 interoperability 4 6 InterSwitchLink ISL 10 ISL link limit 3 L LC
102. lso support a wide range of CLI tests that can be invoked while connected directly to the switch via a serial connection to the Silkworm 2400 by opening a telnet session or by way of the front panel of the Silkworm 2800 Some of the tests pertinent for troubleshooting are listed below Storage Automated Diagnostic Environment s brocadetest invokes crossPortTest for testing loopback ports spinFab for testing E Port connections between switches and loopPortTest for testing L Ports m supportShow m switchShow m qlShow m diagShow m crossPortTest m loopPortTest m spinFab m nsShow supportShow supportShow runs nearly all commands and should be gathered when placing a service call or escalation The Explorer Data Collection utility SUNWexplo gathers the support Show output if the Brocade Silkworm switch is placed in the opt SUNWexplo etc saninput txt Input file for extended data collection Format is SWITCH SWITCH TYPE PASSWORD LOGIN Valid switch types are ancor and brocade LOGIN is required for brocade switches the default is admin 172 20 67 167 brocade password admin 172 20 67 164 brocade password admin Appendix B Brocade Communications Systems Switch Troubleshooting 89 CODE EXAMPLE B 1 supportShow Sample Output telnet gt Trying 172 20 67 167 Connected to 172 20 67 167 Escape character is Fabric OS tm Release v2 6 0 login admin Password diagl67 admin gt supportshow
103. ly licensed product Note For the Brocade Sun StorEdge SAN 4 0 Release phase Sun StorEdge T3 and T3 arrays do not need Quickloop nor do host bus adapters Sun StorEdge T3 and T3 arrays will auto configure as L_Ports and HBAs will auto configure as F_Ports if the switch is in the fabric mode Current Issues with the Storage Automated Diagnostic Environment Version 2 1 and Brocade Switches The minimum Brocade Silkworm switch firmware to use with Storage Automated Diagnostic Environment version 2 1 is v2 6 0c Diagnostic Tools The tools available for troubleshooting differ from the original release of the Sun StorEdge SAN 4 0 Release Since then Sun StorEdge StorTools 4 x and Network Storage Agent 2 1 have had their functionality combined into a single diagnostic package called the Storage Automated Diagnostic Environment version 2 1 Brocade Silkworm switches also have their own GUI called WebTools Storage Automated Diagnostic Environment Version 2 1 and Brocade Switches With the Storage Automated Diagnostic Environment version 2 1 Brocade switches are now supported under the same diagnostic framework as the rest of the Sun SAN product family This support includes monitoring for error and alert conditions revision checking graphic topology display and fault isolation diagnostics Appendix B Brocade Communications Systems Switch Troubleshooting 87 brocadetest 1M The Storage Automated Diagnostic Environment vers
104. marked BAD clear the port and set to OK using the diagClearError port command This command clears the port status only and does not clear the logs or change the port s condition The diagClearError port command should only be used during diagnostic procedures to reset a bad port for retest Some messages contain the following abbreviations m sb Should Be m er Bits in error Note If you run the port StateShow or the diagShow command prior to running a test errors may appear as a result of the normal synchronization process These errors should be addressed if the number of errors found increases when running the portStateShow command again TABLE C 1 Probable Failure Actions Failed Test Action ramTest replace DRAM module or mainboard assembly portRegTest replace mainboard assembly centralMemoryTest replace mainboard assembly cmiTest replace mainboard assembly cmemRetentionTest replace mainboard assembly sramRetentionTest replace mainboard assembly camTest replace mainboard assembly Appendix C Brocade Communications Systems Error Messages 123 TABLE C 1 Probable Failure Actions Continued Failed Test Action portLoopbackTest replace mainboard assembly crossPortTest replace mainboard assembly SFP or fiber cable spinSilk replace mainboard assembly SFP or fibre cable Error Message Numbers An error number ERR xxxx appears at the end of an error message TABLE C 2 matches each error number
105. ment can monitor host message files for errors or connect directly through the in band data path or out of band management path of Sun StorEdge devices in order to obtain status information about each device being monitored Storage Automated Diagnostic Environment Version 2 1 Diagnostic Functionality Diagnostic tests have been integrated into the Storage Automated Diagnostic Environment for device diagnostics and field replaceable unit FRU isolation Each test can be run individually from the command line interface CLI or from the Storage Automated Diagnostic Environment GUI The following tests are described in the Storage Automated Diagnostic Environment User s Guide Version 2 1 Sun StorEdge PCI FC 100 Host Adapter Board Test ifptest Sun StorEdge PCI Dual Fibre Channel Host Adapter Board Test qlctest Sun StorEdge SBus FC 100 Host Adapter Board Test socaltest Sun StorEdge Network FC Switch 16 Switch Test switchtest Sun StorEdge T3 and T3 array Tests t30fdg t3test t3volverify Virtualization Engine Tests vediag veluntest Brocade Silkworm Test brocadetest From the Storage Automated Diagnostic Environment GUI you can select tests from the topology or from a list view When the tests execute the Storage Automated Diagnostic Environment initiates the test on the proper host You can retrieve test results by using the Test Manager selection from the GUI Running Diagnostic Tests From the GUI If you
106. module or fiber cable DIAG PORTSTOPPED Err 3874 spinSilk Port is no longer transmitting as indicated by the Number Of Frames Transmitted counter being stuck at N frames ASIC SFP module or fiber cable failure Replace mainboard assembly SFP module or fiber cable DIAG PORTWRONG Err 3078 crossPortTest Frame erroneously received by port M instead of the intended port N Appendix C ASIC failure Brocade Communications Systems Error Messages Replace mainboard assembly 131 TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action DIAG POST SKIPPED POST is skipped Its message Informational only None required Err 0004 recommended that POST be switch initialization executed DIAG REGERR Data read from ASIC register or ASIC SRAM did not match ASIC failure Replace mainboard Err 0B15 0415 assembly portRegTest data previously written into sramRetentionTest same location DIAG REGERR_URST Port failed to unreset ASIC failure Replace mainboard Err 0B16 0416 assembly portRegTest sramRetentionTest DIAG STATS Port counter value did not ASIC SFP module Replace mainboard Err 2660 2662 3060 match the number of frames or fiber cable failure assembly SFP module 3062 actually transmitted Possible or fiber cable portLoopback Test counters reporting crossPortTest e FramesTx number of frames transmitted e FramesRx number of fram
107. nal Inc in the U S and other countries Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems Inc The OPEN LOOK and Sun Graphical User Interface was developed by Sun Microsystems Inc for its users and licensees Sun acknowledges the pioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry Sun holds a non exclusive license from Xerox to the Xerox Graphical User Interface which license also covers Sun s licensees viho implement OPEN LOOK GUIs and otherwise comply with Sun s written license agreements RESTRICTED RIGHTS Use duplication or disclosure by the U S Government is subject to restrictions of FAR 52 227 14 g 2 6 87 and FAR 52 227 19 6 87 or DFAR 252 227 7015 b 6 95 and DFAR 227 7202 3 a DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Copyright 2002 Sun Microsystems Inc 4150 Network Circle Santa Clara CA 95054 Etats Unis Tous droits r serv s Ce produit ou document est prot g par un copyright et distribu avec des licences qui en restreignent l utilisation la copie la distribution et la d compilation Aucune partie de ce produit o
108. nt driver MPXIO_ offline EventCode 9 20 313 EventTime 2002 09 13 13 06 27 S ESCRIPTION Found 4 driver MPXIO_offline warnings s in logfile var adm messages on diag226 central sun com id 80fee746 H FORMATION he MPxIO multipathing software has noted the path to a storage device has gone ffline Ow RECOMMENDED ACTION 1 Check the Topology View to see what device s are affected 2 Check all cables and connections 3 Check for other alerts that may indicate an underlying problem ex Switch Ports offline 4 The outputs of cfgadm al and luxadm e port may uncover other fabric problems continued 50 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 continuation DETAILS Sep 13 13 05 36 WWN 50020 779286 kern info scsi_v 23000003d5 diag226 Central Sun COM mpxio hci ssd g60020 20000003d53d34940b0004e6b6 multipath status degraded path pci 1f 2000 SUNW qlc 1 fpt0 0 fp4 to address Sep 13 779286 50020 23000003d5 13 05 36 WWN 50020 kern info scsi_v 3 is offline 23000003d5 diag226 Central Sun COM mpxio hci ssd g60020 20000003d53d3493d80003c090 multipath status degraded path pci 1f 2000 SUNW qlc 1 fpt0 0 fp4 to address Sep 13 779286 50020 23000003d5 13 05 36 WWN 50020 kern info scsi_v j2 LS offline 23000003d5 diag226 Central Sun COM mpxio hci ssd g60020
109. ntact customer LOG_WARNING support FLOOD INVLSR Unknown LSR type OS error Contact customer LOG_WARNING support FLOOD LSRLEN Excessive LSU length OS error Contact customer LOG_ERROR support HLO INVHLO Invalid Hello received from OS error Contact customer LOG_ERROR port support HLO HLOTIMEOUT Incompatible Hello timeout OS error Contact customer LOG_ERROR from port support HLO DEADTIMEOUT Incompatible inactivity OS error Contact customer LOG_ERROR timeout from port support FSPF SCN LOG_WARNING Illegal SCN OS error Contact customer support FSPF NBRCHANGE Wrong neighbor ID in Hello OS error Contact customer LOG_WARNING message from port support FSPF INPORT LOG_ERROR Input port out of range OS error Contact customer support 136 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action FSPE VERSION FSPF version not supported OS error Contact customer LOG_ERROR support FSPF SECTION Wrong section ID OS error Contact customer LOG_ERROR support FSPF REMDOMAIN Remote Domain ID out of OS error Contact customer LOG_ERROR range support NBFSM NGBRSTATE Wrong input to neighbor FSM OS error Contact customer LOG_ERROR support MCAST ADDPORT Add port failed OS error Contact customer LOG_WARNING support MCCAST REMPORT Remove port failed OS error Contact customer LOG_WARNING sup
110. nts to Sun at docfeedback sun com Please include the part number 816 6580 11 of your document in the subject line of your email Preface xv xvi Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 CHAPTER 1 Introduction This Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide provides basic procedures for isolating problems of systems that are configured as identified in the Sun StorEdge SAN 4 0 Release Configuration Guide The intended audience for this troubleshooting guide is Sun Service Representatives As such it is therefore assumed that you have been trained on all the components that comprise your particular storage and switch configuration This manual only addresses troubleshooting No repair or corrective action procedures are contained herein This chapter contains the following sections m Document Scope on page 2 a New Features of the Sun StorEdge SAN 4 0 Release on page 3 Document Scope The scope of this document includes the switch and interconnections host bus adapter HBA Small Form Factor Pluggable SFP 2 gigabit transceiver and cables on either side of the switch as shown in the following diagram oe erie N y Switch N Switch 4 A FIGURE 1 1 Switch and Interconnections The Storage Automated Diagnostic Environment version 2 1 software package is required to support the configurations in this document Additi
111. ober 2002 In both of these outputs a Fibre Channel FC address appears the six digit number 1084e4 for example The FC address potentially provides useful troubleshooting information The key to this is knowing how the Sun FC switch encodes the addresses For a Qlogic switch the address must first be changed from Hex to a 24 bit binary number Example 1084e4 translates into hexadecimal as 100001000010011100100 The calculator removes the first 3 bits because they were zeros The number is actually 000100001000010011100100 which is the number used in this example 000100001000010011100100 is the 24 bit binary representation of 1084e4 Qlogic encodes this number in the following way Bits 0 3 Fabric ID Bits 4 9 Chassis ID Bits 10 13 ASIC Bits 14 15 Port Bits 16 23 AL_PA m The AL_PA will be zero if the device is a full fabric device otherwise it will be the AL_PA of the loop device m StorEdge Network Fibre Channel Switches have 2 or 4 ASICS 2 on the 8port switch 4 on the 16port switch These ASICs are numbered from 0 3 m Each ASIC has 4 ports numbered 0 3 a The numbering on the switch faceplate goes from 1 8 or 1 16 a So ASIC 0 port 0 is actually Port 1 if you were looking at the switch ASIC 3 port 3 would be Port 16 if you were looking at the switch Appendix D Converting Sun FC Switches Fibre Channel Addresses 141 000100001000010011100100 is broken down as follows 0001 Fabric ID 000010 Chas
112. om Revision 1 Driver Revision 6 0 2 1 17 continued 58 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 continuation Running external loopback test Test Pattern 0x7e7e7e7e k Test Pattern 0x7e7e7e7e k Test Pattern Oxlelelele kK Test Pattern Oxf1f1f1f1 Performing Loop Back Frame Test Pattern Oxb5b5b5b5 Performing Loop Back Frame Test Pattern 0x4a4a4a4a Performing Loop Back Frame Test Pattern 0x78787878 k k k k k Performing Loop Back Frame Performing Loop Back Frame Performing Loop Back Frame Performing Loop Back Frame Performing Loop Back Frame Test Pattern 0xe7e7e7e7 Performing Loop Back Frame Test Pattern 0xaa55aa55 Performing Loop Back Frame Test Pattern Ox7f7 7 7 Performing Loop Back Frame Test Pattern Ox0f0f0f0f Performing Loop Back Frame Test Pattern Ox00ff00ff Performing Loop Back Frame Test Pattern 0x25252525 gqlctest Stopped successfully qictest completed successfully error code 0 Remove FC Loopback Cable from hba devices pci l1lf 2000 SUNW qglc 1 fp 0 0 devctl Restore ORIGINAL FC Cable into hba devices pci l1lf 2000 SUNW qlc 1 fp 0 0 devectl ORIGINAL hba devices pci 1f 2000 SUNW qlc 1 fp 0 0 devctl is Functional Remove FC Cable from switch2 100000c0dd00bfda sw 67 84 port 0 Insert FC Loopback Cable into switch2 100000c0dd00bfda sw 67 84 port 0 Continue Isolation switch2test started
113. on switch2 100000c0dd00bfda port 0 Called with options dev 0 172 20 67 84 passwd x selectpattern critical userpattern 0x7e7e7e7e switch2test Started Connected to 172 20 67 84 Switch Model type is SANbox2 16 Power and Fans are okay Detected a loopback plug inserted onto this port Get original port counters for port 0 Detected port type Not Initialized 09 13 02 13 58 59 diag226 Central Sun COM MSGID 6021 switch2test run_offline_loopback ERROR 0 172 20 67 84 Loopback test failed to start continued Chapter 4 Troubleshooting Example 59 continuation switch2test failed error code 256 Remove FC Loopback Cable from switch2 100000c0dd00bfda sw 67 84 port 0 Insert a NEW FC GBIC or SFP into switch2 100000c0dd00bfda sw 67 84 port 0 port 0 Continue Isolation switch2test started on switch2 100000c0dd00bfda port 0 Called with options dev 0 172 20 67 84 passwd x selectpattern critical userpattern 0x7e7e7ee switch2test Started Connected to 172 20 67 84 Switch Model type is SANbox2 16 Power and Fans are okay Detected a loopback plug inserted onto this port Get original port counters for port 0 Detected port type Not Initialized External loopback test passed Get port counters after testing for port 0 Compare of port counters passed Test Passed switch2test completed successfully error code 0 Remove FC Loopback Cab
114. onal information and resources are available at http www sun com storage san or at http sunsolve Sun COM gt Product Patches PatchPro These websites contain information on software versions and provide necessary patches 2 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 New Features of the Sun StorEdge SAN 4 0 Release The Sun StorEdge SAN 4 0 release supports many new features that are summarized in TABLE 1 1 Several features of the SAN 3 x release are not included in the SAN 4 0 release and many features were carried forward For an explanation of the new features see the Sun StorEdge SAN 4 0 Release Configuration Guide TABLE 1 1 Feature Supported Configurations SAN 3 x Features Not Supported in SAN 4 x Cascaded configurations limited to three linear connected switches or three ISL links between switches SAN configurations limited to single switch or simple cascades Limit of 2 switches supported in a SAN Limited partial fabric supported for connections between hosts and switches Comparison of the SAN 3 0 and SAN 4 0 Releases SAN 3 x Features Included In SAN 4 x N A Support for local host and storage device attachment with short or long wave cables and transceivers for disaster tolerant configurations N A N A SAN 4 x New Features Cascaded configuration limit increased to eight linear connected switches or seven ISL links between
115. or Contact customer LOG_CRITICAL support SYS SYSCALL LOG_ERROR System call failed OS error Contact customer support SYS BADPTR LOG_ERROR Bad system pointer OS error Contact customer support SYS INTRPT Bad system interrupt OS error Contact customer LOG_CRITICAL support SYS FLASHRD FLASH memory read error OS error Contact customer LOG_ERROR support Appendix C Brocade Communications Systems Error Messages 135 TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action SYS FLASHWR FLASH memory write error OS error Contact customer LOG_ERROR support TIMERS ENQFAIL Invalid timeout value OS error Contact customer LOG_CRITICAL support TIMERS MSG Invalid message OS error Contact customer LOG_WARNING support FLANNEL PHANTOM Port s PLT limit exceeded OS error Contact customer LOG_WARNING support ASIC MINI_BUFFER LOG_WARNING ASIC Failure Bad mainboard Contact customer support LSDB LSID LOG_ERROR Link State ID d out of range OS error Contact customer support LSDB NOLOCALENTRY No database entry for local OS error Contact customer LOG_CRITICAL link state record support LSDB NOLSR No link state record for OS error Contact customer LOG_WARNING domain support LSDB MAXINCARN Local link state record OS error Contact customer LOG_WARNING reached max incarnation support FLOOD INVLSU Discard received LSU OS error Co
116. or detected at the wrong ASIC failure Replace mainboard Err 102B port assembly centralMemoryTest DIAG CMERRTYPE Port got the wrong CMEM ASIC failure Replace mainboard Err 102A error type assembly centralMemoryTest DIAG CMICKSUM CMI message received failed ASIC or mainboard Replace mainboard Err 2036 bad checksum test failure assembly cmiTest DIAG CMIDATA CMI data received but did ASIC or mainboard Replace mainboard Err 2035 not match data transmitted failure assembly cmiTest DIAG CMIINVCAP Unintended ASIC ASIC or mainboard Replace mainboard Err 2034 erroneously got CMI capture failure assembly cmiTest flag DIAG CMINOCAP CMI intended receiver ASIC ASIC or mainboard Replace mainboard Err 2033 failed to get CMI capture flag failure assembly cmiTest DIAG CMISA1 Err 2032 cmiTest DIAG CMNOBUF Err 1029 centralMemoryTest An attempt to send a CMI message from ASIC to ASIC failed Port could not get any buffer Appendix C ASIC failure ASIC failure Replace mainboard assembly Replace mainboard assembly Brocade Communications Systems Error Messages 129 TABLE C 3 Diagnostic Error Messages Continued Message Description Probable Cause Action DIAG DATA Payload received by port did mainboard SFP Replace mainboard Err 266E 306E not match payload module or fiber assembly SFP module portLoopbackTest transmitted cable failure or fiber cable crossPortTest DIAG ERRSTAT Err 264
117. port MCAST ADDBRANCH Add branch failed OS error Contact customer LOG_ERROR support MCAST REMBRANCH Remove branch failed OS error Contact customer LOG_ERROR support MCAST NOPARENT Null parent OS error Contact customer LOG_ERROR support MCAST NOPARENTLSR Null IsrP OS error Contact customer LOG_ERROR support UCAST ADDPATH Add path failed OS error Contact customer LOG_CRITICAL support UCAST ADDPORT Add port failed OS error Contact customer LOG_WARNING support UCAST REMPORT Remove port failed OS error Contact customer LOG_WARNING support UCAST RRTIM Invalid reroute timer ID OS error Contact customer LOG_CRITICAL support UCAST SPFCOST No minimum cost path in OS error Contact customer LOG_WARNING candidate support UCAST RELICPDB Relic PDB to Domain OS error Contact customer LOG_WARNING support Appendix C Brocade Communications Systems Error Messages 137 138 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 APPENDIX D Converting Sun FC Switches Fibre Channel Addresses This appendix explains how the Sun FC switch encodes Fibre Channel addresses Note This information only applies to the Sun FC switches This appendix contains the following topics a Converting a Fabric Address into Fabric ID Chassis ID ASIC Port and AL_PA on page 140 a Example on page 141 139 Converting a Fabric Address into Fabric ID Chassis ID ASIC Port and AL_
118. rEdge SAN 4 0 Release Server Compatibility Matrix 13 Sun StorEdge SAN 4 0 Release Storage Array Compatibility Matrix 14 Supported Features of the Sun StorEdge T3 Array 15 Sun StorEdge SAN 4 0 Release HBA Compatibility Matrix 15 Unbundled Software 17 Sun StorEdge SAN 4 0 Release Optional Software Packages Compatibility Matrix 18 Sun StorEdge and Brocade Communications Systems Port Descriptions 19 Differences Between Sun StorEdge and Brocade Port Communications Systems Port Nomenclature 20 Arrays Zones and Initiators 23 Software Download Sites 67 Software Installation Sequence 69 SAN Supportability Matrix with Solaris 8 02 02 Update 7 or Later 84 Disk Array Supportability Matrix with Solaris 8 02 02 Update 7 or Later 85 Fibre Channel Switch Supportability Matrix with Solaris 8 02 02 Update 7 or Later 85 Application Supportability Matrix with Solaris 8 02 02 Update 7 or Later 86 Sun StorEdge and Brocade Communications Systems Port Descriptions 95 TABLE B 6 Differences Between Sun StorEdge and Brocade Port Communications Systems Port Nomenclature 95 TABLE C 1 Probable Failure Actions 123 TABLE C 2 Error Message Codes Defined 124 TABLE C 3 Diagnostic Error Messages 128 TABLE D 1 ASIC and Port Values 142 x Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Preface This Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide describes how to diagnose and troubleshoot the Sun StorEdge SAN 4
119. s a G_Port when it is not yet fully connected or has not yet assumed a specific function in the fabric GL_Port Generic loop port This port can automatically configure as either an E_Port F_Port or an FL_Port A port is defined as a G_Port when it is not yet fully connected or has not yet assumed a specific function in the fabric TABLE B 6 Differences Between Sun StorEdge and Brocade Port Communications Systems Port Nomenclature Sun StorEdge Port Brocade Port Function TL_Port L_Port Translated loop port Loop port This port enables private devices to communicate with fabric or public devices In the Brocade switch this address translation is automatic In Sun StorEdge switches the private device must be configured on a TL_Port N A U_Port Universal Port This port can operate as an E_Port F_Port or FL_Port A port is defined as a U_Port when it is not yet fully connected or has not yet assumed a specific function in the fabric Appendix B Brocade Communications Systems Switch Troubleshooting 95 Accessing the Brocade Silkworm Switch You can access Brocade Silkworm switches in a number of ways m Open a telnet session by way of a standard RJ 45 Ethernet port m Access the front panel Brocade Silkworm 2800 only a Use a serial connection Brocade Silkworm 2400 only m Use the Brocade WebTools GUI The serial connection available on the Brocade Silkworm 2400 switch is intended for initial IP address configuration only
120. sis ID 0001 ASIC ID 00 Port ID 11100100 AL_PA You can convert these back into usable numbers Binary gt Decimal except for AL_PA change it to Hex Fabric ID 1 Chassis ID 2 ASIC ID 1 Port ID 0 AL_PA E4 From this information you can conclude the following m The Fabric ID of the switch is 1 m The Chassis ID of the switch is 2 a The port in question is port 0 of ASIC 1 m Port 0 of ASIC 1 is Port 5 if you were to look at the switch faceplate Refer to TABLE D 1 to see the ASIC Port breakdown m The AL_PA of the device is E4 Knowing this information you can easily determine where this device is located in the SAN See TABLE D 1 TABLE D 1 ASIC and Port Values Switch Port ASIC ID Port ID 1 0 0 2 0 1 3 0 2 4 0 3 142 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 TABLE D 1 ASIC and Port Values Continued 5 1 0 6 1 1 7 1 2 8 1 3 9 2 0 10 2 a 11 2 2 12 2 3 13 3 0 14 3 1 15 3 2 16 3 3 Appendix D Converting Sun FC Switches Fibre Channel Addresses 143 144 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Acronyms amp Glossary This glossary contains definitions for terms used in this guide Acronyms AL_ PA Arbitrated Loop Physical Address 8 bit value used to identify a device E_Port An expansion or inter switch port that can be connected to an E_Port of another switch to create a cascading interswitch link ISL F_Port Ona Fibre Chann
121. switches Two of the ISL links can use long wave transceivers and cables SAN configuration restrictions lifted Meshes and other configurations are now possible Configurations support up to 239 switches Check with the vendor specific switch documentation for details Full fabric support for connections between storage devices hosts and switches Chapter 1 Introduction 3 TABLE 1 1 Feature Ports and Zones ISLs SAN 3 x Features Not Supported in SAN 4 x Configurations limited to use of Segmented Loop SL or Name Server NS port based zoning N A Nested port based zoning supported Hard zones supported SL_port connections to arrays supported N A Long wave only 1 Gbit GBICs supported for connectivity Long wave only SC SC cables supported SAN 3 x Features Included In SAN 4 x NS port based zoning supported for fabric capability Overlapping port based NS zones supported N A N A TL_port connections to the Sun StorEdge T3 and T3 arrays supported for fibre channel arbitrated loop and fabric configurations Short and long wave cables and transceivers supported N A Long wave and short wave SC cables supported Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Comparison of the SAN 3 0 and SAN 4 0 Releases Continued SAN 4 x New Features WWN based zoning supported for interoperability support among FC
122. t C shell C shell superuser Bourne shell and Korn shell Bourne shell and Korn shell superuser machine_name machine_name xii Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Product Sun StorEdge NetworkSAN 4 0 Release Related Documentation TABLE P 1 Application Documentation information Latest information Installation Configurations Safety and Compliance Installer user information 1 Gbyte switch Installer user information 2 Gbyte switch Reference information User s information Sun StorEdge SAN 4 0 Release Related Documentation Title Sun StorEdge SAN 4 0 Release Guide to Documentation Sun StorEdge SAN 4 0 Release Notes Brocade Fabric OS v 3 0 Release Notes Sun StorEdge SAN 4 0 Release Installation Guide Sun StorEdge SAN 4 0 Release Configuration Guide Sun StorEdge SAN 4 0 Release Regulatory and Safety Compliance Manual Sun StorEdge Network Switch 16 SANbox 16 with E_Ports Installer s User Manual Sun StorEdge Network Switch with E_Ports Management Manual Sun StorEdge Network FC Switch 8 and Switch 16 Release Notes Sun StorEdge Network 2Gb Switch 8 16 SANbox2 Management Manual Sun StorEdge Network 2 Gb FC Switch 16 FRU Installation Sun StorEdge Network 2Gb Switch 16 SANbox2 Installer s User s Manual Brocade Fabric OS Reference Manual Version 3 0 Brocade SilkWork 3800 Hardware Reference Guide
123. t Configuration Link initialization receiver transmitter negotiation to bring connected ports online Fabric analysis the switch checks for ports connected to other Fabric elements If there are other Fabric elements connected it identifies the master switch Address assignment once the master switch has been identified port addresses may be assigned Each switch tries to keep the same addresses that were previously used These are stored in the switch s configuration flash PROM Routing table construction after addresses are assigned the unicast routing tables are constructed 10 Enable normal port operation Note If any of the steps listed above fails replace the entire switch as a single FRU 100 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 General Troubleshooting Procedures This section lists the broad steps on how to approach a Brocade Silkworm switch problem in a SAN environment It lays out a methodical approach and lists various tools and resources available at each step It is expected that using Storage Automated Diagnostic Environment version 2 1 for monitoring will greatly reduce the time consuming process of narrowing down the problem Discover the Error m Storage Automated Diagnostic Environment version 2 1 messages and alerts mw var adm messages m Application specific errors Determine the extent of problem m cfgadm al output m luxadm e
124. ting Guide October 2002 continued from previous page Site Lab Broom Source diag229 central sun com Severity Error Actionable Category HOST Deviceld host diag229 central sun com EventType AlarmEvent M lun T300 c3t50020F23000068CCd1s2 statusA EventCode 7 5 27 EventTime 2002 07 11 10 35 08 The state of lun T300 c3t50020F23000068CCd1ls2 statusA on diag229 central sun com changed from 0 K to Missing target t3 t3 67 166 172 20 67 166 INFORMATION luxadm display reported a change in the port status of one of it s paths The agent then tries to find which enclosure this path corresponds to by reviewing it s database of T3 s and VE s luxadm display 2a00006022004188 DEVICE PROPERTIES for disk 2a00006022004188 Status Port A O K x monitoring this field Vendor SUN Product ID SESSO1 WWN Node 2a00006022004188 WWN Port A 2b00006022004188 Revision 080D Serial Num Unsupported Unformatted capacity 241724 000 MBytes Write Cache Enabled Read Cache Enabled Minimum prefetch 0x0 Maximum prefetch 0x0 Device Type Disk device Path s dev rdsk c7t2B00006022004188d0s2 devices sbus 8 0 SUNW qlc 1 30000 fp 0 0 ssd w2b00006022004188 0 c raw FIGURE B 3 Storage Automated Diagnostic Environment Alert This alert shows m Anerror on port two of switch 172 20 67 167 occurred m A Sun StorEdge Traffic Manager offline event occurred a The HBA is offline Appen
125. to focus attention on Host to Switch Switch to Switch cascaded or Switch to Storage Chapter 4 Troubleshooting Example 45 46 3 Check the array status luxadm display command output LED status Output from telnet session to the Sun StorEdge T3 array Explorer Sun StorEdge T3 array Extractor output 4 Check the Sun StorEdge 2 Gb FC switch status Storage Automated Diagnostic Environment version 2 1 device monitoring view SANbox2 Switch GUI display LED status on the Sun StorEdge 2 Gb FC switch Note You can use the Storage Automated Diagnostic Environment version 2 1 to detect user configuration errors that may not show up as hard errors anywhere else For example a user might accidentally change a switch port to a different mode TL to F or rezone a switch 5 Test the FRUs Storage Automated Diagnostic Environment version 2 1 diagnostic tests switchtest and qlctest Sun StorEdge T3 array tests OFDG 6 Verify the fix Storage Automated Diagnostic Environment version 2 1 monitoring status Storage Automated Diagnostic Environment version 2 1 diagnostic tests var adm messages log information Multipathing status returns to normal condition LED status Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Troubleshooting Example of a Host to Switch Error Determine the Error The first indication of a problem can come from a Storage Automated Diagnostic Environment version
126. u document ne peut tre reproduite sous aucune forme par quelque moyen que ce soit sans l autorisation pr alable et crite de Sun et de ses bailleurs de licence s il y en a Le logiciel d tenu par des tiers et qui comprend la technologie relative aux polices de caract res est prot g par un copyright et licenci par des fournisseurs de Sun Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie UNIX est une marque d pos e aux Etats Unis et dans d autres pays et licenci e exclusivement par X Open Company Ltd La notice suivante est applicable Netscape Communicator Copyright 1995 Netscape Communications Corporation Tous droits r serv s Sun Sun Microsystems the Sun logo AnswerBook2 docs sun com Sun StorEdge network FC switch 8 et Solaris sont des marques de fabrique ou des marques d pos es ou marques de service de Sun Microsystems Inc aux Etats Unis et dans d autres pays Toutes les marques SPAR sont utilis es sous licence et sont des marques de fabrique ou des marques d pos es de SPARC International Inc aux Etats Unis et dans d autres pays Les produits portant les marques SPARC sont bas s sur une architecture d velopp e par Sun Microsystems Inc L interface d utilisation graphique OPEN LOOK et Sun a t d velopp e par Sun Microsystems Inc pour ses utilisateurs et licenci s Sun reconna t les efforts de pionnier de Xerox pour
127. uide Sun StorEdge Traffic Manager Software Installation and Configuration Guide Storage Automated Diagnostic Environment User s Guide Version 2 1 Sun Cluster 3 0 Installation Guide VERITAS Volume Manager 3 2 Installation Guide RAID Manager 6 22 User s Guide Rackmount Placement Matrix xiv Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 Sun StorEdge SAN 4 0 Release Related Documentation Continued 816 4771 816 4773 816 4768 816 0778 816 4775 816 4769 816 4770 806 7532 806 4199 806 6991 816 2490 816 4999 816 5001 816 1420 816 5324 806 1419 875 3165 806 0478 805 4748 TABLE P 1 Sun StorEdge SAN 4 0 Release Related Documentation Continued man pages cfgadm utility cfgadm_fp 1M n a format utility format 1M n a luxadm utility luxadm 1M n a Find these documents at http www sun com products n solutions hardware docs Network_Storage_Solutions SAN index html Other Documentation Accessing Documentation Online The docs sun com web site enables you to access select Sun technical documentation on the Web You can browse the www sun com archive or search for a specific book title at http www sun com products n solutions hardware docs Network_Storage Solutions SAN index html Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions You can email your comme
128. ver the array is still using the secondary paths for the I O data stream secondary path is ONLINE primary path is STANDBY Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 3 Issue the luxadm failover primary command to the affected LUN luxadm failover primary dev rdsk c9t60020F20000003D53D349365000C1691d0s2 luxadm display dev rdsk c9t60020F20000003D53D349365000C1691d0s2 D EVICE PROPERTIES for disk dev rdsk c9t60020F20000003D53D349365000C1691d0s2 Status Port A Status Port B Vendor Product ID WWN Node WWN Port A WWN Port B Revision Serial Num Unformatted capacity Write Cache Read Cache Minimum prefetch Maximum prefetch Device Type Path s O K O K SUN T300 50020f2000000345 50020 23000003d5 50020f23000003c5 0201 Unsupported 51203 250 MBytes Enabled Enabled 0x0 0x0 Disk device dev rdsk c9t60020F20000003D53D349365000C1691d0s2 devices scsi_vhci ssd g60020f20000003d53d349365000c1691 c raw Controller Device Address Class State Controller Device Address Class State devices pci 1lf 2000 SUNW qlc 1 fp 0 0 50020 23000003d5 0 primary ONLINE devices pci 4 2000 SUNW glc 1 fpe0 0 50020 23000003c5 0 secondary STANDBY The luxadm failover primary command causes the I O data stream to resume to the primary path and the system returns to full operational mode Chapter 4 Troubleshooting Examp
129. ver ulpl 4 hard 3 vol2 u2 failover ulpl 4 hard 5 vol2 u2 failover u2pl 5 hard 0 voll u2 failover u2pl 5 hard 1 voll u2 failover u2pl 5 hard 4 voll u2 failover u2pl 5 hard 2 vol2 u2 primary u2pl D hard 3 vol2 u2 primary u2pl 5 hard 5 vol2 u2 primary These command outputs indicate that both controllers are active u2 owns all the LUNs and WWN 50020 23000003d5 corresponds to the WWN of the Master Controller This confirms that the problem is most likely not with the Sun StorEdge T3 arrays Thus there is probably an upstream path problem Chapter 4 Troubleshooting Example 55 Check the Switch Status View the Monitor Device display of the Storage Automated Diagnostic Environment as shown in FIGURE 4 3 Protect Sahas i i Saji arinez Flasher Shall iaia ag oy j THEN man 1 i aa ie Board SEpersue 5 CENL apia amar rely 1 old Fan Fi ET agite E JEEE i Far ad iles saut el Power supa nes diag hast Far Power euch ar Sites ageet mema lint t Tr a T wage ab i al he ad i olf LARC ding areni x L 1 REG ATI ages San E HORN F TLN HAN Im E Fmt MENATA Ee MONT LAE HOAT ARACH i LENAT Lios the Tiimi ied io seith large ER of irarri T t AGAN Pame Santh Sprie Enter ree cor ai etes the care eTe t E Em Gta trans BOGS is 15 ad iagi fost igri He RE cs drs an a ae a FIGURE 4 3 Troubleshooting Example View 3 F
130. witches support Java enabled Webtools Brocade Webtools is a GUI that provides management capabilities such as maintaining zones setting port attributes and setting up cascaded switches a cfgadm plug in for Fabric on demand node creation This component is delivered with the Solaris upgrades for the FC switch product It is used to discover SAN attached devices in addition to creating and deleting nodes for these devices These features are implemented through the cfgadm framework See the cfgadm_fp 1M man page for additional information m luxadm and libg_fc liba5k These components are enhanced to support the SAN attached devices They provide persistent switch attached device configuration across reboots probe SAN attached devices that are available on a host and provide information on various devices 66 Sun StorEdge SAN 4 0 Release Field Troubleshooting Guide October 2002 m Storage Automated Diagnostic Environment version 2 1 The Storage Automated Diagnostic Environment version 2 1 is a separately installed software product It is a lightweight remote monitoring agent designed to track storage product reliability availability and serviceability The Storage Automated Diagnostic Environment version 2 1 also provides revision and patch level checking log file monitoring and diagnostic testing Downloading Patches and Packages You can download the required software components from the following web sites listed in TAB
131. y TABLE 2 5 Supported Features of the Sun StorEdge T3 Array Feature Supported Cascading Yes Zone Type Name Server zone Maximum number of arrays per SL zone 8 Maximum initiators per LUN 2 Maximum initiators per zone 22 1 The host must be connected to the F_Port on the switch a Sun StorEdge T3 array must be connected to the TL port of the switch 2 This implies 2 initiators 2 hosts for simple arrays T3WG but 4 initiators 2 hosts for a partner pair T3ES Each host has one path to each of the Sun StorEdge T3 arrays in the partner pair Host Bus Adapters TABLE 2 6 Sun StorEdge SAN 4 0 Release HBA Compatibility Matrix FW Code Levels for HBAs and I O Boards Version X6757A Sun StorEdge SBus Dual Fibre Channel Host Bus Adapter 1 13 06 or higher X6799A Sun StorEdge PCI Single Fibre Channel Network Adapter 1 13 or higher X6727A Sun StorEdge PCI Dual Fibre Channel Network Adapter 1 13 or higher X6767A Sun StorEdge 2G FC PCI Single Channel Network Adapter 1 13 08 or higher X6768A Sun StorEdge 2G FC PCI Dual Channel Network Adapter 1 13 08 or higher X6748A Sun StorEdge cPCI Dual Fibre Channel Network Adapter 1 13 or higher Chapter 2 Configurations 15 Software Packages and Patches You can download software packages or patches with the following procedures Y To generate the most recent patch list for a Sun Solaris Release 1 Access the SunSolve web site http sunsolve Sun COM The SUNSOLVE ONLINE menu is

Download Pdf Manuals

Related Search

Related Contents

Monacor MCC-122/SW  BD_BOX manual, version 2.2, Rigid  Dicota Reclaim 10-11.6  Swann DVR4-2550  Grass Valley Indigo Quick Start Guide  User Manual 取扱説明書 Installation Manual 設置要領書 （保証書付）  Traduzione delle istruzioni per l`uso originali  MATHERS CONTROLS INC.    Ecomectin ® 0,5 % Solution cutanée pour bovins  

Copyright © All rights reserved. Failed to retrieve file