Home

Emulex Drivers for Solaris User Manual

1. ACTION No action needed informational 0721 NOTICE NPIV Link up VERBOSE_MASK LOG_LINK 0x00000080 ESCRIPTION This indicates that the Fibre Channel link is up for ll virtual ports D a SEVERITY LEVEL Notice MESSAGE NPIV Link up ACTION No action needed informational 0730 NOTICE Link reset VERBOSE_MASK LOG_LINK 0x00000080 or LOG_SFS 0x00002000 ESCRIPTION This indicates that an issue has forced the Fibre hannel link to be reset DI C SEVERITY LEVEL Notice MESSAGE Link reset ACTION No action needed informational 0731 ERROR Link reset failed VERBOSE MASK LOG_LINK 0x00000080 or LOG_SFS 0x00002000 ESCRIPTION This indicates that an attempt to reset the Fibr hannel link has failed DI G SEVERITY LEVEL Error MESSAGE Link reset failed ACTION No action needed informational However if the problem persists report this error to your customer service representative ELS Events Message IDs 0800 0899 0800 DEBUG ELS sent VERBOSE_MASK LOG_ELS 0x00000100 DESCRIPTION This indicates that an ELS command is being sent SEVERITY LEVEL Debug Emulex Drivers for Solaris User Manua P008022 01A Rev A gt G EMULEX Emulex Drivers for Solaris User Manua MESSAGE ELS sent ACTION
2. D T SE M F SSAGE Unsolicited CT dropped ACTION No action needed informational 1622 DEBUG CT reply VE RBOSE _MASK LOG_CT 0x00010000 ESCRIP nsolicited CT command TION This indicates that a reply is being sent for an VERIT Y LEVEL Debug F D u SE M SSAGE CT reply ACTION No action needed informational 1630 ERROR Invalid CT command found VE RBOSE _MASK LOG_CT 0x00010000 ESCRI nvalid command code PTION This indicates that a CT command was found with an VERITY LEVEL Error D i SE M ESSAGE Invalid CT command found ACTION persis No action needed informational However if the problem ts report this error to your customer service representative Fibre Channel Security Protocol FCSP Events Message IDs 1700 1799 1700 DEBUG FCSP VERBOSE_MASK LOG_FCSP 0x00020000 DESCRIPTION This provides general information about the driver s FCSP interface SEVERITY LEVEL Debug MESSAGE FCSP ACTION No action needed informational Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 1701 DEBUG FCSP detail VERBOSE_MASK ESCRIPTION P interface D F SEVERITY LEV MESSAGE FCS ACTION No action needed EL Debug P detail
3. ACTION No action needed informational 0510 DEBUG Stray mailbox interrupt VERBOSE_MASK LOG_MBOX 0x00000020 ESCRIPTION This indicates that a mailbox command completion nterrupt was received and the mailbox is not valid This error EVERITY LEVEL Debug ESSAGE ACTION N persists D i could indicate a driver or firmware problem S M Stray mailbox interrupt o action needed informational However if the problem report this error to your customer service representative 0520 DEBUG Mailbox error VERBOSE_MASK LOG_MBOX 0x00000020 ESCRIPTION This indicates that an unsupported or illegal mailbox ommand was completed This error could indicate a driver or EVERITY LEVEL Debug D 6 firmware problem 9 M ESSAGE Mailbox error ACTION persists No action needed informational However if the problem report this error to your customer service representative 0530 ERROR Mailbox timeout VERBOS F_MASK LOG_MBOX 0x00000020 ESCRI PTION The firmware did not response a mailbox command This rror could indicate a hardware or firmware problem ESSAG P D e SEVERITY LEVEL Error M Mailbox timeout ACTION persis ts No action needed informational However if the problem report this error to your customer ser
4. Table 4 1 FC FCoE Configuration File Parameters Parameter Description Activation ack0 Indicates whether the adapter tries uses ACKO for Class 2 Adapter e 0 The adapter only uses ACK1 when running Class 2 traffic reset default e 1 The adapter attempts to use ACKO when running Class 2 traffic to a device If the device does not support ACKO then the adapter uses ACK1 adisc support _ Sets the driver level support for the FC ADISC login I O recovery Dynamic method e 0 No support Flushes active I Os for all FCP target devices at link down e 1 Partial support Flushes I Os for non FCP2 target devices at link down e 2 Full support Holds active I Os for all devices at link down assign alpa Note This property is only applicable if the topology is set to loop Link reset If multiple adapter instances on the same host are on the same loop set this property differently for each adapter Possible values are 0x00 0x0ef A 0x00 setting default means no preference console errors_ Verbose mask for driver error messages to the console Possible Dynamic values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 console notices Verbose mask for driver notice messages to the console Possible Dynamic values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 console Verbose mask for driver warning messages to the console Possible Dynamic warnings values are 0x0000000 OxFFFFFFFF The
5. 1702 DEBUG FCSP error LOG_FCSP VERBOSE_MASK ESCRIPTION DFC request D a SEVERITY LEV MESSAGE FCS ACTION No action needed EL Debug P error 1705 DEBUG FCSP state LOG_FCSP VERBOSE_MASK DESCRIPTION changing SEVERITY L MESSAGE FCS ACTION No action needed EVEL Debug P state 1706 DEBUG FCSP event LOG_FCSP VERBOS ESCRI FE MASK PTION ccurred ERITY L FCS EV EVEL Debug ESSAGE D o S M P event ACTION No action needed 1707 DEBUG FCSP status LOG_FCSP ERBOS ESCRI E MASK PTION ERITY LEVEL Debug ESSAGE FCS P status ACTION No action needed 1710 DEBUG FCSP start LOG_FCSP ERBOS ESCRI specific ERITY L V E MASK PTION node D a S EV EVEL Debug Emulex Drivers for Solaris User Manua LOG_FCSP_DETAIL This provides detailed information about the driver s 59 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 0x01000000 informational 0x00020000 This indicates that an error was found while processing informational 0x00020000 This indicates that an authentication state is informational 0x00020000 This indicates that an authentication event has informational 0x000200
6. Description Sets the virtual port s behavior when discovering targets in the SAN e 1 Prevents the VPort from logging into other initiator ports on the SAN Also rejects logins from other ports in the SAN because it assumes that all ports that send a PLOGI are initiators This is the default value e 0 The driver attempts to login to every port that it can access in the SAN and accept logins from all ports Note In a SAN that has other initiators this parameter greatly reduces the driver s use of hardware resources Activation Link reset P008022 01A Rev A 5 NIC Driver Configuration 19 gt EMULEX Using the NIC Configuration File elxnic conf 5 NIC Driver Configuration In Solaris 10 the driver exports certain parameters that can be configured by editing the Emulex NIC out of box driver for Solaris configuration file elxnic conf In Solaris 11 while you can configure the driver using the elxnic conf file Emulex recommends using the dladm utility available by default on Solaris 11 systems For more information on using this Solaris NIC configuration utility see the dladm 1M man page Using the NIC Configuration File elxnic conf If the elxnic conf file is not present you can download it from the Downloads section of the Emulex website Changing Driver Parameters The configurable driver parameters are described in Table 5 1 NIC Configuration File Parameters on page 19 To edit the elxn
7. Verbose mask for driver notice messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF log errors Verbose mask for driver warning messages to the messages file Possible values are 0x0000000 OxF FFFFFFF The default value is OxFFFFFFFF Emulex Drivers for Solaris User Manual log verbose when set to non zero verbose messages are generated Default Disabled P008022 01A Rev A gt EMULEX Log Message Overview 6 FC FCoE Driver Console and Log Messages Log Message Overview Types of Log Messages Logged in the System File Log messages are logged to the var adm messages system file Table 6 2 lists the types of log messages that can be logged to the system file Table 6 2 Log Message Types for the FC FCoE Driver Verbose Bit Log Message Verbose Mask Verbose Description Pages 0x00000001 LOG_MISC Miscellaneous events 31 32 0x00000002 LOG_DRIVER Driver attach and detach events 32 34 0x00000004 LOG_INIT HBA initialization events 34 35 0x00000008 LOG_MEM Memory management events 36 37 0x00000010 LOG_SLI Service Level Interface SLI events 37 41 0x00000020 LOG_MBOX Mailbox events 41 42 0x00000040 LOG_NODE Node events 43 44 0x00000080 LOG_LINK Link events 44 45 0x00000100 LOG_ELS ELS events 45 47 0x00000200 LOG_PKT General I O packet events 47 49 0x00000400 LOG_FCP FC
8. S M PTION This indicates that an FCF object state is changing TY LEVEL Debug ERBOSE_MASK ESCRI EVERI ESSAGE FCF state ACTION No action needed informational Emulex Drivers for Solaris User Manual P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 61 SC EMULEX Log Messages for the FC FCoE Driver 1830 DEBUG FCF event VERBOSE_MASK DESCRIPTION This indicates that an FCF event has occurred SEVERITY LEVEL Debug MESSAGE FCF event ACTION No action needed informational Emulex Drivers for Solaris User Manual P008022 01A Rev A gt EMULEX 7 NIC Driver Log Messages 62 Setting MOD_MASK and SEVERITY 7 NIC Driver Log Messages This section describes the log messages you may see from the NIC driver Note To reset the adapter reboot the system or on DR capable SPARC machines use the Solaris cfgadm command for configuring system devices Setting MOD MASK and SEVERITY Log messages are generated based on the settings of the Module Mask MOD_MASk and the Severity Level SEVERITY as indicated in the log_level parameter See the log_level parameter in Table 5 1 NIC Configuration File Parameters on page 19 Table 7 1 details the values and meanings of MOD_MASK in the log_level parameter Table 7 1 MOD_MASK Information for NIC Driver Log Messages Name MOD_ MASK Meaning MOD_CONFIG 0x10000 Mess
9. This is usually caused by an adapter ACTION Contact your customer servic Emulex Drivers for Solaris User Manual presentative P008022 01A Rev A gt EMULEX 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 54 IOCTL Events Message IDs 1400 1499 1400 DEBUG ERBOSE_MASK ESCRIPTION OCTL interface EVERITY L ESSAG IOCTL ACTION No action needed IOCTL LOG_IOCTL V EV EL Debug pP D T S M IOCTL detail LOG_IOCTL_D 1401 DEBUG ERBOSE_MASK ESCRIPTION OCTL interface EVERITY L ESSAG IOCTL detail ACTION No action needed V EV BL Debug D I S M Poe 1410 DEBUG DFC E MASK PTION terface ERBOS ESCRI LOG_IOCTL EV EV EL Debug ERITY L ESSAGE DFC ACTION No action needed 1411 DEBUG DFC detail ETAIL 0x00004000 This provides general information about the driver s informational 0x04000000 This provides detailed information about the driver s informational 0x00004000 This provides general information about the driver s informational ETAIL 0x04000000 ERBOSE_ MASK PTION terface LOG_IOCTL_D TY LEV EL ERI Debug ESSAG DFC detail ACTION No action needed F 1420 DEBUG DFC Error L
10. informational FCP Target Mode Events Message IDs 1100 1199 1100 DEBUG FCT detail VERBOSE_MASK LOG_FCT_DETAIL 0x00800000 ESCRIPTION This provides detailed information about the driver s terface D F SEVERITY LEVEL Debug MESSAGE FCT detail ACTION No action needed informational 1110 DEBUG FCT debug VERBOS E_ MASK LOG_FCT 0x00000800 ESCRI PTION This provides general information about the driver s terface TY LEVEL Debug D EF SEVERI MESSAG E FCT debug ACTION No action needed informational 1120 DEBUG FCT error VERBOS E_ MASK LOG_FCT 0x00000800 ESCRI PTION This indicates that a general error has occurred in the s FCT interface EVERI TY LEVEL Debug D driver S M ESSAG ER FCT error ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 1130 DEBUG FCT API VERBOS FE MASK ESCRI nterf PTION This provides an API trace with the driver s FCT ace TY LEVEL Debug D a SEVERI MESSAG BE FCT API ACTION Emulex Drivers for Solaris U No action needed informational ser Manual P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages 5 Log Messages fo
11. issuing acquit MOD_CONFIG CE_WARN Config vlan failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Failed to Setup handlers Emulex Drivers for Solaris User Manual Reload the driver MOD_CONFIG P008022 01A Rev A CE_WARN 7 NIC Driver Log Messages Log Messages for the NIC Driver SXC EMULEX 67 Table 7 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Recommended Action MOD_MASK Severity Hardware UE Detected Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to retrieve intr types Unload and then reload the driver MOD_CONFIG CE_WARN MSIX not supported The system continues to work with MOD_CONFIG CE_WARN INTX Could not get supported intrs Reload the driver MOD_CONFIG CE_WARN Alloc intr failed Reload the driver MOD_CONFIG CE_WARN Unable to get intr priority Reload the driver MOD_CONFIG CE_WARN Failed to add interrupt Reload the driver MOD_CONFIG CE_WARN handler Int
12. peration D fe SEVERITY LEVEL Notice M ESSAGE Driver detach ACTION No action needed informational 0111 ERROR Driver detach failed VERBOSE _MASK LOG DRIVER 0x00000002 o some issue D t SEVERITY LEVEL Error M ESSAGE Driver detach failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative 0112 DEBUG Driver detach R 0x00000002 Gl VERBOSE_MASK LOG_DRIV D operation SEVERITY LEVEL Debug M ESSAGE Driver detach ACTION No action needed informational 0120 DEBUG Driver suspend R 0x00000002 BI VERBOSE_MASK LOG_DRIV D operation SEVERITY LEVEL Debug M ESSAGE Driver suspend ACTION No action needed informational ESCRIPTION This indicates that the driver is performing a attach ESCRIPTION This indicates that the driver is performing a detach ESCRIPTION This indicates that the driver was unable to detach due ESCRIPTION This indicates that the driver is performing a detach ESCRIPTION This indicates that the driver is performing a suspend P008022 01A Rev A 33 gt G EMULEX 0121 ERROR Driver suspend failed R 0x00000002 CJ VERBOSE_MASK DESCRIPTION due to some issue S M LOG
13. rss_key_static Enables static RSS key generation The possible values are 0 disabled or 1 enabled The default value is 0 rx_bcopy_limit Sets the receive buffer size threshold to use the copy mode The possible values are any values that are less than or equal to the default_mtu value The default value is 128 Note On Solaris 11 consider changing this value to fine tune the receive performance Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 5 NIC Driver Configuration 21 Using the NIC Configuration File elxnic conf Table 5 1 NIC Configuration File Parameters Continued Parameter rx_frag_size Definition Sets the size of the pre allocated receive buffer A higher value results in better resource utilization The possible values are 2048 4096 and 8192 The default value is 2048 Note On Solaris 10 consider changing the value to 4096 or 8192 if the default_mtu value is 9000 rx_max_bufs Sets the maximum number of pre allocated receive buffers The possible values are 1024 8192 The default value is 2048 Note On Solaris 10 consider increasing the rx_max_bufs value if the rx_drops_no_frags_q x increments continuously in the kstat output rx_rings Sets the maximum number of receive queues Possible values are e 1to 5 OCe10102 and OCe11102 The default value is 5 e 1to 16 OCe11102 native mode on Solaris 10 The default value is 8 e 1to 8 OCe11102 nat
14. 0x00000004 ESCRIPTION dapter has failed D a SEVERITY LEVEL M LOG_INIT Error ESSAGE Adapter initialization failed ACTION Check your hardware configuration This indicates that the adapter is initializing This indicates that an attempt to initialize the If the problem persists report this error to your customer servic Emulex Drivers for Solaris User Manual representative P008022 01A Rev A gt G EMULEX 0202 DEBUG Adapter initialization 0x00000004 V D ERBOS ESCRI SEVERI MESSAGE ACTION No action needed FE MASK PTION TY L LOG_INIT EV MEA Debug Adapter initialization 0210 DEBUG Adapter transition 0x00000004 V D ERBOS ESCRI SEVERI MESSAGE ACTION No action needed E MASK PTION TY E LOG_INIT EV EL Debug Adapter transition 0220 DEBUG Adapter online 0x00000004 VERBOSE_MASK ESCRIPTION ommunicate EVERITY L ESSAGE ACTION No action needed LOG_INIT EV EL Debug D c S M Adapter online 0230 DEBUG Adapter offline 0x00000004 VERBOSE_MASK ESCRIPTION o communica EVERITY L ESSAGE ACTION No action needed LOG_INIT Ce EVEL Debug D t S M Adapter offline 0231 WARNING
15. 8 Gb s adapter or a 16 Gb s adapter using 8 Gb s optics verify it is not attempting to connect to a 1 Gb s device Only 2 Gb s 4 Gb s and 8 Gb s devices are supported on these adapters e Fora16 Gb s adapter using 16 Gb s optics verify it is not attempting to connect to a 1 Gb s device or 2 Gb s device Only 4 Gb s 8 Gb s and 16 Gb s devices are supported on this adapter Setting Notices Warning and Error Logging Levels Table 6 1 lists the types of notices warnings and error logging levels you may set using the appropriate FC FCoE driver parameters Table 6 1 Setting Types of Console and Log Messages for the FC FCoE Driver elxfc Parameter console notices Description Verbose mask for driver error messages to the console Possible values are 0x0000000 OxF FFFFFFF The default value is 0x0000000 console warnings Verbose mask for driver notice messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 console errors Verbose mask for driver warning messages to the console Possible values are 0x0000000 0xFFFFFFFF The default value is 0x0000000 Ipfc Parameter log only when set to 0 log messages are logged to the system log file and also printed on the console Default Disabled log notices Verbose mask for driver error messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF log warnings
16. Adapter shutdown 0x00000004 V LOG_INIT ERBOSE_MASK ESCRIPTION ill require a reboot to reinitialize EVERITY L ESSAGE EV EL Warning D wW S M Adapter shutdown This indicates that the adapter is 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 35 initializing informational This indicates that the adapter is changing states informational This indicates that the adapter is online and ready to informational This indicates that the adapter is offline and unable informational This indicates that the adapter has been shutdown and representative ACTION Contact your customer servic 0240 ERROR Adapter reset failed VERBOSE_MASK LOG_INIT 0x00000004 DESCRIPTION failed SEVERITY LEVEL Error MESSAGE Adapter reset failed Emulex Drivers for Solaris User Manual This indicates that an attempt to reset the adapter has P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 36 gt EMULEX Log Messages for the FC FCoE Driver ACTION Check your hardware configuration If the problem persists report this error to your customer service representative Memory Management Events Message IDs 0300 0399 0300 DEBUG Memory alloc VERBOSE_MASK LOG_MEM 0x00000008 DESCRIPTION This indicates that the driver allocated system memory
17. Information for NIC Driver Log MessageS seeeeeeeeeeeaee 62 Severity Level Information for NIC Driver Log Messages c eeeeeeee ees 62 Log Messages for the NIC Driver for Solaris 10 ccccsceseeeeseeeeeeeeenenne es 63 Log Messages for the NIC Driver for Solaris 11 ccccccceeceeeeeeeeeeeeeeeene ees 65 P008022 01A Rev A List of Tables 6 SC EMULEX 1 Introduction 7 Prerequisites 1 Introduction This document provides information for using the Emulex Fibre Channel FC and Fibre Channel over Ethernet FCoE out of box drivers for Solaris StorEdge SAN Foundation Software SFS which is part of the SFS Leadville stack The module name for this FC FCoE driver is elxfc This document also provides information for using the Emulex network interface card NIC out of box driver for Solaris which operates the NIC function of the Emulex OneConnect universal converged network adapter UCNA The module name for this NIC driver is elxnic Prerequisites Audience You should be familiar with Solaris and have access to standard system information before installing or using this driver For the FC FCoE driver familiarity with Oracle Storage SFS and FC and FCoE is essential For the NIC driver familiarity with the Emulex OneConnect UCNA and Ethernet networking is essential Supported Operating Systems One of the following operating systems must be installed e Solaris 10 SPARC e
18. Link Up atten ACTION No action needed informational 0413 DEBUG Link Down atten VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that the adapter has triggered a link EVERITY LEVEL Debug D down attention interrupt S M ESSAGE Link Down atten ACTION No action needed informational 0420 ERROR Adapter hardware error V ERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that an interrupt has occurred and the tatus register indicates a nonrecoverable hardware error EVERITY LEVEL Error D S S M ESSAGE Adapter hardware error ACTION This error usually indicates a hardware problem with the adapter Try running adapter diagnostics Report these errors to customer service 0421 NOTICE Adapter temperature V ERBOSE_MASK LOG_SLI 0x00000010 D ai S M ESCRIPTION This indicates that the adapter has provided general nformation about the adapter s temperatur EVERITY LEVEL Notice ESSAGE Adapter temperatur Emulex Drivers for Solaris User Manual P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 39 gt EMULEX Log Messages for the FC FCoE Driver ACTION No action needed informational 0422 WARNING Adapter temperature VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This indicates that the adapter s temperatu
19. Link reset Virtual port registration table The enable npiv must be set to 1 The virtual port registration table may have any number of comma delimited entries Each entry must be of the form PHYS_WWPN VPORT_WWNN VPORT_WWPN VPORT_ID Where e PHYS WWPN World Wide Port Name of adapter s physical port e VPORT_WWNN Desired World Wide Node Name of virtual port e VPORT_WWPN Desired World Wide Port Name of virtual port e VPORT_ID Desired virtual port ID 1 to maximum vports For entries with the same PHYS WWPN VPORT_WWNN and VPORT_WWPN the VPORT_ID must start at 1 and increment by one sequentially without gaps in the number sequence The VPORT_ID 0 is reserved for the physical port For example vport 10000000cC9123456 10000000c9123456 10000000cC9123457 10000000c9123457 10000000c9123457 Emulex Drivers for Solaris User Manual 28010000c9123456 28020000cC9123456 28010000c9123457 28020000c9123457 28030000c9123457 20010000c9123456 20020000c9123456 20010000cC9123457 20020000c9123457 20030000c9123457 All entries are automatically created or removed by the OneCommand Manager application 1 220 1 20 3 P008022 01A Rev A gt EMULEX 4 FC FCoE Driver Configuration 18 FC FCoE Configuration File Parameters Table 4 1 FC FCoE Configuration File Parameters Continued Parameter vport restrict login Emulex Drivers for Solaris User Manual
20. No action needed informational 0801 DEBUG ELS comp VERBOSE_MASK LOG_ELS 0x00000100 SEVERITY LEVEL Debug MESSAGE ELS comp ACTION No action needed informational 0810 ERROR Stray ELS completion VERBOSE_MASK LOG_ELS 0x00000100 EVERITY LEVEL Error D a could indicate a driver or firmware problem S M ESSAGE Stray ELS completion 6 FC FCoE Driver Console and Log Messages 46 Log Messages for the FC FCoE Driver DESCRIPTION This indicates that an ELS command completed normally ESCRIPTION This indicates that an ELS command completion was eceived without issuing a corresponding ELS command This error ACTION No action needed informational However if the problem persists report this error to your customer servic 0811 DEBUG Abnormal ELS completion VERBOSE_MASK LOG_ELS 0x00000100 EVERITY LEVEL Debug ESSAGE Abnormal ELS completion D s t FCP target The driver will automatically S M representative ESCRIPTION This indicates that an ELS command completed with a tatus error in the IOCB It could mean the Fibre Channel device on he network is not responding or the Fibre Channel device is not an ACTION retry this ELS command if needed If the command is a PLOGI or PRLI and the destination PortID is not an FCP Target no action
21. a maximum of 31 vectors By default each function has a maximum of two message signaled interrupts extended MSI X vectors For example with three OCe11102 adapters in FLEX10 mode there are 24 functions and the driver needs at least two vectors per function for a total of 48 vectors If the MSI X allocation fails the driver reverts to the PCIe legacy interrupts INTx allocation which results in suboptimal performance Normally the network drivers allocate vectors at level 6 but the requirement of 48 vectors is beyond the limit of 31 which causes issues A solution is to assign level 6 to 12 functions and level 5 to the remaining functions so that all functions can get two MSI X vectors for optimum performance It is not uncommon to assign level 5 or 6 on Solaris under these conditions The following example shows how the interrupt priority for a PCI function can be configured to a level 5 1 Type grep elxnic etc path_to_inst pci 0 0 pci8086 340d 6 pcil0df e743 0 0 elxnic pci 0 0 pci8086 340d 6 pcil0df e743 0 1 1 elxnic pci 0 0 pci8086 3410 9 pcil0df e742 0 2 elxnic pci 0 0 pci8086 3410 9 pcil0df e742 0 1 3 elxnic grep elxnic etc driver_aliases elxnic pciex19a2 710 Emulex Drivers for Solaris User Manual P008022 01A Rev A 5 NIC Driver Configuration 25 DC EMULEX Using the dladm Utility for Solaris 11 Note In the previous example pci n n pcinnnn nnnd
22. adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN POST ERROR Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN HW POST1 FAILED Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Failed to allocate bmbx Reload the driver MOD_CONFIG CE_WARN FUNCTION RESET FAILED Emulex Drivers for Solaris User Manual Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG P008022 01A Rev A CE_WARN 7 NIC Driver Log Messages Log Messages for the NIC Driver SC EMULEX 66 Table 7 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Mailbox initialization failed with lt ret code gt Recommended Action Check for the faulty hardware using fmadm faulty If the hardware is
23. are e 0 Flow control disabled e 1 Transmit only e 2 Receive only e 3 Both transmit and receive default Flow control cannot be disabled on NIC FCoE UNCAS fm_capability Sets the driver s device fault management capability to one of the values defined for Solaris fault management capability The fm_capability value is a bitmap of one or more of these values e 0x00000000 DDI_FM_NOT_CAPABLE A value of zero indicates that the fm_capability is disabled 0x00000001 DDI_FM_EREPORT_CAPABLE 0x00000002 DDI_FM_ACCCHK_CAPABLE 0x00000004 DDI_FM_DMA_CHK_CAPABLE The default value is 0x00000007 DDI_FM_ACCCHK_CAPABLE DDI_FM_ACCCHK_CAPABLE and DDI_FM_DMA_CHK_CAPABLE log_level Sets the driver s verbosity for logs in var adm messages The log_level parameter is comprised of MOD_MASK upper 16 bits and SEVERITY lower 16 bits The MOD_MASK value is a bitmap of one or more of these values e 0x10000 MOD_CONFIG 0x20000 MOD_TX 0x40000 MOD_RX 0x80000 MOD_ISR The possible values for SEVERITY e 0x0 CE_CONT 0x1 CE_NOTE 0x2 CE_WARN 0x3 CE_PANIC 0x4 CE_IGNORE For details on MOD_MASK and SEVERITY see Setting MOD_MASK and SEVERITY on page 62 max_tx_rings Sets the maximum number of transmit queues The possible values are e 1 for 0Ce10102 e 1to 8 for OCe11102 on Solaris 10 The default value is 2 e 1to 16 for OCe11102 on Solaris 11 The default value is 8
24. default value is 0x0000000 cr count Specifies a count of I O completions after an interrupt response is Link reset generated The possible values are 1 255 The default value is 1 Note This property is disabled if cr delay 0 cr delay Specifies a count of milliseconds after which an interrupt response is Link reset generated if cr count has not been satisfied Possible values are 0 63 The default value is 0 Note When cr delay 0 the Coalesce Response parameter cr_count is disabled enable auth DHCHAP support in the driver Link reset e 0 Disabled default e 1 Enabled enable npiv NPIV support in the driver Adapter 0 Disabled remove all vports first reset e 1 Enabled requires SLI 3 and later Emulex Drivers for Solaris User Manual P008022 01A Rev A gt EMULEX 4 FC FCoE Driver Configuration 16 FC FCoE Configuration File Parameters Table 4 1 FC FCoE Configuration File Parameters Continued Parameter fct queue depth Description Queue depth of target mode port Possible values are 0 4096 When set to 0 it indicates that the maximum is determined by the type of HBA Activation Reboot link speed Sets the link speed for initializing the FC connection e 0 auto detect e 2 2 Gb s 4 4Gb s 8 8 Gb s e 16 16 Gb s Link reset linkup delay Sets the driver wait period seconds for a link up after adapter initialization Possible values are 0 60 The defau
25. eee eee eee ees 32 HBA Initialization Events Message IDs 0200 0299 cccccce ects cnet eect ee n 34 Memory Management Events Message IDs 0300 0399 cccccecee eset ee eeeeeeee ees 36 Service Level Interface Events Message IDs 0400 0499 eee eee eee 37 Mailbox Events Message IDs 0500 0599 ccc cee eee e cette eee eee teat eae 41 Node Events Message IDs 0600 0699 00 c cece eee een ees 43 Link Events Message IDs 0700 0799 e ccc eecec eee eee eee eee teens teeta 44 ELS Events Message IDs 0800 0899 cc ic isecctiwiicneaetaaiadennediwitesacandacdanegelialans 45 General I O Packet Events Message IDs 0900 0999 cece cece ete 47 FCP Traffic Events Message IDs 1000 1099 cc cece cece eee teense teat ene es 49 FCP Target Mode Events Message IDs 1100 1199 0 cece cece eee eee eee ees 50 IP Traffic Events Message IDs 1200 1299 ccccceec cece cents eee ee eee tenet en enn ees 51 Solaris SFS Events Message IDs 1300 1399 cc cece eect eee e ee eeeeeeeeeeenet enna 52 IOCTL Events Message IDs 1400 1499 ssssesssseeesrirrrirrrrrrrinnn nnrir eee teens 54 Firmware Download Events Message IDs 1500 1599 cece eect ees 55 Emulex Drivers for Solaris User Manual P008022 01A Rev A DE EMULEX Table of Contents 5 Common Transport Events Message IDs 1600 1699 cece eect es 57 Fibre Channel Security Proto
26. heck your network connections eturn a positive result This could indicate a connectivity problem If the problem persists report this error to your system administrator 1313 DEBUG BIU diagnostic completed VERBOSE_MASK LOG_SFS 0x00002000 DESCRIPTION SEVERITY LEVEL Debug MESSAGE BIU diagnostic completed ACTION No action needed informational 1314 ERROR BIU diagnostic failed This indicates that a BIU diagnostic has completed This indicates that a BIU diagnostic has failed to return a positive result This usually caused by an adapter hardware VERBOSE_MASK LOG_SFS 0x00002000 DESCRIPTION problem SEVERITY LEVEL Error MESSAGE BIU diagnostic failed ACTION Co r ntact your customer servic 1315 DEBUG POST diagnostic completed EF MASK LOG_SFS 0x00002000 PTION This indicates that a POST EVEL VERBOS DESCRI SEVERI MESSAGE ACTION No action needed TY E Debug POST diagnostic completed 1316 ERROR POST diagnostic failed LOG_SFS 0x00002000 This indicates that a POST VERBOS DESCRI return a positive result hardware problem 9 M E MASK PTION EVERITY LEVEL WEOE ESSAGE POST diagnostic failed presentative diagnostic has completed informational diagnostic has failed to
27. image to the adapter and reboot and or replace the adapter RQ create failed lt code gt Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter Emulex Drivers for Solaris User Manual P008022 01A Rev A 64 7 NIC Driver Log Messages Log Messages for the NIC Driver SC EMULEX 65 For Solaris 11 The following table details the log messages provided by the NIC driver for Solaris 11 operating systems Table 7 4 Log Messages for the NIC Driver for Solaris 11 Log Message Ring buffer allocation failed lt code gt Recommended Action Configure the server with more memory MOD_MASK MOD_CONFIG Severity CE_WARN mcast ADD DEL failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Could not retrieve num_bars Reset the adapter MOD_CONFIG CE_WARN Could not get size of bar Reset the adapter MOD_CONFIG CE_WARN Could not map bar Reset the adapter MOD_CONFIG CE_WARN soft_reset bit asserted 1 Reset failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the
28. n represents the parent of the PCI function the unit number follows the last symbol and pciexnnan nnn indicates the device name 2 Add the following entry to kernel drv elxnic conf name pciex19a2 710 parent pci 0 0 pci8086 3410 09 unit address 0 interrupt priorities 5 Note The path and unit number may vary on your system 3 Reboot the system Interrupt priorities can be examined using the mdb command For example echo interrupts mdb k grep oce The third column shows the interrupt priority level of the vector in the following output IRQ Vect IPL Bus Trg Type CPU Share APIC INT ISR s 64 0x42 5 Edg MSI X 3 I oce_isr 65 0x43 5 Edg MSI X 0 1 oce_isr Using the dladm Utility for Solaris 11 Configuring the NIC Interface Using dladm To configure the interface on Solaris 11 Use the dladm utility to configure the NIC interface and also perform a runtime update of the following driver parameter For example to change the MTU in Solaris 11 unplumb the interface and run gt dladm set linkprop p mtu 9000 lt interface gt where lt interface gt is net lt 0 1 2 gt To see the plumbed interfaces run gt ifconfig a Tunable Parameters Tunable parameters can be changed during runtime On Solaris 10 the ndd command can be used to change the value of tunable parameters On Solaris 11 these values can be changed using the dladm command The para
29. the system and the NIC interface is created with one of the following commands dladm show dev Solaris 10 driver dladm show phys Solaris 11 driver Once you have determined that the NIC interface has been created you can proceed to configure it To configure the NIC interface s 1 Plumb the interface ifconfig elxnic lt X gt plumb Solaris 10 driver Emulex Drivers for Solaris User Manual P008022 01A Rev A 5 NIC Driver Configuration 22 DC EMULEX Using the NIC Configuration File elxnic conf ifconfig net lt X gt plumb Solaris 11 driver Where lt X gt is the interface number To see the interfaces created run dladm show link This command lists all the interfaces in the system 2 Assign a static IP address ifconfig elxnic lt X gt lt IP_Address gt netmask lt NetMask gt up Solaris 10 driver ifconfig net lt X gt lt IP_Address gt netmask lt NetMask gt up Solaris 11 driver 3 Edit the etc hosts file a symlink to etc inet hosts and add the IP address and hostname that you wish to assign to the given NIC interface See the hosts 4 man page for more information 4 Edit the etc inet ipnodes file and add an entry for the IP address and hostname for the given interface The etc inet ipnodes file is primarily for IPv6 only but this step is necessary for the IP address change to take effect 5 Edit the etc netmasks file and add a
30. 00 This indicates that an authentication status is being informational 0x00020000 This indicates that authentication is being started to P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages 60 Log Messages for the FC FCoE Driver M ESSAG E FCSP start ACTION No action needed informational 1720 DEBUG FCSP comp ERBOS E_ MASK LOG_FCSP 0x00020000 ESCRI PTION This indicates that authentication is being stopped or ted to a specific node TY LEVEL Debug ESSAG Es FCSP comp ACTION No action needed informational Fibre Channel Fabric FCF Events Message IDs 1800 1899 1800 DEBUG FCF VERBOSE_MASK DESCRIPTION This provides general information about the driver s FCF interface SEVERITY LEVEL Debug MESSAGE FCE ACTION No action needed informational 1801 DEBUG FCF detail ERBOS FE MASK ESCRI PTION This provides detailed information about the driver s terface EVERI TY LEVEL Debug ESSAG E FCF detail ACTION No action needed informational 1810 DEBUG FCF error ERBOS F MASK ESCRI PTION This indicates that an error was found while processing TY LEVEL Debug ESSAG E FCF error ACTION No action needed informational 1820 DEBUG FCF state V D
31. 0x00008000 VERBOSE_MASK LOG_FIRMWARE Emulex Drivers for Solaris User Manual representative P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages 57 Log Messages for the FC FCoE Driver E SCRIP TION This indicates that a firmware update is required on he adapter D t SEVERITY LEVEL Warning MESSAGE Firmware update required ACTION The user must perform a manual adapter reset or link reset once the host environment is stable to trigger an automatic firmware downloa downloa d Do not power cycle or reboot the system during the d operation Common Transport Events Message IDs 1600 1699 1600 DEBUG CT sent VERBOSE_MASK LOG_CT 0x00010000 DESCRIP TION This indicates that a CT command is being sent SEVERITY LEVEL Debug MESSAGE ACTION CT sent No action needed informational 1601 DEBUG CT comp VERBOSE_MASK LOG_CT 0x00010000 DESCRIP TION This indicates that a CT command completed normally SEVERIT Y LEVEL Debug MESSAGE ACTION CT comp No action needed informational 1610 ERROR Stray CT completion VERBOSE_MASK LOG_CT 0x00010000 DESCRIP receive could i TION This indicates that a CT command completion was d without issuing a corresponding CT command This error ndicate
32. C Driver Table 7 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Recommended Action MOD_ MASK Severity MAP FAILED Low System resources Repeat the MOD_TX CE_WARN operation that generated the log If the error log is generated again reboot the system Emulex Drivers for Solaris User Manual P008022 01A Rev A
33. CJ SEVERITY LEVEL Debug MESSAGE Memory alloc ACTION No action needed informational 0301 ERROR Memory alloc failed M 0x00000008 VERBOSE_MASK LOG_MI CJ ESCRIPTION This indicates that the driver was unable to allocate ystem memory The system is low on memory resources D S SEVERITY LEVEL Error M ESSAGE Memory alloc failed ACTION No action needed informational However if the problem persists report this error to your system administrator 0310 ERROR Memory pool error VERBOSE_MASK LOG_MEM 0x00000008 ESCRIPTION This indicates that a problem has occurred with the emory buffer pool management D m SEVERITY LEVEL Error M ESSAGE Memory pool error ACTION No action needed informational However if the problem persists report this error to your customer service representative 0311 DEBUG Memory pool alloc failed VERBOSE_MASK LOG_MEM 0x00000008 ESCRIPTION This indicates that the driver was unable to allocate emory from one of its own memory pools D m SEVERITY LEVEL Debug MESSAGE Memory pool alloc failed ACTION If the problem occurs frequently you may be able to configure more resources for that pool If this does not solve the problem report these errors to customer service 0312 DEBUG Memory pool detail
34. D_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter Legacy MQ ring alloc failed Increase the memory MOD_CONFIG CE_WARN Legacy MQ create failed Hardware error Download the MOD_CONFIG CE_WARN re lt code gt same firmware image to the adapter and reboot and or replace the adapter Q EXT ring alloc failed Increase the memory MOD_CONFIG CE_WARN Extended MQ create failed Hardware error Download the MOD_CONFIG CE_WARN re lt code gt same firmware image to the adapter and reboot and or replace the adapter WQ Buffer Pool create failed Increase the memory MOD_CONFIG CE_WARN WQ MAP Handles Pool create Increase the memory MOD_CONFIG CE_WARN failed WQ Packet Desc Pool create Increase the memory MOD_CONFIG CE_WARN failed Failed to create WQ ring Increase the memory MOD_CONFIG CE_WARN WOCQ create failed Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter W create failed rc lt code gt Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter RQ bdesc alloc failed Increase the memory MOD_CONFIG CE_WARN RQ shadow ring alloc failed _ Increase the memory MOD_CONFIG CE_WARN RQ Buffer Pool create failed Increase the memory MOD_CONFIG CE_WARN RQ ring create failed Hardware error Download the MOD_CONFIG CE_WARN same firmware
35. ION ts report this error to your customer service representative persis General I O Packet Events Message IDs 0900 0999 0900 NOTICE Packet abort Invalid ELS command found No action needed informational However if the problem EF MASK LOG_PKT 0x00000200 PTION This indicates that an I O packet is being aborted VERBOS DESCRI SEVERITY LEVEL Notice MESSAGE Packet abort ACTION No action needed informational 0901 WARNING Packet abort failed V D h S M A P ERBOS F_MASK LOG_PKT 0x00000200 ESCRI PTION This indicates that an attempt to abort an I O packet as failed EVERITY LEVEL Warning F ESSAGE CTION ts report this error to your customer service representative ersis Packet abort failed No action needed informational However if the problem 0910 DEBUG Packet timeout V D b S M ERBOS E_ MASK LOG_PKT 0x00000200 ESCRI PTION This indicates that an I O packet has timed out and is eing aborted ESSAG Foe EVERITY LEVEL Debug Packet timeout ACTION No action needed informational Emulex Drivers for Solaris User Manual P008022 01A Rev A gt EMULEX 6 FC FCoE Driver Console and Log Messages 48 Log Messages for the FC FCoE Driver Emulex Drivers for Solaris User Manua 0911 DEBUG CHANNEL watchd
36. IPTION This is a general purpose warning message SEVERITY LEVEL Warning MESSAGE None ACTION No action needed informational 0004 ERROR VERBOSE_MASK LOG_MISC 0x00000001 DESCRIPTION This is a general purpose error message SEVERITY LEVEL Error MESSAGE None ACTION No action needed informational 0005 PANIC VERBOSE_MASK LOG_MISC 0x00000001 Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX DESCRIPTION SEVERITY LEVEL MESSAGE Panic None ACTION Contact your customer servic 0010 DEBUG Event LOG_MISC VERBOSE_MASK DESCRIPTION SEVERITY LEVEL MESSAGE ACTION No action needed Debug Event 0011 DEBUG Event queued VERBOSE_MASK DESCRIPTION SEVERITY LEVEL MESSAGE ACTION No action needed LOG_MISC Debug Event queued 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 32 This is a general purpose panic message Severe representative 0x00000001 This is debug information about a driver event informational 0x00000001 This indicates that a driver event is being queued informational 0012 DEBUG Event dequeued VERBOSE_MASK DESCRIPTION SEVERITY LEVEL MESSAGE ACTION No action nee
37. LOG_IP 0x00001000 ESCRI eceived but was dropped for some reason PTION This indicates that an unsolicited IP sequence was ERITY LEVEL Debug D T SEV M ESSAGE Unsolicited IP dropped ACTION No action needed informational 1221 DEBUG IP recvd VERBOSE_MASK LOG_IP 0x00001000 ESCRIPTION This indicates that an unsolicited IP sequence was eceived EV ERITY LEVEL Debug D E S M ESSAGE IP recvd ACTION No action needed informational Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages 52 Log Messages for the FC FCoE Driver 1230 ERROR Invalid IP sequence found VERBOSE_MASK LOG_IP 0x00001000 ESCRIPTION This indicates that an IP sequence was found with an nvalid code D i SEVERITY LEVEL Error M ESSAGE Invalid IP sequence found ACTION No action needed informational However if the problem persists report this error to your customer service representative Solaris SFS Events Message IDs 1300 1399 1300 DEBUG SFS VERBOSE_MASK LOG_SFS 0x00002000 ESCRI PTION This provides general information about the driver s terface ESSAG D S SEVERITY LEVEL Debug M E SFS ACTION No action needed informational 1301 DEBUG SFS de
38. MASK LOG_SLI 0x00000010 DESCRIPTION This indicates that an IOCB was received from the adapter with an illegal value This error could indicate a driver or firmware problem S M EVERITY LEVEL Error ESSAGE IOCB invalid ACTION No action needed informational However if the problem persists report this error to your customer service representative 0451 DEBUG IOCB queue full VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This indicates that the IOCB queue is full This will occur during normal operation S EVERITY LEVEL Debug Emulex Drivers for Solaris User Manua P008022 01A Rev A gt G EMULEX Emulex Drivers for Solaris User Manual 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver MESSAGE IOCB queue full ACTION No action needed informational 0452 DEBUG IOCB event VERBOSE_MASK LOG_SLI 0x00000010 eported by the adapter D SEVERITY LEVEL Debug MESSAGE IOCB event ACTION No action needed informational 0453 DEBUG IOCB stale VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that an IOCB completed after its ssociated packet completed D a SEVERITY LEVEL Debug MESSAGE IOCB stale ACTION No action needed informational 0460 DEBUG SLI VERBOSE_MASK LOG_SLI
39. OG_IOCTL V ERBOSE_MASK ESCRIPTION DFC reques EVERITY LEV ESSAG DFC ACTION No ac EL Debug D a S M Poe BrFETOE tion needed Emulex Drivers for Solaris User Manual This provides detailed information about the driver s informational 0x00004000 This indicates that an error was found while processing informational P008022 01A Rev A gt EMULEX 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 55 Firmware Download Events Message IDs 1500 1599 1500 DEBUG Firmware image F ERBOS ESCRI E MASK PTION LOG_FIRMWAR EVEL Debug ESSAGE Firmware image Py 0x00008000 This provides general information about the firmware ACTION No action needed informational 1501 DEBUG Firmware detail VERBOSE_MASK LOG_FIRMWARE_DETAIL 0x10000000 DESCRIPTION This provides detailed information about the firmware image SEVERITY LEVEL Debug MESSAGE Firmware detail ACTION No action needed informational 1502 NOTICE Firmware Library VERBOSE_MASK ER ESCRIPTION river s library LOG_DRIV EV Notice EL ERITY L D d S M EV ESSAGE ACTION No action needed Firmware Library 0x00000002 This shows the versions of firmware con
40. P traffic events 49 0x00000800 LOG_FCT FCP target mode events 50 50 0x00001000 LOG_IP IP traffic events 51 52 0x00002000 LOG_SFS Solaris SFS events 52 53 0x00004000 LOG_IOCTL IOCTL events 54 54 0x00008000 LOG_FIRMWARE Firmware download events 55 56 0x00010000 LOG_CT Common transport events 57 58 0x00020000 LOG_FCSP Fibre Channel Security Protocol FCSP events 58 60 0x00040000 LOG_FCF Fibre Channel Fabric FCF events 60 61 0x007C0000 LOG_RESERVED Reserved 0x00800000 LOG_FCT_DETAIL Detailed FCT events 50 0x01000000 LOG_FCSP_DETAIL Detailed FCSP events 59 0x02000000 LOG_NODE_DETAIL Detailed node events 43 43 0x04000000 LOG_IOCTL_DETAIL Detailed IOCTL events 54 54 0x08000000 LOG_IP_DETAIL Detailed IP events 51 0x10000000 LOG_FIRMWARE_DETAIL Detailed Firmware events 55 0x20000000 LOG_SFS_DETAIL Detailed Solaris SFS events 52 Emulex Drivers for Solaris User Manual P008022 01A Rev A 29 6 FC FCoE Driver Console and Log Messages 30 gt EMULEX Log Message Overview Table 6 2 Log Message Types for the FC FCoE Driver Continued Verbose Bit Log Message Verbose Mask Verbose Description Pages 0x40000000 LOG_MBOX_DETAIL Detailed Mailbox events 42 0x80000000 LOG_SLI_DETAIL Detailed HBA SLI events 41 OXFFFFFFFF LOG_ALL_MSG All logging on all events Log Message Severity Levels Table 6 3 lists the severity type of the FC FCoE driver log message in the order of severity Table 6 3 Severity Levels of FC FCoE D
41. Service Level Interface UCNA universal converged network adapter UMC universal multichannel vNIC virtual NIC Vport virtual port Emulex Drivers for Solaris User Manual P008022 01A Rev A gt lt EMULEX 2 Installing and Uninstalling Q Installing the Drivers for Solaris 10 and 11 2 Installing and Uninstalling Installing the Drivers for Solaris 10 and 11 FC FCoE Out of Box Driver elxfc To install the FC FCoE out of box driver 1 Login as root 2 Download the platform specific FC FCoE out of box driver from the Emulex website to a convenient directory The file is a regular tar file 3 Extract the installation image from the tar file For example cd lt location of driver package gt tar xvf elxfc_kit 2 75i s10 sparc tar 4 Install the driver kit For example cd lt location of driver package gt pkgadd d 5 Reboot the system NIC Out of Box Driver elxnic To install the NIC out of box driver 1 Login as root 2 Download the platform specific NIC out of box driver from the Emulex website to a convenient directory The file is a regular tar file 3 Extract the installation image from the tar file For example cd lt location of driver package gt tar xvf elxnic_kit 4 1 xxx 0 sl0 sparc tar 4 Install the driver kit For example cd lt location of driver package gt pkgadd d 5 Reboot the system The elxnic Driver and NIC Inbox Driver oce Cannot Coexist Because the out of box NIC driver elxn
42. Solaris 10 x64 e Solaris 11 SPARC e Solaris 11 x64 Adapter Firmware and Stack Compatibility For adapters that are compatible with the Emulex FC FCoE and NIC drivers see the driver s Downloads page on the Emulex website For compatible firmware versions see the Downloads page for the specific adapter This driver supports the Solaris Ethernet stack including NIC virtualization Crossbow vSwitch and vRouter Known Issues See the product release notes for the latest information Emulex Drivers for Solaris User Manual P008022 01A Rev A 1 Introduction Abbreviations SG EMULEX Abbreviations ADISC Discover Address APIC advanced programmable interrupt controller CLI Command line interface CNA converged network adapter DHCHAP Diffie Hellman Challenge Handshake Authentication Protocol DR dynamic reconfiguration FC Fibre Channel FCA Fibre Channel adapter FCIO FC input output FC IP Fibre Channel over IP FCoE Fibre Channel over Ethernet FCTL FC transport library FW firmware Gb s gigabit per second HBA host bus adapter HW hardware IOCB Input Output Control Block INTx PCIe legacy interrupts where x is variable IRM interrupt resource management LACP Link Aggregation Control Protocol Ipfc LightPulse Fibre Channel MSI X message signaled interrupts extended MTU maximum transmission unit NIC network interface card NPIV N_Port ID Virtualization PCI Peripheral Component Interconnect SFS SAN Foundation Software SLI
43. T 0x00000200 ESCRI rror status This can occur during normal operation PTION This indicates that an I O packet was completed with an TY LEVEL Debug D e SEVERI M ESSAG ACTION persis FCP Traffic Events Message IDs 1000 1099 E Packet completion error No action needed informational However if the problem ts report this error to your customer service representative 1000 DEBUG Stray FCP completion VERBOS E_ MASK LOG_FCP 0x00000400 ESCRI eceived without issuing a corresponding FCP command This error PTION This indicates that an FCP command completion was EVERI TY LEVEL Debug D is could indicate a driver or firmware problem S M ESSAGE Stray FCP completion ACTION No action needed informational However if the problem persis ts report this error to your customer service representative 1001 DEBUG FCP completion error V ERBOS E_ MASK LOG_FCP 0x00000400 Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages 50 Log Messages for the FC FCoE Driver ESCRIPTION This indicates that an FCP command completed with an rror status These errors can occur during normal operation D e SEVERITY LEVEL Debug MESSAGE FCP completion error ACTION No action needed
44. V M gt lt EMULEX Emulex Drivers for Solaris User Manual FC and FCoE Driver Version 2 85 8 0 NIC Driver Version 4 2 324 12 P008022 01A Rev A Emulex Connects Servers Storage and People gt EMULEX Copyright 2003 2012 Emulex All rights reserved worldwide No part of this document may be reproduced by any means or translated to any electronic medium without the prior written consent of Emulex Information furnished by Emulex is believed to be accurate and reliable However no responsibility is assumed by Emulex for its use or for any infringements of patents or other rights of third parties which may result from its use No license is granted by implication or otherwise under any patent copyright or related rights of Emulex Emulex the Emulex logo AutoPilot Installer AutoPilot Manager BlockGuard Connectivity Continuum Convergenomics Emulex Connect Emulex Secure EZPilot FibreSpy HBAnyware InSpeed LightPulse MultiPulse OneCommand OneConnect One Network One Company SBOD SLI and VEngine are trademarks of Emulex All other brand or product names referenced herein are trademarks or registered trademarks of their respective companies or organizations Emulex provides this manual as is without any warranty of any kind either expressed or implied including but not limited to the implied warranties of merchantability or fitness for a particular purpose Emulex may make improvements and changes to the product de
45. V and OS Virtualization ccccccc cece ece cece sisii mend nhin eee a eka eE aia Ea 13 Using VPorts with Oracle VM Server for SPARC Solaris Containers or Oracle VM Server for 86 rispar onini annen a iR rA EE NE Ae E AE INARA 14 Configuring Target Mode Support for Solaris 11 ssssssssssrsrrrerrerrrrrrrrrrrrreee 14 FC FCoE Configuration File Parameter sssssssusunnnnnnnnnnnnununnnnnnnnnnnnnnnnnnnnnnn 14 5 NIC Driver Configuration sssssssssusnnnnnnnnnnnnnnsunnnnnnnnnnnnnnnnnunnnnnnnnnnnnnn 19 Using the NIC Configuration File elxnic conf sssssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 19 Emulex Drivers for Solaris User Manual P008022 01A Rev A DE EMULEX Table of Contents 4 Changing Driver Parameters viiiictoisssteacenieevniaxerderrbaverwctehawaereeteueieciwoean 19 NIC Configuration File Parameters 0t lt scccchvetalenaanwne sc icekeneed shoes savedsheeseabatakans 19 Configuring the NIC INCRACEdcsccctsiscinessbelaccezedseieeenssbeiaveceishivwvectasiesceta 21 Removing the NIC Interface USING EIXNIC cceec eee e eee e cease eens eeeaeeeeneenenne nes 22 Multi ring Mode and the Effect of ddi_msix_alloc_limit 0 cc ceeeeeee eee ee 23 Solaris LO reei durni ireo ea a eke landed ad bedi nd ead TEAT EEA DONLAN SENE bacdineeetaa aaa tha ds 23 Solanis Plerin tends aging Patinlsaaans bbtadanedas Ea Ena ode aa idea toutes 23 Changing Interrupt Priorities sscccseve xovunedpensteen lt seeaasRenaianus See chusesanc
46. VEL MESSAGE ACTION No action needed Debug Node destroy 0611 DEBUG Node closed d informational 0x00000040 This indicates that a node has been updated for a informational 0x00000040 This indicates that a node has been destroyed for a informational VERBOSE_MASK LOG_NODE_DETAIL 0x02000000 Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 44 DESCRIPTION This indicates that a node has been temporarily closed for I O transport SEVERITY LEVEL Debug MESSAGE Node closed ACTION No action needed informational 0612 NOTICE Node missing VERBOSE_MASK LOG_NODE 0x00000040 DESCRIPTION This indicates that a FCP2 device node has been found missing SEVERITY LEVEL Notice MESSAGE Node missing ACTION No action needed informational 0620 DEBUG Node not found VERBOSE_MASK LOG_NODE 0x00000040 DESCRIPTION This indicates that there was an attempt to send an I O pkt to an unknown device nod The driver maintains a node table entry for every device it needs to communicate with on the FC network SEVERITY LEVEL Debug MESSAGE Node not found ACTION No action needed informational However if the problem pers
47. VERBOSE_MASK LOG_MEM 0x00000008 DESCRIPTION This provides detailed information about memory bufferpool management S EVERITY LEVEL Debug Emulex Drivers for Solaris User Manual P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 37 gt EMULEX Log Messages for the FC FCoE Driver MESSAGE Memory pool detail ACTION No action needed informational 0320 NOTICE No unsolicited buffer available VERBOSE MASK LOG_MEM 0x00000008 DESCRIPTION This indicates that the driver s unsolicited buffer pool is exhausted The I O will be dropped and most likely retried by the remote devic SEVERITY LEVEL Notice MESSAGE No unsolicited buffer available ACTION If the problem occurs frequently you may be able to configure more resources for that pool If this does not solve the problem report these errors to customer service 0330 ERROR Invalid access handle VERBOSE MASK LOG_MEM 0x00000008 ESCRIPTION This indicates that the driver had an invalid access andle assigned by the system D h SEVERITY LEVEL Error MESSAGE Invalid access handle ACTION If the problem occurs frequently report these errors to customer service 0331 ERROR Invalid DMA handle VERBOSE_MASK LOG_MEM 0x00000008 ESCRIPTION This indicates that the driver had an invalid dma andle assigned by the
48. _DETAIL 0x80000000 SEVERITY LEVEL Debug MESSAGE SLI detail ACTION No action needed informational 0461 ERROR SLI ERROR VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This error provides information about an SLI event SEVERITY LEVEL Error MESSAGE SLI ERROR ACTION No action needed informational 0462 DEBUG SLI DEBUG VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This provides debug information about an SLI event SEVERITY LEVEL Debug MESSAGE SLI DEBUG ACTION No action needed informational Mailbox Events Message IDs 0500 0599 0500 DEBUG Mailbox event VERBOSE_MASK LOG_MBOX 0x00000020 ESCRIPTION This indicates that an IOCB local error event is being DESCRIPTION This provides detailed information about an SLI event P008022 01A Rev A 41 gt G EMULEX 6 FC FCoE Driver Console and Log Messages 42 Log Messages for the FC FCoE Driver DESCRIPTION This indicates that a mailbox event has occurred SEVERITY LEVEL Debug MESSAGE Mailbox event ACTION No action needed informational 0501 DEBUG Mailbox detail VERBOSE_MASK LOG_MBOX_DETAIL 0x40000000 ESCRIPTION This provides detailed information about a mailbox D e SEVERITY LEVEL Debug M ESSAGE Mailbox detail
49. _DRIV EVERITY LEVEL ESSAGE Eeror Driver suspend failed ACTION Check your hardware and software configuration report this error to your customer service problem persists representative 0130 DEBUG Driver resume VERBOSE_MASK LOG_DRIVER 0x00000002 DESCRIPTION operation SEVERITY LEVEL Debug MESSAGE Driver resume ACTION No action needed informational 0131 ERROR Driver resume failed 0x00000002 VERBOSE_MASK ESCRIPTION o some issue D t SEVERITY LEVEL MESSAGE LOG_DRIVER HETOE Driver resume failed ACTION Check your hardware and software configuration report this error to your customer service problem persists representative 6 FC FCoE Driver Console and Log Messages This indicates that the driver was unabl 34 Log Messages for the FC FCoE Driver This indicates that the driver was unable to suspend If the This indicates that the driver is performing a resume to resume du If the HBA Initialization Events Message IDs 0200 0299 0200 NOTICE Adapter initialization 0x00000004 VERBOSE_MASK DESCRIPTION SEVERITY LEVEL MESSAGE ACTION No action needed LOG_INIT Notice Adapter initialization informational 0201 ERROR Adapter initialization failed VERBOSE_MASK
50. a driver or firmware problem SEVERIT MESSAGE ACTION persist Y LEVEL Error Stray CT completion No action needed informational However if the problem s report this error to your customer service representative 1611 DEBUG Abnormal CT completion VERBOSE_MASK LOG_CT 0x00010000 ESCRIP tatus he net his Cl TION This indicates that a CT command completed with a error in the IOCB It could mean the Fibre Channel device on work is not responding The driver will automatically retry command if needed D S t SEVERI M A S tate t ESSAGE Y LEVEL Debug Abnormal CT completion Check physical connections to Fibre Channel network and the he remote PortID is in Emulex Drivers for Solaris User Manual P008022 01A Rev A SG EMULE x 6 FC FCoE Driver Console and Log Messages 58 Log Messages for the FC FCoE Driver 1620 DEBUG CT rcvd VERBOS F MASK LOG_CT 0x00010000 ESCRI PTION This indicates that an unsolicited CT command was ERITY LEVEL Debug ESSAGE CI rvd ACTION No action needed informational 1621 DEBUG Unsolicited CT dropped VERBOS F MASK LOG_CT 0x00010000 F E SCRIP TION This indicates that an unsolicited CT command was eceived and then dropped for some reason VERIT Y LEVEL Debug
51. ages in the device configuration path are logged MOD_TX 0x20000 Messages in the transmit data path are logged MOD_RX 0x40000 Messages in the receive data path are logged MOD_ISR 0x80000 Messages in the interrupt path are logged a MOD MASK is a bitmap of one or more of these values Table 7 2 details the values and meanings of SEVERITY in the log_level parameter Table 7 2 Severity Level Information for NIC Driver Log Messages Name SEVERITY Value Meaning CE_CONT 0x0 Continuation CE_NOTE 0x1 Information CE_WARN 0x2 Warning CE_PANIC 0x3 Causes the operating system to panic CE_IGNORE 0x4 No action Emulex Drivers for Solaris User Manual P008022 01A Rev A gt EMULEX Log Messages for the NIC Driver For Solaris 10 7 NIC Driver Log Messages Log Messages for the NIC Driver The following table details the log messages provided by the NIC driver for Solaris 10 operating systems Table 7 3 Log Messages for the NIC Driver for Solaris 10 Log Message Recommended Action MOD_MASK SEVERITY pci_config_setup failed Reset or replace the adapter MOD_CONFIG CE_WARN with re lt code gt Device Unknown Driver does not have support for a MOD_CONFIG CE_WARN particular adapter Contact Emulex for further information PCI Initialization Failed Reset or replace the adapter or MOD_CONFIG CE_WARN move the adapter to different slot HW Initializati
52. and 1 are required The above example shows that ports 2 9 have been added to support up to ten virtual ports The port number of each entry must increment by one in sequential order without gaps in the number sequence That is you cannot have name fp class fibre channel port 7 and then have the next line be name fp class fibre channel port 10 Reboot the system To create delete and list virtual ports after a system reboot see the OneCommand Manager Application User Manual Enabling NPIV Support on Solaris 11 To enable NPIV support in the driver 1 2 4 Log in as root or su to root Check whether enable npiv is set to 1 in the configuration file It is set to 0 by default If enable npiv is already set to 1 do not reboot otherwise set enable npiv 1 and reboot the system See Chapter 6 of the Solaris Express SAN Configuration and Multipathing Guide NPIV Configuration Limits The following limitations apply to NPIV e There is no Fibre Channel over IP FC IP support on virtual ports e You cannot delete a virtual port with a mounted file system e Due to the limitation of the Solaris SFS stack deleting a virtual port causes that virtual port to go offline e The Emulex LightPulse LP11000 and LPe11000 family of adapters can support up to 100 virtual ports e The Emulex LightPulse LPe12000 family of adapters can support up to 255 virtual ports NPIV and OS Virtualiz
53. as provided general nformation about the adapter s async status D i SEVERITY LEVEL Notice M ESSAGE Adapter Async Status ACTION No action needed informational Emulex Drivers for Solaris User Manual P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 4Q gt EMULEX Log Messages for the FC FCoE Driver 0430 DEBUG Ring event VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This indicates that an SLI ring event has occurred SEVERITY LEVEL Debug MESSAGE Ring event ACTION No action needed informational 0431 DEBUG Ring error VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This indicates that an SLI ring error is being reported by the adapter S M EVERITY LEVEL Debug ESSAGE Ring error ACTION No action needed informational 0432 DEBUG Ring reset VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This indicates that an SLI ring is being reset SEVERITY LEVEL Debug MESSAGE Ring reset ACTION No action needed informational 0440 DEBUG Adapter msg VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that a message was sent to the driver D from the adapter SEVERITY LEVEL Debug M ESSAGE Adapter msg ACTION No action needed informational 0450 ERROR IOCB invalid VERBOSE_
54. ation Solaris has several OS virtualization solutions including Oracle VM for SPARC Oracle VM for x86 and Solaris containers Devices configured to be seen on an Emulex FC or Ethernet port either a physical port or a virtual port can be used with any of these OS virtualization solutions Emulex strongly recommends that you consult the latest document on these technologies to learn the best use of resources related to NPIV technology Emulex Drivers for Solaris User Manual P008022 01A Rev A 4 FC FCoE Driver Configuration 14 gt G EMULEX FC FCoE Configuration File Parameters Using VPorts with Oracle VM Server for SPARC Solaris Containers or Oracle VM Server for 86 To use NPIV with Oracle VM Server for SPARC formerly Logical Domains Solaris containers or Oracle VM Server for x86 formerly xVM user domains 1 Create virtual ports for the domains containers to which you want to present dedicated storage Discover and attach the targets to the virtual ports Assign the target to the domain or container The attachment runs through the virtual port that provides the path to the target Configuring Target Mode Support for Solaris 11 Target mode support is only available on FC host bus adapters HBAs To configure target mode support for Solaris 11 1 2 4 Log in as root or su to root Set target mode to 1 in the configuration file You can also set individual paths to target mode lxfcX
55. ble values are 0 4096 The default value is 0 which means no_limit Adapter reset pci max read Sets the PCI X maximum memory read byte count Possible values are 512 1024 2048 or 4096 The default value is 2048 Adapter reset pm support Emulex Drivers for Solaris User Manual Power management support in the driver e 0 Disabled default e 1 Enabled Reboot P008022 01A Rev A gt EMULEX 4 FC FCoE Driver Configuration 17 FC FCoE Configuration File Parameters Table 4 1 FC FCoE Configuration File Parameters Continued Parameter Description Activation target depth Sets the remote FCP target queue depth Possible values are 0 2048 Link reset The default value is 512 A value of O no_limit target mode Note This property is applicable to Solaris 11 only Reboot COMSTAR target mode support e 0 Disabled default e 1 Enabled If target mode is enabled for a port then the SFS initiator mode is disabled for that port topology Sets the topology Set to point to point mode if you want to run as an Link reset N_Port Set to loop mode if you want to run as an NL _Port 0 loop then point to point default e 2 point to point only e 4 loop only e 6 point to point then loop ub bufs Sets the number of unsolicited buffers the driver should allocate Reboot Possible values are 40 16320 The default value is 1000 vport Note This property is applicable to Solaris 10 only
56. col FCSP Events Message IDs 1700 1799 58 Fibre Channel Fabric FCF Events Message IDs 1800 1899 cece eee 60 7 NIC Driver Log Messages ssssssssssunnnnnnnnnnnnnnnnunnnnnnnnnnnnnnnnnunnnnnnnnnnnnnn 62 Setting MOD MASK and SEVERIN Y sssssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 62 Log Messages for the NIC Driver s s sssssssssussununnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnunnnnnnn 63 POP Solaris LOaren R E EEE 63 For Solaris TL 2450224520 csratadanuteraurtamiatautatscanantiensevagnetavas EOR n EEEE Ni 65 Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX List of Tables Table 4 1 Table 5 1 Table 5 2 Table 5 3 Table 6 1 Table 6 2 Table 6 3 Table 7 1 Table 7 2 Table 7 3 Table 7 4 Emulex Drivers for Solaris User Manual FC FCoE Configuration File Parameters lt lt cvecsocespevecantessceecartvasedvcaceasacees 15 NIC Configuration File Parameters ccecce cece sees seen ee eeeee nents nente nent ees 19 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 10 23 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 24 Setting Types of Console and Log Messages for the FC FCoE Driver 28 Log Message Types for the FC FCoE Driver ccccececeeseneeeeneeeeneenenee es 29 Severity Levels of FC FCoE Driver Log MessagesS c eeeeeeee eee teat ees 30 MOD_MASK
57. dd more memory Failed to setup adapter Check for the faulty hardware using MOD CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit kstat setup Failed with Reload the driver MOD_CONFIG CE_WARN lt ret_code gt MAC allocation Failed Unload and then reload the driver MOD_CONFIG CE_WARN MAC registration failed Unload and then reload the driver MOD_CONFIG CE_WARN Detach failed lt num_buffers gt Reset the adapter MOD_CONFIG CE_WARN pending buffers in rq lt rq_id gt Failed to query fw config Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to get stats Check for the faulty hardware using MOD CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit EQ ring alloc failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system EQ create failed Check for t
58. ded LOG_MISC Debug Event dequeued 0x00000001 This indicates that a driver event is being dequeued informational Driver Events Message IDs 0100 0199 0100 NOTICE Driver attach VERBOSE_MASK ESCRIPTION peration D fe SEVERITY LEVEL MESSAGE ACTION No action needed LOG_DRIVER Notice Driver attach 0x00000002 This indicates that the driver is performing an attach informational 0101 ERROR Driver attach failed VERBOSE_MASK ESCRIPTION o some issue D an SEVERITY LEVEL MESSAGE LOG_DRIV Gl R Brror Emulex Drivers for Solaris User Manual 0x00000002 This indicates that the driver was unable to attach due Driver attach failed P008022 01A Rev A gt G EMULEX Emulex Drivers for Solaris User Manual 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative 0102 DEBUG Driver attach VERBOSE_MASK LOG_DRIVER 0x00000002 D operation SEVERITY LEVEL Debug M ESSAGE Driver attach ACTION No action needed informational 0110 NOTICE Driver detach R 0x00000002 VERBOSE_MASK LOG_DRIV
59. dware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Invalidqlength Must be 256 2000 Set the correct queue length using dladm MOD_CONFIG CE_WARN WQ allocation failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN WQ Buffer Pool create failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN WQ MAP Handles Pool create failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN WQ Packet Desc Pool create failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN Failed to create WQ ring Emulex Drivers for Solaris User Manual Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG P008022 01A Rev A CE_WARN 69 7 NIC Driver Log Messages 70 Log Messages for the NIC Driver gt EMULEX Table 7 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Recommended Acti
60. e MAC lt mac_add gt Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN oce_instance_setup adapters exceeded max The driver supports a maximum of 16 adapters MOD_CONFIG CE_WARN oce_instance_clear illegal adapter dev lt Bus Device Func gt The driver continues to work No action is necessary MOD_CONFIG CE_WARN oce_rx ino frags The system cannot receive data because driver is low on resources Reload the driver If the same error recurs reset the adapter MOD_RX CE_WARN kstat creation failed Reload the driver MOD_CONFIG CE_WARN Could not allocate stats_dbuf Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN wqb pool empty The system cannot transmit data because driver is low on resources Check for a process generating heavy traffic MOD_TX CE_WARN wqm pool empty Emulex Drivers for Solaris User Manual The system cannot transmit data because driver is low on resources Check for a process generating heavy traffic MOD_TX P008022 01A Rev A CE_WARN 71 7 NIC Driver Log Messages 72 gt G EMULEX Log Messages for the NI
61. e transmit ring and five receive rings Note On non IRM systems with multiple adapters the attach for few NIC functions may fail because of lack of interrupt vectors allowed at the default level To solve the problem use Table 5 3 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 on page 24 Emulex Drivers for Solaris User Manual P008022 01A Rev A xs 5 NIC Driver Configuration 24 gt G EMULEX Using the NIC Configuration File elxnic conf The following table shows how the value of ddi_msix_alloc_limit affects receive traffic distribution across CPU cores for Solaris 11 Table 5 3 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 Value of CPU cores ddi_msix_alloc_limit participatingin NIC Mode APIC in etc system RX processing Limiting Factor 0Ce10102 N A XAPIC Default 2 Solaris and APIC in platform 0Ce10102 N A XAPIC 4 4 0Ce10102 0Ce10102 N A x2APIC Default 4 OCe10102 OCe11102 Legacy xAPIC Default 2 Solaris and APIC in platform OCe11102 Legacy xAPIC 4 4 firmware and driver OCe11102 Legacy x2APIC Default 4 firmware and driver OCe11102 Advanced xAPIC Default 2 Solaris and APIC in platform OCe11102 Advanced xAPIC 8 7 firmware and driver OCe11102 Advanced x2APIC Default 7 firmware and driver Changing Interrupt Priorities The Solaris operating system divides the available interrupts among multiple priority levels each priority level has
62. entereaeten 24 Using the dladm Utility for Solaris 11 ssssssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 25 Configuring the NIC Interface Using dladm cc cece ecee cesses eeaeeeeneeeeaeeeeanes 25 T nable PATAMELSRS nnnc nari dikni Ra aia EE a aaa 25 Private or Unlisted Parameters cccccccc cece cece sees eee eee eee veeveeeenesneunenanenannas 26 Creating a Virtual NIC Using dladm siisiciasvevscieasanisaareeiveseserieasnicussveasecenieee 26 6 FC FCoE Driver Console and Log Messages ssssusssnnnnnnnssnunnnnnnnnnnnnnnnnn 28 General Situations sssssssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnan 28 FC Link Fails to Come Up on 8 Gb s or 16 Gb s Adapter cee eee eee ee 28 Setting Notices Warning and Error Logging Levels scecssceeeseeeeceeeeseeeesaeeesaee 28 Log Massage OVGIVIOW sisscscccscstascsacscnscacenasensseatsscsceacnsatasesassesteamecenseessasaees 29 Types of Log Messages Logged in the System File ccccceceeeeeeeeeeeeeeeeeeenenenas 29 Log Message Severity Levels cccecceeee eee e teeter nets eet e teense tee enae eas 30 Log Message Example wczccvtitvinsteveriver a nestor ien acer teers neste tesiwrias 30 Log Messages for the FC FCOE Driver s ssssssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnunnnnnnn 31 Miscellaneous Events Message IDs 0001 0099 0 cece eee eens 31 Driver Events Message IDs 0100 0199 ccc ccece eee eee ee
63. errupts block enable Reload the driver MOD_CONFIG CE_WARN failed Failed to enable ret lt ret Reload the driver MOD_CONFIG CE_WARN code gt interrupt lt int num gt type lt int type gt cnt lt num_vectors gt Interrupt block disable Reset the adapter MOD_CONFIG CE_WARN failed Failed to disable the Reset the adapter MOD_CONFIG CE_WARN interrupts mod_install failed rval Reset the adapter MOD_CONFIG CE_WARN Map PCI config failed with Reset the adapter MOD_CONFIG CE_WARN lt ret_code gt Device Unknown The device is not supported by the MOD_CONFIG CE_WARN driver PCI initialization failed Reset the adapter MOD_CONFIG CE_WARN HW initialization failed with Check for the faulty hardware using MOD_CONFIG CE_WARN ret_code fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Interrupt setup failed with Reload the driver MOD_CONFIG CE_WARN lt ret_code gt Emulex Drivers for Solaris User Manual P008022 01A Rev A s 7 NIC Driver Log Messages 68 gt G EMULEX Log Messages for the NIC Driver Table 7 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Recommended Action MOD_ MASK Severity Failed to init rings Low system resources Reboot the MOD_CONFIG CE_WARN system to see if the problem resolves itself If possible a
64. ev A xs 5 NIC Driver Configuration 23 gt G EMULEX Using the NIC Configuration File elxnic conf Multi ring Mode and the Effect of ddi_msix_alloc_limit Solaris 10 The elxnic driver is enabled to work in the multi ring mode by default To check the number of active transmit receive tx rx rings type the following ndd get dev elxnic lt xX gt rx_rings ndd get dev elxnic lt xX gt tx_rings The variable lt X gt is the interface number of the elxnic driver The following table shows how the value of ddi_msix_alloc_limit affects receive traffic distribution across CPU cores for Solaris 10 Table 5 2 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 10 Value of CPU Cores ddi_msix_alloc_limit Participating in NIC Mode APIC in etc system RX Processing Limiting Factor 0Ce10102 N A XAPIC Default 2 Solaris and APIC in platform 0Ce10102 N A xAPIC 4 4 OCe10102 OCe10102 N A x2APIC Default 4 OCe10102 OCe11102 Legacy xAPIC Default 2 Solaris and APIC in platform OCe11102 Legacy xAPIC 4 4 firmware and driver OCe11102 Legacy x2APIC Default 4 firmware and driver OCe11102 Advanced xAPIC Default 2 Solaris and APIC in platform OCe11102 Advanced xAPIC 15 15 firmware and driver OCe11102 Advanced x2APIC Default 15 firmware and driver a APIC advanced programmable interrupt controller Solaris 11 Solaris 11 is multi ring enabled by default It creates on
65. faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_MASK MOD_CONFIG Severity CE_WARN Firmaware version read failed with lt ret code gt Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Firmware configuration read failed with lt ret code gt Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN MAC address read failed with lt ret code gt Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Interface creation failed for group instance Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without
66. he faulty hardware using MOD_ CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit CQ allocation failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system Emulex Drivers for Solaris User Manual P008022 01A Rev A gt EMULEX Table 7 4 Log Messages for the NIC Driver for Solaris 11 Continued 7 NIC Driver Log Messages Log Messages for the NIC Driver Log Message CQ ring alloc failed Recommended Action Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_MASK MOD_CONFIG Severity CE_WARN CQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN MQ ring alloc failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN MQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the har
67. ic and the inbox NIC driver oce support the same set of device ids these drivers cannot coexist You can only have one driver attach to one device id By default the oce driver claims all the device ids Therefore when installing the elxnic driver on top of the oce driver the elxnic driver installation fails To reestablish the device id to driver bindings 1 You must run the emlxdrv utility For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual 2 Retry the elxnic installation Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 2 Installing and Uninstalling 10 Uninstalling the Drivers for Solaris 10 and 11 Uninstalling the Drivers for Solaris 10 and 11 FC FCoE Driver To uninstall the FC FCoE out of box driver 1 Login as root 2 Remove the out of box driver by typing pkgrm lt OOB_pkg_name gt For example pkgrm EMLXelxfc 3 Reboot the system NIC Driver To uninstall the NIC out of box driver 1 Login as root 2 Remove the out of box driver by typing pkgrm lt nic_pkg_name gt For example pkgrm EMLXelxnic 3 Reboot the system Emulex Drivers for Solaris User Manual P008022 01A Rev A gt lt EMULEX 3 Utilities for Solaris Drivers 11 OneCommand Manager Application 3 Utilities for Solaris Drivers Emulex provides three utilities to facilitate configuring and using the Solaris drivers e OneCommand Manager app
68. ic conf file 1 Open the file in a text editor 2 Change the parameters to the desired settings e The syntax of single lines in the file lt variable gt lt value gt For example default_mtu 9000 e Comment lines must start with a character 3 Save the file 4 Ifthe driver is already loaded unload and reload it Changes to the configuration file require you to unload and reload the driver For more information see Installing and Uninstalling on page 9 NIC Configuration File Parameters For the Solaris 10 driver you can configure the elxnic driver parameters using either the elxnic conf file for driver parameters that are common to all the elxnic devices or the ndd utility for driver parameters that may need to be set with different values for different elxnic devices For the Solaris 11 driver use the dladm utility The following table lists the NIC configuration file parameters Table 5 1 NIC Configuration File Parameters Parameter Definition Sets the default maximum transmission unit MTU for the driver The possible values are 1500 and 9000 The default value is 1500 default_mtu Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 5 NIC Driver Configuration 20 Using the NIC Configuration File elxnic conf Table 5 1 NIC Configuration File Parameters Continued Parameter flow_control Definition Sets the ethernet flow control The possible values
69. is needed Otherwise check physical connections to Fibre Channel network and the state the remote PortID is in 0820 DEBUG ELS rcvd VERBOSE_MASK LOG_ELS 0x00000100 D received SEVERITY LEVEL Debug MESSAGE ELS rcvd ACTION No action needed informational 0821 DEBUG Unsolicited ELS dropped VERBOSE_MASK LOG_ELS 0x00000100 D received and then dropped for some reason SEVERITY LEVEL Debug ESCRIPTION This indicates that an unsolicited ELS command was ESCRIPTION This indicates that an unsolicited ELS command was P008022 01A Rev A gt G EMULEX M F ESSAGE 6 FC FCoE Driver Console and Log Messages 47 Log Messages for the FC FCoE Driver Unsolicited ELS dropped ACTION No action needed informational 0822 DEBUG ELS reply V ERBOS F MASK LOG_ELS 0x00000100 ESCRI nsolicited ELS command PTION This indicates that a reply is being sent for an EVERITY LEVEL Debug D u S M ESSAGE F ELS reply ACTION No action needed informational 0830 ERROR Invalid ELS command found V F ERBOSE MASK LOG_ELS 0x00000100 ESCRI PTION This indicates that an ELS command was found with an nvalid command code EVERITY LEVEL Error D a S M ESSAG Gi ACT
70. ists report this error to your customer service representative 0621 DEBUG Node timeout VERBOSE_MASK DESCRIPTION r to be opened flushed S M LOG_NODE T EVERITY LEVEL Debug ESSAGE ACTION No action needed Node timeout 0x00000040 This indicates that th or it has been offline too long and needs to be node timer expired the node is informational Link Events Message IDs 0700 0799 0700 DEBUG Link event VERBOSE_MASK DESCRIPTION SEVERITY LEVEL MESSAGE LOG_SLI Debug Link event 0x00000010 This indicates that a link event has occurred or LOG_LINK 0x00000080 ACTION No action needed informational 0710 NOTICE Link down VERBOSE_MASK LOG_LINK 0x00000080 Emulex Drivers for Solaris User Manual P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 45 gt EMULEX Log Messages for the FC FCoE Driver ESCRIPTION This indicates that the Fibre Channel link is down to he adapter D t SEVERITY LEVEL Notice MESSAGE Link down ACTION Check your network connections If the problem persists report this error to your system administrator 0720 NOTICE Link up VERBOSE_MASK LOG_LINK 0x00000080 DESCRIPTION This indicates that the Fibre Channel link is up SEVERITY LEVEL Notice MESSAGE Link up
71. ive mode on Solaris 11 The default value is 5 The actual number of transmit and receive queues that are created depends on the number of vectors allocated The actual number can be checked using the ndd 1m command on Solaris 10 or the dladm 1M command on Solaris 11 For more information run man ndd on Solaris 10 or man dladm on Solaris 11 On non IRM capable machines with FLEX10 or multi adapter setup some of the functions may fail to attach because of a lack of interrupts See Changing Interrupt Priorities on page 24 to for more information tx_bcopy_limit Sets the transmit buffer size threshold to use the copy mode The possible values are 128 256 512 1024 and 2048 The default value is 512 Note On Solaris 11 consider reducing this value if a wqb pool empty message is frequently observed Consider increasing the value if a wqm pool empty message is frequently observed For descriptions of these messages see page 71 in Table 7 4 Log Messages for the NIC Driver for Solaris 11 tx_intr_enable Enables the handling of transmit completions in interrupt mode The possible values are 0 disabled or 1 enabled The default value is 0 Note Enable this parameter if you observe frequent frame loss Also consider using this in conjunction with rx_max_bufs Configuring the NIC Interface The NIC interface must be created before you can configure it You can verify that the driver is loaded on
72. le 4 If the driver is already loaded you must unload and reload the driver to implement your changes For more information see Installing and Uninstalling on page 9 To determine the requirement for the parameter change to take effect see the Activation column in Table 4 1 FC FCoE Configuration File Parameters on page 15 Configuring NPIV Support Enabling NPIV Support on Solaris 10 To enable N_Port ID Virtualization NPIV support in the driver 1 Login as root or su to root 2 Set enable npiv 1 in the configuration file 3 The FC port fp driver parameters are updated when the Emulex emlxu utilities package EMLXemlxu is installed Entries from 2 254 can be added to the kernel drv fp conf file For example name fp name fp name fp name fp name fp Emulex Drivers for Solaris User Manual channel class fibr channel class fibr channel class fibr channel class fibr channel class fibr port 0 port 1 port 2 port 3 port 4 P008022 01A Rev A 4 4 FC FCoE Driver Configuration 13 gt G EMULEX Editing the FC FCoE Configuration File elxfc conf name fp class fibre channel port 5 name fp class fibre channel port 6 name fp class fibre channel port 7 name fp class fibre channel port 8 name fp class fibre channel port 9 The first two lines are listed by default because ports 0
73. lication e emlxadm utility included in the Fibre Channel adapter FCA utilities e emlxdrv utility included in the FCA utilities Note When you install the OneCommand Manager application also install the Solaris FCA Utilities OneCommand Manager Application The OneCommand Manager application provides the functions of the emlxadm utility plus additional functions allowing you to remotely manage multiple systems It offers a choice of a graphical user interface and a scriptable command line interface It is a direct user interface to the FC input output FCIO interface provided by the Oracle StorEdge SFS The FCIO interface provides an Oracle common ioctl interface to the FC transport library FCTL which manages the FCA drivers for each FC FCoE adapter attached to the host system The OneCommand Manager application also directly interfaces with the Emulex network driver allowing you to manage the NIC function of Emulex UCNAs For more information see the OneCommand Manager Application User Manual emlxadm Utility The emlxadm utility changes driver parameters through a local interactive or command line interface CLI mode It can also update firmware on non Oracle branded devices For more information see the Solaris FCA Utilities User Manual emlxdrv Utility The emlxdrv utility associates the Emulex Solaris SFS out of box drivers and the Solaris LightPulse Fibre Channel Ipfc driver to the various models of Emulex FC FCoE adap
74. lt value is 10 Adapter reset log errors Verbose mask for driver error messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OXFFFFFFFF Dynamic log notices Verbose mask for driver notice messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF Dynamic log warnings Verbose mask for driver warning messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF Dynamic max xfer size This property is only used by the driver on i386 platforms The driver does not limit transfer size on SPARC platforms Sets the maximum SCSI transfer size in bytes per I O This property determines the scatter gather list buffer size A pool of buffers is reallocated by the driver during boot A larger transfer size requires a larger memory allocation Possible values are 131072 1388544 The default value is 339968 e 131072 339968 small memory model range e 339969 688128 medium memory model range e 688129 1388544 medium memory model range Reboot network on IP networking support in the driver e 0 Disabled e 1 Enabled default Reboot num iocbs The number of Input Output Control Block IOCB buffers to allocate Possible values are 128 10240 The default value is 1024 Adapter reset num nodes The number of remote FC nodes N_Ports the driver supports Possi
75. meters on Solaris 11 are named differently They include a prefix of _ to each of the parameter names Through the dladm utility the following tunable parameters are provided by the driver along with their usage log_level gt dladm set linkprop p _log_level lt value gt lt interface gt Note See Setting MOD_MASK and SEVERITY on page 62 for log_level values Emulex Drivers for Solaris User Manual P008022 01A Rev A 5 NIC Driver Configuration 26 DC EMULEX Using the dladm Utility for Solaris 11 rx_bcopy_limit gt dladm set linkprop p _rx_bcopy_limit lt value in bytes gt lt interface gt tx_bcopy_limit gt dladm set linkprop p _tx_bcopy_limit lt value in bytes gt lt interface gt tx_ring_size gt dladm set linkprop p _tx_ring_size lt values between 256 and 2048 gt lt interface gt Or gt dladm set linkprop p _tx_ring_size lt values less than tx_ring_size gt lt interface gt Private or Unlisted Parameters Private or unlisted parameters can be set during driver attach through dladm utility and also the elxnic conf file To list the private driver parameters using the dladm utility gt dladm show linkprop p lt property name gt lt interface gt The driver provides the following private parameters e log_level e rx_bcopy_limit e rx_ring_size e rx_rings e rx_rings_per_group e tx_bcopy_limit e tx_reclaim_threshold e tx_ring_size e tx_
76. n entry with the IP address and desired subnet mask for the given interface See the netmasks 4 man page for more information 6 Restart the network service Run svcadm restart network physical or reboot the system Removing the NIC Interface using elxnic To remove the NIC interface 1 Remove all the elxnic entries from etc hosts 2 Remove all the entries from etc inet ipnodes that are related to elxnic interfaces 3 Remove all the elxnic netmask entries from etc netmasks Unplumb the interface using the following command ifconfig elxnic lt xX gt down unplumb Solaris 10 driver ifconfig net lt X gt down unplumb Solaris 11 driver Where lt X gt is the interface number Alternatively you can use the sys unconfig 1M utility for Solaris 10 or sysconfig 1M utility for Solaris 11 to unconfigure a device These utilities can delete the configurations of IP address netmask hostname nfs mounts ldap and so on on the host The sys unconfig 1M sysconfig 1M utility reboots the system and clears the existing IP configuration so you must enter all the information again even for the existing NICs already configured in the system The sys unconfig 1M sysconfig 1M utility must be executed from a console On reboot you are presented with a set of user interface based data entry forms that facilitate the required change in configuration Emulex Drivers for Solaris User Manual P008022 01A R
77. nstance to another NOTICE identifies the driver message severity level This may change from one driver version to another For other severity information see Table 6 3 Emulex Drivers for Solaris User Manual P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 3 gt EMULEX Log Messages for the FC FCoE Driver Severity Levels of FC FCoE Driver Log Messages on page 30 e 720 identifies the driver message identification number This number does change from one driver version to another e Link up identifies the actual error or event message This message does not change from one driver version to another e 8 Gb s fabric identifies additional information specific to the error or event message This information is normally intended for technical support This may change from one driver version to another Log Messages for the FC FCoE Driver Miscellaneous Events Message IDs 0001 0099 0001 DEBUG VERBOSE_MASK LOG_MISC 0x00000001 DESCRIPTION This is a general purpose informational message SEVERITY LEVEL Debug MESSAGE None ACTION No action needed informational 0002 NOTICE VERBOSE_MASK LOG_MISC 0x00000001 DESCRIPTION This is a general purpose informational message SEVERITY LEVEL Notice MESSAGE None ACTION No action needed informational 0003 WARNING VERBOSE_MASK LOG_MISC 0x00000001 DESCR
78. og VERBOSE_MASK LOG_PKT 0x00000200 DI a I O channel tx queue SEVERITY LEVEL Debug MESSAGE CHANNEL watchdog ACTION No action needed informational 0912 DEBUG TXQ watchdog VERBOSE_MASK LOG_PKT 0x00000200 D transmit queue SEVERITY LEVEL Debug MESSAGE TXQ watchdog ACTION No action needed informational 0920 DEBUG Packet flush VERBOSE MASK LOG_PKT 0x00000200 SEVERITY LEVEL Debug MESSAGE Packet flush ACTION No action needed informational 0921 DEBUG Packet flushed VERBOSE MASK LOG_PKT 0x00000200 SEVERITY LEVEL Debug MESSAGE Packet flushed ACTION No action needed informational 0922 NOTICE Packet flush timeout VERBOSE MASK LOG_PKT 0x00000200 ESCRIPTION This indicates that I O s are getting stale waiting on ESCRIPTION This indicates that an I O was found missing from the DESCRIPTION This indicates that an I O packet is being flushed DESCRIPTION This indicates that an I O packet has been flushed ESCRIPTION This indicates that an I O packet flush request has EVERITY LEVEL Notice ESSAGE Packet flush timeout D t will attempt to recover by itself S M ACTION No action needed informational However if the problem imed out with some I O packets s still n
79. on Failed Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter Failed to setup interrupts Reload the driver after changing MOD_CONFIG CE_WARN the interrupt priorities Failed to allocate Queue Increase the memory MOD_CONFIG CE_WARN memory oce_rx no frags Malfunctioning hardware Check MOD_RX CE_WARN and or replace the SFP and or adapter ddi_dma_addr_bind_handle Increase the memory MOD_CONFIG CE_WARN failed rc lt code gt Ring buffer allocation failed Increase the memory MOD_CONFIG CE_WARN lt code gt POST ERROR Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter Insufficient Vectors Reload the driver after changing MOD_CONFIG CE_WARN the interrupt priorities EQ ring alloc failed Increase the memory MOD_CONFIG CE_WARN EQ create failed rc lt code gt Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter Emulex Drivers for Solaris User Manual P008022 01A Rev A 63 gt EMULEX Table 7 3 Log Messages for the NIC Driver for Solaris 10 Continued 7 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK SEVERITY CQ create failed lt code gt Hardware error Download the MO
80. on MOD_ MASK Severity WCCQ create failed Check for the faulty hardware using MOD_ CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit WQ create failed Check for the faulty hardware using MOD CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit RQ allocation failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system RQ bdesc alloc failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system RQ shadow ring alloc failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system RQ ring create failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system RQ create failed Check for the faulty hardware using MOD CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_pa
81. ot completed The driver persists report this error to your customer service representative 0930 NOTICE Packet transport failed VERBOSE_MASK LOG_PKT 0x00000200 D failed The I O packet will be retried by the upper layer 5 EVERITY LEVEL Notice ESCRIPTION This indicates that an attempt to send an I O packet P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages 49 Log Messages for the FC FCoE Driver ME SSAGE Packet transport failed ACTION No action needed informational 0931 ERROR Packet transport error VE RBOSE _MASK LOG_PKT 0x00000200 F E SCRIPTION This indicates that an error occurred while attempting o send an I O packet The I O packet will likely be failed back to F VERITY LEVEL Error F D t the user application S M SSAGE Packet transport error ACTION No action needed informational However if the problem persists report this error to your customer service representative 0932 DEBUG Packet transport VE RBOSE_MASK LOG_PKT 0x00000200 ESCRI PTION This provides additional information about a packet F VERITY LEVEL Debug D being sent 5 M F SSAGE Packet transport ACTION No action needed informational 0940 DEBUG Packet completion error VE RBOSE_MASK LOG_PK
82. r the FC FCoE Driver IP Traffic Events Message IDs 1200 1299 1200 DEBUG IP detail VE RBOS E_ MASK LOG_IP_DETAIL 0x08000000 ESCRI PTION This provides detailed information about the driver s P interface VERI TY LEVEL Debug D I SE M F SSAG E IP detail ACTION No action needed informational 1210 ERROR Stray IP completion VE RBOS E_ MASK LOG_IP 0x00001000 ESCRI eceived without issuing a corresponding IP sequence This error PTION This indicates that an IP sequence completion was F VERI TY LEVEL Error F SSAG D x could indicate a driver or firmware problem S M E Stray IP completion ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 1211 DEBUG Abnormal IP completion VERBOS E_ MASK LOG_IP 0x00001000 ESCRI tatus PTION This indicates that an IP sequence completed with a error in the IOCB It could mean the Fibre Channel device on twork is not responding EVERI TY LEVEL Debug D S the ne S M ESSAGE Abnormal IP completion ACTION No action needed informational However if the problem persis ts report this error to your system administrator 1220 DEBUG Unsolicited IP dropped VERBOSE_MASK
83. re is too hot S M EVERITY LEVEL Warning ESSAGE Adapter temperatur ACTION Check hardware ventilation Reduce adapter usage Shutdown host system 0423 NOTICE Adapter notice VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that the adapter has provided general nformation about the adapter s condition D i SEVERITY LEVEL Notice MESSAGE Adapter notice ACTION No action needed informational 0424 WARNING Adapter warning VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that an interrupt has occurred indicating a recoverable adapter error D a SEVERITY LEVEL Warning MESSAGE Adapter warning ACTION This error usually indicates a hardware or firmware problem with the adapter Check and or update firmware levels Report these errors to customer service 0425 ERROR Adapter error VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that a recoverable adapter error has ccurred D 0 SEVERITY LEVEL Error M ESSAGE Adapter error ACTION This error usually indicates a hardware or firmware problem with the adapter Check and or update firmware levels Report these errors to customer service 0426 NOTICE Adapter Async Status VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that the adapter h
84. rings Creating a Virtual NIC Using dladm To create a virtual NIC vNIC use the dladm utility with the create vnic option For example dladm create vnic l1 net0 vnicl Once a vNIC is created it can be assigned to a zone using the zonecfg utility For example zonecfg z zonel zonecfg zonel No such zone configured zonecfg zonel gt create zonecfg zonel gt set zonepath export zonel Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX zonecfg zonecfg zonecfg zonecfg zonecfg zonecfg zonel gt zonel gt zonel gt zonel gt zonel gt zonel gt 5 NIC Driver Configuration 27 Using the dladm Utility for Solaris 11 create add net set physical vnicl set address 192 168 1 100 verify commit Up to 63 VLANs can be used with each universal multichannel UMC virtual channel Note You cannot run Link Aggregation Control Protocol LACP when UMC is enabled Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages 28 General Situations 6 FC FCoE Driver Console and Log Messages This section describes the situations console messages and log messages you may see from the FC FCoE driver General Situations FC Link Fails to Come Up on 8 Gb s or 16 Gb s Adapter An FC link may fail to come up if the adapter attempts to connect to a device running at a speed that the adapter does not support e For an
85. river Log Messages Severity Level Description DEBUG Informational Message provides engineering debugging information NOTICE Informational Message provides general purpose information WARNING Message provides a general purpose warning ERROR Message indicates that a driver error has occurred PANIC Severe Message indicates that the driver has forced a system panic to occur Log Message Example The following is an example of a log message on the system console 5 0336JelxfcO NOTICE 720 Link up 8Gb fabric The following is an example of the same message in the system message log var adm messages file Jan 19 14 45 36 sunv240 elxfc ID 349649 kern info 5 0336 elxfc0 NOTICE 720 Link up 8Gb fabric In the above system log message Jan 19 14 45 36 the date and time when the error or event occurred sunv240 the name of the host machine elxfc the module where the message originates In this case elxfc means that it is from Emulex SFS FCA out of box driver ID 349649 kern info a Solaris specific message ID and kernel message level This changes from one driver message to another 5 0336 the driver message context tag This may change from one driver version to another elxfc0 the module instance where the message originates In this case elxfc0 means that it is from Emulex SFS FCA out of box driver instance of 0 This changes from one driver i
86. scribed in this manual at any time and without any notice Emulex assumes no responsibility for its use nor for any infringements of patents or other rights of third parties that may result Periodic changes are made to information contained herein although these changes will be incorporated into new editions of this manual Emulex disclaims any undertaking to give notice of such changes Emulex 3333 Susan Street Costa Mesa CA 92626 Emulex Drivers for Solaris User Manual P008022 01A Rev A DE EMULEX Table of Contents 3 Table of Contents List OF Tabl6S cisciscicccncstersdtatcnsssbnrsersnacienrtisnisennad emantes Csi snaieneeeeeeraeianeanns 6 1 Introductio ciissinteccsdscrstsiertnncnnsnnsenrddnasienienanentenenenenisreiennee teenies 7 PrOrequiSileSs sccissseisstcindscsassacseadiasesdasedessecsaernsssecssearssaTedaesiaaneciadenaanedaaes 7 AUCIENC Ss vcautv nonce tuwieetivneresstutuiwedcoevesw ener E a a eE eh 7 Supported Operating SYSUGMIS 2 cscececeiancdcacec tava backteDieaewasnlateesactsenioewaeetacass 7 Adapter Firmware and Stack Compatibility cccccccceeeeeeeeeeeeeeeeeeeaeeenanes 7 KMOWN ISSUCS sssssssssnsnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnannan anann 7 ADbDreviatiOns E T 8 2 Installing and Uninstalling sssssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnunnnnnnnnnnnnnnnnnnnnn 9 Installing the Drivers for Solaris 10 and 11 ssssssnnsnssnssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 9 FC FCoE Out of Bo
87. system D h SEVERITY LEVEL Error MESSAGE Invalid DMA handle ACTION If the problem occurs frequently report these errors to customer service Service Level Interface Events Message IDs 0400 0499 0400 DEBUG Vital Product Data VERBOSE MASK LOG_SLI 0x00000010 ESCRIPTION This provides vendor specific information about the D a SEVERITY LEVEL Debug MESSAGE Vital Product Data ACTION No action needed informational 0410 DEBUG Link atten VERBOSE MASK LOG_SLI 0x00000010 Emulex Drivers for Solaris User Manual P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages 38 gt lt EMULEX Log Messages for the FC FCoE Driver DESCRIPTION This indicates that the adapter has triggered a link attention interrupt SEVERITY LEVEL Debug MESSAGE Link atten ACTION No action needed informational 0411 DEBUG State change VERBOSE_MASK LOG_SLI 0x00000010 DESCRIPTION This indicates that the adapter has changed state SEVERITY LEVEL Debug MESSAGE State change ACTION No action needed informational 0412 DEBUG Link Up atten VERBOSE_MASK LOG_SLI 0x00000010 ESCRIPTION This indicates that the adapter has triggered a link up ttention interrupt D a SEVERITY LEVEL Debug M ESSAGE
88. tail VERBOS E_ MASK LOG_SFS_DETAIL 0x20000000 ESCRI PTION This provides detailed information about the driver s terface TY LEVEL Debug ESSAG E SFS detail ACTION No action needed informational 1310 WARNING Diagnostic error VERBOS E MASK LOG_SFS 0x00002000 ESCRI PTION This indicates that a diagnostic request did not te because of some issue TY LEVEL Warning ESSAG E Diagnostic error ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 1311 DEBUG ECHO diagnostic completed VERBOS E_ MASK LOG_SFS 0x00002000 DESCRI PTION This indicates that an ECHO diagnostic has completed SEVERI TY LEVEL Debug MESSAG E ECHO diagnostic completed ACTION No action needed informational Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 1312 WARNING ECHO diagnostic failed 0x00002000 ndicates that an VERBOS ESCRI E MASK PTION LOG_SFS This i 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 53 ECHO diagnostic has failed to h your FC network EVERITY L ECHO diagnostic failed EVEL Warning D r wit S MESSAGE ACTION C
89. tained in the informational 1510 ERROR Bad firmware image VERBOS ESCRI the dow E MASK PTION nload function LOG_FIRMWAR O EV EVERITY L BL ESSAG Bad fir ACTION Obtain the proper report this error to your mMrror D t S M pP ai 0x00008000 This indicates that a bad firmware image was provided mware image If the problem persists representative image file customer servic 1511 ERROR Firmware image not compatible F VERBOSE_MASK LOG_FIRMWAR DESCRIPTION compatible with SEVERITY LEVEL Error MESSAGE F ACTION Obtain the proper report this error to your Emulex Drivers for Solaris User Manual 0x00008000 a This indicates that the firmware image provided was not the existing hardware irmware image not compatible If the problem persists representative image file customer servic P008022 01A Rev A 6 FC FCoE Driver Console and Log Messages gt G EMULEX 1520 NOTICE Firmware download 0x00008000 LOG_F IRMWARE VERBOSE_MASK ESCRIPTION has occurred D ay SEVERITY LEVEL MESSAGE ACTION No action needed Notice Firmware download informational 1521 NOTICE Firmware download complete VERBOSE_MASK LOG_FIRMWARE 0x00008000 DESCRIPTION image
90. ters The emlxdrv utility is used for binding associating the Emulex Leadville Fibre Channel out of box drivers to the various models of Emulex FC adapters If the driver binding configuration is changed the host system must be rebooted for the new configuration to take effect For more information see the Solaris FCA Utilities User Manual Emulex Drivers for Solaris User Manual P008022 01A Rev A gt EMULEX 4 FC FCoE Driver Configuration 12 Editing the FC FCoE Configuration File elxfc conf 4 FC FCoE Driver Configuration The module name for the Emulex SFS FCA out of box driver is elxfc You can configure the Emulex SFS FCA driver parameters by e Editing the configuration file elxfc conf which is described in this section e Using the OneCommand Manager application For more information see the OneCommand Manager Application User Manual e Using the Emulex FCA utilities emlxadm and emlxdrv For more information see the Solaris FCA Utilities User Manual Editing the FC FCoE Configuration File elxfc conf The configuration file contains all the parameters necessary to initialize the Emulex SFS FCA out of box driver Changing Driver Parameters The configurable driver parameters are defined in Table 4 1 FC FCoE Configuration File Parameters on page 15 To change driver parameters 1 Open the configuration file in a text editor Change the parameters to the desired settings 2 3 Save the fi
91. th gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to del q Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Emulex Drivers for Solaris User Manual P008022 01A Rev A gt EMULEX Table 7 4 Log Messages for the NIC Driver for Solaris 11 Continued 7 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Failed to set EQ delay Recommended Action Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_MASK MOD_CONFIG Severity CE_WARN Failed to Configure RSS Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN MAC addition failed Reload the driver MOD_CONFIG CE_WARN Could not find the MAC lt mac addr gt Provide the correct MAC address MOD_CONFIG CE_WARN Failed to delet
92. vice representative Emulex Drivers for Solaris User Manual P008022 01A Rev A gt G EMULEX 6 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver 43 Node Events Message IDs 0600 0699 0600 DEBUG Node create LOG_NODE VERBOSE_MASK ESCRIPTION emote device D ia SEVERITY LEVEL MESSAGE ACTION No action needed Debug Node create 0601 DEBUG Node opened VERBOSE_MASK LOG_NODE_DETAIL 0x00000040 This indicates that a node has been created for a informational 0x02000000 ESCRIPTION ransport D t SEVERITY LEVEL MESSAGE ACTION No action needed Debug Node opened This indicates that a node has been opened for I O informational 0602 NOTICE Node create failed VERBOSE_MASK ESCRIPTION LOG_NODE Notice EVERITY LEVEL 0x00000040 This indicates that a nod create request for a remote D device has failed S M ESSAGE Node create fail ACTION No action needed 0603 DEBUG Node updated LOG_NODE VERBOSE_MASK ESCRIPTION emote device D Y SEVERITY LEVEL MESSAGE ACTION No action needed Debug Node updated 0610 DEBUG Node destroy LOG_NODE VERBOSE_MASK ESCRIPTION emote device D ie SEVERITY LE
93. was successful SEVERITY LEVEL Notice MESSAGE Firmware download complete ACTION No action needed informational 1522 ERROR Firmware download failed VERBOSE_MASK LOG_FIRMWARE 0x00008000 DESCRIPTION image was failed SEVERITY LEVEL Error MESSAGE Firmware download failed ACTION Check your hardware configuration 56 Log Messages for the FC FCoE Driver This indicates that an attempt to download a firmware This indicates that an attempt to download a firmware This indicates that an attempt to download a firmware If the problem persists report this error to your customer servic 1523 WARNING Firmware updated 0x00008000 VERBOSE_MASK ESCRIPTION he adapter D SEVERITY LEVEL MESSAGE A t LOG_F IRMWARE Warning Firmware updated he new firmware 1530 DEBUG Firmware dump LOG_FIRMWARE VERBOSE_MASK 0x00008000 DESCRIPTION SEVERITY LEVEL MESSAGE Debug Firmware dump ACTION Check your hardware configuration representative This indicates that new firmware has been updated on CTION A reboot or adapter power cycle will be required to activate This indicates that a firmware core dump has occurred If the problem persists report this error to your customer servic 1540 WARNING Firmware update required
94. x Driver Gite j scesivcavanteseragudedimiasenkiocntacuatesixersanteaused 9 NIC Out of Box Driver elXniC 4 ssiccsmesicneesinieicwevinesveeterdausebtediarseaeraersvees 9 The elxnic Driver and NIC Inbox Driver oce Cannot CoexiSt cccccceeeeeeeeeeeeaes 9 Uninstalling the Drivers for Solaris 10 and 11 sssssssssssssunnnnnnnnnnnnnnnnnnnnnnnnn 10 PC COE Diver eoria eaa A E E cine lasieendasiacrehderrdaade yess 10 DIG DTIVET peor weaned seaeacatlesecevanedn cues E wemeteunes caecum E E E 10 3 Utilities for Solaris Drivers sssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 11 OneCommand Manager Application ssssssssssnnnrnnnnnsnnunnnnnnnnnnnnnunnnnnnnnnnnnnnnn 11 CMIXAGM VtiiTY iis ccccicscescctsscsssscscsscatesescssssstsssssssssesssesssserasserssserasssrssserees 11 Si VEE iscsi a EE a N 11 4 FC FCoE Driver Configuration ssssssssssssssunnnnnnnnnnnnnnnunnunnnnnnnnnnnnnnnnnn 12 Editing the FC FCoE Configuration File elxfc conf ssssssssnnnnnnnnnsnnnnnnnnnnnnnnnn 12 Changing Driver ParaMetelss cccccce cece cece e renee eee eee nets seat ee eatee satin esnntennngs 12 Configuring NPIV Support isisccicaxeicaesteiwesnritiir edie idssseredrte she eieeceeNoranene 12 Enabling NPIV Support on Solaris 10 0 0 0 0 cece eee en eee teeter 12 Enabling NPIV Support on Solaris 11 0 0 0 rea 13 NPIV Configuration LiIMits ccceccecce cee c eee eeeeeeee esas eeeeeeee sent eeaeseneeeeeenne ented 13 NPI
95. xX target mode 1 Where X is the specific numeric path For example when elxfc1 target mode 1 then all other paths stay in initiator mode Remove the comment for this line ddi forceattach 1 Reboot the system To configure targets see the Oracle COMSTAR Administration document FC FCoE Configuration File Parameters Notes e All parameters are adapter specific e All adapter specific parameters have an elxfcX prefix where X is the driver instance number For example setting elxfcO link speed 4 makes 4 Gb s the link speed setting for the 0 instance of the elxfc driver e The OneCommand Manager application reflects the configuration file driver parameters For more information see the OneCommand Manager Application User Manual e If you want to override a driver parameter for a single driver loading session you can specify it as a parameter to the modload command The following example is for 64 bit platforms modload kernel drv sparcv9 elxfc automap 0 Emulex Drivers for Solaris User Manual P008022 01A Rev A 4 FC FCoE Driver Configuration 15 gt lt EMULEX FC FCoE Configuration File Parameters e The Activation column in the following Table 4 1 shows the requirement for the parameter change to take effect Activation requirements include adapter reset dynamic reset no reset is necessary link reset and reboot The following table lists the FC FCoE configuration file parameters

Emulex Drivers for Solaris User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents