Home

PCI Hot Plug User`s Guide I/O devices edition

image

Contents

1. following indicate to bind the auto mapped target with the card usr sbin Ipfe lputil lt Return gt LightPulse Common Utility for Solaris SPARC Version 1 6a8 03 03 2004 Copyright c 2003 Emulex Network Systems Inc Emulex Fibre Channel Host Adapters Detected 2 Host Adapter 0 Ipfc11 is an LP9802 Ready Mode Host Adapter 1 Ipfc9 is an LP9802 Ready Mode MAIN MENU 1 List Adapters 2 Adapter Information 3 Firmware Maintenance 4 Reset Adapter 5 Persistent Bindings 0 Exit Enter choice gt 5 lt Return gt PERSISTENT BINDINGS MENU Display Current Bindings Display All Nodes Duplicate Adapter Bindings Bind Target Manually Bind Automapped Targets Delete Binding s Return to Main Menu Enter choice gt 5 lt Return gt 0 Ipfc11 1 Ipfc9 Select an adapter gt 0 lt Return gt SDN uno Automapped FCP Nodes Node Target WWPN WWNN Automapped FCP Node 0 50 06 0e 80 00 10 04 92 50 06 0e 80 00 10 04 92 Automapped FCP Node 1 50 06 0e 80 00 10 04 90 50 06 0e 80 00 10 04 90 Press the Enter or Return key to continue Bind all auto mapped targets Y N gt Y lt Return gt Select Binding Method 1 By Node Name 2 By Port Name 3 By D ID 0 Cancel Enter Choice gt 2 lt Return gt 9 Connect to redundant system The following procedure is described for MPHD GRMPHD If you use the redundancy software other than MPHD GRMPHD see the document for each produc
2. for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility WWPN zoning of SN200 series Host affinity of Array disk device ETERNUS3000 GR700 800 series and binding setting for fjpfca conf sd conf of host can be added from SAN management window automatically See Operation guide or User s Manual of each product for details Before using this function the following procedure 8 a 1 and 8 a 2 except fcp bind target setting are necessary Moreover begin from procedure 8 a 3 after executing this function If you don t use SAN management function of the above products No procedure is necessary Go to step 8 for Fibre Channel Card PW028FC3 PW028FC3U No procedure is necessary Go to step 8 Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration Set up driver Add the configuration of driver according to the following operation As for file related drivers additional configuration of the PCI card driver and the device driver is needed a Add the configuration of PCI cards driver SCSI driver Solaris OE glm
3. name hddv class scsi target 0 lun 7 name hddv class scsi target 1 lun 0 name hddv class scsi target 1 lun 1 Remove comments of the LUN in use an name hddv class scsi target 1 lun 2 name hddv class scsi target 3 lun 0 name hddv class scsi target 3 lun 1 Remove comments of extended LUN name hddv class scsi target 3 lun 2 name hddv class scsi target 3 lun 3 6 Check the LUN definition overlap between sd conf and hddv conf by executing hddvchk conf command The message example for Check NG means that target 3 is defined in both files and the procedures must be performed again from procedure 8 b 4 The followings are examples of execution of the FJSVhddv package installation to opt The path of the hddvchk_conf command depends on the installed directory Check OK to procedure 8 b 7 opt FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 8 b 4 opt FJSVhddv bin hddvchk_conf lt Return gt NG ID 3 7 Execute the following command in order to make the hard disk driver set up the LUN added update_drv f hddv lt Return gt In case disk array equipment currently used exists the following messages are displayed but do not effect performance update_drv f hddv lt Return gt Cannot unload module hddv Will be unloaded upon reboot Forcing update of hddv conf
4. Fibre Channel driver PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X 1 After saving execution result of prtpicl IM command take the difference between the result and the information obtained in procedure 3 a to calculate the instance number of the fjpfca driver of the PCI card added In the following example instance number is 1 indicating that the interface name of the PCI card added is fipfcal Making the LED of the PCI card blink using the fc_adm command can specify the relation between the instance number and the slot position The relation between the WWPN and instance number of the PCI card added can be known from the fc info a command prtpicl v gt tmp prtpicl pfca lt Return gt diff tmp prtpicl pre tmp prtpicl pfca more lt Return gt status okay fru PCI slot PCI 02 at Rack 0 IO_BOX 1 component name ROBO1 PCI 02 devfs path pci 8d 2000 fibre channel 1 driver name fipfca binding name pcil0cf 105c bus addr 1 instance 1 class obp device name fibre channel EE VVVVV VV VV VO 2 Edit the kernel drv fjpfca conf file and add the following property definitions to the instance number determined in 8 a 1 port type of topology link speed Defined when adding PCI cards with Fabric connection This definition is not needed with FC AL connection fcp bind target connection between target ID and WWN Defined when adding disk array with Fabric connection 59
5. for Fibre Channel Card PW028FC3 PW028FC3U To replace PCI cards with the following configurations Fibre Channel switch and disk array device need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch If the Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label on the back of the card These characters represent the bottom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 TEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration a Before extension of PCI cards save the current execution result of the prtpicl 1M command current configuration at present prtpicl v gt tmp prtpicl pre lt Return gt b Check the
6. name hddv class scsi target 1 lun 2 name hddv class scsi target 3 lun 0 name hddv class scsi target 3 lun 1 Remove comments of extended LUN name hddv class scsi target 3 lun 2 name hddv class scsi target 3 lun 3 f Check the LUN definition overlap between sd conf and hddv conf by executing hddvchk_conf command The message example for Check NG means that target 3 is defined in both files and the procedures must be performed again from procedure 1 d The followings are examples of execution of the FJSVhddv package installation to opt The path of the hddvchk_ conf command depends on the installed directory Check OK to procedure 1 g opt FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 1 d opt FJSVhddv bin hddvchk_conf lt Return gt NGID 3 g Reconfigure the kernel restart the system and then start system operation touch reconfigure lt Return gt usr sbin shutdown y i6 g0 lt Return gt Stop the machine administration hardware monitoring daemon Execute the following commands to stop the machine administration hardware monitoring daemon usr sbin FJSVmadm prephp lt Return gt If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped ete rc0 d K10hbanyware stop lt Return gt Jete
7. Commands and other input use the following prompts C shell prompt prompt Bourne and korn shell prompt prompt Super user prompt 4 Commands entered by the user is shown in bold cfgadm c configure pcipsy2 ROB00 PCI slot01 lt Return gt Key combinations are represented for example by CTL C which means to simultaneously press the Control and C key Reference Manuals If necessary refer to the following manuals PCI Hot Plug User s Guide Dynamic Reconfiguration User s Guide Trademarks Sun Sun Microsystems the Sun Logo Solaris and all Solaris based marks and logos are trademarks or registered trademarks of Sun Microsystems Inc in the U S and other countries and are used under license All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International Inc in the U S and other countries Products with the SPARC trademark are based on architecture developed by Sun Microsystems All other products or company names mentioned in this document are claimed as trademark and trade names by their respective companies FUJITSU LIMITED November 2003 January 2003 First Edition April 2003 Second Edition June 2003 Third Edition July 2003 Fourth Edition November 2003 Fifth Edition May 2004 Sixth Edition Notes This manual may not be copied by any means without the expressed written permission of FUJITSU LIMITED FUJITSU LIMITED reserves the right to make c
8. PCI Hot Plug User s Guide I O devices edition FUJITSU Preface Purpose This manual describes the procedure of exchanging or extending file PCI cards and network PCI cards using the PCI Hot Plug feature Intended Readers This manual is intended for the following readers System software developers and test engineers System support engineers System administrators who uses this function Hardware engineers who uses this function Organization This manual is organized as follows Chapter 1 PCI cards with support for PCI Hot Plug describes the lists of PCI cards supporting PCI Hot Plug Chapter 2 Overview of replacement and extension of PCI cards describes the outline of a procedure of replacement and extension of PCI cards Chapter 3 File devices describes the detailed procedure of PCI Hot Plug about file devices Chapter 4 Network devices describes the detailed procedure of PCI Hot Plug about network devices Chapter 5 Notes for PCI Hot Plug describes the notes when using PCI Hot Plug Notation Used The following shows the notation conventions used in this manual In this manual the Solaris TM Operating Environment is abbreviated to Solaris OE the Solaris TM 8 Operating Environment is abbreviated to Solaris 8 OE the Solaris TM 9 Operating Environment is abbreviated to Solaris 9 OE The titles of chapters are enclosed in parentheses Example See Chapterl PCI cards supporting PCI Hot Plug
9. Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Stop the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U stop the daemons Add PCI cards Extend PCI cards Connect PCI cards It changes into the state where the PCI card is usable 10 11 Start the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U start the daemons Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Preparation to recognize devices for Fibre Channel If you use SAN management function preparation to recognize devices Set up driver a Add the driver configuration of PCI cards Add the driver configuration of PCI cards b Add the configuration of device driver Add the configuration of device driver in the case of file devices Setup applications Configure the high layer products and services about extended PCI cards Start applications Start high layer products and services used by the replaced PCI card Network devices procedures 1 2 2 2 2 Setup I O devices which will be added to system Setup devices which will be added to system in the case of file devices on Solaris 8 OE Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Add PCI card
10. devices pci 89 2000 fibre channel 1 hddv 3 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s3 gt devices pci 89 2000 fibre channel 1 hddv 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s4 gt devices pci 89 2000 fibre channel 1 hddv 3 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s5 gt devices pci 89 2000 fibre channel 1 hddv 3 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s6 gt devices pci 89 2000 fibre channel 1 hddv 3 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s7 gt devices pci 89 2000 fibre channel 1 hddv 3 0 h 4 Start the format 1M command and configure labeling and partition slice information calculated in 9 b 3 to the logical path name of each extended LUN c Add configure of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver No procedure is necessary Go to step 10 Fibre Channel driver PW008FC2U W008FC2X GP7B8FC1U GP7B8FC1X No procedure is necessary Go to step 10 Fibre Channel Card PW028FC3 PW028FC3U Bind the auto mapped target connected with the card and modify the entries of lpfc conf to match the requirements of the extended Fibre Channel Controller These procedures are reflected on next boot time In the following indicate to bind the auto mapped target with the card usr sbin Ipfe Iputil lt Return gt LightPulse Common Utility for Solaris SPARC Version 1 6a8 03 03 2004 Copyright c 2003
11. devices pci 89 4000 scsi 2 sd 2 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s3 gt devices pci 89 4000 scsi 2 sd 2 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s4 gt devices pci 89 4000 scsi 2 sd 2 0 e 23 lrwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s5 gt devices pci 89 4000 scsi 2 sd 2 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s6 gt devices pci 89 4000 scsi 2 sd 2 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s7 gt devices pci 89 4000 scsi 2 sd 2 0 h Tape device diff tmp prtpicl pre tmp prtpicl post grep devfs path grep st lt Return gt gt devfs path pci 89 4000 scsi 2 st 5 0 Is 1 dev rmt grep pci 89 4000 scsi 2 st 5 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 1 gt devices pci 89 4000 scsi 2 st 5 0 Irwxrwxrwx 1 root root 41 Sep 20 22 53 1b gt devices pci 89 4000 scsi 2 st 5 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 1bn gt devices pci 89 4000 scsi 2 st 5 0 bn Irwxrwxrwx 1 root root 41 Sep 20 22 53 Ic gt devices pci 89 4000 scsi 2 st 5 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 1cb gt devices pci 89 4000 scsi 2 st 5 0 cb Irwxrwxrwx 1 root root 41 Sep 20 22 53 1cbn gt devices pci 89 4000 scsi 2 st 5 0 cbn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1cn gt devices pci 89 4000 scsi 2 st 5 0 cn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1h gt devices pci 89 40
12. diff tmp prtpicl pre tmp prtpicl post grep devfs path grep sd lt Return gt gt devfs path pci 89 4000 scsi 2 sd 2 0 Is l dev dsk grep pci 89 4000 scsi 2 sd 2 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s0 gt devices pci 89 4000 scsi 2 sd 2 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s1 gt devices pci 89 4000 scsi 2 sd 2 0 b lrwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s2 gt devices pci 89 4000 scsi 2 sd 2 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s3 gt devices pci 89 4000 scsi 2 sd 2 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s4 gt devices pci 89 4000 scsi 2 sd 2 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s5 gt devices pci 89 4000 scsi 2 sd 2 0 f lrwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s6 gt devices pci 89 4000 scsi 2 sd 2 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s7 gt devices pci 89 4000 scsi 2 sd 2 0 h Tape device diff tmp prtpicl pre tmp prtpicl post grep devfs path grep st lt Return gt gt devfs path pci 89 4000 scsi 2 st 5 0 Is l dev rmt grep pci 89 4000 scsi 2 st 5 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 1 gt devices pci 89 4000 scsi 2 st 5 0 Irwxrwxrwx 1 root root 41 Sep 20 22 53 1b gt devices pci 89 4000 scsi 2 st 5 0 b lrwxrwxrwx 1 root root 41 Sep 20 22 53 1bn gt devices pci 89 4000 scsi 2 st 5 0 bn Irwx
13. not the first time to Check if kernel drv hddv conf exists If it exists the hard disk driver is being installed so start from procedure 8 b 3 If it does not exist the system is being operated with none active extension procedures so start from procedure 8 b 2 Not exist new install to procedure 8 b 3 Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory Exists operation with non active extension procedures to procedure 8 b 2 Is kernel drv hddv conf lt Return gt kernel drv hddv conf When operating with non active extension procedures execute the following commands and confirm that kernel drv hddv conf is deleted hddvadm i lt Return gt Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory Use the following command to create hddv conf file for the active extension fun ction The message examples for operation with non active extension procedures means that disk array device GR720 currently used with taget 1 lun 0 is registered twice on the sd hddv driver New installation to procedure 8 b 5 hddvadm M lt Return gt Operation with non active extension procedures to procedure 8 b 4 hddvadm M lt Return gt already ID 1 exists devices pci 1d 2000 fibre channel 1 sd 1 0 a raw GR720 When performing pre defined extension the same target number cannot be regis
14. 8 After saving execution result of the prtpicl 1M command get the physical path name of added LUN by taking the difference between the result and the information obtained in 3 a and calculate the corresponding logical path name under dev dsk In the following example c3t3d0 is logical path name of added lun 0 The logical path name of lun 1 2 is set to c3t3d1 c3t3d2 respectively because cXtYdZmeans X PCI card number Y target number Z lun number prtpicl v gt tmp prtpicl post lt Return gt diff tmp prtpicl pre tmp prtpicl post grep devfs path grep hddv lt Return gt gt devfs path pci 89 2000 fibre channel 1 hddv 3 0 gt devfs path pci 89 2000 fibre channel 1 hddv 3 1 gt devfs path pci 89 2000 fibre channel 1 hddv 3 2 Is l dev dsk grep pci 89 2000 fibre channel 1 hddv 3 0 lt Return gt lrwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s0 gt devices pci 89 2000 fibre channel 1 hddv 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s1 gt devices pci 89 2000 fibre channel 1 hddv 3 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s2 gt devices pci 89 2000 fibre channel 1 hddv 3 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s3 gt devices pci 89 2000 fibre channel 1 hddv 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s4 gt devices pci 89 2000 fibre channel 1 hddv 3 0 e lrwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s5 gt devices
15. Emulex Network Systems Inc Emulex Fibre Channel Host Adapters Detected 2 Host Adapter 0 Ipfc11 is an LP9802 Ready Mode Host Adapter 1 Ipfc9 is an LP9802 Ready Mode MAIN MENU 1 List Adapters 2 Adapter Information 3 Firmware Maintenance 4 Reset Adapter 5 Persistent Bindings 0 Exit Enter choice gt 5 lt Return gt PERSISTENT BINDINGS MENU Display Current Bindings Display All Nodes Duplicate Adapter Bindings Bind Target Manually Bind Automapped Targets Delete Binding s Return to Main Menu Enter choice gt 5 lt Return gt 0 Ipfc11 1 Ipfc9 Select an adapter gt 0 lt Return gt Automapped FCP Nodes Node Target WWPN WWNN OMSM RR mm Automapped FCP Node 0 50 06 0e 80 00 10 04 92 50 06 0e 80 00 10 04 92 Automapped FCP Node 1 50 06 0e 80 00 10 04 90 50 06 0e 80 00 10 04 90 Press the Enter or Return key to continue Bind all auto mapped targets Y N gt Y lt Return gt Select Binding Method 1 By Node Name 2 By Port Name 3 By D_ID 0 Cancel Enter Choice gt 2 lt Return gt 10 Setup redundant system Execute the following commands to create a new redundant system The following procedure is described for MPHD GRMPHD If you use the redundancy software other than MPHD GRMPHD see the document for each product In case of MPHD the commands need to be executed for each LUN specifying the path name determined in 9 b 3 as a parameter The ita
16. Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Connect equipment to PCI cards Connect equipment to PCI cards Setup driver a Add the driver configuration of PCI cards Add the driver configuration of PCI cards b Add the configuration of device driver Add the configuration of device driver in the case of file devices Setup redundant system Configure the environmental configuration of a new redundant system and activate Setup applications Configure the high layer products and services about a new redundant system Start applications Start high layer products and services used by the new redundant system Extension of PCI cards to redundant system When extending PCI cards to the existing redundant system it is possible to extend PCI cards without stopping services and applications The extension procedure of PCI card to existing redundant system is as follows File devices procedures 1 2 10 Setup I O devices which will be added to system Setup devices which will be added to system in the case of file devices on Solaris 8 OE Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Stop the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U stop the daemons Add PCI cards Extend PCI cards Connect PCI cards It changes into the state where the PCI card is usable St
17. When using the Multipath Function the FNA Fujitsu Network Architecture SNA System Network Architecture communication protocol over Ethernet is valid For details please refer to the manual of Netcompo FNA LAN and high layer applications 4 2 3 Extension of PCI cards to redundant system This subsection describes the procedure extending PCI cards to the existing redundant configuration system with the following redundant configuration software SynfinityLink 2 2 PRIMECLUSTER GLS 4 0 or later The replacement and extension of PCI cards are supported only on Redundant Line Control Function of SynfinityLink Notes Because of the dynamic extension if the environment of SynfinityLink or PRIMECLUSTER GLS has been modified system reboot is not required When using other redundant software please refer to manuals of each product Moreover when extending PCI cards to the existing redundant configuration system it is unnecessary to operate about the high layer products Consequently PCI cards can be extended without stopping the high layer products 1 Stop the hardware monitoring of the Machine Administration The hardware monitoring of the Machine Administration is stopped by using the following command usr sbin FJSVmadm prephp lt Return gt 2 Add PCI cards a Before extending the PCI card please save the result current configuration information of the prtpicl 1M command prtpicl v gt
18. blink the ALARM LED of Ap_Id displayed in procedure 4 a cfgadm x led fault mode blink pcipsy3 COM00 PCI slot02 lt Return gt 5 Replace the PCI card Replace the PCI card disconnected in 4 with a replacement card and connect cable to devices This operation is performed by our customer support When exchanging Fibre Channel cards the following operations are also required for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker StorageMGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 7 If you don t use SAN management function of the above products To replace PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on SN200 series Ifthe Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the eight characters shown on a label on the front plate of the card These characte
19. lun 1 2 is set to c3t3d1 c3t3d2 respectively because cXtYdZmeans X PCI card number Y target number Z lun number prtpicl v gt tmp prtpicl post lt Return gt diff tmp prtpicl pre tmp prtpicl post grep devfs path grep hddv lt Return gt gt devfs path pci 89 2000 fibre channel 1 hddv 3 0 gt devfs path pci 89 2000 fibre channel 1 hddv 3 1 40 gt devfs path pci 89 2000 fibre channel 1 hddv 3 2 Is l dev dsk grep pci 89 2000 fibre channel 1 hddv 3 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s0 gt devices pci 89 2000 fibre channel 1 hddv 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s1 gt devices pci 89 2000 fibre channel 1 hddv 3 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s2 gt devices pci 89 2000 fibre channel 1 hddv 3 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s3 gt devices pci 89 2000 fibre channel 1 hddv 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s4 gt devices pci 89 2000 fibre channel 1 hddv 3 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s5 gt devices pci 89 2000 fibre channel 1 hddv 3 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s6 gt devices pci 89 2000 fibre channel 1 hddv 3 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s7 gt devices pci 89 2000 fibre channel 1 hddv 3 0 h 4 Start the format 1M command and configure label
20. opt FJS Vhanet usr sbin stphanet n sha0 lt Return gt Multipath Function usr opt FJS Viomp bin iompadm c mpnet stop mpnet0 hmel lt Return gt usr opt FJS Viomp bin iompadm c mpnet disconnect mpnet0 hmel lt Return gt 4 Disconnect the PCI card a Please specify the PCI bus slot position by the interface e g hmel in procedure 2 Specify the replacing PCI card usr sbin FJSVmadm inst2comp hmel lt Return gt pcipsy21 ROB01 PCI slot03 b Obtained Ap Id is specified as an argument of the cfgadm 1M command and it confirms that the slot status of the PCI card that disconnects is connected configured cfgadm pcipsy21 ROB01 PCI slot03 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy21 ROB01 PCI slot03 pci pci hp connected configured ok c Please disconnect the PCI card by executing the cfgadn 1M command with Ap_Id and confirm that the slot status is disconnected unconfigured cfgadm c disconnect pcipsy21 ROB01 PCI slot03 lt Return gt efgadm pcipsy21 ROB01 PCI slot03 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy21 ROB01 PCI slot03 pci pci hp disconnected unconfigured unknown d To confirm the slot position at replacement operation blink the ALARM LED of Ap Id d 4 a isplayed in procedure cfgadm x led fault mode blink pcipsy21 R0B01 PCI slot03 lt Return gt 5 Replace the PCI card The PCI card disconnected
21. st in this procedure and perform the same operation 1 See kernel drv sd conf and check that target 2 and lun 0 are defined When this definition does not exist add the definition If it is commented out remove comments Disk equipment vi kernel drv sd conf lt Return gt name sd class scsi target 0 lun 0 name sd class scsi In case the definition does not exist target 2 lun 0 add or remove comments Tape equipment vi kernel drv st conf lt Return gt name st class scsi 45 target 0 lun 0 name st class scsi In case the definition does not exist target 5 lun 0 add or remove comments 2 To make the sd driver set up the disk device added execute the following commands When the commands are executed the following messages are displayed but do not effect performance Similar messages are displayed when a tape device already exists when a tape device is added but does not effect performance Disk device update_drv f sd lt Return gt Cannot unload module sd Will be unloaded upon reboot Forcing update of sd conf Tape device update_drv f st lt Return gt 3 After saving the execution result of the prtpicl 1M command take the difference between the result and the information obtained in 3 a and get the physical path name of additional disk device then get the logical path name under dev dsk In the following example
22. 1 d hddvadm M lt Return gt already ID 1 exists devices pci 1d 2000 fibre channel 1 sd 1 0 a raw GR720 d When performing pre defined extension the same target number cannot be registered in sd conf and hddv conf 19 20 so delete or comment out the conflicting definition parts in sd conf file when definition in the two files conflict with each other The following example shows the case that target 1 is repeated vi kernel drv sd conf lt Return gt name sd class scsi target 0 lun 0 N name sd class scsi target 1 lun 0 name sd class scsi Delete or comment out target 1 lun 1 conflicting definition parts in sd hddv name sd class scsi target 1 lun 2 A target number that is already used by the sd driver of the system disk or CD ROM cannot be deleted In this case change the target number in hddv conf and of the disk array device so that it does not conflict with sd conf Edit the kernel drv hddv conf file created automatically by the hddvadm M command and remove comments of the LUN definition to pre define and the LUN definition currently being used with non active extension procedures If case active extension has been performed before and the LUN definition to extend the next procedures 1 f 1 g are not needed The following example shows target 3 lun 0 2 for pre defined extension and disk array device GR720 target 1 in use with non
23. 4 or earlier it is necessary to apply the driver version 1 4 1 or later and the patch 912214 02 or later Please contact our customer service about the latest patch 8 When using Solaris 8 OE it is necessary to apply the patch 114536 03 or later Please contact our customer service about the latest patch When applying the patch 114536 03 or later if the patch 912314 01 or later has applied it is necessary to remove the patch When removing the patch 912314 01 or 912314 02 the platform sun4us kernel drv fjgi conf file which defines fjgi interface settings will be replaced If you have edited fjgi conf please make a backup copy of fjgi conf beforehand and pick up your own settings and add them to the new one after removing the patch if necessary 9 When using Solaris 9 OE it is necessary to apply the patch 114994 03 or later Please contact our customer service about the latest patch When applying the patch 114994 03 or later if the patch 912660 01 or later has applied it is necessary to remove the patch When removing the patch 912660 01 or 912660 02 the platform sun4us kernel drv fjgi conf file which defines fjgi interface settings will be replaced If you have edited fjgi conf please make a backup copy of fjgi conf beforehand and pick up your own settings and add them to the new one after removing the patch if necessary 10 System rebooting is needed for hot extension 11 When PCI card is InfiniBand please refer to BLAS
24. 60 This definition is not needed with FC AL connection max throttle maximum issued SCSI commands Defined to limit the number of SCSI commands issued at the same time The need and value of this definition depends on the disk array device so refer to the manuals of each disk array device Below is an example where definitions for a PCI card at fjpfcal instance number 1 and a disk array device at target 3 is added vi kernel drv fjpfca conf lt Return gt port fipfca0 nport fipfcal nport spl lt add fcp bind target fipfca0t0 0x50000e1000002501 fjpfca1t3 0x50000e1000002ab0 lt add max throttle fjpfca0t0 128 fjpfca1t3 240 lt add 3 Execute the following command to make the fjpfca driver set up the additional part usr sbin FJSVpfca fc_config v lt Return gt Fibre Channel driver PW028FC3 PW028FC3U Configuration is not required Compare the output of prtpicl 1M command with the output saved at 3 b and find the instance number of the added card b Add configuration of device driver Disk Tape devices Solaris OE sd st This example is a case where a disk device of target 2 lun 0 is pre defined in procedure 1 and added in procedure 4 If the device is a tape device re read sd as st in this procedure and perform the same operation 1 Execute the following command to make the sd driver set up the added disk device usr sbin devfsadm lt Return gt 2 After saving t
25. Card PW028FC3 PW028FC3U No procedure is necessary Go to step 7 7 Connect to redundant system The following procedure is described for MPHD GRMPHD If you use the redundancy software other than MPHD GRMPHD see the document for each product Execute the following command specifying the logical path name from 3 b If the operating path switched in procedure 3 the operating path will be automatically switched back If both MPHD GRMPD controlled devices are connected to the PCI card to replace the commands for both products need to be executed MPHD usr opt FJS Viomp bin iompadm c mphd restart adapter connect dev rdsk c3t1d0s2 lt R eturn gt GRMPD usr opt FJS Viomp bin iompadm c mplb restart adapter connect dev rdsk c3t1d0s2 lt Return gt 8 If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started ete re2 d S99hbanyware start lt Return gt Jetc rc2 d S99hbanywareDisc start lt Return gt 9 Update hardware configuration information of machine administration Start the hardware monitoring daemon Execute the following commands to update hardware configuration information of machine administration and to restart the hardware monitoring daemon usr sbin FJSVmadm postphp lt Return gt 3 2 Extension of PCI cards This section describes the procedures to add PCI cards using the PCI Hot Plug feature on non redundant and redundant systems with Solar
26. Extension of PCI cards on non redundant system This subsection describes extension procedure of PCI cards without the redundant configuration software 1 Stop the hardware monitoring of the Machine Administration The hardware monitoring of the Machine Administration is stopped by using the following command Jusr sbin FJSV madm prephp lt Return gt 2 Add PCI cards a Before extending the PCI card please save the result current configuration information of the prtpicl 1M command prtpicl v gt tmp prtpicl pre lt Return gt b Check the status of the slot Subsequent examples describe extension of PCI cards to the slot COM01 PCI slot02 The COM01 PCI slot02 indicates the cabinet number 0 the system board number 1 physical slot number 02 The relationship of the position of a PCI card and format of Ap Id is shown below N an integral number Location of PCI slot Element Format of Ap Id Cabinet of Cabinet Number X System Board Number Y pcipsyN CXMOY PCI slotZZ PRIMEPOWER 900 1500 2500 Physical Slot Number ZZ I O Cabinet Number X PCI Disk Box PCI Disk Box Number Y pcipsyN RXBOY PCI slotZZ Physical Slot Number ZZ other than those above Physical Slot Number ZZ pcipsyN PCI slotZZ Please confirm that the PCI slot status which extended PCI cards is empty unconfigured by using cfgadm 1M command cfgadm grep COM01 PCI slot02 lt
27. Return gt e name sd class scsi target 0 lun 0 name sd class scsi target 1 lun 0 name sd class scsi Delete or comment out target 1 lun 1 conflicting definition parts in sd hddv name sd class scsi target 1 lun 2 A target number that is already used by the sd driver of the system disk or CD ROM cannot be deleted In this case change the target number in hddv conf and of the disk array device so that it does not conflict with sd conf e Edit the kernel drv hddv conf file created automatically by the hddvadm M command and remove comments of the LUN definition to pre define and the LUN definition currently being used with non active extension procedures If case active extension has been performed before and the LUN definition to extend the next procedures 1 f 1 g are not needed If the target number of each disk array controller of a redundant system differs add definition for each target number The following example shows target 3 lun 0 2 for pre defined extension and disk array device GR720 target 1 in use with non active extension procedures being registered Is kernel drv hddv conf lt Return gt kernel drv hddv conf vi kernel drv hddv conf lt Return gt name hddv class scsi target 0 lun 0 name hddv class scsi target 0 lun 7 name hddv class scsi target 1 lun 0 name hddv class scsi target 1 lun 1 Remove comments of the LUN in use
28. Return gt PERSISTENT BINDINGS MENU 1 Display Current Bindings 2 Display All Nodes 3 Duplicate Adapter Bindings 4 Bind Target Manually 5 Bind Automapped Targets 6 Delete Binding s 0 Return to Main Menu Enter choice gt 5 lt Return gt 0 Ipfc11 1 Ipfc9 Select an adapter gt 0 lt Return gt Automapped FCP Nodes Node Target WWPN WWNN Automapped FCP Node 0 50 06 0e 80 00 10 04 92 50 06 0e 80 00 10 04 92 Automapped FCP Node 1 50 06 0e 80 00 10 04 90 50 06 0e 80 00 10 04 90 Press the Enter or Return key to continue Bind all auto mapped targets Y N gt Y lt Return gt Select Binding Method 1 By Node Name 2 By Port Name 3 By D_ID 0 Cancel Enter Choice gt 2 lt Return gt 9 Setup applications Add configuration for the application using the logical path name determined in 8 b Disk device filesystem operation Create file system To mount at system start add an entry in the etc vfstab file newfs dev rdsk c2t2d0s6 lt Return gt vi etc vfstab lt Return gt dev dsk c2t2d0s6 dev rdsk c2t2d0s6 mnt ufs 1 yes Disk device raw access operation Tape device 49 10 Configure applications For details see the manual of each application Disk device swap device Add swap device To make valid at system start add an entry in the etc vfstab file swap a dev dsk c2t2d0s4 lt Return gt vi ete vfstab lt Return gt dev
29. Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 4 If you don t use SAN management function of the above products To add PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on SN200 series If the Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the eight characters shown on a label on the front plate of the card These characters represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 0e24 4061 for Fibre Channel Card PW028FC3 PW028FC3U 57 58 To replace PCI cards with the following configurations Fibre Channel switch and disk array device need to be reconfigured individually If
30. attached to each PCI card about memory capacity required in order to extend PCI cards and installation guide of the redundant configuration software about memory capacity required 5 2 Restrictions This section describes restrictions when exchanging and extending PCI cards by using PCI Hot Plug feature 75 76 Please do not exchange or expand PCI cards by using PCI Hot Plug feature during executing Dynamic Reconfiguration DR
31. cards that support PCI Hot Plug for network devices When using below PCI cards please refer to 5 1 1 Network driver configuration changing Please ask the sales staff about the latest information of PCI Hot Plug supporting cards Supporting Functions Software of driver Functions Product ID ONE Hot Hot Redundant Software driver name clock 1 replacement i extension 2 SynfinityLink 2 2 X1033A U 3 Solaris OE hme 33MHz OK OK X1033A X PRIMECLUSTER GLS 4 0 or later 4 FUJITSU PCI 10 100 ao 2 2 PWOOSFE1 Ethernet 1 0 or later 33MHz OK OK Enclosed with a PCI PRIMECLUSTER card 5 GLS 4 0 or later 4 FUJITSU PCI Quad n RENT 2 2 PW008QE1 10 100 SIDER 1 00r 335MHz OK OK later enclose with a PRIMECLUSTER PCI card 6 GLS 4 0 or later 4 FUJITSU PCI Quad ce 2 2 PWO008QE2 100 ene a OF 33MHz OK OK Ethernet ater enclosed with a PRIMECLUSTER PCI card GLS 4 0 or later 4 FUJITSU PCI Gigabit aoe 2 2 Ethernet 1 4 1 or later 33MHz PE028GE LU enclosed with a PCI 66MHz ve OK PRIMECLUSTER card 7 GLS 4 0 or later 4 FUJITSU PCI Gigabit aoe 2 2 Ethernet 1 4 1 or later 33MHz BWOOSGET Enelosed with a PCI 66MHz ve OK PRIMECLUSTER card 7 GLS 4 0 or later 4 FUJITSU PCI Gigabit S 2 2 Ethernet 2 0 or later 33MHz Pons enclosed with a PCI 66MHz OR OS PRIMECLUSTER card 78 9 GLS 4 0 or later 4 PWO008GES FUJITSU PCI Gigabit 33MHz OK
32. defined extension function The message examples for operation with non active extension procedures means that disk array device GR720 currently used with taget 1 lun 0 is registered twice on the sd hddv driver New installation to procedure 1 e hddvadm M lt Return gt Operation with non active extension procedures to procedure 1 d hddvadm M lt Return gt already ID 1 exists devices pci 1d 2000 fibre channel 1 sd 1 0 a raw GR720 d When performing pre defined extension the same target number cannot be registered in sd conf and hddv conf so delete or comment out the conflicting definition parts in sd conf file when definition in the two files conflict with each other The following example shows the case that target 1 is repeated vi kernel drv sd conf lt Return gt name sd class scsi target 0 lun 0 name sd class scsi target 1 lun 0 name sd class scsi Delete or comment out target 1 lun 1 conflicting definition parts in sd hddv name sd class scsi target 1 lun 2 A target number that is already used by the sd driver of the system disk or CD ROM cannot be deleted In this case change the target number in hddv conf and of the disk array device so that it does not conflict with sd conf e Edit the kernel drv hddv conf file created automatically by the hddvadm M command and remove comments of the LUN definition to pre define and the LUN definition c
33. definition currently being used with non active extension procedures If case active extension has been performed before and the LUN definition to extend the next procedures 1 f 1 g are not needed The following example shows target 3 lun 0 2 for pre defined extension and disk array device GR720 target 1 in use with non active extension procedures being registered Is kernel drv hddv conf lt Return gt kernel drv hddv conf vi kernel drv hddv conf lt Return gt name hddv class scsi target 0 lun 0 name hddv class scsi target 0 lun 7 name hddv class scsi target 1 lun 0 name hddv class scsi target 1 lun 1 remove comments of the LUN in use name hddv class scsi target 1 lun 2 61 62 name hddv class scsi target 3 lun 0 name hddv class scsi target 3 lun 1 remove comments of extended LUN name hddv class scsi target 3 lun 2 name hddv class scsi target 3 lun 3 6 Check the LUN definition overlap between sd conf and hddv conf by executing hddvchk conf command The message example for Check NG means that target 3 is defined in both files and the procedures must be performed again from procedure 8 b 4 The followings are examples of execution of the FJSVhddv package installation to opt The path of the hddvchk_conf command depends on the installed directory Check OK to procedure 8 b 7 opt FJSVhddv bin hddvchk_conf lt Return gt kerne
34. extension slot position Note that the push button is only effective in multiuser mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time efgadm c configure pcipsy18 R0B01 PCIFslot02 lt Return gt cfgadm pcipsy18 ROB01 PCI slot02 lt Return gt 51 52 Ap Id Type Receptacle Occupant Condition pcipsy18 R0B01 PCI slot02 mult hp connected configured ok If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started ete re2 d S99hbanyware start lt Return gt Jete rc2 d S99hbanywareDisc start lt Return gt Update hardware configuration information of machine administration Start the hardware monitoring daemon Execute the following commands to update hardware configuration information of machine administration and to restart the hardware monitoring daemon usr sbin FJSVmadm postphp lt Return gt Preparation to recognize devices for Fibre Channel When the Host Affinity function is being used with Fibre Channel SN200 series Host Affinity must be configured for the device added for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SA
35. fipfcal nport spl lt added fcp bind target fjpfca0t0 0x50000e 1000002501 fjpfca1t3 0x50000e1000002ab0 lt added max throttle fjpfca0t0 128 fipfcalt3 240 lt added 3 Execute the following command to make the fjpfca driver take in the added part usr sbin FJSVpfca fc_config v lt Return gt Fibre Channel driver PW028FC3 PW028FC3U Configuration is not required Compare the output of prtpicl 1M command with the output saved at 4 b and find the instance number of the added card b Add device driver configuration Add device driver configuration with the following procedures according to the I O device type Disk Tape devices Solaris OE sd st This example is a case where a disk device of target 2 lun 0 is pre defined in procedure 1 and added in procedure 5 If the device is a tape device re read sd as st in this procedure and perform the same operation 1 Execute the following command to make the sd driver set up the added disk device usr sbin devfsadm lt Return gt 2 After saving the execution result of the prtpicl 1M command take the difference between the result and the information obtained in 4 a and get the physical path name of additional disk device then get the logical path name under dev dsk In the following example c2t2d0 is the logical path name of the disk device added prtpicl v gt tmp prtpicl post lt Return gt Disk device
36. is usable 8 Start applications Start high layer products and services used by the replaced PCI card 9 Start the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U start the daemons 10 Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Network devices procedures 1 Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration 2 Specify the replacing PCI card Specify the devices and interfaces that are influenced by replacing PCI cards 3 Stop applications Stop services and high layer products that are influenced by replacing PCI cards 4 Disconnect the PCI card It changes into the state where the PCI card is exchangeable 5 Replace the PCI card Replace the PCI card 6 Connect the PCI card It changes into the state where the PCI card is usable 7 Start applications Start high layer products and services used by the replaced PCI card 8 Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration 2 1 2 Replacement of PCI cards on redundant system When exchanging PCI cards with redundant software it is possible to exchange PCI cards without stopping services and applications The replacement procedure
37. on the back of the card These characters represent the bottom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 IEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration 6 Connect the PCI card Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the replacement slot position Note that the push button is only effective in multiuser mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time cfgadm c configure pcipsy3 COM00 PCI slot02 lt Return gt cfgadm pcipsy3 COM00 PCI slot02 lt Return gt Ap Id Type Receptacle Occupant Condition pcipsy3 COM00 PCI slot02 mult hp connected configured ok When exchanging Fibre Channel cards the follow
38. pci 89 2000 fibre channel 1 hddv 3 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s6 gt devices pci 89 2000 fibre channel 1 hddv 3 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s7 gt devices pci 89 2000 fibre channel 1 hddv 3 0 h 9 Start the format 1M command and configure labeling and partition slice information calculated in 8 b 8 to the logical path name of each extended LUN c Add configure of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver No procedure is necessary Go to step 9 Fibre Channel driver PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X No procedure is necessary Go to step 9 Fibre Channel Card PW028FC3 PW028FC3U Bind the auto mapped target connected with the card and modify the entries of Ipfc conf to match the requirements of the extended Fibre Channel Controller These procedures are reflected on next boot time In the following indicate to bind the auto mapped target with the card usr sbin Ipfe lputil lt Return gt LightPulse Common Utility for Solaris SPARC Version 1 6a8 03 03 2004 Copyright c 2003 Emulex Network Systems Inc Emulex Fibre Channel Host Adapters Detected 2 Host Adapter 0 Ipfc11 is an LP9802 Ready Mode Host Adapter 1 Ipfc9 is an LP9802 Ready Mode MAIN MENU 1 List Adapters 2 Adapter Information 3 Firmware Maintenance 4 Reset Adapter 5 Persistent Bindings 0 Exit Enter choice gt 5 lt
39. rc0 d K10hbanywareDisc stop lt Return gt 4 Add PCI cards Add PCI cards according to the following procedure for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 5 If you don t use SAN management function of the above products To add PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on SN200 series If the Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the eight characters shown on a label on the front plate of the card These characters represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 0e24 4061
40. sbin FJSVpfca fc_adm l fipfcal lt Return gt 2 Edit kernel drv fjpfca conf and add the following property definitions to the instance number from 9 a 1 Execute the following command to make the fipfca driver take in the added part port topology classification link speed Define this property when PCI cards using Fabric connection are added This definition is not needed with FC AL connection fep bind target connection of target ID and WWN Define this property when disk array equipment using Fabric connections are added This definition is not needed with FC AL connection max throttle number of maximum SCSI command issue This property is defined for restriction on simultaneous issue of SCSI commands The necessity and value of this definition depends on the specification of the disk array device so refer to the user s manual of each equipment The following example shows the definition of a fjpfcal PCI card instance number 1 and disk array equipment target 3 being added vi kernel drv fjpfca conf lt Return gt port fipfca0 nport fipfcal nport sp1 lt added fcp bind target fipfca0t0 0x50000e1000002501 fipfcalt3 0x50000e1000002ab0 lt added max throttle fjpfca0t0 128 fipfcalt3 240 lt added usr sbin FJSVpfca fc_config v lt Return gt Fibre Channel driver PW028FC3 PW028FC3U Configuration is not required Compare the output of prtpicl 1
41. sd conf lt Return gt name sd class scsi target 0 lun 0 name sd class scsi target 3 lun 0 name sd class scsi target 3 lun 1 name sd class scsi target 3 lun 2 b Boot the system and reconfigure the kernel touch reconfigure lt Return gt usr sbin shutdown y i6 g0 lt Return gt If you use hddv If this is the first time to pre define a disk array device begin with procedure 1 a If this is not the first time to pre define a disk array device begin with procedure 1 e a Check if kernel drv hddv conf exists Check if kernel drv hddv conf exists If it exists the hard disk driver is being installed so start from procedure l c If it does not exist the system is being operated with none active extension procedures so start from procedure 1 b Not exist new install to procedure 1 c Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory Exists operation with non active extension procedures to procedure 1 b Is kernel drv hddv conf lt Return gt kernel drv hddv conf b When operating with non active extension procedures execute the following commands and confirm that kernel drv hddv conf is deleted hddvadm i lt Return gt Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory c Use the following command to create hddv conf file for the pre
42. slot Format of Ap Id Chassis No X z i System board No Inside chassis of PRIMEPOWER 900 1500 2500 Y pcipsyN CXMOY PCIHslotZZ Physical slot No ZZ I O Chassis No X PCI Disk BOX PCI Disk BOX No Y pcipsyN RXBOY PCT slotZZ Physical slot No ZZ Other So SoL NO pcipsyN PCI slotZZ Below an example of adding a PCI card to chassis number 0 PCI Disk BOX number 1 physical slot number 02 slot in PCI Disk BOX ROBO01 PCI slot02 is explained Check the status of the target slot is empty unconfigured cfgadm grep R0B01 PCIFslot02 lt Return gt pcipsy18 ROBO1 PCI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 3 b cfgadm x led fault mode blink pcipsy18 ROB01 PCI slot02 lt Return gt d After checking that the READY LED on the PCI slot to add the PCI card is off add PCI cards and connect cable to devices This operation is performed by our customer support e Use the cfgadm 1M command to check that the slot status of the added PCI card changed to disconnected unconfigured efgadm pcipsy18 ROBO01 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy18 ROB01 PCIfslot02 unknown disconnected unconfigured unknown 4 Connect the PCI card Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the
43. status of the slot When adding PCI cards to a redundant configuration several PCI cards may be added to the system In this case perform to procedures 4 on each card The relationship of the position of a PCI card and format of Ap Id is shown below Location of PCI slot Definition of slot Format of Ap Id Inside chassis of Chassis No X PRIMEPOWER System board No Y pcipsyN CXMOY PCI slotZZ 900 1500 2500 Physical slot No ZZ I O Chassis No X PCI Disk BOX PCI Disk BOX No Y pcipsyN RXBOY PCI slotZZ Physical slot No ZZ Other Physical slot No ZZ pcipsyN PCI slotZZ Below an example of adding a PCI card to chassis number 0 PCI Disk BOX number 1 physical slot number 02 slot in PCI Disk BOX ROBO01 PCI slot02 is explained Check the status of the target slot is empty unconfigured cfgadm grep R0B01 PCIFslot02 lt Return gt pcipsy18 ROBO1 PCI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 4 b cfgadm x led fault mode blink pcipsy18 ROB01 PCI slot02 lt Return gt d After checking that the READY LED on the PCI slot to add the PCI card is off add PCI cards and connect cable 37 38 to devices This operation is performed by our customer support e Use the cfgadm 1M command to check that the slot status of the added PCI card changed to disconnected u
44. the PCI card specifying the Ap Id from 4 b confirm that the slot status has changed to disconnected unconfigured cfgadm c disconnect pcipsy21 ROB01 PCI slot03 lt Return gt efgadm pcipsy21 ROB01 PCI slot03 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy21 ROBO1 PCI slot03 unknown disconnected unconfigured unknown Note When error occurs during disconnect cfgadm command unusually fail with following message If cfgadm command fails execute the command once again cfgadm Component system is busy try again disconnect failed d To confirm the slot position at replacement operation blink the ALARM LED of Ap Id displayed in procedure 4 a cfgadm x led fault mode blink pcipsy21 RO0B01 PCI slot03 lt Return gt 5 Replace the PCI card Replace the PCI card disconnected in 4 with a replacement card and connect cable to devices This operation is performed by our customer support When exchanging Fibre Channel cards the following operations are also required for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 7 If you don t use SAN management function of the above products To replace PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series ne
45. the following command to stop the hardware monitoring daemon of machine administration usr sbin FJSVmadm prephp lt Return gt 2 If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped Jete rc0 d K10hbanyware stop lt Return gt ete rc0 d K10hbanywareDisc stop lt Return gt 3 Specify the replacing PCI card Follow the instructions below and determine the interface name of the path connecting the target PCI card and I O devices and the connected I O device The following procedure is described for MPHD GRMPHD If you use the redundancy software other than MPHD GRMPHD see the document for each product a Determine from the WARNING messages output on the console the interface name of the path connecting the target PCI card and I O devices and the connected I O device In the example below fipfca3 interface name of the path connecting the target PCI card and I O devices and hddv lis the LUN Logical Unit Number of the disk array device connected to fjpfca3 WARNING pci 8d 2000 fibre channel 1 fjpfca3 Hard Error PCI DMA error WARNING pci 8d 2000 fibre channel 1 hddv 1 0 hddv1 SCSI transport failed reason reset giving up NOTICE mphd0 I O path switchover succeeded pci 8d 2000 fibre channel 1 hddv 1 0 gt pci 89 2000 fibre channel 1 hddv 2 0 The following procedures are also explained assuming the console message
46. 0 d K10hbanywareDisc stop lt Return gt 2 Specify the replacing PCI card Follow the instructions below and determine the interface name of the path connecting the target PCI card and I O devices and the connected I O device a Determine from the WARNING messages output on the console the interface name of the path connecting the target PCI card and I O devices and the connected I O device In the example below glm2 is the interface name of the path connecting the broken PCI card and I O devices and sd20 is the disk device connected to glm2 When exchanging a PCI card which has two ports the physical path name of the connection path between the I O device corresponding to the other port and the I O device connected to that path must be determined in the same manner The physical path name corresponding to the other port can be determined by the fact that the name of the two ports on the same PCI card have a relation like pci 89 4000 scsi 2 and pci 89 4000 scsi 2 1 The I O device connected to that path resides under the directory of the physical path name determined WARNING pci 89 4000 scsi 2 glm2 invalid intcode fe00 WARNING pci 89 4000 scsi 2 sd 3 0 sd20 SCSI transport failed reason reset giving up If you use the Fibre Channel Card PW028FC3 PW028FC3U the messages are shown as follows WARNING Ipfc0 INe Adapter Hardware Error WARNING pci 89 4000 fibre channel 2 sd 3 0 sd20 SCS
47. 00 scsi 2 st 5 0 h Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hb gt devices pci 89 4000 scsi 2 st 5 0 hb Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hbn gt devices pci 89 4000 scsi 2 st 5 0 hbn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hn gt devices pci 89 4000 scsi 2 st 5 0 hn 3 If the device is a disk device start the format 1M command and configure labeling and partition slice information of the logical path name of added disks If the device is a tape device this procedure is not needed Disk array device hard disk driver hddv This example is a case where a disk array device of target 3 lun 0 2 is pre defined in procedure 1 and added in procedure 5 1 There may be a change of status depending on the system operating state after pre definition in procedure 1 so check the LUN definition conflict between sd conf and hddv conf again In case of Check NG the definitions are conflicting so go back to procedure 1 e Check OK to procedure 9 b 2 opt FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 1 e opt FJSVhddv bin hddvchk_conf lt Return gt NGID 3 2 Execute the following command to make the hard disk driver set up the LUN usr sbin hddvadmdr lt Return gt 3 After saving execution result of the prtpicl command get the physical path name of added LUN by taking the difference between the r
48. 1 develop drv lt Return gt mount F ufs dev dsk c2t3d0s6 pub lt Return gt If the device is a disk unit raw access operation or a tape device Restart applications and resume usage Refer to the manual of each application for details If the device is a disk unit swap device Add swap device and resume usage sbin swapadd 2 lt Return gt 8 If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started ete re2 d S99hbanyware start lt Return gt Jete rc2 d S99hbanywareDisc start lt Return gt 9 Update hardware configuration information of machine administration Start the hardware monitoring daemon the hardware monitoring daemon usr sbin FJSVmadm postphp lt Return gt Execute the following commands to update hardware configuration information of machine administration and to restart 3 1 2 Replacement of PCI cards on redundant system PCI cards can be replaced without stopping services such as user applications on a redundant system using software such as multipath control Here the procedure to replace PCI cards on a redundant system using the following redundancy software products is explained Multipath Disk Control MPHD GR Multipath Driver GRMPD If other redundancy software products are used see the manual of each product 1 Stop the machine administration hardware monitoring daemon Use
49. 2 lt Return gt cfgadm pcipsy18 R0B01 PCIFslot02 lt Return gt Ap Id Type Receptacle Occupant Condition pcipsy18 ROBO1 PCI slot02 pci pci hp connected configured ok 4 Start the hardware monitoring of the Machine Administration Please execute the following command in order to update configuration information and restart the hardware monitoring of the Machine Administration usr sbin FJSVmadm postphp lt Return gt 5 Connect equipment to PCI cards The extended PCI card is connected with network equipment by the cable 6 Setup driver The driver configuration is added by following operations a The interface name is investigated in order to configure drivers and high layer products Please save the result of the prtcicl IM command and obtain the difference information between current result and the result taken at 2 a Then the driver instance number for the extended PCI card is obtained 70 In the following example since the instance number is 1 it can be determined that the interface name of the extended PCI card is hme1 prtpicl v gt tmp prtpic post lt Return gt diff tmp prtpicl pre tmp prtpicl post more lt Return gt status okay devfs path pci 8d 2000 network 1 driver name hme binding name SUNW hme bus addr 1 instance 1 class obp device name network VVVVV VV VO b It confirms that the interface name that obtained
50. 5 COM01 PCI slot02 c The configuration of each driver is added Please refer to each driver manual for details 7 Setup applications The configuration of extended PCI card used by high layer products services applications is added Please refer to each high layer product manual for details 8 Start applications By the following operations please start the high layer product service application used by the extended PCI card a When using TCP IP interface The example in the case of using TCP IP interface is shown below Furthermore when the high layer program which is using the PCI card needs to restart please refer to the manual of each high layer program usr sbin ifconfig hmel plumb lt Return gt usr sbin ifconfig hmel inet 192 168 10 10 netmask broadcast trailers up lt Return gt b When using FNA SNA communication protocol over Ethernet When not using the redundant configuration software it is necessary to start all interfaces of Netcompo FNA LAN and all high layer applications that are using Netcompo FNA LAN For details please refer to the manual of Netcompo FNA LAN and high layer applications 4 2 2 Extension of PCI cards with new redundant system This subsection describes extension procedure of a new redundant system with the following redundant configuration software lt SynfinityLink 2 2 PRIMECLUSTER GLS 4 0 or later The replacement and extension of PCI cards are supported
51. 8384 683680 Start applications Use the logical path name determined in 8 to start applications filesystem operation Mount filesystem mount F ufs dev FJSVmphd dsk mphd2s6 mnt lt Return gt raw access operation Start applications For details see the manual of each application swap device This procedure is not required 3 2 2 3 Extension of PCI cards to redundant system The procedure to add PCI cards to a redundant system in order to extend redundancy on a Solaris 9 OE system is explained with an example with GR multipath driver GRMPD There is no additional pattern for Multipath Disk Control MPHD If multipath software products other than GRMPD are being used see the manual of each product No configuration is needed for applications when adding PCI cards to an existing redundant system 1 Stop the machine administration hardware monitoring daemon Use the following command to stop the hardware monitoring daemon of machine administration usr sbin FJSVmadm prephp lt Return gt If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped ete rc0 d K10hbanyware stop lt Return gt Jete rc0 d K10hbanywareDisc stop lt Return gt Add PCI cards Add PCI cards according to the following procedure for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of
52. 89 2000 fibre channel 1 hddv 3 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s7 gt devices pci 89 2000 fibre channel 1 hddv 3 0 h 4 Start the format 1M command and configure labeling and partition slice information calculated in 9 b 3 to the logical path name of each extended LUN c Add configure of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver No procedure is necessary Go to step 10 Fibre Channel driver PW008FC2U W008FC2X GP7B8FC1U GP7B8FC1X No procedure is necessary Go to step 10 Fibre Channel Card PW028FC3 PW028FC3U Bind the auto mapped target connected with the card and modify the entries of lpfc conf to match the requirements of the extended Fibre Channel Controller These procedures are reflected on next boot time In the following indicate to bind the auto mapped target with the card usr sbin Ipfe Iputil lt Return gt LightPulse Common Utility for Solaris SPARC Version 1 6a8 03 03 2004 Copyright c 2003 Emulex Network Systems Inc Emulex Fibre Channel Host Adapters Detected 2 Host Adapter 0 Ipfc11 is an LP9802 Ready Mode Host Adapter 1 Ipfc9 is an LP9802 Ready Mode MAIN MENU 1 List Adapters 2 Adapter Information 3 Firmware Maintenance 4 Reset Adapter 5 Persistent Bindings 0 Exit Enter choice gt 5 lt Return gt PERSISTENT BINDINGS MENU 1 Display Current Bindings 2 Display All Nodes 3 Duplicate Adapter Bi
53. Add the driver configuration of PCI cards Add the driver configuration of PCI cards b Add the configuration of device driver Add the configuration of device driver in the case of file devices Connect to redundant system Connect device paths and interfaces of the replaced PCI card to the redundant system Switch the redundant path Switch the online path for extended path if needed 10 Chapter 3 File Devices This chapter describes in detail the procedures of replacement and extension of file PCI cards by using PCI Hot Plug For details about software to use PCI cards in redundant configuration see the manuals of each software 3 1 Replacement of PCI card This section describes the procedures to exchange PCI cards using the PCI Hot Plug feature on non redundant and redundant systems 3 1 1 Replacement of PCI cards on non redundant system Before exchanging PCI cards without using redundancy software such as multipath control applications using the PCI cards must be stopped Follow the procedures below to exchange PCI cards on a non redundant system 1 Stop the machine administration hardware monitoring daemon Execute the following command to stop the hardware monitoring daemon of machine administration usr sbin FJSVmadm prephp lt Return gt If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped Jete rc0 d K10hbanyware stop lt Return gt Jete rc
54. CI card and format of Ap Id is shown below Location of PCI slot Definition of slot Format of Ap Id Chassis No X System board No Y pcipsyN CXMOY PCI slotZZ Physical slot No ZZ Inside chassis of PRIMEPOWER 900 1500 2500 I O Chassis No X PCI Disk BOX PCI Disk BOX No Y pcipsyN RXBOY PCI slotZZ Physical slot No ZZ Physical slot No ZZ Below an example of adding a PCI card to chassis number 0 PCI Disk BOX number 1 physical slot number 02 slot in PCI Disk BOX ROBO1 PCI slot02 is explained Check the status of the target slot is empty unconfigured cfgadm grep R0B01 PCIFslot02 lt Return gt pcipsy18 ROBO1 PCI slot02 unknown empty unconfigured unknown Other pcipsyN PCI slotZZ c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 3 b cfgadm x led fault mode blink pcipsy18 ROB01 PCI slot02 lt Return gt d After checking that the READY LED on the PCI slot to add the PCI card is off add PCI cards and connect cable to devices This operation is performed by our customer support e Use the cfgadm 1M command to check that the slot status of the added PCI card changed to disconnected unconfigured efgadm pcipsy18 ROB01 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy18 ROBO01 PCIfslot02 unknown disconnected unconfigured unknown 4 Connec
55. Disk Control 2 2 1 or FUJITSU PCI Fibre Channel 33MHz later 75 PWOO8FC2U 2 2 1 or later enclosed with 6 Mi OK OK a PCI card 7 GR Multipath Driver 1 0 1 or later PW028FC3 Emulex Fibre Channel 33MHz OK OK 9 Software of driver Supporting Functions A Operating Redundant Functions Product ID kani clock 1 Hot Hot Software replacement expansion PW028FC3U Solaris TM OE Driver 66MHZ 6 01c or later 8 1 Please refer to 2 1 1 2 PCI Hot Plug configure operation of the PCI Hot Plug User s Guide about the operating clock of PCI cards and PCI slots 2 In case of using Solaris 8 OE patch 109885 09 or later is needed 3 Replacement and expansion are not supported due to hardware specifications 4 Replacement is not supported due to hardware specifications 5 Multipath Disk Control load balance option is not supporting PCI Hot Plug 6 If using Solaris 9 OE it is necessary to apply the FUJITSU PCI Fibre Channel 2 2 patch level 08 or later 7 In case of using FUJITSU PCI Fibre Channel 2 2 patch 910936 13 or later is needed And in case of using FUJITSU PCI Fibre Channel 2 2 1 patch 912069 09 or later is needed 8 Firmware version 1 90a4 or later is required OpenBoot F code should be disabled 9 Redundant software should support Dynamic Reconfiguration function 1 2 PCI cards for network devices The following list shows the PCI
56. FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 4 If you don t use SAN management function of the above products To add PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on SN200 series If the Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the eight characters shown on a label on the front plate of the card These characters represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 0e24 4061 for Fibre Channel Card PW028FC3 PW028FC3U To replace PCI cards with the following configurations Fibre Channel switch and disk arra
57. FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 1 e opt FJSVhddv bin hddvchk_conf lt Return gt NG ID 3 2 Execute the following command to make the hard disk driver set up the LUN usr sbin hddvadmdr lt Return gt 3 After saving execution result of the prtpicl command get the physical path name of added LUN by taking the difference between the result and the information obtained in 4 a and calculate the corresponding logical path name under dev dsk In the following example c3t3d0 is logical path name of added lun 0 The logical path name of lun 1 2 is set to c3t3d1 c3t3d2 respectively because cXtYdZmeans X PCI card number Y target number Z lun number prtpicl v gt tmp prtpicl post lt Return gt diff tmp prtpicl pre tmp prtpicl post grep devfs path grep hddv lt Return gt gt devfs path pci 89 2000 fibre channel 1 hddv 3 0 gt devfs path pci 89 2000 fibre channel 1 hddv 3 1 gt devfs path pci 89 2000 fibre channel 1 hddv 3 2 Is l dev dsk grep pci 89 2000 fibre channel 1 hddv 3 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s0 gt devices pci 89 2000 fibre channel 1 hddv 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s1 gt devices pci 89 2000 fibre channel 1 hddv 3 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s2 gt
58. FUJITSU PCI SCSI Adapter Driver Configuration is not required Fibre Channel driver PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X 1 After saving execution result of prtpicl 1M command take the difference between the result and the information obtained in procedure 3 a to calculate the instance number of the fjpfca driver of the PCI card added In the following example instance number is 1 indicating that the interface name of the PCI card added is fipfcal Making the LED of the PCI card blink using the fe adm command can specify the relation between the instance number and the slot position The relation between the WWPN and instance number of the PCI card added can be known from the fc info a command prtpicl v gt tmp prtpicl pfca lt Return gt diff tmp prtpicl pre tmp prtpicl pfca more lt Return gt status okay devfs path pci 8d 2000 fibre channel 1 driver name fipfca binding name pcil0cf 105c bus addr 1 instance 1 class obp device name fibre channel VVVvvvVvvoVve usr sbin FJSVpfca fc_adm l fipfcal lt Return gt 2 Edit kernel drv fjpfca conf and add the following property definitions to the instance number from 8 a 1 port topology classification link speed Define this property when PCI cards using Fabric connection are added This definition is not needed with FC AL connection fcp bind target connection of target ID and WWN Define this property when disk array
59. Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility WWPN zoning of SN200 series Host affinity of Array disk device ETERNUS3000 GR700 800 series and binding setting for fjpfca conf sd conf of host can be added from SAN management window automatically See Operation guide or User s Manual of each product for details Before using this function the following procedure 8 a 1 and 8 a 2 except fcp bind target setting are necessary Moreover begin from procedure 8 a 3 after executing this function If you don t use SAN management function of the above products No procedure is necessary Go to step 8 for Fibre Channel Card PW028FC3 PW028FC3U No procedure is necessary Go to step 8 Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration Set up driver Add driver configurations with the operation below With file related drivers configuration for the PCI card driver and the device driver is needed a Add configuration for PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver Configuration is not required
60. I transport failed reason reset giving up Exec the following command and check the physical path name grep Ipfe etc path to inst lt Return gt pci 89 4000 fibre channel 2 0 Ipfc The second value is instance number of each Ipfe instance Determine the logical path name under dev dsk corresponding to the disk device sd20 connected to the target PCI card In the example below c2t3d0 is the logical path corresponding to sd20 Is l dev dsk grep pci 89 4000 scsi 2 sd 3 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s0 gt devices pci 89 4000 scsi 2 sd 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s1 gt devices pci 89 4000 scsi 2 sd 3 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s2 gt devices pci 89 4000 scsi 2 sd 3 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s3 11 12 gt devices pci 89 4000 scsi 2 sd 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s4 gt devices pci 89 4000 scsi 2 sd 3 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s5 gt devices pci 89 4000 scsi 2 sd 3 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s6 gt devices pci 89 4000 scsi 2 sd 3 0 g lrwxrwxrwx 1 root root 41 Sep 20 22 53 c2t3d0s7 gt devices pci 89 4000 scsi 2 sd 3 0 h 3 Stop applications Stop applications with the following operations a Stop vold sh etc init d volmgt st
61. Id is shown below Location of PCI slot Definition of slot Format of Ap Id Chassis No X System board No Y pcipsyN CXMOY PCI slotZZ Physical slot No ZZ Inside chassis of PRIMEPOWER 900 1500 2500 I O Chassis No X PCI Disk BOX PCI Disk BOX No Y pcipsyN RXBOY PCI slotZZ Physical slot No ZZ Physical slot No ZZ Below an example of adding a PCI card to chassis number 0 system board number 1 physical slot number 02 slot in chassis COM01 PCI slot02 is explained Check the status of the target slot is empty unconfigured cfgadm grep COM01 PCI slot02 lt Return gt Other pcipsyN PCI slotZZ 43 44 pceipsy15 COM01 PCI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 3 b cfgadm x led fault mode blink pcipsy15 C0M01 PCIFslot02 lt Return gt d After checking that the READY LED on the PCI slot to add the PCI card is off add PCI cards and connect cable to devices This operation is performed by our customer support e Use the cfgadm 1M command to check that the slot status of the added PCI card changed to disconnected unconfigured cfgadm pcipsy15 C0M01 PCIFslot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy15 COM01 PCI slot02 unknown disconnected unconfigured unknown 4 Connect PCI card
62. M command with the output saved at 4 b and find the instance number of the added card b Add device driver configuration Add device driver configuration with the following procedures according to the I O device type Disk Tape devices Solaris OE sd st This example is a case where a disk device of target 2 lun 0 is pre defined in procedure 1 and added in procedure 6 If the device is a tape device re read sd as st in this procedure and perform the same operation 1 Execute the following command to make the sd driver set up the added disk device usr sbin devfsadm lt Return gt 2 After saving the execution result of the prtpicl 1M command take the difference between the result and the information obtained in 4 a and get the physical path name of additional disk device then get the logical path name under dev dsk In the following example c2t2d0 is the logical path name of the disk device added prtpicl v gt tmp prtpicl post lt Return gt Disk device diff tmp prtpicl pre tmp prtpicl post grep devfs path grep sd lt Return gt gt devfs path pci 89 4000 scsi 2 sd 2 0 Is l dev dsk grep pci 89 4000 scsi 2 sd 2 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s0 gt devices pci 89 4000 scsi 2 sd 2 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s1 gt devices pci 89 4000 scsi 2 sd 2 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s2 gt
63. N management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility WWPN zoning of SN200 series Host affinity of Array disk device ETERNUS3000 GR700 800 series and binding setting for fjpfca conf sd conf of host can be added from SAN management window automatically See Operation guide or User s Manual of each product for details Before using this function the following procedure 8 a 1 and 8 a 2 except fcp bind target setting are necessary Moreover begin from procedure 8 a 3 after executing this function If you don t use SAN management function of the above products No procedure is necessary Go to step 8 for Fibre Channel Card PW028FC3 PW028FC3U No procedure is necessary Go to step 8 Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration Set up driver Add driver configurations with the operation below With file related drivers configuration for the PCI card driver and the device driver is needed a Add configuration for PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver Configuration is not required Fibre Channel driver PW008FC2U PW008FC2X GP7B8FC1U G
64. O device type Disk Tape devices Solaris OE sd st This example is a case where a disk device of target 2 lun 0 is pre defined in procedure 1 and added in procedure 5 If the device is a tape device re read sd as st in this procedure and perform the same operation l Execute the following command to make the sd driver set up the added disk device usr sbin devfsadm lt Return gt 2 After saving the execution result of the prtpicl 1M command take the difference between the result and the information obtained in 4 a and get the physical path name of additional disk device then get the logical path name under dev dsk In the following example c2t2d0 is the logical path name of the disk device added prtpicl v gt tmp prtpicl post lt Return gt Disk device diff tmp prtpicl pre tmp prtpicl post grep devfs path grep sd lt Return gt gt devfs path pci 89 4000 scsi 2 sd 2 0 Is l dev dsk grep pci 89 4000 scsi 2 sd 2 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s0 gt devices pci 89 4000 scsi 2 sd 2 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s1 gt devices pci 89 4000 scsi 2 sd 2 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s2 gt devices pci 89 4000 scsi 2 sd 2 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s3 39 gt devices pci 89 4000 scsi 2 sd 2 0 d lrwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0
65. OK SynfinityLink 2 2 Supporting Functions Software of driver Operating Functions Product ID Hot Redundant Software i clock 1 Hot driver name replacement extension 2 Ethernet 2 0 or later 66MHz 3 losed with a PCI do 9 aPC PRIMECLUSTER GLS 4 0 or later 4 SynfinityLink 2 2 GP7B8AT1U FUJITSU PCI ATM 3 ATM 1 2 or later enclosed 33MHz OK NG 10 GP7B8AT1X with a PCI card PRIMECLUSTER GLS 4 0 or later 4 BLASTBAND 1 0 or PRIMECLUSTER ES InfiniBand 11 PWO28SY1 lie 66MHz OK OK GLS 4 1A20 or later 1 Please refer to 2 1 1 2 PCI Hot Plug configure operation of the PCI Hot Plug User s Guide about the operating clock of PCI cards and PCI slots 2 In case of replacing PCI card the PCI card with which the network interface is not once activated from the time of system booting cannot be exchanged 3 The replacement and expansion are supported only on the Redundant Line Control Function 4 When using the PRIMECLUSTER GLS 4 0 the replacement and expansion are supported only on the Redundant Line Control Function 5 It is necessary to apply the patch 912785 02 or later Please contact our customer service about the latest patch 6 When using the FUJITSU PCI Quad 10 100 Ethernet 1 0 it is necessary to apply the patch 912216 06 or later Please contact our customer service about the latest patch 7 If using the FUJITSU PCI Gigabit Ethernet 1
66. P7B8FC1X 1 After saving execution result of prtpicl IM command take the difference between the result and the information obtained in procedure 3 a to calculate the instance number of the fjpfca driver of the PCI card added In the following example instance number is 1 indicating that the interface name of the PCI card added is fipfcal Making the LED of the PCI card blink using the fc_adm command can specify the relation between the instance number and the slot position The relation between the WWPN and instance number of the PCI card added can be known from the fc info a command prtpicl v gt tmp prtpicl pfca lt Return gt diff tmp prtpicl pre tmp prtpicl pfca more lt Return gt status okay fru PCI slot PCI 02 at Rack 0 IO_BOX 1 component name ROBO1 PCI 02 devfs path pci 8d 2000 fibre channel 1 driver name fipfca binding name pcil0cf 105c bus addr 1 instance 1 class obp device name fibre channel VVVVV VV VV Vt 2 Edit the kernel drv fjpfca conf file and add the following property definitions to the instance number determined in 8 a 1 port type of topology link speed Defined when adding PCI cards with Fabric connection This definition is not needed with FC AL connection fcp bind target connection between target ID and WWN Defined when adding disk array with Fabric connection This definition is not needed with FC AL connection max throttle maximum issued SCSI c
67. PCI card with the following procedure a By using inst2comp 1M command determine the slot position of the PCI card called an attachment point identifier Ap_Id from the interface name of the path connecting the target PCI card and I O devices determined in procedure 2 a glm2 Please refer to PCI Hot Plug User s Guide about the detail of inst2comp 1M command In this example the Ap Id is peipsy3 COM00 PCI slot02 usr sbin FJSVmadm inst2comp glm2 lt Return gt pcipsy3 COM00 PCI slot02 b Specify Ap Id determined from 4 a as a parameter and confirm that the slot status of the PCI card to disconnect is connected configured cfgadm pcipsy3 COM00 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy3 COM00 PCI slot02 mult hp connected configured ok c After executing the command to disconnect the PCI card specifying the Ap_ Id from 4 a confirm that the slot status has changed to disconnected unconfigured cfgadm c disconnect pcipsy3 COM00 PCI slot02 lt Return gt efgadm pcipsy3 COM00 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy3 COM00 PCI slot02 unknown disconnected unconfigured unknown Note When error occurs during disconnect cfgadm command unusually fail with following message If cfgadm command fails execute the command once again cfgadm Component system is busy try again disconnect failed d To confirm the slot position at replacement operation
68. Return gt Automapped FCP Nodes Node Target WWPN WWNN Automapped FCP Node 0 50 06 0e 80 00 10 04 92 50 06 0e 80 00 10 04 92 Automapped FCP Node 1 50 06 0e 80 00 10 04 90 50 06 0e 80 00 10 04 90 Press the Enter or Return key to continue Bind all auto mapped targets Y N gt Y lt Return gt 41 Select Binding Method 1 By Node Name 2 By Port Name 3 By D ID 0 Cancel Enter Choice gt 2 lt Return gt 10 Connect to redundant system The following procedure is described for MPHD GRMPHD If you use the redundancy software other than MPHD GRMPHD see the document for each product To connect the added PCI card to the redundant system execute the following command and confirm that the path name determined in procedure 9 b 3 in underlined letters is added usr sbin mplbconfig nv lt Return gt Phase 1 checking dev rdsk Phase 2 checking multi path Phase 3 analyzing path Path Action Element path LUN Storage Zone mplb0 exist c1t4d0s2 c2t3d0s2 0 GR720464f 12340001 mplb8 add c3t3d0s2 0 GR8404550 000213 usr sbin mplbconfig av lt Return gt IOMP dev FJSVmplb fiomp adms Node dev FJS V mplb rdsk mp1b8s0 dev FJSVmplb rdsk mp1b8s1 dev FJSV mplb rdsk mp1b8s2 dev FJSV mplb rdsk mp1b8s3 dev FJS V mplb rdsk mp1b8s4 dev FJSV mplb rdsk mp1b8s5 dev FJSV mplb rdsk mp1b8s6 dev FJSV mplb rdsk mp1b8s7 3 2 2 Solari
69. Return gt pceicsy15 COM01 PClI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 2 b cfgadm x led fault mode blink pcipsy15 C0M01 PCIFslot02 lt Return gt d Please confirm that READY LED of the PCI bus slot that extends a PCI card has gone out and extend a PCI card This operation is performed by our customer support e Please confirm that the PCI slot status which extended PCI cards is disconnected unconfigured by using cfgadm 1M command cfgadm pcipsy15 COM01 PCl slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pceicsy15 COM01 PCI slot02 unknown disconnected unconfigured unknown 3 Connect PCI cards The cfgadm command is executed with the configure option to Ap Id or the push button of the PCI bus slot is pushed Then extended PCI card is connected 68 In addition a push button is valid only in multiple user mode Please confirm that the slot status is connected configured by using the cfgadm 1M command after the above mentioned procedure cfgadm c configure pcipsy15 COM01 PCI slot02 lt Return gt cfgadm pcipsy15 COM01 PCl slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy15 COMO1 PCFfslot02 pci pci hp connected configured ok 4 Start the hardware monitoring of the Machine Administration Please execute the following commands in order
70. TBAND GUIDE for the procedure for replacement and expansion Chapter 2 Overview of replacement and extension of PCI cards This chapter describes the outline of a procedure of replacement and extension of PCI cards by using PCI Hot Plug 2 1 Replacement of PCI card This section describes outline to exchange PCI cards using PCI Hot Plug feature About software which makes PCI card redundantly please refer to each manual of the software 2 1 1 Replacement of PCI cards on non redundant system Before you exchange PCI cards without redundant software you must stop applications which using the PCI cards The replacement procedure of PCI cards is as follows Please refer to Chapter 3 File devices or Chapter 4 Network devices about detailed replacing procedure of PCI cards File devices procedures 1 Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration 2 Stop the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U stop the daemons 3 Specify the replacing PCI card Specify the devices and interfaces that are influenced by replacing PCI cards 4 Stop applications Stop services and high layer products that are influenced by replacing PCI cards 5 Disconnect the PCI card It changes into the state where the PCI card is exchangeable 6 Replace the PCI card Replace the PCI card 7 Connect the PCI card It changes into the state where the PCI card
71. a PCI card PW008QE2 10 100BASE T x 4 FUJITSU PCI Quad 10 100 Ethernet 1 1 or later enclosed with a PCI card Please make a setting by the ndd command Or please reboot a system after changing the kernel drv fjqe conf file PP028GE1U PP028GE1X 1000BASE SX FUJITSU PCI Gigabit Ethernet The ndd command is not supported 1 4 1 or later Please reboot a system after changing the kernel drv fjge conf PWO008GE1U enclosed with a PCI card file PW008GE1X 1000BASE T PW008GE4 1000BASE SX FUJITSU PCI Gigabit Ethernet Please make a setting by the ndd command 2 0 or later Or please reboot a system after changing the PW008GE5 10 100 1000BASE T enclosed with a PCI card platform sun4us kernel drv fjgi conf file 1 In case of X1033A U X please refer to Sun Microsystems Inc web page about Platform Notes The hme FastEthernet Device Driver and ndd 1M man page etc 5 1 2 Using tape device while PCI Hot Plug operation By using the PCI Hot Plug feature a job which uses tape devices may be terminated abnormally While using the PCI Hot Plug feature avoid using tape devices 5 1 3 Others When expanding PCI cards by using PCI Hot Plug feature it is necessary to install the device driver case of file devices and the driver for using the added PCI card When extending PCI cards each driver consumes memory capacity to control PCI cards Please refer to the installation guide
72. above mentioned procedure is an interface name that corresponds to the PCI bus slot of the added PCI card Please carry out this procedure when it cannot identify relationship between an interface name and PCI bus slot by expanding two or more PCI cards especially usr sbin FJSVmadm inst2comp hmel lt Return gt pcicsy18 ROBO1 PCI slot02 c The configuration of each driver is added Please refer to each driver manual for details 7 Setup redundant system When establishing the redundant configuration system it is necessary to configure the environmental configuration of the Redundant Line Control Function or the Multipath Function and to activate the redundant configuration system For details of environmental configuration and activation please refer to each function manual of SynfinityLink or PRIMECLUSTER GLS 8 Setup applications The configuration of high layer product services applications is added Please refer to the manual of each high layer product for details 9 Start applications By following operations please start the high layer product a When using TCP IP interface The high layer product services applications using the TCP IP interface is started For details of starting the high layer products please refer to the manual of each product b When using FNA SNA communication protocol over Ethernet It is necessary to start all interfaces of Netcompo FNA LAN and all high layer applications that are using Netcompo FNA LAN
73. active extension procedures being registered Is kernel drv hddv conf lt Return gt kernel drv hddv conf vi kernel drv hddv conf lt Return gt name hddv class scsi target 0 lun 0 name hddv class scsi target 0 lun 7 name hddv class scsi target 1 lun 0 name hddv class scsi target 1 lun 1 Remove comments of the LUN in use name hddv class scsi target 1 lun 2 name hddv class scsi target 3 lun 0 name hddv class scsi target 3 lun 1 Remove comments of extended LUN name hddv class scsi target 3 lun 2 or name hddv class scsi target 3 lun 3 Check for LUN definition conflict between sd conf and hddv conf by executing the hddvchk_conf command The message example for Check NG means that target 3 is defined in both files and the procedures must be performed again from procedure 1 d The followings are examples of execution of the FJSVhddv package installation to opt The path of the hddvchk_conf command depends on the installed directory Check OK to procedure 1 g opt FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 1 d opt FJSVhddv bin hddvchk_conf lt Return gt NG ID 3 Reconfigure the kernel restart the system and then start system operation touch reconfigure lt Return gt usr sbin shutdown y i6 g0 lt Return gt Stop the machi
74. and specifying the logical path name of the connected LUN determined in procedure 3 b This command only needs to be executed on the representation LUN and does not need to be executed on each LUN under the same PCI card If the operation path is disconnected on a redundant system the standby path will automatically be switched to operation If both MPHD GRMPD controlled devices are connected to the target PCI card the commands for both products need to be executed MPHD usr opt FJS Viomp bin iompadm c mphd change adapter disconnect dev rdsk c3t1d0s2 lt Return gt GRMPD usr opt FJS Viomp bin iompadm c mplb change adapter_disconnect dev rdsk c3t1d0s2 lt Return gt 4 Disconnect the PCI card Disconnect the defected PCI card with the following procedures a Determine the slot position of the PCI card from the interface name of the path connecting the target PCI card and I O devices determined in procedure 3 a fjpfca3 In this example the Ap Id is pcipsy2 1 ROB01 PCI slot03 usr sbin FJSVmadm inst2comp fjpfca3 lt Return gt pcipsy21 ROB01 PCI slot03 Specify the Ap Id from 4 a as a parameter and confirm that the slot status of the PCI card to disconnect is connected configured cfgadm pcipsy21 ROB01 PCI slot03 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy21 ROB01 PClI slot03 fibre hp connected configured ok After executing the command to disconnect
75. art the daemons If you use the Fibre Channel Card PW028FC3 PWO028FC3U start the daemons Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Preparation to recognize devices for Fibre Channel If you use SAN management function preparation to recognize devices Set up driver a Add the driver configuration of PCI cards Add the driver configuration of PCI cards b Add the configuration of device driver Add the configuration of device driver in the case of file devices Connect to redundant system Connect device paths and interfaces of the replaced PCI card to the redundant system Switch the online path for extended path if needed Network devices procedures 1 Setup I O devices which will be added to system Setup devices which will be added to system in the case of file devices on Solaris 8 OE Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Add PCI cards Extend PCI cards Connect PCI cards It changes into the state where the PCI card is usable Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Connect equipment to PCI cards Connect equipment to PCI cards Set up driver a
76. ations a The interface name is investigated in order to configure drivers and high layer products Please save the result of the prtcicl 1M command and obtain the difference information between current result and the result taken at 2 a Then the driver instance number for the extended PCI card is obtained In the following example since the instance number is 1 it can be determined that the interface name of the extended PCI card is hmel prtpicl v gt tmp prtpic post lt Return gt diff tmp prtpicl pre tmp prtpicl post more lt Return gt status okay devfs path pci 8d 2000 network 1 driver name hme binding name SUNW hme bus addr 1 instance 1 class obp device name network VVVVV VV VO b It confirms that the interface name that obtained above mentioned procedure is an interface name that corresponds to the PCI bus slot of the added PCI card Please carry out this procedure when it cannot identify relationship between an interface name and PCI bus slot by expanding two or more PCI cards especially usr sbin FJSVmadm inst2comp hmel lt Return gt pcipsy18 ROBO1 PCI slot02 c The configuration of each driver is added Please refer to each driver manual for details 7 Connect to redundant system Please execute following commands in order to connect the extended PCI card to the existing redundant configuration system Notes On the NIC switching mode in Redundant Line Control Func
77. because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration a Before extension of PCI cards save the current execution result of the prtpicl 1M command current configuration at present prtpicl v gt tmp prtpicl pre lt Return gt b Check the status of the slot The relationship of the position of a PCI card and format of Ap Id is shown below Location of PCI slot Definition of slot Format of Ap Id Inside chassis of Chassis No X PRIMEPOWER System board No Y pcipsyN CXMOY PCI slotZZ 900 1500 2500 Physical slot No ZZ I O Chassis No X PCI Disk BOX PCI Disk BOX No Y pcipsyN RXBOY PCI slotZZ Physical slot No ZZ Other Physical slot No ZZ pcipsyN PCI slotZZ Below an example of adding a PCI card to chassis number 0 system board number 1 physical slot number 02 slot in chassis COM01 PCI slot02 is explained Check the status of the target slot is empty unconfigured cfgadm grep COM01 PCI slot02 lt Return gt pcipsy15 COM01 PCI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 4 b cfgadm x led fault mode blink pcipsy15 C0M01 PCIFslot02 lt Return gt d After checking that the READY LED on the PCI slot to add the PCI card is off add PCI cards and conne
78. being operated with none active extension procedures so start from procedure 8 b 2 Not exist new install to Procedure 8 b 3 Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory Exist operation with non active extension procedures to Procedure 8 b 2 Is kernel drv hddv conf lt Return gt kernel drv hddv conf 2 When operating with non active extension procedures execute the following commands and confirm that kernel drv hddv conf is deleted hddvadm i lt Return gt Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory 3 Use the following command to create hddv conf file for the pre defined extension function The message examples for operation with non active extension procedures means that disk array device GR720 currently used with taget 1 lun 0 is registered twice on the sd hddv driver New installation to procedure 8 b 5 hddvadm M lt Return gt Operation with non active extension procedures to procedure 8 b 4 hddvadm M lt Return gt already ID 1 exists devices pci 1d 2000 fibre channel 1 sd 1 0 a raw GR720 4 When performing active extension the same target number cannot be registered in sd conf and hddv conf so delete or comment out the conflicting definition parts in sd conf file when definition in the two files conflict with each other The following example shows the case
79. c add n sha0 i hmel lt Return gt NIC switching mode in Redundant Line Control Function opt FJS Vhanet usr sbin hanetnic change n sha0 lt Return gt opt FJS Vhanet usr sbin strptl n shal lt Return gt GS SURE linkage mode in Redundant Line Control Function 67 opt FJS Vhanet usr sbin strhanet n sha0 lt Return gt opt FJS Vhanet usr sbin hanetpoll on lt Return gt Multipath Function usr opt FJS Viomp bin iompadm c mpnet connect mpnet0 hmel lt Return gt usr opt FJS Viomp bin iompadm c mpnet start mpnet0 hmel lt Return gt Notes It is necessary to configure the IP address specified by ifconfig 1M command in etc inet hosts and etc hostname hmel Unless these are configured the virtual interface for fast switching mode can not be activated after rebooting the system In addition in order to use IPv6 address please refer to the PRIMECLUSTER GLS 4 1A20 or later manual 8 Switch back the redundant path Please switch back an online communication path if needed 9 Start the hardware monitoring of the Machine Administration Please execute the following commands in order to update configuration information and restart the hardware monitoring of the Machine Administration usr sbin FJSVmadm postphp lt Return gt 4 2 Extension of PCI cards This section describes extension procedure of the PCI card by using PCI Hot Plug on non redundant system and redundant system 4 2 1
80. c2t2d0 is the logical path name of the disk device added prtpicl v gt tmp prtpicl post lt Return gt Disk equipment diff tmp prtpicl pre tmp prtpicl post grep devfs path grep sd lt Return gt gt devfs path pci 89 4000 scsi 2 sd 2 0 Is l dev dsk grep pci 89 4000 scsi 2 sd 2 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s0 gt devices pci 89 4000 scsi 2 sd 2 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s1 gt devices pci 89 4000 scsi 2 sd 2 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s2 gt devices pc1 89 4000 scsi 2 sd 2 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s3 gt devices pci 89 4000 scsi 2 sd 2 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s4 gt devices pci 89 4000 scsi 2 sd 2 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s5 gt devices pci 89 4000 scsi 2 sd 2 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s6 gt devices pci 89 4000 scsi 2 sd 2 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s7 gt devices pci 89 4000 scsi 2 sd 2 0 h Tape equipment diff tmp prtpicl pre tmp prtpicl post grep devfs path grep st lt Return gt gt devfs path pci 89 4000 scsi 2 st 5 0 Is l dev rmt grep pci 89 4000 scsi 2 st 5 0 lt Return gt lrwxrwxrwx 1 root root 41 Sep 20 22 53 1 gt devices pci 89 4000 scsi 2 st 5 0 lrwxrwxrwx 1 root root 41 Sep 20 22 53 1b gt device
81. ct cable to devices This operation is performed by our customer support e Use the cfgadm 1M command to check that the slot status of the added PCI card changed to disconnected unconfigured 21 22 cfgadm pcipsy15 COM01 PCI slot02 lt Return gt Ap Id Type Receptacle Occupant Condition pcipsy15 COM01 PCI slot02 unknown disconnected unconfigured unknown 5 Connect PCI cards Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the extension slot position Note that the push button is only effective in multiuser mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time cfgadm c configure pcipsy15 COM01 PCI slot02 lt Return gt cfgadm pcipsy15 COM01 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy15 COM01 PCI slot02 mult hp connected configured ok If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started ete re2 d S99hbanyware start lt Return gt Jete rc2 d S99hbanywareDisc start lt Return gt Update hardware configuration information of machine administration Start the hardware monitor
82. d has gone out and extend a PCI card This operation is performed by our customer support e Please confirm that the PCI slot status which extended PCI cards is disconnected unconfigured by using cfgadm 1M command cfgad m pcipsy18 ROBO01 PCI slot02 lt Return gt Ap Id Type Receptacle Occupant Condition pcicsy18 ROBO1 PCI slot02 unknown disconnected unconfigured unknown 3 Connect PCI cards The cfgadm command is executed with the configure option to Ap_Id or the push button of the PCI bus slot is pushed Then a extended PCI card is connected In addition a push button is valid only in multiple user mode Please confirm that the slot status is connected configured by using the cfgadm 1M command after the above mentioned procedure cfgadm c configure pcipsy18 ROB01 PCI slot02 lt Return gt cfgadm pcipsy18 ROB01 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy18 ROBO1 PCI slot02 pci pci hp connected configured ok Start the hardware monitoring of the Machine Administration Please execute the following command in order to update configuration information and restart the hardware monitoring of the Machine Administration usr sbin FJSVmadm postphp lt Return gt Connect equipment to PCI cards The extended PCI card is connected with network equipment by the cable Setup driver The driver configuration is added by following oper
83. devices pci 89 2000 fibre channel 1 hddv 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s1 gt devices pci 89 2000 fibre channel 1 hddv 3 0 b lrwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s2 gt devices pci 89 2000 fibre channel 1 hddv 3 0 c lrwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s3 gt devices pci 89 2000 fibre channel 1 hddv 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s4 gt devices pci 89 2000 fibre channel 1 hddv 3 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s5 gt devices pci 89 2000 fibre channel 1 hddv 3 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s6 gt devices pci 89 2000 fibre channel 1 hddv 3 0 g lrwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s7 gt devices pci 89 2000 fibre channel 1 hddv 3 0 h 9 Start format command and configure labeling and partition slice information calculated at 8 b 8 to the logical path name of each extended LUN c Add configure of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver No procedure is necessary Go to step 9 Fibre Channel driver PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X No procedure is necessary Go to step 9 Fibre Channel Card PW028FC3 PW028FC3U Bind the auto mapped target connected with the card and modify the entries of Ipfc conf to match the requirements of the extended Fibre Channel Controller These procedures are reflected on next boot time In the
84. ds without making them redundant on a Solaris 8 OE system are explained here 1 Setup I O devices which will be added to system Pre define devices to be added with the following procedures according to the device type Extension using PCI Hot Plug cannot be done without definition so devices must be defined before the system goes into operation Disk Tape devices Solaris OE sd st This is an example where a disk device at target 2 lun 0 is pre defined If the device is a tape device re read sd in the following as st and perform the same operations a Confirm that target 2 lun 0 is defined in kernel drv sd conf If this definition does not exist add the definition If it is commented out remove the comments Disk device vi kernel drv sd conf lt Return gt name sd class scsi target 0 lun 0 name sd class scsi In case the definition does not exist target 2 lun 0 add or remove comments Tape device vi kernel drv st conf lt Return gt name st class scsi target 0 lun 0 name st class scsi In case the definition does not exist target 5 lun 0 add or remove comments b In case kernel drv sd conf was updated in 1 a reconfigure the kernel restart the system and then start system operation If it was not updated this procedure is not required touch reconfigure lt Return gt shutdown y i6 g0 lt Return gt Disk Array device hard disk driver hddv This i
85. dsk c2t2d0s4 swap no swap l lt Return gt swapfile dev swaplo blocks free dev dsk c2t2d0s4 32 164 16 788384 683680 Start applications Use the logical path name determined in 8 b to start applications Disk device filesystem operation Mount filesystem mount F ufs dev dsk c2t2d0s6 mnt lt Return gt Disk device raw access operation Tape device Start applications For details see the manual of each application Disk device swap device This procedure is not required 3 2 2 2 Extension of PCI cards with new redundant system The procedure to add PCI cards to a new redundant system on a Solaris 9 OE system is explained with examples for the multipath software below Multipath Disk Control MPHD GR Multipath Driver GRMPD an example with GR multipath driver GRMPD If other redundant software is used see the manual of each product l 50 Stop the machine administration hardware monitoring daemon Use the following command to stop the hardware monitoring daemon of machine administration usr sbin FJSVmadm prephp lt Return gt If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped Jete rc0 d K10hbanyware stop lt Return gt Jete rc0 d K10hbanywareDisc stop lt Return gt Add PCI cards Add PCI cards according to the following procedure for PCI Fibre Channel PW008FC2U PW008
86. e status of the target slot is empty unconfigured cfgadm grep R0B01 PCIFslot02 lt Return gt pcipsy18 ROBO1 PCI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 4 b cfgadm x led fault mode blink pcipsy18 ROB01 PCI slot02 lt Return gt d After checking that the READY LED on the PCI slot to add the PCI card is off add PCI cards and connect cable to devices This operation is performed by our customer support e Use the cfgadm 1M command to check that the slot status of the added PCI card changed to disconnected unconfigured efgadm pcipsy18 ROBO01 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy18 ROBO01 PCl slot02 unknown disconnected unconfigured unknown 5 Connect the PCI card Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the extension slot position Note that the push button is only effective in multiuser mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time cfgadm c configure pcipsy18 R0OB01 PCI slot02 lt Return gt cfgadm pcipsy18 ROB01 PCI slot02 lt Re
87. e the fipfca driver take in the added part port topology classification link speed Define this property when PCI cards using Fabric connection are added This definition is not needed with FC AL connection fcp bind target connection of target ID and WWN Define this property when disk array equipment using Fabric connections are added This definition is not needed with FC AL connection max throttle number of maximum SCSI command issue This property is defined for restriction on simultaneous issue of SCSI commands The necessity and value of this definition depends on the specification of the disk array device so refer to the user s manual of each equipment The following example shows the definition of a fipfcal PCI card instance number 1 and disk array equipment target 3 being added vi kernel drv fjpfca conf lt Return gt port fjpfca0 nport fipfcal nport sp1 lt added fcp bind target fipfca0t0 0x5000081000002501 fipfca1t3 0x50000e1000002ab0 lt added max throttle fipfca0t0 128 fipfcalt3 240 lt added Jusr sbin FJSVpfca fc_config v lt Return gt Fibre Channel driver PW028FC3 PW028FC3U Configuration is not required Compare the output of prtpicl 1M command with the output saved at 4 b and find the instance number of the added card b Add device driver configuration Add device driver configuration with the following procedures according to the I
88. ed to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on SN200 series Ifthe Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the eight characters shown on a label on the front plate of the card These characters represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 0e24 4061 for Fibre Channel Card PW028FC3 PW028FC3U To replace PCI cards with the following configurations Fibre Channel switch and disk array device need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch Ifthe Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label
89. eover begin from procedure 9 a 3 after executing this function If you don t use SAN management function of the above products No procedure is necessary Go to step 9 for Fibre Channel Card PW028FC3 PW028FC3U No procedure is necessary Go to step 9 Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration Setup driver Add the configuration of driver according to the following operation As for file related drivers additional configuration of the PCI card driver and the device driver is needed a Add configurations of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver Configuration is not required Fibre Channel driver PW008FC2U W008FC2X GP7B8FC1U GP7B8FC1X 1 After saving execution result of prtpicl IM command take the difference between the result and the information obtained in procedure 4 a to calculate the instance number of the fjpfca driver of the PCI card added In the following example instance number is 1 indicating that the interface name of the PCI card added is fipfcal Making the LED of the PCI card blink using the fc_adm command can specify the relation between the instance number and the slot p
90. equipment using Fabric connections are added This definition is not needed with FC AL connection max throttle number of maximum SCSI command issue This property is defined for restriction on simultaneous issue of SCSI commands The necessity and value of this definition depends on the specification of the disk array device so refer to the user s manual of each equipment The following example shows the definition of a fjpfcal PCI card instance number 1 and disk array equipment target 3 being added vi kernel drv fjpfca conf lt Return gt port fipfca0 nport fipfcal nport sp1 lt added fcp bind target fipfca0t0 0x5000081000002501 fipfca1t3 0x50000e1000002ab0 lt added max throttle fipfca0t0 128 fipfcalt3 240 lt added 3 Execute the following command to make the fjpfca driver take in the added part Jusr sbin FJSVpfca fc_config v lt Return gt Fibre Channel driver PW028FC3 PW028FC3U Configuration is not required Compare the output of prtpicl 1M command with the output saved at 3 b and find the instance number of the added card Add device driver configuration Add device driver configuration with the following procedures according to the I O device type Disk Tape devices Solaris OE sd st This example is a case where a disk device of target 2 lun 0 is pre defined in procedure 1 and added in procedure 4 If the device is a tape device re read sd as
91. esult and the information obtained in 4 a and calculate the corresponding logical path name under dev dsk In the following example c3t3d0 is logical path name of added lun 0 The logical path name of lun 1 2 is set to c3t3d1 c3t3d2 respectively because cXtYdZmeans X PCI card number Y target number Z lun number prtpicl v gt tmp prtpicl post lt Return gt diff tmp prtpicl pre tmp prtpicl post grep devfs path grep hddv lt Return gt gt devfs path pci 89 2000 fibre channel 1 hddv 3 0 gt devfs path pci 89 2000 fibre channel 1 hddv 3 1 gt devfs path pci 89 2000 fibre channel 1 hddv 3 2 Is l dev dsk grep pci 89 2000 fibre channel 1 hddv 3 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s0 24 gt devices pci 89 2000 fibre channel 1 hddv 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s1 gt devices pci 89 2000 fibre channel 1 hddv 3 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s2 gt devices pci 89 2000 fibre channel 1 hddv 3 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s3 gt devices pci 89 2000 fibre channel 1 hddv 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s4 gt devices pci 89 2000 fibre channel 1 hddv 3 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s5 gt devices pci 89 2000 fibre channel 1 hddv 3 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s6 gt devices pci
92. following operation As for file related drivers additional configuration of the PCI card driver and the device driver is needed a Add configurations of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver Configuration is not required Fibre Channel driver PW008FC2U W008FC2X GP7B8FC1U GP7B8FC1X 1 After saving execution result of prtpicl IM command take the difference between the result and the information obtained in procedure 4 a to calculate the instance number of the fjpfca driver of the PCI card added In the following example instance number is 1 indicating that the interface name of the PCI card added is fipfcal Making the LED of the PCI card blink using the fc_adm command can specify the relation between the instance number and the slot position The relation between the WWPN and instance number of the PCI card added can be known from the fc info a command prtpicl v gt tmp prtpicl pfca lt Return gt diff tmp prtpicl pre tmp prtpicl pfca more lt Return gt gt status okay devfs path pci 8d 2000 fibre channel 1 driver name fipfca binding name pcil0cf 105c bus addr 1 instance 1 class obp device gt name fibre channel usr sbin FJSVpfca fc_adm l fjpfeal lt Return gt VVVV VV 2 Edit kernel drv fjpfca conf and add the following property definitions to the instance number from 9 a 1 Execute the following command to mak
93. fy the replacing PCI card Specify the devices and interfaces that are influenced by replacing PCI cards Disconnect from redundant system Disconnect the devices path and interfaces of PCI cards from the redundant system Disconnect the PCI card It changes into the state where the PCI card is exchangeable Replace the PCI card Replace the PCI card Connect the PCI card It changes into the state where the PCI card is usable Connect to redundant system Connect device paths and interfaces of the replaced PCI card to the redundant system Switch back the redundant path Switch back the online path if needed Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration 2 2 Extension of PCI cards This section describes outline to extend PCI cards using PCI Hot Plug feature About software which makes PCI card redundantly please refer to each manual of the software 2 2 1 Extension of PCI cards on non redundant system When not using the redundant configuration software the extension procedure of PCI cards is as follows Please refer to Chapter 3 File devices or Chapter 4 Network devices about detailed extending procedure of PCI cards File devices procedures 1 2 Setup I O devices which will be added to system Setup devices which will be added to system in the case of file devices on Solaris 8 OE
94. g nv lt Return gt Phase 1 checking dev rdsk Phase 2 checking multi path Phase 3 analyzing path Path Action Element path LUN Storage Zone mplb0 exist c1t4d0s2 c2t3d0s2 0 GR720464f 12340001 mplb8 new c3t3d0s2 c4t3d0s2 0 GR8404550 000213 usr sbin mplbconfig av lt Return gt IOMP dev FJS Vmplb fiomp adm8 Node dev FJSV mplb rdsk mp1b8s0 dev FJSV mplb rdsk mplb8s1 dev FJSV mplb rdsk mp1b8s2 dev FJSVmplb rdsk mp1b8s3 dev FJSV mplb rdsk mplb8s4 dev FJSV mplb rdsk mplb8s5 dev FJSV mplb rdsk mp1b8s6 dev FJSV mplb rdsk mp1b8s7 10 Setup applications Add configuration for the application using the logical path name determined in 8 filesystem operation Create file system To mount at system start add an entry in the etc vfstab file newfs dev FJSVmphd rdsk mphd2s6 lt Return gt vi etc vfstab lt Return gt dev FJSV mphd dsk mphd2s6 dev FJS Vmphd rdsk mphd2s6 mnt ufs 1 yes 11 raw access operation Configure applications For details see the manual of each application swap device Add swap device To make valid at system start add an entry in the etc vfstab file swap a dev FJSV mphd dsk mphd2s4 lt Return gt vi ete vfstab lt Return gt dev FJSV mphd dsk mphd2s4 swap no swap l lt Return gt swapfile dev swaplo blocks free dev FJSV mphd dsk mphd2s4 32 164 16 78
95. g command to create hddv conf file for the pre defined extension function The message examples for operation with non active extension procedures means that disk array device GR720 currently used with taget 1 lun 0 is registered twice on the sd hddv driver New installation to procedure 8 b 5 hddvadm M lt Return gt Set up with a non active extension procedure to procedure 8 b 4 hddvadm M lt Return gt already ID 1 exists devices pci 1d 2000 fibre channel 1 sd 1 0 a raw GR720 4 In activity extension because same target number can t be registered in sd conf and hddv conf delete or comment out the duplication definition parts in sd conf file when both definition are overlapped The following example shows the case that target 1 is repeated vi kernel drv sd conf lt Return gt name sd class scsi target 0 lun 0 name sd class scsi target 1 lun 0 name sd class scsi delete or comment out target 1 lun 1 the duplication definition parts in sd hddv name sd class scsi target 1 lun 2 A target number that is already used by the sd driver of the system disk or CD ROM cannot be deleted In this case change the target number in hddv conf and of the disk array device so that it does not conflict with sd conf 5 Edit the kernel drv hddv conf file created automatically by the hddvadm M command and remove comments of the LUN definition to pre define and the LUN
96. hanges into the state where the PCI card is usable Start the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U start the daemons Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Preparation to recognize devices for Fibre Channel If you use SAN management function preparation to recognize devices Setup driver a Add the driver configuration of PCI cards Add the driver configuration of PCI cards b Add the configuration of device driver 10 11 12 Add the configuration of device driver in the case of file devices Setup redundant system Configure the environmental configuration of a new redundant system and activate Setup applications Configure the high layer products and services about a new redundant system Start applications Start high layer products and services used by the new redundant system Network devices procedures 1 EN 9 10 2 2 3 Setup I O devices which will be added to system Setup devices which will be added to system in the case of file devices on Solaris 8 OE Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Add PCI cards Extend PCI cards Connect PCI cards It changes into the state where the PCI card is usable Start the hardware monitoring of the Machine Administration
97. hanges to this manual without prior notice Copyright 1995 GLOBEtrotter Software Inc Copyright 1995 Software Research Associates Inc All Rights Reserved All Rights Reserved Copyright C FUJITSU LIMITED 2004 ii Contents Chapter 1 PCI cards with support for PCI Hot Plug ooooccccccccccoccnnccccnnnncccnnnnnannnnnno 1 121 PClcards Tor Tile devices iii 1 1 2 PCh cards for network devices oia aida 2 Chapter 2 Overview of replacement and extension of PCI cards 5 2 1 Replacement of PCI Card miiie io ia A dd dees laden 5 2 2 Extension of PCl cardS coito da ta arae aaae A Weed Dd it eae 6 Chapters File DeCs 11 3 1 Replacement of PCI Card oii ra aeaee ia ea aaa a a ae aaa aa aeae A AREE a aeaa 11 3 2 Extension of PCl Cards do aia 18 Chapter 4 Network Devices ooocccccccconoooccccccccccccccononnccnnnncnonononnnnnnnnnnnnnnanannnnnss 65 4 1 Replacement of PCI card scenerne eee eee eee ere 65 4 2 Extension of PCl cards 4 2020 iste ae ese eh Mate tt 68 Chapter 5 Notes RESIICHOMNS cia 75 91 NOtOS RIG RER BIDE BSN ABE SE ain oe een ia ee ee ie Ae ete 75 5 2 RESCUE 75 111 iv Chapter 1 PCI cards with support for PCI Hot Pl ug This chapter shows the list of PCI cards supporting PCI Hot Plug feature The driver patches and the option driver packages enclosed with a PCI card in this chapter can be downloaded from the following URLs The driver patches http softwa
98. hbn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hn gt devices pci 89 4000 scsi 2 st 5 0 hn 3 If the device is a disk device start the format 1M command and configure labeling and partition slice information of the logical path name of added disks If the device is a tape device this procedure is not needed Disk array device hard disk driver hddv This example is a case where a disk array device of target 3 lun 0 2 is pre defined in procedure 1 and added in procedure 5 1 There may be a change of status depending on the system operating state after pre definition in procedure 1 so check the LUN definition conflict between sd conf and hddv conf again In case of Check NG the definitions are conflicting so go back to procedure 1 e Check OK to procedure 9 b 2 opt FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 1 e opt FJSVhddv bin hddvchk_conf lt Return gt NGID 3 2 Execute the following command to make the hard disk driver set up the LUN usr sbin hddvadmdr lt Return gt 3 After saving execution result of the prtpicl command get the physical path name of added LUN by taking the difference between the result and the information obtained in 4 a and calculate the corresponding logical path name under dev dsk In the following example c3t3d0 is logical path name of added lun 0 The logical path name of
99. he execution result of the prtpicl 1M command take the difference between the result and the information obtained in 3 a and get the physical path name of additional disk device then get the logical path name under dev dsk In the following example c3t3d0 c4t3d0 is the logical path name of the disk device added prtpicl v gt tmp prtpicl post lt Return gt diff tmp prtpicl pre tmp prtpicl post grep devfs path grep hddv lt Return gt devfs path pci 8d 2000 fibre channel 1 sd 3 0 devfs path pci 8d 2000 fibre channel 1 sd 3 1 devfs path pci 8d 2000 fibre channel 1 sd 3 2 devfs path pci 89 2000 fibre channel 1 sd 3 0 devfs path pci 89 2000 fibre channel 1 sd 3 1 devfs path pci 89 2000 fibre channel 1 sd 3 2 Is l dev dsk grep pci 8d 2000 fibre channel 1 sd 3 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s0 gt devices pci 8d 2000 fibre channel 1 sd 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s1 gt devices pci 8d 2000 fibre channel 1 sd 3 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s2 gt devices pci 8d 2000 fibre channel 1 sd 3 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s3 gt devices pci 8d 2000 fibre channel 1 sd 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s4 gt devices pci 8d 2000 fibre channel 1 sd 3 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s5 gt devices pci 8d 2000 fibre channel 1 sd 3 0 f Irwxrwxrwx 1 ro
100. i 89 2000 fibre channel 1 hddv 3 0 lt Return gt 9 Start the format 1M command and configure labeling and partition slice information calculated in 8 b 8 to the logical path name of each extended LUN c Add configure of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver No procedure is necessary Go to step 9 Fibre Channel driver PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X No procedure is necessary Go to step 9 Fibre Channel Card PW028FC3 PW028FC3U Bind the auto mapped target connected with the card and modify the entries of Ipfc conf to match the requirements of the extended Fibre Channel Controller These procedures are reflected on next boot time In the following indicate to bind the auto mapped target with the card usr sbin Ipfe lputil lt Return gt LightPulse Common Utility for Solaris SPARC Version 1 6a8 03 03 2004 Copyright c 2003 Emulex Network Systems Inc Emulex Fibre Channel Host Adapters Detected 2 Host Adapter 0 Ipfc11 is an LP9802 Ready Mode Host Adapter 1 Ipfc9 is an LP9802 Ready Mode MAIN MENU 1 List Adapters 2 Adapter Information 3 Firmware Maintenance 4 Reset Adapter 5 Persistent Bindings 0 Exit Enter choice gt 5 lt Return gt PERSISTENT BINDINGS MENU Display Current Bindings Display All Nodes Duplicate Adapter Bindings Bind Target Manually Bind Automapped Targets Delete Binding s Retu
101. in procedure 4 Disconnect the PCI card is exchanged for a new PCI card Out customer support works about this procedure Notes When using the PRIMECLUSTER GLS Multipath Function please exchange the PCI card after waiting 10 seconds or more after Procedure 4 Disconnect the PCI card 6 Connect the PCI card The cfgadm command is executed with the configure option to Ap_Id or the push button of the PCI bus slot is pushed Then a new PCI card is connected In addition a push button is valid only in multiple user mode Please confirm that the slot status is connected configured by using the cfgadm 1M command after the above mentioned procedure Notes If the setup of driver conf 4 file exist please refer to 5 1 1 Network driver configuration changing cfgadm c configure pcipsy21 ROB01 PCI slot03 lt Return gt cfgadm pcipsy21 R0B01 PCIFslot03 lt Return gt Ap Id Type Receptacle Occupant Condition pcipsy21 ROBO1 PCI slot03 pci pci hp connected configured ok 7 Connect to redundant system In order to connect the exchanged PCI card into a redundant system please execute the following command with interface name specified at procedure 2 Specify the replacing PCI card Fast switching mode in Redundant Line Control Function usr sbin ifconfig hmel plumb lt Return gt usr sbin ifconfig hmel IP address netmask broadcast trailers up lt Return gt opt FJSVhanet usr sbin hanetni
102. ing and partition slice information calculated in 9 b 3 to the logical path name of each extended LUN c Add configure of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver No procedure is necessary Go to step 10 Fibre Channel driver PW008FC2U W008FC2X GP7B8FC1U GP7B8FC1X No procedure is necessary Go to step 10 Fibre Channel Card PW028FC3 PW028FC3U Bind the auto mapped target connected with the card and modify the entries of Ipfc conf to match the requirements of the extended Fibre Channel Controller These procedures are reflected on next boot time In the following indicate to bind the auto mapped target with the card usr sbin Ipfe Iputil lt Return gt LightPulse Common Utility for Solaris SPARC Version 1 6a8 03 03 2004 Copyright c 2003 Emulex Network Systems Inc Emulex Fibre Channel Host Adapters Detected 2 Host Adapter 0 Ipfc11 is an LP9802 Ready Mode Host Adapter 1 Ipfc9 is an LP9802 Ready Mode MAIN MENU 1 List Adapters 2 Adapter Information 3 Firmware Maintenance 4 Reset Adapter 5 Persistent Bindings 0 Exit Enter choice gt 5 lt Return gt PERSISTENT BINDINGS MENU 1 Display Current Bindings 2 Display All Nodes 3 Duplicate Adapter Bindings 4 Bind Target Manually 5 Bind Automapped Targets 6 Delete Binding s 0 Return to Main Menu Enter choice gt 5 lt Return gt 0 Ipfc11 1 Ipfc9 Select an adapter gt 0 lt
103. ing configurations Fibre Channel switch and disk array device need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch If the Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label on the back of the card These characters represent the bottom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 IEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration a Before extension of PCI cards save the current execution result of prtpicl 1M command composition information at present prtpicl v gt tmp prtpicl pre lt Return gt b Check the status of the slot The relationship of the position of a PCI card and format of Ap
104. ing daemon Execute the following commands to update hardware configuration information of machine administration and to restart the hardware monitoring daemon usr sbin FJSVmadm postphp lt Return gt Preparation to recognize devices for Fibre Channel When the Host Affinity function is being used with Fibre Channel SN200 series Host Affinity must be configured for the device added for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility WWPN zoning of SN200 series Host affinity of Array disk device ETERNUS3000 GR700 800 series and binding setting for fjpfca conf sd conf of host can be added from SAN management window automatically See Operation guide or User s Manual of each product for details Before using this function the following procedure 9 a 1 and 9 a 2 except fep bind target setting are necessary Moreover begin from procedure 9 a 3 after executing this function If you don t use SAN management function of the above products No procedure is necessary Go to step 9 for Fibre Channel Card PW028FC3 PW028FC3U No procedure is necessary Go to step 9 Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry p
105. ing operations are also required for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker StorageMGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility a Refresh current condition on management window SAN Storage Area Network management function searches and indicates replaced PCI card This function will adjust switch zoning and host affinity function of disk array device ETERNUS3000 GR700 800 series with new WWN of replaced PCI card See Operation guide or User s Manual of each product for details 17 Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration b Reconnect the replaced PCI card with changed zoning setting by using the following commands cfgadm c disconnect pcipsy3 COM00 PCI slot02 lt Return gt H cfgadm c configure pcipsy3 COM00 PCI slot02 lt Return gt cfgadm pcipsy3 COM00 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy3 COM00 PCI slot02 mult hp connected configured ok If you don t use SAN management function of the above products No procedure is necessary Go to step 7 for Fibre Channel
106. is 8 OE and Solaris 9 OE The difference between the procedures for the two OEs is that I O devices to be added must be pre defined before system operation with Solaris 8 OE but pre definition is not needed with Solaris 9 OE 3 2 1 Solaris 8 OE The procedures to add PCI cards on a Solaris 8 OE system are explained here To use the PCI Hot Plug function for extension on Solaris OE I O devices to be added must be pre defined and the system must be rebooted before system operation If the I O devices to be added are already defined pre definition is not needed and procedure 1 below can be skipped If you use Fibre Channel Card PW028FC3 PW028FC3U ensure the automap function is effective Boot the system after modifying Ipfc conf vi kernel drv Ipfc conf lt Return gt If automap is set SCSI IDs for all FCP nodes without persistent bindings will be automatically generated If new FCP devices are added to the network when the system is down there is no guarantee that these SCSI IDs will remain the same when the system is booted again The bind method of the port is used as the binding method of automap devices to preserve SCSI IDs between link down and link up If automap is 0 only devices with persistent bindings will be recognized by the system automap 1 lt set to 1 18 3 2 1 1 Extension of PCI cards on non redundant system Procedures to add PCI car
107. is is an example where a disk array controller of target 3 lun 0 is added with pre definition to an existing disk array device Extension using PCI Hot Plug cannot be done without definition so devices must be defined before the system goes into operation If you use Solaris OE sd If this is the first time to pre define a disk array device begin with procedure 1 a If this is not the first time to pre define a disk array device go to step 2 a Modify kernel drv sd conf Ensure target 3 lun 0 target 3 lun 1 target 3 lun 3 are defined in kernel drv sd conf If they are not defined or commented modify kernel drv sd conf vi kernel drv sd conf lt Return gt name sd class scsi target 0 lun 0 name sd class scsi target 3 lun 0 name sd class scsi target 3 lun 1 salt name sd class scsi target 3 lun 2 b Boot the system and reconfigure the kernel touch reconfigure lt Return gt usr sbin shutdown y i6 g0 lt Return gt If you use hddv If this is the first time to pre define a disk array device begin with procedure 1 a If this is not the first time to pre define a disk array device begin with procedure 1 e a Check if kernel drv hddv conf exists Check if kernel drv hddv conf exists If it exists the hard disk driver is being installed so start from procedure l c If it does not exist the system is being operated with none active extension procedures so start from p
108. l drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 8 b 4 opt FJSVhddv bin hddvchk_conf lt Return gt NGID 3 7 Execute the following command in order to make the hard disk driver set up the LUN added update drv f hddv lt Return gt In case disk array equipment currently used exists the following messages are displayed but do not effect performance update drv f hddv lt Return gt Cannot unload module hddv Will be unloaded upon reboot Forcing update of hddv conf 8 After saving execution result of the prtpicl 1M command get the physical path name of added LUN by taking the difference between the result and the information obtained in 3 a and calculate the corresponding logical path name under dev dsk In the following example c3t3d0 is logical path name of added lun 0 The logical path name of lun 1 2 is set to c3t3d1 c3t3d2 respectively because cXtYdZmeans X PCI card number Y target number Z lun number prtpicl v gt tmp prtpicl post lt Return gt diff tmp prtpicl pre tmp prtpicl post grep devfs path grep hddv lt Return gt gt devfs path pci 89 2000 fibre channel 1 hddv 3 0 gt devfs path pci 89 2000 fibre channel 1 hddv 3 1 gt devfs path pci 89 2000 fibre channel 1 hddv 3 2 Is l dev dsk grep pci 89 2000 fibre channel 1 hddv 3 0 lt Return gt lrwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s gt
109. lic letters below are the new multipath names and the underlined letters are the path names that compose the multipath MPHD usr opt FJS Viomp bin iompadm c mphd new dev rdsk c3t3d0s2 dev rdsk c4t3d0s2 lt Return gt IOMP dev FJS Vmphd fiomp adm2 Node dev FJSV mphd rdsk mphd2s0 dev FJSVmphd rdsk mphd2s1 dev FJSV mphd rdsk mphd2s2 dev FJSV mphd rdsk mphd2s3 33 34 11 12 dev FJSVmphd rdsk mphd2s4 dev FJSVmphd rdsk mphd2s5 dev FJSVmphd rdsk mphd2s6 dev FJSVmphd rdsk mphd2s7 GRMPD usr sbin mplbconfig nv lt Return gt Phase 1 checking dev rdsk Phase 2 checking multi path Phase 3 analyzing path Path Action Element path LUN Storage Zone mplbo0 exist c1t4d0s2 c2t3d0s2 0 GR720464f 12340001 mplb8 new c3t3d0s2 c4t3d0s2 0 GR8404550 000213 usr sbin mplbconfig av lt Return gt IOMP dev FJS Vmplb fiomp adm8 Node dev FJSV mplb rdsk mp1b8s0 dev FJS Vmplb rdsk mp1b8s1 dev FJSV mplb rdsk mp1b8s2 dev FJSV mplb rdsk mp1b8s3 dev FJSV mplb rdsk mp1b8s4 dev FJSV mplb rdsk mp1b8s5 dev FJSV mplb rdsk mp1b8s6 dev FJSV mplb rdsk mp1b8s7 Setup applications Add configuration for the application using the logical path name determined in 9 filesystem operation Create file system To mount at system start add an entry in the etc vfstab file newfs dev FJSVmphd rdsk mphd2s6 lt Return gt vi e
110. lled directory Check OK to procedure 1 g opt FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 1 d opt FJS Vhddv bin hddvchk_conf lt Return gt NG ID 3 g Reconfigure the kernel restart the system and then start system operation touch reconfigure lt Return gt usr sbin shutdown y i6 g0 lt Return gt 2 Stop the machine administration monitoring daemon Use the following command to stop the hardware disorder monitoring daemon of machine administration usr sbin FJSVmadm prephp lt Return gt If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped Jete rc0 d K10hbanyware stop lt Return gt Jete rc0 d K10hbanywareDisc stop lt Return gt Add PCI cards Add PCI cards according to the following procedure for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 5 If you don t use SAN management function of the above products To add PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series need to be reconfigured individually If zone configuration by WWPN World Wide P
111. logical path name under dev dsk In the following example c3t3d0 is logical path name of added lun 0 The logical path name of lun 1 2 is set to e3t3d1 c3t3d2 respectively because cXtYdZmeans X PCI card number Y target number Z lun number prtpicl v gt tmp prtpicl post lt Return gt diff tmp prtpicl pre tmp prtpicl post grep devfs path grep hddv lt Return gt gt devfs path pci 89 2000 fibre channel 1 hddv 3 0 gt devfs path pci 89 2000 fibre channel 1 hddv 3 1 gt devfs path pci 89 2000 fibre channel 1 hddv 3 2 lrwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s0 gt devices pci 89 2000 fibre channel 1 hddv 3 0 a Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s1 gt devices pci 89 2000 fibre channel 1 hddv 3 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s2 gt devices pci 89 2000 fibre channel 1 hddv 3 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s3 gt devices pci 89 2000 fibre channel 1 hddv 3 0 d Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s4 gt devices pci 89 2000 fibre channel 1 hddv 3 0 e Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s5 gt devices pci 89 2000 fibre channel 1 hddv 3 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s6 gt devices pci 89 2000 fibre channel 1 hddv 3 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s7 gt devices pci 89 2000 fibre channel 1 hddv 3 0 h Is l dev dsk grep pc
112. me hddv class scsi target 3 lun 0 name hddv class scsi target 3 lun 1 remove comments of extended LUN name hddv class scsi target 3 lun 2 name hddv class scsi target 3 lun 3 6 Check the LUN definition overlap between sd conf and hddv conf by executing hddvchk_ conf command The message example for Check NG means that target 3 is defined in both files and the procedures must be performed again from procedure 8 b 4 The followings are examples of execution of the FJSVhddv package installation to opt The path of the hddvchk_conf command depends on the installed directory Check OK to procedure 8 b 7 opt FJSVhddv bin hddvchk_conf lt Return gt kernel drv sd conf and kernel drv hddv conf seems to be correct Check NG to procedure 8 b 4 opt FJSVhddv bin hddvchk_conf lt Return gt NGID 3 7 Execute the following command in order to make the hard disk driver set up the LUN added update_drv f hddv lt Return gt In case disk array equipment currently used exists the following messages are displayed but do not effect performance update_drv f hddv lt Return gt Cannot unload module hddv Will be unloaded upon reboot Forcing update of hddv conf 8 After saving execution result of the prtpicl 1M command get the physical path name of added LUN by taking the difference between the result and the information obtained in 3 a and calculate the corresponding
113. n be known from the eight characters shown on a label on the front plate of the card These characters represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 0e24 4061 for Fibre Channel Card PW028FC3 PW028FC3U To replace PCI cards with the following configurations Fibre Channel switch and disk array device need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch Ifthe Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label on the back of the card These characters represent the bottom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 IEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally
114. nconfigured cfgadm pcipsy18 ROB01 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy18 ROBO01 PCIfslot02 unknown disconnected unconfigured unknown 5 Connect PCI cards Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the extension slot position Note that the push button is only effective in multi user mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time cfgadm c configure pcipsy18 ROB01 PCI slot02 lt Return gt cfgadm pcipsy18 R0B01 PCIFslot02 lt Return gt Ap Id Type Receptacle Occupant Condition pcipsy18 ROBO1 PCI slot02 mult hp connected configured ok If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started Jetc rc2 d S99hbanyware start lt Return gt Jetc rc2 d S99hbanywareDisc start lt Return gt Update hardware configuration information of machine administration Start the hardware monitoring daemon Execute the following commands to update hardware configuration information of machine administration and to restart the hardware monitoring daemon Jusr sbin FJS Vmadm postph
115. ndings 4 Bind Target Manually 5 Bind Automapped Targets 6 Delete Binding s 0 Return to Main Menu Enter choice gt 5 lt Return gt 0 Ipfc11 1 Ipfc9 Select an adapter gt 0 lt Return gt Automapped FCP Nodes Node Target WWPN WWNN Automapped FCP Node 0 50 06 0e 80 00 10 04 92 50 06 0e 80 00 10 04 92 Automapped FCP Node 1 50 06 0e 80 00 10 04 90 50 06 0e 80 00 10 04 90 Press the Enter or Return key to continue Bind all auto mapped targets Y N gt Y lt Return gt Select Binding Method 1 By Node Name 25 10 11 2 By Port Name 3 By D ID 0 Cancel Enter Choice gt 2 lt Return gt Setup applications Add configuration for the application using the logical path name determined in 9 b Disk device filesystem operation Create file system To mount at system start add an entry in the etc vfstab file newfs dev rdsk c2t2d0s6 lt Return gt vi etc vfstab lt Return gt dev dsk c2t2d0s6 dev rdsk c2t2d0s6 mnt ufs 1 yes Disk device raw access operation Tape device Configure applications For details see the manual of each application Disk device swap device Add swap device To make valid at system start add an entry in the etc vfstab file swap a dev dsk c2t2d0s4 lt Return gt vi ete vfstab lt Return gt dev dsk c2t2d0s4 swap no swap l lt Return gt swapfile dev swaplo blocks free dev d
116. ne administration hardware monitoring daemon Execute the following commands to stop the machine administration hardware monitoring daemon usr sbin FJSVmadm prephp lt Return gt If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped Jete rc0 d K10hbanyware stop lt Return gt Jete rc0 d K10hbanywareDisc stop lt Return gt Add PCI cards Add PCI cards according to the following procedure for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 5 If you don t use SAN management function of the above products To add PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on SN200 series Ifthe Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card ca
117. ng ATM devices opt FJS Vatm bin atmlink adapter number lt Return gt b When using FNA SNA communication protocol over Ethernet When not using the redundant configuration software it is necessary to start all interfaces of Netcompo FNA LAN and all high layer applications that are using Netcompo FNA LAN For details please refer to the manual of Netcompo FNA LAN and high layer applications Start the hardware monitoring of the Machine Administration Please execute the following commands in order to update configuration information and restart the hardware monitoring of the Machine Administration Please refer to PCI Hot Plug User s Guide about details of postphp 1M command usr sbin FJSVmadm postphp lt Return gt 4 1 2 Replacement of PCI cards on redundant system When exchanging PCI cards with redundant configuration software it can exchange PCI cards without stopping applications This subsection describes replacement procedure of PCI cards with the following redundant configuration software SynfinityLink 2 2 PRIMECLUSTER GLS 4 0 or later The replacement and extension of PCI cards are supported only on Redundant Line Control Function of SynfinityLink Notes Because of the dynamic replacement if the environment of SynfinityLink or PRIMECLUSTER GLS has been modified system reboot is not required When using other redundant software please refer to manuals of each product l 66 Sto
118. of PCI cards is as follows Please refer to Chapter 3 File devices or Chapter 4 Network devices about detailed replacing procedure of PCI cards File devices procedures 1 Z 10 Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Stop the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U stop the daemons Specify the replacing PCI card Specify the devices and interfaces that are influenced by replacing PCI cards Disconnect from redundant system Disconnect the devices path and interfaces of PCI cards from the redundant system Disconnect the PCI card It changes into the state where the PCI card is exchangeable Replace the PCI card Replace the PCI card Connect the PCI card It changes into the state where the PCI card is usable Connect to redundant system Connect device paths and interfaces of the replaced PCI card to the redundant system Switch back the online path if needed Start the daemons If you use the Fibre Channel Card PW028FC3 PWO028FC3U start the daemons Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Network devices procedures l Zi Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Speci
119. ollows 1 Stop the hardware monitoring of the Machine Administration The hardware monitoring of the Machine Administration is stopped by using the following command Please refer to PCI Hot Plug User s Guide about the details of prephp IM command usr sbin FJSVmadm prephp lt Return gt 2 Specify the replacing PCI card The interfaces e g hmel which stop applications for replacement of PCI cards are specified from warning messages outputted the console 3 Stop applications By following operations the high layer product e g service application which uses PCI cards for exchange is stopped a When using TCP IP interface The example in the case of using TCP IP interface is shown below Please refer to the online manual etc about the details of the ifconfig 1M command Moreover when high layer programs which using the TCP IP interface needs to be stopped please stop each high layer program Please refer to each manual about the stop procedure of high layer programs 1 When using Ethernet devices usr sbin ifconfig hmel down lt Return gt usr sbin ifconfig hmel unplumb lt Return gt 2 When using ATM devices opt FJS Vatm bin atmunlink adapter number lt Return gt b When using FNA SNA communication protocol over Ethernet When not using the redundant configuration software it is necessary to stop all high layer applications that are using Netcompo FNA LAN and all interfaces of Netcompo FNA LAN Fo
120. ommands Defined to limit the number of SCSI commands issued at the same time The need and value of this definition depends on the disk array device so refer to the manuals of each disk array device Below is an example where definitions for a PCI card at fjpfcal instance number 1 and a disk array device at target 3 is added vi kernel drv fjpfca conf lt Return gt port fipfca0 nport fjpfcal nport sp1 lt add fcp bind target fipfca0t0 0x50000e1000002501 fjpfca1t3 0x50000e1000002ab0 lt add max throttle fjpfca0t0 128 fjpfca1t3 240 lt add 3 Execute the following command to make the fjpfca driver set up the additional part lusr sbin FJSVpfca fc config v lt Return gt Fibre Channel driver PW028FC3 PW028FC3U Configuration is not required Compare the output of prtpicl 1M command with the output saved at 3 b and find the instance number of the added card b Add configuration of device driver This is an example where an disk array device in redundant configuration at target 3 lun 0 2 is added in procedure 4 If this is the first time to pre define a disk array device begin with procedure 8 b 1 If this is not the first time to pre define a disk array device begin with procedure 8 b 5 1 Check if kernel drv hddv conf exists Check if kernel drv hddv conf exists If it exists the hard disk driver is being installed so start from procedure 8 b 3 If it does not exist the system is
121. on guide or User s Manual of each product for details Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration b Reconnect the replaced PCI card with changed zoning setting by using the following commands cfgadm c disconnect pcipsy3 COM00 PCI slot02 lt Return gt H cfgadm c configure pcipsy3 COM00 PCI slot02 lt Return gt cfgadm pcipsy3 COM00 PCIFslot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy3 COM00 PCI slot02 mult hp connected configured ok If you don t use SAN management function of the above products No procedure is necessary Go to step 8 for Fibre Channel Card PW028FC3 PW028FC3U No procedure is necessary Go to step 8 7 Start applications Restart the stopped applications with the following operations a Start vold sh etc init d volmgt start lt Return gt b Restart the usage of the device stopped in procedure 4 b If the device is a disk unit file system operation Mount the unmounted filesystem and resume usage mount F ufs dev dsk c2t3d0s3 export home lt Return gt mount F ufs dev dsk c2t3d0s0 develop firm lt Return gt mount F ufs dev dsk c2t3d0s
122. on path if needed Please refer to manuals of each redundant configuration software about how to switch a communication path 73 74 Chapter 5 Notes Restrictions This chapter describes notes and restrictions in case a PCI card exchanges or extends by using PCI Hot Plug feature 5 1 Notes This section describes notes when exchanging and extending PCI cards by using PCI Hot Plug feature 5 1 1 Network driver configuration changing In case of configuring parameters in driver conf 4 file and replacing or extending the PCI card by using the PCI Hot Plug feature parameters which configured in driver conf 4 file may not be valid To change the initial parameters after the PCI card being replaced or extended by using PCI Hot Plug feature please refer to the solution of each PCI card shown below Each PCI card manual 1 has the description of setting by the ndd command Please refer it Bone ID Software of driver Resolution Functions X1033A U Please make a setting by the ndd command X1033A X Solaris OE hme Or please reboot a system after changing the kernel drv hme conf 10 100BASE T file PWOO8FE1 10 100BASE T FUJITSU PCI 10 100 Ethernet 1 0 or later enclosed with a PCI card Please make a setting by the ndd command Or please reboot a system after changing the kernel drv fjfe conf file PWO08QE1 10 100BASE T x 4 FUJITSU PCI Quad 10 100 Ethernet 1 0 or later enclosed with
123. only on Redundant Line Control Function of SynfinityLink 69 Notes Because of the dynamic exteinsion if the environment of SynfinityLink or PRIMECLUSTER GLS was newly added system reboot is not required When using other redundant software please refer to manuals of each product 1 Stop the hardware monitoring of the Machine Administration The hardware monitoring of the Machine Administration is stopped by using the following command usr sbin FJSVmadm prephp lt Return gt 2 Add PCI cards a Before extending the PCI card please save the result current configuration information of the prtpicl 1M command prtpicl v gt tmp prtpicl pre lt Return gt b Check the status of the slot Subsequent examples describe extension of PCI cards to the slot ROBO1 PCI slot02 The ROBO1 PCI slot02 indicates the I O cabinet number 0 the PCI Disk Box number 1 physical slot number 02 In the extension of a new redundant system although two or more PCI cards are extended whenever you add a PCI card please perform from procedure 2 b to 3 Connect PCI cards The relationship of the position of a PCI card and format of Ap Id is shown below N an integral number Location of PCI slot Element Format of Ap Id Cabinet Number X System Board Number Y pcipsyN CXMOY PCI slotZZ Physical Slot Number ZZ Cabinet of PRIMEPOWER 900 1500 2500 I O Cabinet Number X PCI Disk Bo
124. op lt Return gt b Stop the all I O devices connected to the target PCI card determined in procedure 3 If the device is a disk unit file system operation 1 Determine the mountpoint of the disk from the logical path name determined in procedure 3 b c2t3d0 mount grep c2t3d0 lt Return gt export home on dev dsk c2t3d0s3 setuid read write largefiles on Mon Sep 30 01 00 51 2002 develop firm on dev dsk c2t3d0s0 setuid read write largefiles on Mon Sep 30 01 00 51 2002 develop drv on dev dsk c2t3d0s1 setuid read write largefiles on Mon Sep 30 01 00 51 2002 2002 pub on dev dsk c2t3d0s6 setuid read write largefiles on Mon Sep 30 01 00 50 2 Stop access to the disk To check which process is using the target file system command as follows fuser c export home lt Return gt export home 14967c 14571c 14493ctm 14020c 13828tm 13803c 13575c 13133c 13125tm 13107c 12682ctm 12066tm 12048c 11971ctm 11952ctm 11937c 11867c 11846c 349m 3 Unmount the disk umount export home lt Return gt umount develop firm lt Return gt umount develop drv lt Return gt umount pub lt Return gt If the device is a disk unit raw access operation or a tape device use the fuser 1M 1 Check the access statistics of the target disk determined in procedure 3 a Do the same with a tape device iostat xc lt Return gt extended device statistics cpu device r s w
125. ording to the following procedure for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker StorageMGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility No procedure is necessary Go to step 7 If you don t use SAN management function of the above products To add PCI cards with the following configurations Fibre Channel switch SN200 series and disk array device ETERNUS3000 GR700 800 series need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on SN200 series If the Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the eight characters shown on a label on the front plate of the card These characters represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 0e24 4061 for Fibre Channel Card PW028FC3 PW028FC3U To replace PCI cards with the follow
126. ort Name is done on SN200 series If the Host Affinity function of ETERNUS3000 GR700 800 series is used For details see SN200 Series Affinity User s Guide or ETERNUS3000 GR700 800 series GRmgr User s Guide If you use the Fibre Channel switch or disk array device other than described above see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the eight characters shown on a label on the front plate of the card These characters represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 0e24 4061 for Fibre Channel Card PW028FC3 PW028FC3U To replace PCI cards with the following configurations Fibre Channel switch and disk array device need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch If the Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label on the back of the card These characters represent the bo
127. osition The relation between the WWPN and instance number of the PCI card added can be known from the fc info a command prtpicl v gt tmp prtpicl pfca lt Return gt diff tmp prtpicl pre tmp prtpicl pfca more lt Return gt status okay devfs path pci 8d 2000 fibre channel 1 driver name fipfca binding name pcil0cf 105c bus addr 1 instance 1 class obp device name fibre channel VVVvvvVvoVve usr sbin FJSVpfca fc_adm l fipfcal lt Return gt 2 Edit kernel drv fjpfca conf and add the following property definitions to the instance number from 9 a 1 port topology classification link speed Define this property when PCI cards using Fabric connection are added This definition is not needed with FC AL connection fcp bind target connection of target ID and WWN Define this property when disk array equipment using Fabric connections are added This definition is not needed with FC AL connection max throttle number of maximum SCSI command issue This property is defined for restriction on simultaneous issue of SCSI commands The necessity and value of this definition depends on the specification of the disk array device so refer to the user s manual of each equipment The following example shows the definition of a fjpfcal PCI card instance number 1 and disk array equipment target 3 being added vi kernel drv fjpfca conf lt Return gt port fipfca0 nport
128. ot root 41 Sep 20 22 53 c3t3d0s6 gt devices pci 8d 2000 fibre channel 1 sd 3 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c3t3d0s7 gt devices pci 8d 2000 fibre channel 1 sd 3 0 h Is l dev dsk grep pci 89 2000 fibre channel 1 sd 3 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 c4t3d0s0 gt devices pci 89 2000 fibre channel 1 sd 3 0 a VVV VV V Disk array device hard disk driver hddv This example is a case where a disk array device of target 3 lun 0 2 is pre defined in procedure 1 and added in procedure 4 1 Check if kernel drv hddv conf exists Check if kernel drv hddv conf exists If it exists the hard disk driver is being installed so start from procedure 8 b 3 If it does not exist the system is being operated with none active extension procedures so start from procedure 8 b 2 Not exist new install to procedure 8 b 3 Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory Exist operation with non active extension procedures to procedure 8 b 2 Is kernel drv hddv conf lt Return gt kernel drv hddv conf 2 When operating with non active extension procedures execute the following commands and confirm that kernel drv hddv conf is deleted hddvadm i lt Return gt Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory 3 Use the followin
129. p lt Return gt Preparation to recognize devices for Fibre Channel When the Host Affinity function is being used with Fibre Channel SN200 series Host Affinity must be configured for the device added for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility WWPN zoning of SN200 series Host affinity of Array disk device ETERNUS3000 GR700 800 series and binding setting for fjpfca conf sd conf of host can be added from SAN management window automatically See Operation guide or User s Manual of each product for details Before using this function the following procedure 9 a 1 and 9 a 2 except fcp bind target setting are necessary Moreover begin from procedure 9 a 3 after executing this function If you don t use SAN management function of the above products No procedure is necessary Go to step 9 for Fibre Channel Card PW028FC3 PW028FC3U No procedure is necessary Go to step 9 Note When changing Affinity configuration on SN200 series I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration Set up driver Add the configuration of driver according to the
130. p the hardware monitoring of the Machine Administration The hardware monitoring of the Machine Administration is stopped by using the following command usr sbin FJSVmadm prephp lt Return gt Specify the replacing PCI card The interfaces e g hmel which stop applications for replacement of PCI cards are specified from warning messages outputted the console Disconnect from redundant system In order to disconnect the PCI card for exchange from a redundant system please execute the following command with the interface name specified by procedure 2 Specify the replacing PCI card On the redundant system of standby mode when an online communication path is disconnected a standby communication path will be online communication path automatically When using the GS SURE linkage mode in Redundant Line Control Function of SynfinityLink or PRIMECLUSTER GLS it is necessary to deactivate virtual interfaces e g sha0 used by GS SURE linkage mode Fast switching mode in Redundant Line Control Function opt FJS Vhanet usr sbin hanetnic delete n sha0 i hme1 lt Return gt Jusr sbin ifconfig hmel unplumb lt Return gt NIC switching mode in Redundant Line Control Function opt FJSVhanet usr sbin hanetpoll off lt Return gt lopt FJSVhanet usr sbin stpptl n shal lt Return gt opt FJSVhanet usr sbin hanetnic change n sha0 lt Return gt GS SURE linkage mode in Redundant Line Control Function
131. processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration Connect the PCI card Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the replacement slot position Note that the push button is only effective in multiuser mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time H cfgadm c configure pcipsy3 COM00 PCI slot02 lt Return gt cfgadm pcipsy3 COM00 PCIFslot02 lt Return gt Ap Id Type Receptacle Occupant Condition pcipsy3 COM00 PCI slot02 mult hp connected configured ok When exchanging Fibre Channel cards the following operations are also required for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker StorageMGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility a Refresh current condition on management window SAN Storage Area Network management function searches and indicates replaced PCI card This function will adjust switch zoning and host affinity function of disk array device ETERNUS3000 GR700 800 series with new WWN of replaced PCI card See Operati
132. r details please refer to the manual of Netcompo FNA LAN and high layer applications 4 Disconnect the PCI card a The Ap Id is displayed using the following command based on the interface e g hmel specified in Procedure 2 Specify the replacing PCI card The attachment pint identifier Ap Id is a value for the cfgadm 1M command specifying the slot position of the PCI card Please refer to PCI Hot Plug user s guide about the details of cfgadm 1M and Ap Id usr sbin FJSVmadm inst2comp hmel lt Return gt pcipsy3 COMO00 PCI slot02 b Obtained Ap Id is specified as an argument of the cfgadm 1M command and it confirms that the slot status of the PCI card that disconnects is connected configured cfgadm pcipsy3 COM00 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy3 COMO00 PCI slot02 pci pci hp connected configured ok c Please disconnect the PCI card by executing the cfgadn 1M command with Ap_Id and confirm that the slot status is disconnected unconfigured cfgadm c disconnect pcipsy3 COM00 PCI slot02 lt Return gt cfgadm pcipsy3 COM00 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy3 COM00 PCI slot02 pci pci hp disconnected unconfigured unknown d To confirm the slot position at replacement operation blink the ALARM LED of Ap Id displayed in procedure 4 a cfgadm x led fault mode blink pcipsy3 COM00 PCI slot02 lt Ret
133. re fujitsu com en security index html The option driver packages enclosed with a PCI card http primepower fujitsu com en driver e_index html Please contact our customer service about the latest information of the driver patches and the option driver packages 1 1 PCI cards for file devices The following list describes the PCI cards that support PCI Hot Plug for file devices Please ask the sales staff about the latest information of PCI Hot Plug supporting cards Supporting Functions Software of driver Operating Redundant Functions Product ID Hot Hot driver name clock 71 0 O Software replacement expansion X6540A U Solaris OE glm 2 33MHz NG 3 NG 3 none Multipath Disk Control 2 2 1 or X6541A U later 5 Solaris OE glm 2 33MHz NG 4 OK X6541A X GR Multipath Driver 1 0 1 or later Multipath Disk Control 2 2 1 or I GP7B8SC1U later 5 SCS Solaris OE glm 2 33MHz OK OK GP7B8SC1X GR Multipath Driver 1 0 1 or later PP028SCIU FUJITSU PCI SCSI Adapter Driver 1 0 or later enclosed 33MHz OK OK none PPO28SC1X with a PCI card FUJITSU ULTRA LVD SCSI Host Bus Adapter 33MHz io BW008SC3 Driver 1 0 or later enclosed 66MHz NG 3 NGOS adie with a PCI card Multipath Disk Control 2 2 1 or GP7B8FC1U FUJITSU PCI Fibre Channel later 5 2 2 or later enclosed with a 33MHz OK OK GP7B8FC1X PCI card 6 7 GR Multipath Driver 1 0 1 or later sae Multipath
134. rn to Main Menu Enter choice gt 5 lt Return gt 0 Ipfc11 1 Ipfc9 Select an adapter gt 0 lt Return gt SDN BWNeH Automapped FCP Nodes Node Target WWPN WWNN Automapped FCP Node 0 50 06 0e 80 00 10 04 92 50 06 0e 80 00 10 04 92 Automapped FCP Node 1 50 06 0e 80 00 10 04 90 50 06 0e 80 00 10 04 90 55 Press the Enter or Return key to continue Bind all auto mapped targets Y N gt Y lt Return gt Select Binding Method 1 By Node Name 2 By Port Name 3 ByD ID 0 Cancel Enter Choice gt 2 lt Return gt 9 Setup redundant system Execute the following commands to create a new redundant system The following procedure is described for MPHD GRMPHD If you use the redundancy software other than MPHD GRMPHD see the document for each product In case of MPHD the commands need to be executed for each LUN specifying the path name determined in 8 b 8 as a parameter The italic letters below are the new multipath names and the underlined letters are the path names that compose the multipath MPHD usr opt FJS Viomp bin iompadm c mphd new dev rdsk c3t3d0s2 dev rdsk c4t3d0s2 lt Return gt IOMP dev FJS Vmphd fiomp adm2 Node dev FJSV mphd rdsk mphd2s0 dev FJSV mphd rdsk mphd2s1 dev FJSV mphd rdsk mphd2s2 dev FJSV mphd rdsk mphd2s3 dev FJSV mphd rdsk mphd2s4 dev FJSV mphd rdsk mphd2s5 dev FJSV mphd rdsk mphd2s6 dev FJSV mphd rdsk mphd2s7 GRMPD Jusr sbin mplbconfi
135. rocedure 1 b Not exist new install to procedure 1 c Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory Exists operation with non active extension procedures to procedure 1 b Is kernel drv hddv conf lt Return gt kernel drv hddv conf b When operating with non active extension procedures execute the following commands and confirm that kernel drv hddv conf is deleted hddvadm i lt Return gt Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory c Use the following command to create hddv conf file for the pre defined extension function The message examples for operation with non active extension procedures means that disk array device GR720 currently used with taget 1 lun 0 is registered twice on the sd hddv driver New installation to procedure 1 e hddvadm M lt Return gt Operation with non active extension procedures to procedure 1 d hddvadm M lt Return gt already ID 1 exists devices pci 1d 2000 fibre channel 1 sd 1 0 a raw GR720 d When performing pre defined extension the same target number cannot be registered in sd conf and hddv conf so delete or comment out the conflicting definition parts in sd conf file when definition in the two files conflict with each other 35 36 The following example shows the case that target 1 is repeated vi kernel drv sd conf lt
136. rocesses but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration Setup driver Add the configuration of driver according to the following operation As for file related drivers additional configuration of the PCI card driver and the device driver is needed a Add configurations of PCI card driver SCSI driver Solaris OE glm FUJITSU PCI SCSI Adapter Driver Configuration is not required Fibre Channel driver PW008FC2U W008FC2X GP7B8FC1U GP7B8FC1X 1 After saving execution result of prtpicl IM command take the difference between the result and the information obtained in procedure 4 a to calculate the instance number of the fjpfca driver of the PCI card added In the following example instance number is 1 indicating that the interface name of the PCI card added is fipfcal Making the LED of the PCI card blink using the fc_adm command can specify the relation between the instance number and the slot position The relation between the WWPN and instance number of the PCI card added can be known from the fc info a command prtpicl v gt tmp prtpicl pfca lt Return gt diff tmp prtpicl pre tmp prtpicl pfca more lt Return gt gt status okay gt devfs path pci 8d 2000 fibre channel 1 gt driver name fipfca gt binding name pcil0cf 105c bus addr 1 instance 1 class obp device mame fibre channel VVVV usr
137. rs represent the bottom eight digit of the WWPN in hexadecimal form The top eight digit are 13 14 fixed to 10000000 in hexadecimal form For example if the following label is shown on the front plate of the card the WWPN of the replacement card is 100000000e244061 06244061 for Fibre Channel Card PW028FC3 PW028FC3U To replace PCI cards with the following configurations Fibre Channel switch and disk array device need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch Ifthe Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label on the back of the card These characters represent the bottom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 IEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry
138. rwxrwx 1 root root 41 Sep 20 22 53 Ic gt devices pci 89 4000 scsi 2 st 5 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 1cb gt devices pci 89 4000 scsi 2 st 5 0 cb lrwxrwxrwx 1 root root 41 Sep 20 22 53 Icbn 31 gt devices pci 89 4000 scsi 2 st 5 0 cbn lrwxrwxrwx 1 root root 41 Sep 20 22 53 1cn gt devices pci 89 4000 scsi 2 st 5 0 cn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1h gt devices pci 89 4000 scsi 2 st 5 0 h Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hb gt devices pci 89 4000 scsi 2 st 5 0 hb Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hbn gt devices pci 89 4000 scsi 2 st 5 0 hbn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hn gt devices pci 89 4000 scsi 2 st 5 0 hn 3 If the device is a disk device start the format 1M command and configure labeling and partition slice information of the logical path name of added disks If the device is a tape device this procedure is not needed Disk array device hard disk driver hddv This example is a case where a disk array device of target 3 lun 0 2 is pre defined in procedure 1 and added in procedure 5 1 There may be a change of status depending on the system operating state after pre definition in procedure 1 so check the LUN definition conflict between sd conf and hddv conf again In case of Check NG the definitions are conflicting so go back to procedure 1 e Check OK to procedure 9 b 2 it opt
139. s Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the extension slot position Note that the push button is only effective in multiuser mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time cfgadm c configure pcipsy15 COM01 PCI slot02 lt Return gt H cfgadm pcipsy15 COM01 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy15 COM01 PCI slot02 mult hp connected configured ok If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started ete re2 d S99hbanyware start lt Return gt Jete rc2 d S99hbanywareDisc start lt Return gt Update hardware configuration information of machine administration Start the hardware monitoring daemon Execute the following commands to update hardware configuration information of machine administration and to restart the hardware monitoring daemon usr sbin FJSVmadm postphp lt Return gt Preparation to recognize devices for Fibre Channel When the Host Affinity function is being used with Fibre Channel SN200 series Host Affinity must be configured for the device added
140. s Extend PCI cards Connect PCI cards It changes into the state where the PCI card is usable Start the hardware monitoring of the Machine Administration Update the hardware configuration information and restart the hardware abnormal monitoring of the Machine Administration Connect equipment to PCI cards Connect equipment to PCI cards Set up driver a Add the driver configuration of PCI cards Add the driver configuration of PCI cards b Add the configuration of device driver Add the configuration of device driver in the case of file devices Setup applications Configure the high layer products and services about extended PCI cards Start applications Start high layer products and services used by the replaced PCI card Extension of PCI cards with new redundant system The procedure of using the extended PCI card and establishing a new redundant configuration is as follows Please refer to Chapter 3 File devices or Chapter 4 Network devices about detailed extending procedure of PCI cards File devices procedures 1 2 Setup I O devices which will be added to system Setup devices which will be added to system in the case of file devices on Solaris 8 OE Stop the hardware monitoring of the Machine Administration Stop the hardware abnormal monitoring of the Machine Administration Stop the daemons If you use the Fibre Channel Card PW028FC3 PW028FC3U stop the daemons Add PCI cards Extend PCI cards Connect PCI cards It c
141. s 9 OE This section describes the procedures to extend PCI cards on Solaris 9 OE systems If you use Fibre Channel Card PW028FC3 PW028FC3U ensure the automap function is effective Boot the system after modifying Ipfc conf vi kernel drv Ipfc conf lt Return gt If automap is set SCSI IDs for all FCP nodes without persistent bindings will be automatically generated If new FCP devices are added to the network when the system is down there is no guarantee that these SCSI IDs will remain the same when the system is booted again The bind method of the port is used as the binding method of automap devices to preserve SCSI IDs between link down and link up If automap is 0 only devices with persistent bindings will be recognized by the system automap 1 lt set to 1 3 2 2 1 Extension of PCI cards on non redundant system Procedures to add PCI cards without making them redundant on a Solaris 9 OE system are explained here 1 Stop the machine administration hardware monitoring daemon Execute the following commands to stop the machine administration hardware error monitoring daemon usr sbin FJSVmadm prephp lt Return gt 2 If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be stopped ete rc0 d K10hbanyware stop lt Return gt 42 Jete rc0 d K10hbanywareDisc stop lt Return gt 3 Add PCI cards Add PCI cards acc
142. s above b Find the hddv1 with the status offline fail from the results of the iompadm command and determine the logical path name of the LUN connected to the target PCI card The following is an example of MPHD and dev rdsk c3t1d0s2 is the logical path name corresponding to hddv1 In case of GRMPD specify mplb in the c option parameter of the iompadm command 16 usr opt FJS Viomp bin iompadm c mphd p info lt Return gt IOMP dev FJS Vmphd fiomp adm2 gt devices pseudo mphd 2 adm Element dev rdsk c3t1d0s2 offline fail block target completed hard reset sequence GR7104546 010000 00 00 30 hddv1 gt devices pci 84d 2000 fibre channel 1 hddv 1 0 c raw dev rdsk c2t2d0s2 online active block good status with active GR7104546 010000 01 01 32 hddv15 gt devices pci 89 2000 fibre channel 1 hddv 2 0 c raw Node dev FJS Vmphd rdsk mphd2s0 dev FJS Vmphd rdsk mphd2s1 dev FJSVmphd rdsk mphd2s2 dev FJS Vmphd rdsk mphd2s3 dev FJSV mphd rdsk mphd2s4 dev FJS Vmphd rdsk mphd2s5 dev FJS Vmphd rdsk mphd2s6 dev FJS Vmphd rdsk mphd2s7 Function MPmode false AutoPath true Block true NeedSync false c Disconnect from redundant system Disconnect the path between the target PCI card and I O devices The following procedure is described for MPHD GRMPHD If you use the redundancy software other than MPHD GRMPD see the document for each product Execute the following comm
143. s an example where a disk array device at target 3 lun 0 2 is pre defined If this is the first time to pre define a disk array device start from procedure 1 a If this is not the first time to pre define a disk array device start from procedure 1 e a Check if kernel drv hddv conf exists If it does not exist the hard disk driver is being installed so start from procedure 1 c If it does exist the system is being operated with non active extension procedures so start from procedure 1 b Not exist new install to procedure 1 c Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory Exists operation with non active extension procedures to procedure 1 b Is kernel drv hddv conf lt Return gt kernel drv hddv conf b When operating with non active extension procedures execute the following commands and confirm that kernel drv hddv conf is deleted hddvadm i lt Return gt Is kernel drv hddv conf lt Return gt kernel drv hddv conf No such file or directory c Use the following command to create an hddv conf file for the pre defined extension function The message examples for operation with non active extension procedures means that GR720 currently used with taget 1 lun 0 is registered twice on the sd hddv driver New installation to procedure 1 e hddvadm M lt Return gt Operation with non active extension procedures to procedure
144. s kr s kw s wait actv svc_t w b us sy wt id sd0 59 7 7 5 474 5 45 0 0 0 3 9 58 6 0 41 3 7 23 67 sd1 0 1 0 3 1 02 5 0 0 0 0 16 000 sd20 0 0 0 1 0 3 0 7 0 0 0 0 14 7 00 st82 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 nfs1 0 0 0 0 0 0 0 0 0 0 0 0 0 000 2 Stop disk access of applications Disk access statistics of the target disk can be checked as below sar d 60 1 lt Return gt SunOS machine0 5 8 Generic_108528 05 sun4u 10 02 02 17 56 00 device busy avque r w s blks s avwait avserv 17 57 00 nfs1 0 0 0 0 0 0 0 0 0 sd0 2 0 3 2 37 0 0 145 5 sd0 a 1 0 105 0 0 301 4 sd0 b 0 0 00 9 0 0 31 5 sd0 c 0 0 0 0 0 0 0 0 0 sd0 d 10 00 4 0 0 126 8 sd0 e 0 0 0 0 0 0 0 0 0 sd0 f 10 1 160 0 120 9 sd0 g 10 1 1 140 0 111 7 It is the same with tape devices The example below shows access statistics of one minute sd20 0 0 0 0 0 0 0 0 0 sd20 a 0 0 0 0 0 0 0 0 0 sd20 c 0 0 0 0 0 0 0 0 0 sd20 g 0 0 0 0 0 0 0 0 0 st82 0 0 0 0 0 0 0 0 0 3 Stop deactivate applications See the manuals of each software for details If the device is a disk unit swap device 1 Show a list of swap devices and check that the disk of the logical path determined in procedure 3 b c2t3d0 is a swap device swap l lt Return gt swapfile dev swaplo blocks free dev dsk c2t3d0s4 32 164 16 788384 683680 2 Delete the swap device swap d dev dsk c2t3d0s4 lt Return gt 4 Disconnect the PCI card Disconnect the target
145. s pci 89 4000 scsi 2 st 5 0 b lrwxrwxrwx 1 root root 41 Sep 20 22 53 1bn gt devices pci 89 4000 scsi 2 st 5 0 bn Irwxrwxrwx 1 root root 41 Sep 20 22 53 Ic gt devices pci 89 4000 scsi 2 st 5 0 Irwxrwxrwx 1 root root 41 Sep 20 22 53 1cb gt devices pci 89 4000 scsi 2 st 5 0 cb Irwxrwxrwx 1 root root 41 Sep 20 22 53 Icbn gt devices pci 89 4000 scsi 2 st 5 0 cbn lrwxrwxrwx 1 root root 41 Sep 20 22 53 len gt devices pci 89 4000 scsi 2 st 5 0 cn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1h gt devices pci 89 4000 scsi 2 st 5 0 h lrwxrwxrwx 1 root root 41 Sep 20 22 53 1hb gt devices pci 89 4000 scsi 2 st 5 0 hb lrwxrwxrwx 1 root root 41 Sep 20 22 53 1hbn gt devices pci 89 4000 scsi 2 st 5 0 hbn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hn gt devices pci 89 4000 scsi 2 st 5 0 hn information of the logical path name of added disks If the device is a tape device t needed Disk array devices hard disk driver hddv This is an example where an disk array device at target 3 lun 0 2 is pre defined in procedure 4 If this is the first time to pre define a disk array device begin with procedure 8 b 1 If this is pre define a disk array device begin with procedure 8 b 5 1 Check if kernel drv hddv conf exists 4 If the device is a disk device start the format 1M command and configure labeling and partition slice his procedure is not
146. s4 gt devices pci 89 4000 scsi 2 sd 2 0 e lrwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s5 gt devices pci 89 4000 scsi 2 sd 2 0 f Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s6 gt devices pci 89 4000 scsi 2 sd 2 0 g Irwxrwxrwx 1 root root 41 Sep 20 22 53 c2t2d0s7 gt devices pci 89 4000 scsi 2 sd 2 0 h Tape device diff tmp prtpicl pre tmp prtpicl post grep devfs path grep st lt Return gt gt devfs path pci 89 4000 scsi 2 st 5 0 Is l dev rmt grep pci 89 4000 scsi 2 st 5 0 lt Return gt Irwxrwxrwx 1 root root 41 Sep 20 22 53 1 gt devices pci 89 4000 scsi 2 st 5 0 Irwxrwxrwx 1 root root 41 Sep 20 22 53 1b gt devices pci 89 4000 scsi 2 st 5 0 b Irwxrwxrwx 1 root root 41 Sep 20 22 53 1bn gt devices pci 89 4000 scsi 2 st 5 0 bn Irwxrwxrwx 1 root root 41 Sep 20 22 53 Ic gt devices pci 89 4000 scsi 2 st 5 0 c Irwxrwxrwx 1 root root 41 Sep 20 22 53 1cb gt devices pci 89 4000 scsi 2 st 5 0 cb Irwxrwxrwx 1 root root 41 Sep 20 22 53 1cbn gt devices pci 89 4000 scsi 2 st 5 0 cbn Irwxrwxrwx 1 root root 41 Sep 20 22 53 len gt devices pci 89 4000 scsi 2 st 5 0 cn Irwxrwxrwx 1 root root 41 Sep 20 22 53 1h gt devices pci 89 4000 scsi 2 st 5 0 h Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hb gt devices pci 89 4000 scsi 2 st 5 0 hb Irwxrwxrwx 1 root root 41 Sep 20 22 53 1hbn gt devices pci 89 4000 scsi 2 st 5 0
147. sk c2t2d0s4 32 164 16 788384 683680 Start applications Use the logical path name determined in 9 b to start applications Disk device filesystem operation Mount filesystem mount F ufs dev dsk c2t2d0s6 mnt lt Return gt Disk device raw access operation Tape device Start applications For details see the manual of each application Disk device swap device This procedure is not required 3 2 1 2 Extension of PCI cards on new redundant system The procedure to add PCI cards to a new redundant system on a Solaris 8 OE system is explained with examples for the multipath software below Multipath Disk Control MPHD GR Multipath Driver GRMPD If other multipath software is being used see the manual of each product 1 26 Setup devices which will be added to system This is an example where an disk array device at target 3 lun 0 2 is pre defined Extension using PCI Hot Plug is impossible without definition so definition must be done before the system goes into operation If you use Solaris OE sd If this is the first time to pre define a disk array device begin with procedure 1 a If this is not the first time to pre define a disk array device go to step 2 a Modify kernel drv sd conf Ensure target 3 lun 0 target 3 lun 1 target 3 lun 3 are defined in kernel drv sd conf If they are not defined or commented modify kernel drv sd conf vi kernel drv
148. t To connect the added PCI card to the redundant system execute the following command and confirm that the path name determined in procedure 8 b 8 in underlined letters is added usr sbin mplbconfig nv lt Return gt Phase 1 checking dev rdsk Phase 2 checking multi path Phase 3 analyzing path Path Action Element path LUN Storage Zone mplb0 exist c1t4d0s2 c2t3d0s2 0 GR720464f 12340001 mplb8 add c3t3d0s2 0 GR8404550 000213 usr sbin mplbconfig av lt Return gt IOMP dev FJSVmplb fiomp admsg Node dev FJSV mplb rdsk mp1b8s0 dev FJS Vmplb rdsk mp1b8s1 dev FJS Vmplb rdsk mp1b8s2 63 64 dev FJSVmplb rdsk mplb8s3 dev FJSVmplb rdsk mplb8s4 dev FJSVmplb rdsk mplb8s5 dev FJSVmplb rdsk mplb8s6 dev FJSVmplb rdsk mplb8s7 Chapter 4 Network Devices This chapter describes the detailed procedure about replacement or extension of network related PCI cards by PCI Hot Plug Please refer to manuals of each software about the details of the redundant software 4 1 Replacement of PCI card This section describes replacement procedure of the PCI card by using PCI Hot Plug on non redundant system and redundant system 4 1 1 Replacement of PCI cards on non redundant system When exchanging PCI cards without redundant configuration software you must stop applications which using PCI cards The replacement procedure of PCI cards is as f
149. t the PCI card Connect the replaced PCI card using the cfgadm 1M command with the configure option or by pushing the button corresponding to the extension slot position Note that the push button is only effective in multiuser mode After the new PCI card is connected use the cfgadm 1M command and confirm that the slot status has changed to connected configured If a large scale configuration of I O devices is connected to the PCI card in the target slot command execution for status confirmation may take time cfgadm c configure pcipsy18 ROB01 PCI slot02 lt Return gt cfgadm pcipsy18 ROB01 PCI slot02 lt Return gt Ap Id Type Receptacle Occupant Condition pcipsy18 ROBO1 PCI slot02 mult hp connected configured ok If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started ete re2 d S99hbanyware start lt Return gt Jete rc2 d S99hbanywareDisc start lt Return gt Update hardware configuration information of machine administration Start the hardware monitoring daemon Execute the following commands to update hardware configuration information of machine administration and to restart the hardware monitoring daemon usr sbin FJSVmadm postphp lt Return gt Preparation to recognize devices for Fibre Channel When the Host Affinity function is being used with Fibre Channel SN200 series Host Affinity must be configured for the device added for PCI
150. tc vfstab lt Return gt dev FJSVmphd dsk mphd2s6 dev FJS Vmphd rdsk mphd2s6 mnt ufs 1 yes raw access operation Configure applications For details see the manual of each application swap device Add swap device To make valid at system start add an entry in the etc vfstab file swap a dev FJSV mphd dsk mphd2s4 lt Return gt vi ete vfstab lt Return gt dev FJSV mphd dsk mphd2s4 swap no swap l lt Return gt swapfile dev swaplo blocks free dev FJSV mphd dsk mphd2s4 32 164 16 788384 683680 Start applications Use the logical path name determined in 9 to start applications filesystem operation Mount filesystem mount F ufs dev FJSVmphd dsk mphd2s6 mnt lt Return gt raw access operation Start applications For details see the manual of each application swap device This procedure is not required 3 2 1 3 Extension of PCI cards to redundant system The procedure to add PCI cards to a redundant system in order to extend redundancy on a Solaris 8 OE system is explained with an example with GR multipath driver GRMPD There are no additional patterns for Multipath Disk Control MPHD If multipath software products other than GRMPD are being used see the manual of each product No configuration is needed for applications when adding PCI cards to an existing redundant system 1 Setup devices which will be added to system Th
151. tered in sd conf and hddv conf so delete or comment out the conflicting definition parts in sd conf file when definition in the two files conflict with each other The following example shows the case that target 1 is repeated vi kernel drv sd conf lt Return gt name sd class scsi target 0 lun 0 name sd class scsi target 1 lun 0 name sd class scsi Delete or comment out target 1 lun 1 the duplication definition parts in sd hddv name sd class scsi target 1 lun 2 A target number that is already used by the sd driver of the system disk or CD ROM cannot be deleted In this case change the target number in hddv conf and of the disk array device conflict with sd conf so that it does not Edit the kernel drv hddv conf file created automatically by the hddvadm M command and remove comments of the LUN definition to pre define and the LUN definition current ly being used with non active extension procedures If case active extension has been performed before and the LUN definition to extend the next procedures 1 f 1 g are not needed The following example shows target 3 lun 0 2 for pre defined extension and disk array device GR720 target 1 in use with non active extension procedures being registered Is kernel drv hddv conf lt Return gt kernel drv hddv conf vi kernel drv hddv conf lt Return gt 47 48 name hddv class scsi target 0 lun 0
152. that target 1 is repeated vi kernel drv sd conf lt Return gt name sd class scsi 53 target 0 lun 0 name sd class scsi target 1 lun 0 name sd class scsi delete or comment out target 1 lun 1 the duplication definition parts in sd hddv name sd class scsi target 1 lun 2 A target number that is already used by the sd driver of the system disk or CD ROM cannot be deleted In this case change the target number in hddv conf and of the disk array device so that it does not conflict with sd conf 5 Edit the kernel drv hddv conf file created automatically by the hddvadm M command and remove comments of the LUN definition to pre define and the LUN definition currently being used with non active extension procedures If case active extension has been performed before and the LUN definition to extend the next procedures 1 f 1 g are not needed The following example shows target 3 lun 0 2 for pre defined extension and disk array device GR720 target 1 in use with non active extension procedures being registered Is kernel drv hddv conf lt Return gt kernel drv hddv conf vi kernel drv hddv conf lt Return gt name hddv class scsi target 0 lun 0 name hddv class scsi target 0 lun 7 name hddv class scsi target 1 lun 0 name hddv class scsi target 1 lun 1 remove comments of the LUN in use name hddv class scsi target 1 lun 2 na
153. tion it is impossible to extend a new interface to the existing redundant configuration system Moreover when extending an interface on the GS SURE linkage mode it is necessary to extend an interface after deactivating the virtual interface e g sha0 used by the GS SURE linkage mode Fast switching mode in Redundant Line Control Function usr sbin ifconfig hme2 plumb lt Return gt Jusr sbin ifconfig hme2 IP address netmask broadcast trailers up lt Return gt GS SURE linkage mode in Redundant Line Control Function opt FJS Vhanet usr sbin stphanet n sha0 lt Return gt opt FJSVhanet usr sbin hanetconfig create n sha2 m n i 192 168 20 10 t hme2 lt Return gt opt FJSVhanet usr sbin hanetnic modify n sha0 t sha2 sha3 sha4 lt Return gt opt FJSVhanet usr sbin strhanet n sha0 lt Return gt Multipath Function usr opt FJSViomp bin iompadm c mpnet add mpnet0 hme2 lt Return gt usr opt FJSViomp bin iompadm c mpnet start mpnet0 hme2 lt Return gt Notes It is necessary to configure the IP address specified by ifconfig 1M command in etc inet hosts and etc hostname hmel Unless these are configured the virtual interface for fast switching mode can not be activated after rebooting the system In addition in order to use IPv6 address please refer to the PRIMECLUSTER GLS 4 1A20 or later manual 8 Switch the redundant path Please switch an online communication path for extended communicati
154. tmp prtpicl pre lt Return gt b Check the status of the slot 71 72 Subsequent examples describe extension of PCI cards to the slot ROBO1 PCI slot02 The ROBO1 PCI slot02 indicates the I O cabinet number 0 the PCI Disk Box number 1 physical slot number 02 In the extension of a new redundant system although two or more PCI cards are extended whenever you add a PCI card please perform from procedure 2 b to 3 Connect PCI cards The relationship of the position of a PCI card and format of Ap Id is shown below N an integral number Location of PCI slot Element Format of Ap Id Cabinet Number X System Board Number Y pcipsyN CXMOY PCI slotZZ Physical Slot Number ZZ Cabinet of PRIMEPOWER 900 1500 2500 I O Cabinet Number X PCI Disk Box PCI Disk Box Number Y pcipsyN RXBOY PCI slotZZ Physical Slot Number ZZ other than those above Physical Slot Number ZZ pcipsyN PCI slotZZ Please confirm that the PCI slot status which extended PCI cards is empty unconfigured by using cfgadm 1M command cfgadm grep R0B01 PCIFslot02 lt Return gt pcicsy18 ROBO1 PCI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 2 b cfgadm x led fault mode blink pcipsy18 ROB01 PCI slot02 lt Return gt d Please confirm that READY LED of the PCI bus slot that extends a PCI car
155. to update configuration information and restart the hardware monitoring of the Machine Administration usr sbin FJSVmadm postphp lt Return gt 5 Connect equipment to PCI cards The extended PCI card is connected with network equipment by the cable 6 Setup driver The driver configuration is added by following operations a The interface name is investigated in order to configure drivers and high layer products Please save the result of the prtcicl IM command and obtain the difference information between current result and the result taken at 2 a Then the driver instance number for the extended PCI card is obtained In the following example since the instance number is 1 it can be determined that the interface name of the extended PCI card is hmel prtpicl v gt tmp prtpic post lt Return gt diff tmp prtpicl pre tmp prtpicl post more lt Return gt status okay devfs path pci 8d 2000 network 1 driver name hme binding name SUNW hme bus addr 1 instance 1 class obp device name network VVVVV VV VO b It confirms that the interface name that obtained above mentioned procedure is an interface name that corresponds to the PCI bus slot of the added PCI card Please carry out this procedure when it cannot identify relationship between an interface name and PCI bus slot by expanding two or more PCI cards especially usr sbin FJSVmadm inst2comp hmel lt Return gt pcipsy1
156. ttom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 TEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration a Before extension of PCI cards save the current execution result of the prtpicl 1M command current configuration at present prtpicl v gt tmp prtpicl pre lt Return gt b Check the status of the slot The relationship of the position of a PCI card and format of Ap Id is shown below Location of PCI slot Definition of slot Format of Ap Id Inside chassis of Chassis No X PRIMEPOWER System board No Y pcipsyN CXMOY PCI slotZZ 900 1500 2500 Physical slot No ZZ I O Chassis No X PCI Disk BOX PCI Disk BOX No Y pcipsyN RXBOY PCI slotZZ Physical slot No ZZ Other Physical slot No ZZ pcipsyN PCI slotZZ Below an example of adding a PCI card to chassis number 0 PCI Disk BOX number 1 physical slot number 02 slot in PCI Disk BOX ROBO1 PCI slot02 is explained Check th
157. turn gt Ap_Id Type Receptacle Occupant Condition pcipsy18 ROBO1 PCI slot02 mult hp connected configured ok 6 If you use the Fibre Channel Card PW028FC3 PW028FC3U execute the following The daemons will be started Jete rc2 d S99hbanyware start lt Return gt Jete rc2 d S99hbanywareDisc start lt Return gt 7 Update hardware configuration information of machine administration Start the hardware monitoring daemon Execute the following commands to update hardware configuration information of machine administration and to restart the hardware monitoring daemon 29 30 usr sbin FJSV madm postphp lt Return gt 8 Preparation to recognize devices for Fibre Channel When the Host Affinity function is being used with Fibre Channel SN200 series Host Affinity must be configured for the device added for PCI Fibre Channel PW008FC2U PW008FC2X GP7B8FC1U GP7B8FC1X If you use SAN management function of Systemwalker Storage MGR Softek SANView for ETERNUS except for Vixel SP5000 SRM Facility WWPN zoning of SN200 series Host affinity of Array disk device ETERNUS3000 GR700 800 series and binding setting for fjpfca conf sd conf of host can be added from SAN management window automatically See Operation guide or User s Manual of each product for details Before using this function the following procedure 9 a 1 and 9 a 2 except fep bind target setting are necessary Mor
158. urn gt 5 Replace the PCI card The PCI card disconnected in procedure 4 Disconnect the PCI card is exchanged for a new PCI card Our customer 65 service works about this procedure Connect the PCI card The cfgadm command is executed with the configure option to Ap Id or the push button of the PCI bus slot is pushed Then a new PCI card is connected In addition a push button is valid only in multiple user mode Please confirm that the slot status is connected configured by using the cfgadm 1M command after the above mentioned procedure Notes If the setup of driver conf 4 file exist please refer to 5 1 1 Network driver configuration changing cfgadm c configure pcipsy3 COM00 PCI slot02 lt Return gt cfgadm pcipsy3 COM00 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcipsy3 COM00 PCl slot02 pci pci hp connected configured ok Start applications Please restart the stopped high layer product service application by the following operations a When using TCP IP interface The example in the case of using TCP IP interface is shown below Furthermore when the high layer program which is using the PCI card needs to restart please refer to the manual of each high layer program 1 When using Ethernet devices usr sbin ifconfig hmel plumb lt Return gt usr sbin ifconfig hmel inet 192 168 10 10 netmask broadcast trailers up lt Return gt 2 When usi
159. urrently being used with non active extension procedures If case active extension has been performed before and the LUN definition to extend the next procedures 1 f 1 g are not needed If the target number of each disk array controller of a redundant system differs add definition for each target number The following example shows target 3 lun 0 2 for pre defined extension and disk array device GR720 target 1 in use with non active extension procedures being registered 27 28 Is kernel drv hddv conf lt Return gt kernel drv hddv conf vi kernel drv hddv conf lt Return gt name hddv class scsi target 0 lun 0 name hddv class scsi target 0 lun 7 name hddv class scsi target 1 lun 0 name hddv class scsi target 1 lun 1 Remove comments of the LUN in use name hddv class scsi target 1 lun 2 name hddv class scsi target 3 lun 0 name hddv class scsi target 3 lun 1 Remove comments of extended LUN name hddv class scsi target 3 lun 2 name hddv class scsi target 3 lun 3 f Check the LUN definition overlap between sd conf and hddv conf by executing hddvchk_conf command The message example for Check NG means that target 3 is defined in both files and the procedures must be performed again from procedure 1 d The followings are examples of execution of the FJSVhddv package installation to opt The path of the hddvchk_conf command depends on the insta
160. x PCI Disk Box Number Y pcipsyN RXBOY PCI slotZZ Physical Slot Number ZZ other than those above Physical Slot Number ZZ pcipsyN PCI slotZZ Please confirm that the PCI slot status which extended PCI cards is empty unconfigured by using cfgadm 1M command H cfgadm grep R0B01 PCIFslot02 lt Return gt pcicsy18 ROBO1 PCI slot02 unknown empty unconfigured unknown c To confirm the slot position at extension operation blink the ALARM LED of Ap Id displayed in procedure 2 b cfgadm x led fault mode blink pcipsy18 ROB01 PCI slot02 lt Return gt d Please confirm that READY LED of the PCI bus slot that extends a PCI card has gone out and extend a PCI card This operation is performed by our customer support e Please confirm that the PCI slot status which extended PCI cards is disconnected unconfigured by using cfgadm 1M command cfgadm pcipsy15 ROBO1 PCI slot02 lt Return gt Ap_Id Type Receptacle Occupant Condition pcicsy18 ROBO1 PCI slot02 unknown disconnected unconfigured unknown 3 Connect PCI cards The cfgadm command is executed with the configure option to Ap Id or the push button of the PCI bus slot is pushed Then a extended PCI card is connected In addition a push button is valid only in multiple user mode Please confirm that the slot status is connected configured by using the cfgadm 1M command after the above mentioned procedure cfgadm c configure pcipsy18 ROB01 PCI slot0
161. y device need to be reconfigured individually If zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch If the Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label on the back of the card These characters represent the bottom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 TIEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration a Before extension of PCI cards save the current execution result of the prtpicl 1M command current configuration at present prtpicl v gt tmp prtpicl pre lt Return gt b Check the status of the slot The relationship of the position of a PCI card and format of Ap Id is shown below Location of PCI slot Definition of
162. zone configuration by WWPN World Wide Port Name is done on Fibre Channel switch Ifthe Host Zoning function of disk array device is used For details see the document of each product To perform the above reconfiguration the WWPN a 16 digit number of the replacement card is needed The WWPN of the PCI card can be known from the twelve characters shown on a label on the back of the card These characters represent the bottom twelve digit of the WWPN in hexadecimal form The top four digit are fixed to 1000 in hexadecimal form For example if the following label is shown on the back of the card the WWPN of the replacement card is 10000000c9366037 IEEE 0000c9366037 Note When changing Affinity configuration on SN200 series or other Fibre Channel switch I O to other devices is effected by the change and may result in temporal errors I O to disk array devices recovers normally because of retry processes but on Fibre Channel tape devices backup processes may end in errors Stop backup before changing Affinity configuration a Before extension of PCI cards save the current execution result of the prtpicl IM command current configuration at present prtpicl v gt tmp prtpicl pre lt Return gt b Check the status of the slot When adding PCI cards to a redundant configuration several PCI cards may be added to the system In this case perform procedures to 3 on each card The relationship of the position of a P

Download Pdf Manuals

image

Related Search

Related Contents

    Samsung 2243EW Instrukcja obsługi  艦補処公示第1号 平成19年 1月19日 着艦拘束装置の検査  NRVIS Data Class User Guide  Melitta ME10TS Coffeemaker User Manual  now  

Copyright © All rights reserved.
Failed to retrieve file