Home

Implementing an Open IBM SAN Featuring the McDATA Portfolio

1. Pa ooo ooo ooo oo oo oo oo ooo 200 ooo RS6K AIX server ESS default zone default zone Figure 3 57 WNT zone with two Netfinity node ports and one ESS node port There are ESS ports and RS 6000 ports already connected to the switch but no Netfinity port In our case we have only one FC adapter on each host so we only have to add one port of each host to the zones Creating a new zone set To create a new zone set we select Configure gt Zone Sets This displays the zone set library and provides us with options for changing our zone set definitions for example creating new zone sets deleting zone sets or modifying existing zone sets as shown in Figure 3 58 Implementing an Open IBM SAN gt McDATA Fabric Manager gt Zone Sets Figure 3 58 Fabric Manager Zone Sets Because there are no zone sets in the zone library we will need to create one Starting from the Actions button in the Zone Sets window we select New We are presented with a window to define a zone set From this window we will assign a zone set name The Actions button provides us with the different tasks to maintain the zones in this zone set as shown in Figure 3 59 Chapter 3 Implementing a SAN with McDATA 231 lt gt McDATA Fabric Manager Zoning View Default Zone Enabled ctive Zone Set s Set Libra Zone Set Name ITSO_Zone_Set_1 Zones in Set
2. 200 3 3 5 Assigning nicknames to World Wide Port Names 202 3 4 Managing the devices using the Product Manager 204 3 4 1 Managing the ED 6064 0 eee eee 205 3 4 2 Configuring the ED 5000 with the Product Manager 215 3 4 3 Managing the ES 3016 0 eee eee 217 3 4 4 Introduction to the ES 1000 Product Manager 217 3 5 Understanding the McDATA zoning concepts 045 223 3 5 1 Zoning implementation 2 000 cee eee 224 3 5 2 Zone member definitions 00 eee eee ee 224 3 5 3 Zone management with zone sets 20 0 eee ee eee 225 3 6 Managing the Tabit cesser dereen i ae aee E eE ee 227 3 6 1 Using the Fabric Manager views assasaaaaaa naaar 228 Implementing an Open IBM SAN 3 6 2 Zones zone sets and zoning 2 eee eee 229 3 6 3 Adding an AIX zone to the existing zone set 241 3 7 Building a multiswitch fabric 0 2 ee 246 3 7 1 Multiswitch fabric considerations 0 00020 cee eee 246 3 7 2 Solutions for high availability and disaster tolerance 247 3 7 3 Setting up our zoned multiswitch fabric 251 Chapter 4 Implementing the SAN Data Gateway 261 4 1 SAN Data Gateway 1 0 0 ee 262 4 2 Installation juss 2 seas yes eine g tang nek Gedy Soe eS Bae ap 263 4 2 1 Setting the Ethernet address
3. amp lt 8 Sca Chaney Access Options P Data Mover Name 10000060 45160E08 lt lt SCSI Channel 3 SNMP Community Strings IP Address 9 113 24 110 Serial Number 21081300724 lt SCSI Channel 4 hee i a Firmware Revision 3 40 10 e Fibre Channel 1 i E nad Fibre Channel Health Check Level 2 10000000 92 In gt Fibre Channel 4 nea DACA Tibia Health Check Interval 15 Log Size 2047 Update Firmware Receive Event Traps Enabled Restart SAN Data Gateway Serial Baud Rate 19200 Identify SAN Data Gateway Figure 4 29 Enabling Virtual Private SAN Chapter 4 Implementing the SAN Data Gateway 287 288 A dialog box appears requesting the entry of a license key number For units with serial numbers lower than 1300600 you are required to get a license key that is matched to the serial number of the SAN Data Gateway For units with serial numbers higher than 1300600 the VPS feature is bundled into the product Type the word enable and the feature will now be enabled Host registration With VPS enabled the host registration service is also available This service is provided to simplify VPS configurations It provides the host name host type host connection and the unique WWN of the Fibre Channel host bus adapter Host information is sent over the Fibre Channel connection to the Gateway To obtain this information a program is loaded on each host This program is f
4. 005 142 2 6 1 Sharing ESS logical volumes between two host FC ports 143 2 6 2 Removing volume assignments from host FC ports 151 2 7 Configuring ESS FC ports 2 2 te 158 2 7 1 Defining the topology for ESS FC ports 04 159 2 7 2 ESS managed ESS FC port WWPNs 055 164 2 7 3 Configuring host FC ports for FC SW and FC AL 167 Chapter 3 Implementing a SAN with McDATA 175 3 1 Introducing the McDATA products 00 c eee eee 176 3 1 1 ED 6064 Fibre Channel Director 0200 eee 176 3 1 2 ED 5000 Fibre Channel Director 00000 00a 178 3 1 3 ES 3032 and ES 3016 fabric switches 0 179 3 1 4 The ES 1000 loop switch 0 00 180 3 1 5 The Fabricenter equipment cabinet 00000 181 3 2 Setting up the environment 0 000 e ee ee 183 3 2 1 Setting up the network environment 00000 eee 183 3 2 2 Installing the EFC Manager client on remote workstations 187 3 2 3 Introduction to the EFC Manager 0 e eee eee 188 3 3 Managing the environment using the EFC Manager 193 3 3 1 Logging in to the EFC Manager 0 e eee eee 194 3 3 2 Administering the SAN using the EFC Manager 196 3 3 3 Defining users on the EFC Manager 200 005 197 3 3 4 Identifying devices to the EFC Manager
5. New Zone N Modify Zone Delete Zone View Zone Member Copy Zone Save Zone Set Cancel Rename Zone Figure 3 59 Fabric Manager Zone Sets and New Zone Set Creating a new zone Trying to save the zone set without any zones configured would cause the error message shown in Figure 3 60 Therefore we have to go on and create at least one zone and in our case we will create our NT zone 232 Implementing an Open IBM SAN Figure 3 60 Error saving empty zone set So we will add some members to the zone Adding members to the zone Using Actions gt New Zone opens a window where we can define the members of the zone To the right of this window as shown in Figure 3 61 we are presented with all of the WWPNs or nicknames of the connected FC ports NT Zone 1 RPKAG3_C1B2A1 Domain 1 Port 2 Emulex 10 00 00 00 C9 20 DC 71 Port 3 Emulex 10 00 00 00 C9 20 E7 C Port 4 Emulex 10 00 00 00 C9 20 E7 F3 Port 5 KATE_FCSO Part 6 RPKA93_C1B2A1 Port 7 RPKA93_C1B3A1 Figure 3 61 Fabric Manager New Zone Chapter 3 Implementing a SAN with McDATA 233 To the left we can view all the members currently defined for the zone There are two check boxes where we can choose if we want to assign a switch port and all connected node ports to a zone or if we want to specify the node ports based on their WWPN Here the nicknames become important Two Emulex WWPNs belong to RS 6000 ports and
6. 0 0 c cee eee eee 265 4 2 2 Using Telnet on the SAN Data Gateway 265 4 2 3 Startup Sequence 0 ee 266 4 3 StorWatch SAN Data Gateway Specialist 005 267 4 3 1 Installing StorWatch Specialist 0 200 eee 268 4 3 2 Using the StorWatch SAN Data Gateway Specialist 270 4 3 3 Upgrading the firmware 0 0 0 eee 278 4A SCSLASVICES n Ges Saeed Gok Phuket RE aes uke eRe 284 4 4 1 LUN SUPPO x cece ceo ne bee eed ot hee ele pies dane Pee Lee 284 4 4 2 Device disCovery ea ea PEE E eee ete teens 284 4 4 3 Assigning LUN IDs 0 0 0 eee ee 285 4 4 4 Adding SCSI devices 0 0c eee 285 4 5 SAN Data Gateway access options 00 e eee eee eee 286 475 1 ZONING sees ee aoa Ae ae Genes ee Pane eI E a meee Saab eh 286 4 5 2 Virtual Private SAN 0 0 0 eee ee 287 4 5 3 Combining Zoning and Virtual Private SAN 296 4 6 Adding Fibre Channel fabric components 2000 005 297 4 6 1 Connecting an IBM SAN Fibre Channel Switch 297 4 6 2 Connecting a McDATA Enterprise Fibre Channel Director 307 4 7 High availability considerations 0 0 00 cee eee eee 308 4 7 1 Single host with multiple Fibre Channel adapters 309 4 7 2 Multiple SCSI connections 0 00 e eee 309 4 7 3 Adding Fibre Channel switches 020 0 eee eee 310 Chapter 5 Implementin
7. PA Yirtual Private SAN Access Settings ACTIVE Assigned LUNs unknown unknown unknown 10000000 c921da0a plymouth AIX fdewfsesiO Oxef 0 Emulex 10000000 29221802 unknown SWITCH unknown 20fd0060 69201dde ee New Host Data Original Host Data Host Name unknown unknown Host Type SWITCH SWITCH Host Connection unknown unknown Host AWN 20fd0060 69201d4e 20fd0060 69201d4e Figure 4 44 Changing switch information Close New Host Apply Changes Undo Changes Delete a Host Take Host Off Line Chapter 4 Implementing the SAN Data Gateway 301 The information on the host plymouth that was attached using port 4 is still kept in the VPS database but it is now shown in blue to indicate that it is offline Figure 4 45 is a diagram showing the configuration with the switch EuN Servers minim soo unknown plymouth CEE E EE E R DE IBM Switch Fibre Channe 7 1 4 OOOO oo Gateway i1 2 3 poof scsi ESS Figure 4 45 Adding an IBM switch to the Gateway 302 Implementing an Open IBM SAN Once changed as shown in Figure 4 46 the information shown on the main window will reflect the change and the icon on the left hand side of the WWN changes to depict a switch
8. 0 00 eee eee ix Special Notices waives sexi wae ieee whee beats ate ee aae xi IBM trademarks oiii reaa ty Slee Sed teh ect alo allay Shh ea ea ee aS xii Comments welcome 00 0 c ete teens xii Chapter 1 Implementing Fibre Channel host adapter cards 1 1 1 Fibre Channel 0000 c eee 2 1 1 1 Fibre Channel cables and adapter types 004 2 1 1 2 Fibre Channel node to node distances 000 00 eee 3 TAS LUN AN ees eerie head ea aaae eE I a E AEEA 4 1 1 4 Targets andLUNs 0 0 0 2 cee ae 4 1 2 Attaching an ESS to a FICON channel 0 00002 eee eae 4 1 2 1 Configuring the ESS for FICON attachment 4 1 2 2 Attachment considerations 0 000 e eee ee 5 1 2 3 Setting up ESCON and FICON links 2002000 5 1 2 4 Multipathing for ESCON and FICON 0000 e eae 5 1 2 5 Attaching to a FICON channel or a FICON channel path group 6 1 2 6 Attaching an ESS to FICON channels 200 000 7 1 3 IBM iSeries FC host system attachment 0000 0 eae 8 1 3 1 Host limitations for the iSeries 0 0 cece ee eee 8 1 3 2 Attachment requirements for the AS 400 or iSeries 9 1 3 3 Attachment considerations 0 0 0 2 eee eee 9 1 3 4 Recommended configurations for the AS 400 or iSeries 10 1 3 5 Software requirements for the IBM OS 400 operating system 11 1 4 IBM RS
9. 9 113 24 110 ITSO SAN Data Gateway lt 3 SCSI Channel 1 gt SCSI Channel 2 lt 3 SCSI Channel 3 lt SCSI Channel 4 Tr Fibre Channel 1 Current SAN Data Gateway ITSO IP Address Channel Description World Wide Port Name 9 113 24 110 Fibre Channel 4 20040060 45160E08 4 Serial Number 00010072 Media Short Wave Optical Firmware Revision 2 01 11 Port Type point to point N_Port Loop ID Frame Size 2048 Port Mode Public Target Only Connection Point to Point Preferred Max Speed 100 Mb sec Status Ready v gt 4 gt Figure 4 51 McDATA Director connection to a Gateway In the right hand view pane under Port Type you see that the port is in N_Port mode to denote a fabric connection However in the left hand view pane there are no devices listed under the Fibre Channel port 4 description As hosts begin to attach to the McDATA Director and are restarted they will begin to login their own information to the Gateway s VPS database The McDATA is seen as completely transparent to the SAN Data Gateway 4 7 High availability considerations 308 Until now our discussions of connections from the host to the SAN Data Gateway and from the Gateway to the ESS or other SCSI devices have been discussed with single host adapters or utilizing single SCSI connections However special considerations must be taken into account in deciding to add host adapters or in providin
10. Copyright IBM Corp 2001 311 5 1 SLIC Router features 312 The Instant Copy function can create a separately addressable copy of mirrored data that can be used for tape backup After the backup has completed data is resynchronized with the primary copy The Vicom Fibre Channel SLIC Router also can create composite drives by concatenating up to 16 physical disks Using these functions physical drives become members of larger or more complex logical drives A diagram to depict a single host to Router configuration is shown in Figure 5 1 SSA Disk Loop ka O es s amp s 6 Figure 5 1 SLIC Router with a single host Implementing an Open IBM SAN 5 2 Installing the SLIC Router To install and establish a SLIC storage system the Router and all the disks to be used must be set up in a proper sequence During this sequence only a single SLIC Router must be used to do the configuration Once configured other SLIC Routers can be added to the loop This sequence is described below 1 Note For information and a description to understand the LED codes that will be discussed please refer to the SLIC Router Installation and User s Guide 310 605759 Power on SSA disks The SSA disks must be powered on to ensure that all disks spin up and pass the power sequence Make sure all drive LEDs are on solid to indicate a functioning device Any faulty or suspect disk drive should be re
11. IP Address Channel Description World Wide Port Name Serial Number Media Firmware Revision Port Type Loop ID Frame Size Port Mode Connection Max Speed Status Current SAN Data Gateway ITSO 9 113 24 110 Fibre Channel 1 20010060 45160E08 00010072 Short Wave Optical 2 01 11 node loop NL_Port 0 2048 Public Target Only Loop Only 100 Mb sec Ready Figure 4 12 Fibre Channel port data By selecting the key to the left you can expand the tree and select the host system attached to that port Figure 4 13 shows the detail on the specific host Chapter 4 Implementing the SAN Data Gateway 275 lt gt Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc Ol x File View Admin Tools Controls Help E 9 113 24 110 ITSO SAN Data Gateway F SCSI Channel 1 lt 3 SCSI Channel 2 lt SCSI Channel 3 gt SCSI Channel 4 4 Fibre Channel 1 Current SAN Data Gateway ITSO IP Address 9 113 24 110 Channel Description Fibre Channel 1 3 Fibre Channel 4 Fibre Channel Host 10000000 c921da0a Host Name unknown Host Type unknown Host Connection unknown Figure 4 13 Fibre Channel host data As you select and highlight the different ports or devices there are different options available from the top toolbar If an SCSI channel is highlighted select Controls from the toolbar You will notice that all opt
12. Initiator Private Target and Initiator Public Connection Options Loop Loop Preferred Point to Point Point to Point Preferred Identify Channel OK Cancel Figure 4 16 Fibre Channel port parameters Chapter 4 Implementing the SAN Data Gateway 277 A detailed description of the SCSI and Fibre Channel settings can be found in the IBM Storage Area Network Data Gateway Installation and User s Guide SC26 7304 4 3 3 Upgrading the firmware New versions of the SAN Data Gateway firmware can be downloaded from http www storage ibm com hardsoft products sangateway gatewayspec htm This site has a link to a Downloads section from where the latest versions of the SAN Data Gateway can be downloaded You will first have to complete a registration form and then agree to the IBM Terms and Conditions Once you have completed this section you will find a screen similar to that shown below in Figure 4 17 IBM Storage area networks SAN Data Gateway Firmware download Netscape lolx File Edit View Go Communicator Help gt 3 4 a u 3 A 8 N Back Forward Reload Home Search Netscape Print Security Shop Stop m3 Y Bookmarks A Location tp www storage ibm com hardsoft products sangateway support cdr Fimware sdafw htm gt E What s Related amp Instant Message WebMail Contact People Yellow Pages Download Find Sites ea Channels Home Products amp services Support amp downloa
13. Reset Drive Capacity MB m Instant Copy Capacity MB 8689 8689 lt Back Cancel Figure 5 25 Instant Copy Drive Member Selection To remove a drive from the Member window select the desired drive and click the Remove lt lt button Below each window there is a Drive Capacity box As a drive is selected its capacity in megabytes is shown Click the Next gt button to continue to the Assigning Instant Copy Drive Properties window as shown in Figure 5 26 Implementing an Open IBM SAN Instant Copy Drive Setup Wizard Assigning Instant Copy Drive Properties Setup Summary Type Instant Copy Drive with Simple Member FC ID Logical Drive ID 3 FC LUN E Target Number 733283 Drive Name copy 1l Capacity 8689 MB Initialization Method Primary Member x Do Not Initialize Gone Initialize coce Figure 5 26 Instant Copy Drive Properties The properties that can be changed are the FC LUN and the Drive Name There will be a suggested LUN number in this field that can be accepted If not simply type in the desired LUN number A name can also be defined to the copy drive for easier identification with a limit of up to eight characters Click the Next gt button and a dialog box appears to allow you to create another copy drive Click Yes if you would like to create another copy drive and the Instant Copy Drive List window opens and t
14. gt www emulex com Emulex Corporation gt ww fibrechannel com Fibre Channel Industry Association gt www jni com JNI Corporation gt www mcdata com McDATA Corporation gt www pathlight com Pathlight gt www qlogic com QLogic Corporation gt www sanergy com Tivoli SANergy gt www snia org Storage Networking Industry Association gt www tivoli com Tivoli gt www tll org Technical Committee T11 Implementing an Open IBM SAN gt www vicom com Vicom Systems gt www vixel com Vixel gt www scsita org SCSI Trade Association gt www futureio org InfiniBand SM Trade Association gt www nsic org National Storage Industry Consortium gt www ietf org Internet Engineering Task Force gt www ansi org American National Standards Institute gt www standards ieee org Institute of Electrical and Electronics Engineers gt www pc ibm com us US Personal Systems Group How to get IBM Redbooks Search for additional Redbooks or redpieces view download or order hardcopy from the Redbooks Web site ibm com redbooks Also download additional materials code samples or diskette CD ROM images from this Redbooks site Redpieces are Redbooks in progress not all Redbooks become redpieces and sometimes just a few chapters will be published this way The intent is to get the information out much quicker than the formal publishing process allows IBM Redbooks collections Redbooks are
15. If you use Fibre Channel to ESCON cable converters at both ends of the link to allow connection through an ESCON cable the ESCON cable must be a 62 5 micron fiber optic cable The maximum length for the 62 5 micron fiber optic cable is 175 m 575 feet Limitations on distances between nodes on a Fibre Channel network might exist depending on the upper layer protocol ULP Implementing an Open IBM SAN 1 1 2 Fibre Channel node to node distances You can order and have IBM install a maximum of 16 Fibre Channel adapters on ESS Models F10 and F20 Each adapter has a single host port You can install both long wave adapters and short wave adapters in a single ESS Table 1 1 lists the cables that are available for the long wave and short wave adapters This table also lists the distances that the cables support See your IBM field office about 62 5 micron cables or longer cables gt Feature code 3021 Fibre Channel long wave host adapter optional 1 16 for open systems AS 400 iSeries S 390 and zSeries hosts This adapter includes a 31 m 101 ft long wave optics 9 micron cable P N 08H2774 with an SC type connector It provides an interface that supports 100 Mbps full duplex data transfer gt Feature code 3023 Fibre Channel short wave host adapter optional 1 16 for open systems AS 400 iSeries S 390 and zSeries hosts This adapter includes 31 m 101 ft 50 micron cable P N 54G3384 with an SC type connector It prov
16. in first selected storage area EE o O Perform Configuration aa Cancel Configuration Update Figure 2 75 Add Volumes 2 of 2 panel ready to perform the configuration update Again we get a window warning us about a time intensive action and we are asked if we want to continue with the update This is shown in Figure 2 76 A Warning 1402 Time intensive Action The requested configuration update will take approximately 2 to 5 minutes to complete Would you like to continue and perform the update fa Unsigned Java Applet Window Figure 2 76 Warning window time consuming action Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 133 134 As with every run of a configuration update there is a progress window as shown in Figure 2 77 N Performing Configuration Update x Modifying Logical Subsystem Configuration 1581 26 Estimated Remaining Time 1 minute 40 seconds J Unsigned Java Applet Window Figure 2 77 Progress window volume creation After the update has finished successfully we are presented with the message shown in Figure 2 78 2101 The specified volumes have been successfully added j Unsigned Java Applet Window Figure 2 78 Information window successful volume creation Pressing OK leads us back to the Adding Volumes 1 of 2 panel from where we can start the process again and define other volumes Implementing an Open IBM SAN
17. For ValueName click TimeOutValue For data type click REG_DWORD Click OK For data click f0 For radix click Hex g Click OK 4 If the value exists and is less than Ox000000f0 240 decimal perform the following steps to increase it to Oxf0 Click TimeOutValue Click Edit gt DWORD For data click f0 For radix click hex Click OK 5 Exit the Regedt32 program oa95p 9295 6 Restart your Windows 2000 server for the changes to take effect Implementing an Open IBM SAN 1 11 9 Installing Emulex LP8000 adapter cards This section tells you how to attach an ESS to a Windows 2000 host system with Emulex LP8000 adapter cards Single and dual port Fibre Channel interfaces with the Emulex LP8000 adapter cards support the following public and private loop modes Target Public initiator Private initiator Target and public initiator Target and private initiator YYYY Y The ESS supports increased connectivity with the use of Fibre Channel SCSI FCP and FICON directors Specific details on status availability and configuration options for the Fibre Channel directors supported by the ESS are available on the Web www storage ibm com hardsoft products ess supserver htm Perform the following steps to install the Emulex LP8000 adapter card 1 Turn off and unplug the computer 2 Remove the computer case 3 Remove the blank menu from an empty PCI bus slot 4 Insert the host adapter board int
18. Syntax system email userif femail addr com user2 email addr com profile email program name srn N srn number N 2nd srn number Se k SH SHH HE e For Help press F1 NUM Ui Figure 5 5 Edited configuration file Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 319 320 Configuration file information The SLIC_name can be any name that you would like to use to identify the Router Creating a SLIC Zone The path refers to the SLIC Zone file or partition used for the Manager to communicate to the Router To edit this option it requires that a drive on the SSA loop has been recognized by the host and that the drive has been formatted In the example above a Windows NT host was used The Windows NT Disk Administrator was used for the host to recognize the drives the first drive assigned the next drive letter F and it was formatted The file naming for a SLIC Zone depends on the type of operating system running For Windows NT the naming is lt drive letter gt IBM7190 SFA You can enter in many SLIC Zones but only one is required to get access at the beginning After the other drives have been configured as mirrors or composite drives then SLIC Zones can be created for these drives if desired Including many SLIC zones in the path statement will allow the Manager to access a zone on another drive This is helpful to protect against when a drive fails and that drive has a SLIC zone defined to
19. We will now restrict the host FC port PC1_2 to the ESS FC port 3 in bay 1 as an example of modifying the settings for host FC ports from within the Modify Host Systems panel Restricting the ESS FC port access of host FC port PC1_2 To do this we select the host FC port PC1_2 in the Host Systems List table as shown in Figure 2 60 This enables us to change the settings for this port in the Host Attributes section Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 123 Modify Host Systems Host Attributes Nickname pas Host Type foc Server Win NT 4 0 or higher z Host Attachment Ez Charmel attached z Host Systems List PCll PC Server Win NT 4 0 paz PC Server Win NT 4 0 Hosiname IP Address prm o World Wide Port Name 210000088017862 E Fibre Channel Ports Bay 1 Card 3 Port A Bay 1 Card 4 Port A Perform Configuration Update Cancel Configuration Update Figure 2 60 FC port PC1_2 selected for modification As we show here the Fibre Channel Ports list indicates the current setup which is not restricted in ESS FC ports It lists all ESS FC ports that are available as shown in Figure 2 61 Bay 1 Card 3 Port A Bay 1 Card 4 Port A Bay 2 Card 3 Port A Bay 2 Card 4 Port 4 Bay 3 Card 3 Port A Bay 3 Card 4 Port A Bay 4 Card 3 Port A Bay 4 Card 4 Port A Figure 2 61 All installed ESS FC ports 124 Implementing an Open IBM SAN We scr
20. 0 58 1 11 1 Attachment requirements 0 0 0 0 cee eee eee 58 1 11 2 Installing the QLogic QLA2100F adaptercard 59 1 11 3 Installing the QLogic QLA2200F adaptercard 60 1 11 4 Downloading the current Fibre Channel adapter driver 62 1 11 5 Installing the Fibre Channel adapter drivers 63 1 11 6 QLogic QLA2100F or QLogic QLA2200F configuration 63 1 11 7 Configuring for availability and recoverability 64 1 11 8 Setting the TimeOutValue registry 0 2 0 eee 64 1 11 9 Installing Emulex LP8000 adapter cards 65 1 11 10 Downloading the current Fibre Channel adapter driver 65 1 11 11 Installing the Fibre Channel adapter drivers 66 1 11 12 Parameter settings for the Emulex LP8000 on Windows 2000 67 1 11 13 Verifying the configuration 2 000 eee ee eee 69 1 11 14 Verifying networking 00 ee 69 1 12 Locating the worldwide portname 00 eee eee eee 69 1 12 1 Fibre Channel port name identification 69 1 12 2 Locating the WWPN for an AS 400 iSeries 70 1 12 3 Locating the WWPN for an IBM eServer or IBM NUMA Q host 71 1 12 4 Locating the WWPN for an RS 6000 and pSeries host system 71 1 12 5 Locating the WWPN for a Compaq host system 71 1 12 6 Locating the WWPN for a Hewlett Packard host system 72
21. 188 new zone 232 new zone set 230 nickname 202 240 nicknames 122 204 non RAID 109 notification options 85 Novell NetWare FC attachment 26 NUMA Q 15 O Open System Storage 104 Open Fabric 1 0 210 operating mode 209 OS 400 operating system 11 P parallel interface 6 path group 5 Point to Point 298 378 Implementing an Open IBM SAN port card view 206 Port List View 213 220 PPRC 77 preferred domain ID 214 principal switch 252 Private Attributes 354 Problem Log 84 Problem Notification 85 Product Manager 204 pSeries attachment requirements 12 pSeries FC host 11 pseudo host 163 Q QLA2100F 26 QLA2200F 26 27 QLogic QLA2100F 26 47 48 58 59 QLogic QLA2200F 27 38 43 47 49 58 60 queue depth 24 Quick Initialize 335 R R_A_TOV 222 254 RAID 109 RAID 5 75 109 115 130 Redbooks Web site 359 Contact us xii remote workstation 188 Remove logical drive 347 Re Scan SCSI Bus 285 resource allocation time out value R_A_TOV 254 Route table enforced zoning 224 Router config file 318 Router LED codes 313 Router Node Mapping 313 Router power up sequence 315 Router Properties 324 Router Subsystem Diagnostic test 313 RS 6000 11 S SAN Data Gateway 24 261 SCSI 261 266 273 284 309 SCSI Channel 276 SCSI device map 285 SCSI to LUN map 294 scsiRescan 285 SDD 143 309 segmented 255 Server 267 Service port 263 setting a Gateway address 265 setting a Subnetmask 265 Setting the Ethernet
22. 1953152 rpm 7200 interleave 1 trackskew 0 cylinderskew 0 headswitch 0 milliseconds track to track seek 0 milliseconds drivedata 0 8 partitions size offset fstype fsize bsize cpg a 131072 0 unused 0 0 Cyl 0 68 b 262144 131072 unused 0 0 Cyl 68 204 c 1953152 0 unused 0 0 Cyl 0 1017 d 0 0 unused 0 0 Cyl 0 1 e 0 0 unused 0 0 Cyl 0 1 f 0 0 unused 0 0 Cyl 0 1 g 819200 393216 unused 0 0 Cyl 204 631 h 740736 1212416 unused 0 0 Cyl 631 1017 Chapter 1 Implementing Fibre Channel host adapter cards 21 If there is no disklabel on the disk type the following command to write the label to the disk disklabel rw rzh128 shark Substitute your specific disk with the rzh128 command Always specify the rz file without the partition 1 6 5 Configuring AdvFS Before you create an AdvFS file system you must design a structure by assigning a file domain and the file sets Type the following commands to create an AdvFS file system with file sets 1 cd 2 mkfdmn rw dev rzXc vol1_dom 3 mkfset voll_dom voll 4 mkdir voll mount voll_dom vol1 vol1 To display all mounted devices type df k 1 6 6 Configuring devices to mount automatically To enable an AdvFS file system to start automatically add an entry to the etc fstab file to the mount command during startup The following shows an example of a modified etc fstab file
23. 240 Fast command posting Enabled gt 4 GB addressing Disabled for 32 bit systems LUNs per target 0 Enable LIP reset No Enable LIP full login No Enable target reset Yes Login retry count 20 minimum Port down retry count 20 minimum Driver load RISC code Enabled Enable database updates No Disable database load No IOCB allocation 256 Extended error logging Disabled might be enabled for debugging 7 Press Esc to return to the Configuration Settings menu 8 From the Configuration Settings menu scroll down to Extended Firmware Settings Press Enter 9 From the Extended Firmware Settings menu scroll down to Connection Options to open the Option and Type of Connection window 10 Press Enter 11 Select from one of the following options 0 Loop only 1 Point to point 2 Loop preferred If you cannot use arbitrated loop then default to point to point 3 Point to point otherwise loop If you cannot use point to point default to arbitrated loop Note If you connect the ESS directly to the host system the option you select must match the port connections on the ESS 12 Press Esc 13 To save the changes click Yes Press Enter 14 Restart the server 28 Implementing an Open IBM SAN 1 8 3 Loading the current Fibre Channel adapter driver Perform the following steps to load the current driver onto the QLogic adapter card 1 Go to the following Web site www qlc com From the hom
24. EFC Manager 187 188 EFC Manager client installation 188 EFC Manager Software 191 EFC monitoring 197 EFC operational status 206 EFC port number 211 EFC server 193 Emulex 46 Emulex LP8000 32 42 47 53 56 58 65 67 enabling the Ethernet port 265 Enabling VPS 287 error detection time out value E_D_TOV 254 ES 1000 177 180 ES 1000 managing 218 ES 3016 177 179 ES 3016 managing 217 ES 3032 177 179 ESCON 5 104 ESCON directors 175 ESS 307 309 ESS configuration update 110 ESS configuring 89 ESS Copy Server 90 ESS default user 81 ESS disk group section 100 ESS FC adapters 203 ESS FC port 98 ESS FC portaccess 123 ESS FC port definitions 116 ESS FC ports config 158 ESS FC ports topology 159 ESS host interfaces 97 ESS interface adapters 160 ESS introduction panel 78 ESS logical volume 130 376 Implementing an Open IBM SAN ESS logical volume assignments 142 ESS logical volumes 126 ESS Open System Storage 104 ESS operating 82 ESS ports 99 ESS site certificate 79 ESS status 83 ESS storage allocation 103 ESS storage configuration 96 ESS Storage Server Attributes 162 ESS to FICON 7 ESS user administration 93 ESS Web Copy Services 91 ESS Web Interface 77 Expansion Port E_Port 177 extended distance buffering 253 F F_Port 177 F_Ports 246 Fabric Manager 227 fabric zoned 239 Fabricenter 181 FC adapters 98 FC operating parameters 213 221 FC ports 210 FC 9000 7 FC AL 167 177 FC PP 167
25. FC SW 167 feature code 2314 feature code 2315 feature code 2316 feature code 2318 7 feature Code 3019 16 feature code 3021 3 feature code 3022 2 feature code 3023 3 Fibre Channel 277 Fibre Channel adapters 98 Fibre Channel host 275 FICON 4 5 7 FICON switch cascading 7 field replacable units FRU 177 178 Fixed Block 109 Fixed Block Storage 108 114 FlashCopy 77 Format the Drives 315 NNN frame multiplexing 6 full duplex 1 G G_Ports 246 Gateway address 185 Generic Port G_Port 177 Get New Mapping 349 H H_Ports 219 HACMP 246 248 HBA configuration files 41 Heterogeneous Hosts 354 Hewlett Packard 9000 23 Hewlett Packard 9000 FC attachment 23 High availability considerations 308 Homogeneous Hosts 354 hop count 251 host adapter 1 Host Attributes 118 Host information 292 Host registration 288 Hosts Systems 104 HOSTSW 288 l O 6 IBM Enterprise Storage Server 2105 F20 75 IBM SAN Fibre Channel Switch 297 306 IBM Storage Area Network Data Gateway 2108 G07 261 Initialization Method 329 initializeBox 264 InstallAnywhere 192 Installing additional Routers 353 Installing StorWatch Specialist 268 Installing the SLIC Manager 317 Installing the SLIC Router 313 Instant Copy 312 337 Instant Copy Drive 332 Instant Copy Drive Properties 339 inter switch link ISL 177 interconnected directors 7 Interop Mode 210 IOC 0210 54 adapter 17 IOC 0210 54 adapter card 15 17 IP address 1
26. Figure 5 19 Composite Drive Properties Here you can find information on the Composite Drive about the member drives that make up the composite as well as the Composite Drive characteristics Clicking on the Identify Composite button will cause the LED on the actual SSA drives that belong to the Composite to flash If a member drive is selected and the Identify Member button is chosen then the LED only on that drive will flash In both cases a dialog box will appear to allow you to stop the flashing 5 6 Mirror drive A 2 way mirror drive has two drives that contain exactly the same information The SLIC Router can also support a 3 way mirror or 1 way mirror A 3 way mirror consists of three drives with the same information A 1 way mirror is a single drive or single composite drive that is used with an Instant Copy Drive that can attach to the single drive mirror to synchronize the data The Instant Copy Drive can then be split off from the mirror to perform a backup or other action The Instant Copy Drive feature can be used with 2 way and 3 way mirrors as well 332 Implementing an Open IBM SAN 5 6 1 Creating a mirror drive To create a mirror using physical drives from the toolbar select Tools gt Mirror Drive Setup Wizard You will see a dialog box Mirror Drive List that will be blank If there were mirror drives created then it would display the names of the drives Click the Next gt gt button and the Mirror Drive Members
27. File View Admin Tools Controls Help E 9 113 24 110 ITSO SAN Data Gateway lt 3 SCSI Channel 1 lt 3 SCSI Channel 2 gt SCSI Channel 3 amp SCSI Channel 4 gt Fibre Channel 1 Fibre Channel 4 PA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc Current SAN Data Gateway ITSO IP Address Channel Description Fibre Channel Host Host Name Host Type Host Connection Pile Es 9 113 24 110 Fibre Channel 4 20fd0060 69201d4e unknown SWITCH unknown Figure 4 46 Switch port information Attaching hosts to the switch Any hosts that will attach to the switch should have the host registration software loaded and installed Refer to Host registration on page 288 for details Plug in the Fibre Channel cable from their respective adapters and power on or restart the host The registration of the hosts will be completed through the switch Figure 4 47 shows a switch installed on port 4 and two hosts connected on the switch The host plymouth is now connected through the switch and an NT host was added File View Admin Tools Controls Help E 9 113 24 110 ITSO SAN Data Gateway lt 3 SCSI Channel 1 lt 3 SCSI Channel 2 lt 3 SCSI Channel 3 lt SCSI Channel 4 4 Fibre Channel 1 T Fibre Channel 4 Lm 20fd0060 69201d4e unknown 10000000 c9221802 plymouth AIX OnLine S
28. Host Systems List a Hejuye Hosiname IP Address World Wide Pori Name E Fibre Channel Ports Perform Configuration Update Cancel Configuration Update Figure 2 50 Modify Host Systems panel no host FC ports defined Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 117 118 Creating two host FC port definitions In the Host Attributes entry fields we identify the host FC port that will access the ESS The first entry is a nickname to identify the port in the ESS Also we have to choose the host type which is a PC server the type of the host attachment which is Fibre Channel and the WWPN of the host FC port as shown in Figure 2 51 and Figure 2 52 We are doing this for the two host FC ports that we want to access ESS logical volumes nicknamed PC1_1 and PC1_2 Host Atiribuies Nickname Pca Host Type rc Server Win NT 4 0 or higher gt TEM RS 6000 IBM AS 400 V3R1 or V3R6 IBM AS 400 V3R2 VSR or higher HP 9000 Series 800 Sim Solaris 2 5 1 or higher Fibre Channel Ports All installed ports Bay 1 Card 4 Port A Figure 2 51 Host Attributes frame host type selection Implementing an Open IBM SAN Host Atiributes Nickname PC11 Host Type rc Server Win NT 4 0 or higher gt Host Attachment Fim Charmel attached CSI attached Fibre Charmel attached World Wide Port Name 200000 MS E00 C CSB E Fibre Channel Ports All
29. How to get IBM Redbooks on page 359 gt gt gt IBM SAN Survival Guide SG24 6143 IBM SAN Survival Guide Featuring the McDATA Portfolio SG24 6149 Designing an IBM Storage Area Network SG24 5758 Implementing an Open IBM SAN SG24 6116 Introduction to Storage Area Network SAN SG24 5470 Introduction to SAN Distance Solutions SG24 6408 Introducing Hosts to the SAN Fabric SG24 6411 IBM Storage Solutions for Server Consolidation SG24 5355 Implementing the Enterprise Storage Server in Your Environment SG24 5420 Storage Area Networks Tape Future In Fabrics SG24 5474 IBM Enterprise Storage Server SG24 5465 Other resources These publications are also relevant as further information sources gt Building Storage Networks ISBN 0072120509 These IBM publications are also relevant as further information sources gt ESS Web Interface User s Guide for ESS Specialist and ESS Copy Services SC26 7346 IBM Storage Area Network Data Gateway Installation and User s Guide C26 7304 IBM Enterprise Storage Server Configuration Planner SC26 7353 Copyright IBM Corp 2001 355 356 gt gt IBM Enterprise Storage Server Quick Configuration Guide SC26 7354 IBM SAN Fibre Channel Managed Hub 3534 Service Guide SY27 7616 IBM Enterprise Storage Server Introduction and Planning Guide 2105 Models E10 E20 F10 and F20 GC26 7294 IBM Enterprise Storage Server User s Guide 2105 Models E10 E20 F1
30. Log Size 2047 Receive Event Traps Enabled Serial Baud Rate 19200 Figure 4 8 Expanded Gateway view Chapter 4 Implementing the SAN Data Gateway 271 SCSI channels 1 2 and 3 and Fibre Channel ports 1 and 4 also have a key on the left hand side to depict that there are devices attached By selecting a key you will now expand the tree as seen in Figure 4 9 and view the different disk devices attached PA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc iof x File View Admin Tools Controls Help lt SCSI Channel 1 Current SAN Data Gateway ITSO World Wide Node Name 10000060 45160E08 D Disk Device 0 1 IP Address l 9 113 24 110 J Disk Device 1 0 Serial Number 21081300724 9 Disk Device 1 1 Firmware Revision 3 40 10 ia Disk Device 2 0 Health Check Level 2 id Disk Device 2 1 Health Check Interval 15 J Disk Device 3 0 Log Size 2047 iJ Disk Device 3 1 Receive Event Traps Enabled J Disk Device 4 0 Serial Baud Rate 19200 B Disk Device 4 1 9 Disk Device 5 0 B Disk Device 5 1 B Disk Device 6 0 J Disk Device 6 1 J Disk Device 8 0 B Disk Device 8 1 iJ Disk Device 9 0 D Disk Device 9 1 9 Disk Device 10 0 B Disk Device 10 1 D Disk Device 11 0 M Disk Device 11 1 J Disk Device 12 0 z Figure 4 9 SCSI channel expanded view 9 Disk Device 0 0 272 Implementing an Open IBM SAN You ca
31. Storage Server Atiribuies Access Restricted Fibre Channel Access Mode FC Port Atiribuies 1000000009251260 World Wide Port Name Fire Channel Avbitrated Loop Fibre Channel Topology Figure 2 125 ESS FC port for Arbitrated Loop defined Resetting changes made to a selected ESS FC port Using the Reset Selected Port button on the upper right of the screen we can reset the definition for the selected port to the status the port was in before we made any changes Reset Selected Port This brings up a warning window as shown in Figure 2 126 stating that the configuration changes made are going to be discarded N xi A Warning 1605 Reset current configuration This action will cause your current configuration changes for this port to be reset Do you wish to continue j Unsigned Java Applet Window Figure 2 126 Warning window configuration changes are going to be discarded We do not want to reset our changes so we are going to perform the changes Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 169 170 Performing the configuration update Click on the Perform Configuration Update button During the process of performing the update we get a progress window as shown in Figure 2 127 N Performing Configuration Update x Modifying FibreChannel Port Topology Data El Estimated Remaining Time 54 seconds J Unsigned Java Applet Window Figure 2 127 Progr
32. The commands are case sensitive and must be entered as they appear Issue the initializeBox command to remove any configurations files that may be present The unit will restart automatically Note The initializeBox command will erase all configuration files It should be used only during initial SAN Data Gateway installation 264 Implementing an Open IBM SAN 4 2 1 Setting the Ethernet address Once restarted the Ethernet port must be configured and attached using network information provided by the network administrator To set the IP address use the ethAddrSet command The address must contain the double quotes Gateway gt ethAddrSet 9 111 24 66 Network not Enabled Write complete Host Address set to 9 111 24 66 for Ethernet interface value 0 0x0 Gateway gt If a subnet is required then add it after the IP address and separate the two addresses using a comma For example Gateway gt ethAddrSet 9 111 24 66 255 255 255 0 If a gateway or standard router is to be specified then issue the gateAddrGet command to view if there is one set and the gateAddrSet command to set or change it For example Gateway gt gateAddrGet No current gateway address set value 0 0x0 Gateway gt gateAddrSet 193 1 1 11 Write complete The Ethernet port on the SAN Data Gateway comes from the factory disabled To enable it you must issue the ethEnable command This will not take effect until the u
33. The lines that are shown in bold are the lines that were entered since the initial operating system installation root_domain root advfs rw userquota groupquota 0 0 proc proc procfs rw 0 0 usr_domain usr usr advfs rw userquota groupquota 0 0 dev rz8b swapl ufs sw 0 2 voll_dom voll voll advfs rw userquota groupquota vol2_dom voll vol2 advfs rw userquota groupquota vol3 dom voll vol3 advfs rw userquota groupquota vol4 dom voll vol4 advfs rw userquota groupquota vol5 dom voll vol5 advfs rw userquota groupquota vol6_dom voll vol6 advfs rw userquota groupquota vol7_dom voll vol7 advfs rw userquota groupquota vol8 dom voll vol8 advfs rw userquota groupquota vol9 dom voll vol9 advfs rw userquota groupquota vol10_dom vol1 vol10 advfs rw userquota groupquota 0 2 ooooocooocoo N NNNNNNNN When the host system starts it mounts all volumes that you created in 1 6 5 Configuring AdvFS on page 22 22 Implementing an Open IBM SAN 1 7 Hewlett Packard 9000 FC host system attachment This topic describes the host system requirements and provides procedures to attach an ESS to a Hewlett Packard 9000 host system with Fibre Channel adapters 1 7 1 Attachment requirements This section lists the requirements for attaching the ESS to your host system gt gt Ensure that you have all of the items listed in Equipment requirements Ensure that you have the installation script files The script file is on the compact disc
34. click FC64 1063 4 From the menu for FC64 1063 find the section for Solaris JNI Click readme txt 5 Print the readme txt file 6 Follow the instructions in the readme txt file to install the JNI SBUS adapter card 7 Update the parameter list See Table 1 7 on page 42 8 Restart the host system Chapter 1 Implementing Fibre Channel host adapter cards 37 1 9 11 Installing the QLogic QLA2200F adapter card This section tells you how to attach an ESS to a host system with the QLogic QLA2200F adapter card Single and dual port Fibre Channel interfaces with the QLogic QLA2200F adapter card support the following public and private loop modes Target Public initiator Private initiator Target and public initiator Target and private initiator YYYY Y Perform the following steps to install the QLogic QLA2200F adapter card 1 Install the QLogic QLA2200F adapter card in the host system 2 Connect the cable to the ESS port 3 Restart the server 4 Press Alt Q to get to the FAST Util menu 5 From the Configuration Settings menu select Host Adapter Settings 6 From the Host Adapter Settings menu set the following parameters and values a Host adapter BIOS Disabled b Frame size 2048 c Loop reset delay 5 minimum d Adapter hard loop ID Disabled 7 From the Advanced Adapter Settings menu press the Down Arrow to highlight LUNs per target Press Enter Set the parameters and values from the Advanc
35. o64 0GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 2 Loop B ID 00 LUN 0001 array 1 Vol 001 Figure 2 87 Displays of all four volume assignments We see all the information about the location and the current assignments here as well as the ESS logical volume ID This is the ID that will help us later to identify the ESS logical volumes on our host system Right now there are not too many entries in the table Later on as we define more volumes the table will become large To make it easier to view the table we can also perform a sort on the table The sort can be performed using three choices of levels using the drop down list boxes on the top of each column To perform the sort we press the Perform Sort button Now we will modify ESS logical volume assignments 2 6 Modifying ESS logical volume assignments At this time we would only have to configure all the ESS FC ports to enable the ESS to present volumes to a Fibre Channel host There are further changes of the assignment of volumes to ports that might have to be performed For this we use the Modify Volume Assignments panel 142 Implementing an Open IBM SAN For example we can share volumes between host FC ports These ports can be in the same host which uses for example the Subsystem Device Driver SDD to increase the bandwidth and availability or in different hosts for example for clustering Or we might want to unassign volumes that were sh
36. powered on the Status LED will flash rapidly The test will be done on each disk drive in the SSA loop separately and will begin with the drive closest to the A1 port on the back of the Router As the test is completed on a drive the Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 313 314 LED on the SSA drive will flash and then it will move to the next drive This test should continue until all drives have been tested The test runs ina continuous cycle so once all drives have been tested at least once the Router is powered off If a drive fails the test the testing will stop and the Router s Status LED will flash a diagnostic code A code map with a description of the errors can be found in the SLIC Router Installation and User s Guide 310 605759 Assign Fibre Channel target With the Router powered off you can now assign a Fibre Channel target ID number to the Router Any number can be selected however this number must be a unique ID No other device can have the same Fibre Channel target ID once it is set on the Router This is done by setting selected dip switches in SW1 to the down position The switch is set up in binary notation a switch that is down represents a 1 and a switch up represents a 0 Figure 5 2 shows the switch numbers and their corresponding value 128 64 32 16 8 4 2 2 7 6 5 4 3 2 1 O Switch Number F
37. shortest path is taken first Now the director is ready for use in the Fibre Channel network It can be connected to devices such as other switches storage or hosts Implementing an Open IBM SAN 3 4 2 Configuring the ED 5000 with the Product Manager Clicking an ED 5000 icon in the Product View opens the Product Manager Using the interactive Hardware and Port Card View In the Hardware View shown in Figure 3 42 we are presented with the front and back views of the director i ED 5000 olx Hardware View ED 5000 Status Name Status Fully Operational Description State Online Location Maintenance Message LE Controller MPC Slot 0 Control Processor CTP Slot 0 Processor Control Processor CTP Slot 0 Slot 0 Rii ia Module Position 0 G_Port Module tiem Slot 3 T3 15 i ww AOOUOOOOOOOODIIII AOOOOOOOOOOOOIIII Pam View Rear View Figure 3 42 Product Manager ED 5000 Hardware View Chapter 3 Implementing a SAN with McDATA 215 Again the components of the director are interactive and monitored as illustrated Also as with the ED 6064 we have an interactive Port Card View which is accessed by clicking a port card This view with the Port Properties window of a specific port is shown in Figure 3 43 W ED 5000 o x Port Card View FRUName G_Port Module GSM Position Slot 3 State Active Part Number 470 000396 240 Serial Number 80
38. 00066 45166e 68 615 SCSI 601 668 666 26F66666 45166e 68 616 SCSI 601 668 661 21666066 45166e 68 617 SCSI 601 669 666 21166666 45166e 68 618 SCSI 601 669 661 2120006 6 4516 Ge 68 619 SCSI 601 616 666 21366666 45166e 68 626 SCSI 681 616 661 2140006 6 4516 Ge 68 621 SCSI 601 611 666 21566666 45166e 68 622 SCSI 6681 611 661 2166666 6 4516 Ge 68 623 SCSI 661 612 666 21766666 45166e 68 624 SCSI 6681 612 661 218 6006 6 4516 Ge 68 625 SCSI 662 666 666 21966666 45166e 68 626 SCSI 662 666 661 2120006 6 4516 Ge 68 627 SCSI 662 661 666 21b66666 45166e 68 628 SCSI 662 661 661 21c 8006 6 4516 Ge 68 629 SCSI 662 662 666 21066666 45166e 68 636 SCSI 662 662 661 21e 6006 6 4516 Ge 68 Figure 4 37 Service terminal display of device map The numbers on the left are the assigned LUN numbers and note that number 0 has been assigned to the Gateway The other columns contain the device type the SCSI channel it is connected to on the SAN Data Gateway and the actual target and LUN ID Implementing an Open IBM SAN Setting host access to LUNs To view and set host access to particular LUNs access the Virtual Private SAN Access Settings by selecting Controls gt Access Options gt Virtual Private SAN This window will show all the hosts that have registered to the Gateway To allow a host to access a particular LUN place a check mark in the row that corresponds to the host To disable access the square must be clear without a check
39. 1 12 7 Locating the WWPN for a Novell NetWare host system 73 1 12 8 Locating the WWPN fora Sun host system 73 1 12 9 Locating the WWPN for a Windows NT host system 74 1 12 10 Locating the WWPN for a Windows 2000 host system 74 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 75 2 1 Introducing the ESS Web Interface 0 20 eee eee 77 2 1 1 Logging on to the ESS Specialist 0 0 0 2 000 e eee 78 2 1 2 Operating the ESS 0 eee 82 2 1 3 Configuring the ESS oen rare iaa aa i a ee 89 2 1 4 Administer the ESS 0 2 2 eee 93 2 2 Starting the Open Systems Storage Configuration 96 2 2 1 Viewing the storage configuration status 0 4 96 2 2 2 Using the Open System Storage panel 045 104 2 3 Configuring disk groupS 1 6 2 0 cee ee 107 Contents v 2 3 1 Performing the disk group configuration 4 108 2 4 Creating and modifying host FC port definitions 116 2 4 1 Creating host FC port definitions 200 0 0 0s 117 2 4 2 Modifying a host FC port definition 20 0 005 123 2 5 Creating and assigning ESS logical volumes 04 126 2 5 1 Adding ESS logical volumes step one 2 24 126 2 5 2 Adding ESS logical volumes step two 2 129 2 6 Modifying ESS logical volume assignments
40. 156 Implementing an Open IBM SAN Another way to find out about the state of the space in a disk group is to select it In our example shown in Figure 2 111 we select the disk group in which we have an unassigned volume lt b HUGS IB DAB eS j Figure 2 111 Disk group selected unassigned volume s in selected disk group Again the space used for unassigned volumes is displayed in yellow Also we see in the host interfaces row the interfaces that have volumes assigned to them in the selected disk group which is empty Viewing Changes on the Tabular View Pressing the tabular View button from within the Storage Allocation Graphical View panel displays the table containing all existing volume assignments as shown in Figure 2 112 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 157 Storage Allocation Tabular View List of Assigned Volumes Print Table Perform Sort Graphical View Pell LSS 016 600 18486 Open System 016 1 GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 1 Loop A ID 00 LUN 0000 Array 2 Vol 000 Pell LSs 017 700 18486 Open System 016 1 GB Fibre Charmel Device Adapter Pair FC Port A Cluster 2 Loop A ID 00 LUN 0001 Array 1 Vol 000 Pell Ls 017 701 18486 Open System 064 0 GB Fibre Charmel Device Adapter Pair FC Port A Cluster 2 Loop B ID 00 LUN 0003 Array 1 Vol 001 PC12 Lss 017 701 18486 Open System 0640 GB
41. 18 Update the parameter list See Table 1 8 on page 42 19 Restart the host system Note You must restart your system twice if IP is enabled 1 9 5 Installing the JNI PCI adapter card This section tells you how to attach an ESS to a Sun host system with the JNI PCI adapter card 1 ao fF oO N D Perform the following steps to install the JNI PCI adapter card Turn off and unplug the computer Remove the computer case Remove the blank panel from an empty PCI bus slot Insert the host adapter board into the empty PCI bus slot Press firmly until seated Secure the mounting bracket for the adapter to the case with the panel screw 7 Replace the computer case by tightening the screws on the case or use the clamp to secure the cover 1 9 6 Downloading the current JNI PCI Fibre Channel adapter driver This section tells you how to download the JNI PCI Fibre Channel adapter driver 1 2 Plug in and restart your host system Go to the following Web site www jni com 3 From the navigation menu at the top of the page click Drivers 4 From the menu for Locate Driver by Product click FCI 1063 oa Oo oO N Oo From the menu for FCI 1068 find the section for Solaris JNI Click fca pci pkg In the dialog box for File Download click Save this file to disk Click OK In the Save As dialog box create a temporary folder Click Save When you click Save a window displays that shows the prog
42. 3 4 ES 1000 The switch has eight FC AL ports which are called Hub Ports H_Port to connect nodes in a loop and one Bridge Port B_Port that is used to connect the loop switch to other switches although not other ES 1000s or directors This means it allows for connectivity of FC AL nodes to the McDATA SAN This is for example necessary for FC tapes that only support FC AL Also connecting workgroups with less demand on the bandwidth at a lower cost is possible with the ES 1000 The ES 1000 can be used standalone or rack mounted like the other McData switches The management is done as with all the other McDATA FC devices through the EFC Manager or with the embedded web server Further information about the switches can be found in the manuals provided with the switch Implementing an Open IBM SAN 3 1 5 The Fabricenter equipment cabinet The Fabricenter shown in Figure 3 5 serves as the central management unit for the McDATA SAN Figure 3 5 Fabricenter It can take up to four ED 6064 as shown in Figure 3 6 or two ED 5000 Chapter 3 Implementing a SAN with McDATA 181 Ethernet Hub ED 6064 Director EFC Server ED 6064 Director Figure 3 6 Fabricenter with four ED 6064 Additionally the other switches the ES 3016 ES 3032 and the ES 1000 can be mounted in the Fabricenter As well as housing the McDATA switches the cabinet also features the following gt One
43. 38 Product Manager ED 6064 Link Incident Log 212 Implementing an Open IBM SAN Rear View Using the Port List View To view all installed ports and their status in a tabular view and see the changes that have been made we use the Port List View as shown in Figure 3 39 ca ED 6064 ED 6064 1 Port List View d Z Block Config any portname Unblocked Online p Unblocked No Light Port Number Port Name Type Fibre Channel Address Port WN Attached Port WAAN Block Configuration 10 100 km Configuration LIN Alerts Configuration Beaconing Link Incident Operational State Segmentation Reason TEE 4 4 Unblocked No Light G_Port Unblocked No Light G_Port Unblocked Online G_Port Figure 3 39 Product Manager ED 6064 Port List View Port Properties Configuring the FC operating parameters To change the operating parameters we first have to set the ED 6064 offline To set the director offline which will terminate all FC operations we select Maintenance gt Set Online State which is shown in Figure 3 40 Ea Set Online State x Current state is ONLINE Set omine p Cancel Figure 3 40 Product Manager ED 6064 Set Online State Chapter 3 Implementing a SAN with McDATA 213 214 Now we can go to the Configure Operating Parameters window by selecting Configure gt Operating Parameters Here we can change some of the Fibre Channe
44. 6000 or pSeries FC host system attachment 11 1 4 1 Attachment requirements 0 0 00 eee eee 12 1 4 2 Installing the 2105 host attachment package 13 1 4 3 Replacing an older version of the 2105 installation package 13 1 4 4 Installing the 2105 host attachment package 14 1 4 5 Verifying the ESS configuration 00a ee eee 15 1 4 6 ESS devices with multiple paths perLUN 15 1 5 IBM eServer xSeries or IBM NUMA Q FC attachment 15 1 5 1 Attachment requirements 0 0 2 eee 16 1 5 2 xSeries and NUMA Q system requirements 16 1 5 3 Installing the IOC 0210 54 adapter card 17 1 5 4 Configuring the IOC 0210 54 adapter card 17 1 6 Compaq host system FC attachment 00000 eee 18 Copyright IBM Corp 2001 iii iv 1 6 1 Attachment requirements anuanua 18 1 6 2 Compaq Tru64 UNIX Version 4 0x host system 19 1 6 3 Verifying the Compaq configuration 00 eee eee 19 1 6 4 Operating system device recognition 05 19 1 6 5 Configuring AGVFS 0 cee 22 1 6 6 Configuring devices to mount automatically 22 1 7 Hewlett Packard 9000 FC host system attachment 23 1 7 1 Attachment requirements naana anea 23 1 7 2 Installing the 2105 host install scri
45. Address 265 setting the IP address 265 short wave ports 263 SignOn Drive 326 Simple Network Management Protocol 85 SLIC Manager 353 SLIC Manager daemon 316 321 353 SLIC Manager software 316 SLIC Zone 317 SLIC zone 326 353 SMIT 14 SNMP 85 190 sort criteria 144 spreading volumes 132 SSA 311 324 351 SSA loops 115 Starting the SLIC Manager 322 Startup sequence 266 Storage Allocation 89 96 Storage Server Attributes 162 storage type 130 StorWatch Enterprise Storage Server Expert 119 StorWatch SAN Data Gateway Specialist 267 270 Subnet mask 185 Subsystem Device Driver 44 143 309 Sun 24 45 Sun FC attachment 30 switch cascading 8 switch port 234 switch priority 252 Switch registration 299 switched fabric 179 T Target Hosts 144 Technology Pack 17 Telnet 265 TimeOutValue 53 64 Tivoli SANergy 354 topology 167 Track Format 109 track format 108 U Uniform Resource Locator 77 unmap 349 UnMapped 350 URL 77 188 user rights 199 Users 93 V Vicom Fibre Channel SLIC Router 311 Virtual Private SAN 287 293 296 305 Virtual Private SAN VPS 286 volume assignment 127 volume definitions 131 volume placement 128 volumes sequentially placed 132 VPS 289 299 308 VPS Registration Service 288 WwW Windows 2000 FC attachment 58 Windows NT 4 0 FC attachment 47 worldwide port name 16 WWN 202 WWNN 79 166 WWPN 4 97 118 122 159 163 234 235 240 WWPN naming convention 164 WWP
46. After saving the zone we return to the New Zone Set window where we can view the zones in the zone library in the right half of the window 236 Implementing an Open IBM SAN To view the zone members highlight the zone in the zone library and then go to Actions gt View Zone Members as shown in Figure 3 65 gt McDATA Fabric Manager Zoning View Default Zone Enabled ctive Zone Set Zone Set Name IT50_Zone_Set_1 Configure gt Zone Sets Zones in Set Zone Libra Zone Set Library EE NT_Zone_1 lt gt View Zone Members x Zone Name E Zone Members E l RPKA93_C1B2A1 l ble QLogic 20 00 00 E0 88 00 52 5E Adon Emulex 10 00 00 00 C9 20 CA E6 Cancel Save active zone set as Deactivate zone set Figure 3 65 Fabric Manager View Zone Members Assigning the zone to a zone set and saving the zone set To assign the newly created zone NT_Zone_1 in the zone set we created before we will drag and drop the zone from the zone library to the Zones in Set window on the left hand side of the window This displays the zones assigned for this set as shown in Figure 3 66 Chapter 3 Implementing a SAN with McDATA 237 238 gt New Zone Set ITSO_Zone_Set_1 Sav test conet R Figure 3 66 Fabric Manager assigning zone to zone set Now we save the zone set as a member in the Zone Set Library with the Save Zone
47. Enterprise Storage Server configuration 173 174 Implementing an Open IBM SAN Implementing a SAN with McDATA Since the early 1990s McDATA has provided IBM with fiber switches for the S 390 world the ESCON directors They have built up experience in creating the highly available and reliable equipment necessary to meet the demands of S 390 environment Any SAN component needs to be as reliable and as available as the large systems to which they are attached With the McDATA Enterprise Director ED 5000 ED 5000 and its Fibre Channel interface McDATA has moved this proven technology towards the open market With open systems closing up on S 390 systems choosing the McDATA switch allows for enterprise class availability and performance that is usually found in mission critical data centers Now with their second generation director class FC switch the 32 port and 16 port switches and the 9 port loop switch these products are even more prepared to fulfill the demands of a robust and scalable enterprise wide SAN Copyright IBM Corp 2001 175 3 1 Introducing the McDATA products Attention Effective September 28 2001 IBM will withdraw the McDATA ED 5000 FC Director IBM machine and model type 2032 001 and associated field installed features from marketing In this redbook we will maintain our description of it as there is considerable overlap with the features in the firmware of its replacement Additionally we anticipate that th
48. Gateway must add this extra layer of addressing as the host is no longer directly attached to the disk devices but will see a single target ID the SAN Data Gateway In a regular SCSI environment with the host attached directly to the SCSI device the host is able to recognize the target and LUN ID of that device Since we add the SAN Data Gateway in between the host and the device the host is no longer directly attached to the SCSI device to recognize its target or LUN ID 4 4 3 Assigning LUN IDs The Gateway assigns LUN IDs to all the attached devices up to the maximum of 255 and it creates a map of the actual disk device target and LUN ID to its own assigned LUN ID This map is stored in nonvolatile memory within the Gateway 4 4 4 Adding SCSI devices New SCSI devices can be added at any time If a new device is added for example another volume in the IBM Enterprise Storage Server has been assigned to a SCSI port on a San Data Gateway the SCSI buses must be re scanned to detect the new device This can be done from the service terminal using the scsiRescan command or from the StorWatch SAN Data Gateway Specialist If using the Specialist select and highlight the SCSI bus that the device has been assigned to and select Controls gt SCSI Channel gt Re Scan SCSI Bus As it rescans the SAN Data Gateway will assign the next available LUN address to the new device Refresh the data on your Specialist window by selecting View gt Refresh
49. Manager ED 6064 port card view and properties 206 Implementing an Open IBM SAN By moving the mouse over a specific port we see its port number By clicking it we get detailed port information and this is also shown in Figure 3 29 The port we selected is used to connect to another switch to build an ISL as we can see because of the port type which is an E_Port Also we see the parameters that are currently defined for this port and that the port is online Using the right mouse button on a port gives us a context menu as shown in Figure 3 30 ia ED 6064 iof x it Port Card View View A FRU Name G_Port Module GSF1 Dp Q Position Slot 4 eam FPM State Active _ Configure Beaconing Off ee wo Part Number 470 000439 004 mm S Serial Number 80451194 og o Maintenance Help Port Properties Node Properties Port Technology 1 Block Port 1 Enable Beaconing Diagnostics Clear Link Incident mite Reset Port Figure 3 30 ED 6064 port card viewing and configuration options Chapter 3 Implementing a SAN with McDATA 207 208 From here we can perform actions on the port such as resetting the port or performing diagnosis To go back to the full Hardware View we use the field shown in Figure 3 31 Figure 3 31 Product Manager ED 6064 back to hardware view Configuring the director identification There are fields for the name description location and a contact point for
50. Operating Parameters Figure 3 81 EFC Manager Configure Configure Operating Parameters Setting the domain ID Each switch itself is recognized in the fabric as a domain and is identified with a domain ID Domains are used for the 24 bit FC addresses that identify the switch ports in a fabric Every domain ID in the fabric must be unique ranging from 1 to 31 Implementing an Open IBM SAN To view and to change the domain ID we go to the Configure Operating Parameters window from within the Product Manager of the specific switch Then we select Configure gt Operating Parameters In the next window as previously seen in Figure 3 81 we can change the preferred domain ID and other Fibre Channel parameters for the director for instance the Switch Priority The domain ID is requested from the principal switch once the switch becomes online in the fabric The preferred domain ID is only used if it does not exist in the fabric If it is in use already an unused ID is assigned We recommend setting the domain IDs prior to building the multiswitch fabric and prior to zoning One reason is that when two switches join they will determine if there is a Domain ID conflict and if there is a conflict the fabric merging process will fail The second reason is that the domain ID is used to identify switch ports when zoning is implemented using the Domain and switch port number Configuring the ports for the ISLs The ports for the ISLs
51. Remote Client Please follow the instructions for your particular platform to install the application Click the following button to begin the installation process You will receive a Java Security warning requesting permission to download and s start the installer program and to read and write files on your system You Microsoft Windows must grant these permissions to allow installation of the EFC Manager 95 98 NT 2000 appileeton Begin Windows Installation Sun Solaris requires specific patches to support the Java 2 platform used by the installer program and the EFC Manager application Please read the Solaris patch requirements prior to installing the EFC Manager application If the latest patches have not been applied the installer will not run If the patches have been applied click the following button to Sun SolarisfSPARC begin the installation process You will receive a Java Security warning requesting permission to download and start the installer program and to read and write files on your system You must grant these permissions to allow installation of the EFC Manager application Begin Solaris Installation The EFC Manager remote client application will run on HP UX version 11 xor later Click the button below to download and save the installer program to your hard disk After the download is complete run the following command HP UX sh medataClientInstall bin then follow the install prompts You may delete the dow
52. Router must be cleared first Connect the Router to the existing system with the power off Set SW2 to mode 3 and set SW1 to an unique Fibre Channel target ID Power on the new Router OK GR Gos NS When the Status LED on the new Router is on solid lit the install is complete When the new Router is powered on communication between the two Routers will occur to query and update the new Router The new Router will be added as a subordinate so that the first Router will maintain its master status Any configuration changes to the storage system is always done on the master As this is done the changes are also communicated to the subordinate Routers so that all systems in the loop are aware of what is happening Using SLIC Manager on additional Routers Since the master Router does all the work it is not necessary to use SLIC Manager to view the new Router However depending on how the new Router is used this may become a requirement The same daemon used to connect to the first Router can be used to connect to several Routers The configuration file is edited again and the process to name and create a SLIC zone on this new Router can be added within the same file The SLIC Manager software can now be used to communicate to the new Router The SLIC Manager can only communicate to a single Router at a time Multiple SLIC Manager sessions can be started to communicate to each Router Master failover If at some time the Router that
53. SAN Data Gateway lt amp SCSI Channel 1 Current SAN Data Gateway ITSO fE Disk Device 0 0 IP Address 9 113 24 110 B Disk Device 0 1 Disk Device 1 0 5 Disk Device x Channel Description SCSI Channel 1 B Disk Device 2 0 B Disk Device 2 1 o i i B Disk Device 3 0 pietat ai ii Device 5 0 B Disk Device 3 1 ihh i B Disk Device 4 0 annel f Disk Device 4 1 Li a evice 4 Disk Device 5 1 Vea Disk Device 6 0 B Disk Device 6 1 Product ID 2105E20 J Disk Device 8 0 Revision 0525 9 Disk Device 8 1 Serial Number 124FC142 f Disk Device 9 0 Capacity 1 953 151 Blocks f Disk Device 9 1 BlockSize 512 P Disk Device 10 0 Removable No B Disk Device 10 1 l B Disk Device 11 0 width 16 J Disk Device 11 1 Speed Ultra 20MHz P Disk Device 12 0 Status Operational Figure 4 11 Disk device data 274 Implementing an Open IBM SAN You can perform the same drill down on the Fibre Channel host as we did with the SCSI channel and disk devices Select one of the Fibre Channel port connections as shown in Figure 4 12 and its data will be shown on the right hand view pane File View Admin Tools Controls Help E 9 113 24 110 ITSO SAN Data Gateway S SCSI Channel 1 3 SCSI Channel 2 gt SCSI Channel 3 amp SCSI Channel 4 4 Fibre Channel 4 S Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc
54. Set button The Zone Set Library window now looks like Figure 3 67 Zone Sets AITSO_Zone_Set_1 QNT_Zone_1 RPKAG3_C1B2A1 QLogic 20 00 00 E0 88 00 52 5E Emulex 10 00 00 00 C9 20 CA E6 Figure 3 67 One zone set one zone three node ports Implementing an Open IBM SAN We have one zone set ITSO_Zone_Set_1 with one zone NT_Zone_1 We have one ESS port and two Netfinity host ports within the zone one Netfinity port with an Emulex adapter and one with a QLogic adapter The ITSO_Zone_Set_1 zone set with NT_Zone_1 zone is now saved However it is not active yet but can be activated to make the fabric zoned We can now also define more zones in the zone set or create other zone sets However the zone set is not active Activating the zone set and making the fabric zoned To finish our zoning example we will activate the zone set now This is also done using the Action button and by clicking Activate With this action we are prompted to start or to cancel the activation of the zone set with the Activate Zone Set window We Start it and receive a message that the activation is complete as shown in Figure 3 68 Activate Zone Set xi Activate zone set complete Figure 3 68 Fabric Manager zone set activated Viewing the active zoning configuration After returning to the Zoning View window and expanding the zone set by clicking the small symbol to the left of ITSO_Zone_Set_1 and then NT_Zone_1 the Zoning View
55. Specialist Brian Cartwright is an Advisory T Specialist with the Storage Systems Group and is based in Brisbane Australia Brian has 14 years of experience in the I T industry with 6 years at IBM working as a Technical Specialist in the S 390 and Storage Systems Groups During this time Brian has been providing pre sales and technical support for IBM Storage Solutions and has been heavily involved in Copyright IBM Corp 2001 ix the design and implementation of IBM Storage Area Networks across a wide customer base Brian s expertise includes SAN design implementation and management and covers a wide range of disk and tape solutions across a number of different operating system platforms Sven Eichelbaum is an I T Specialist at StorAdvantage GmbH an IBM Business Partner based in Germany which specializes in SAN solutions He has 4 years of experience in designing and implementing storage architectures Before joining StorAdvantage in 2001 he worked in IBM SSD Germany as System Engineer He holds a Dipl Betriebswirt degree in Computer Sciences for Economy from the Staatliche Studienakademie Sachsen Thomas Jahn is an I T Specialist with IBM Germany SSG He has 4 years of experience providing technical support in IBM Thomas has provided technical support for networking and server consolidation on OS 390 UNIX for IBM and its customers before he joined SSD two years ago He is currently engaged in providing technical support for open
56. Unassign selected volume s from target hosts Perform Configuration Update Cancel Configuration Update Figure 2 90 Two selected volume assignments Action field accessible Selecting ESS logical volume assignments for modification Selections of more than one assignment can be done in two ways The first case is if the assignments to be selected are not adjacent Then we click on the first assignment to be selected press and hold the Ctrl key and click on the next assignment to be selected until we have all the assignments we want selected While holding down the Ctrl key we can also click on an already selected assignment to deselect it 144 Implementing an Open IBM SAN The second case is if the assignments to be selected are adjacent Of course to avoid the application of the first selection method we can sort the assignments to show up adjacent We sort the assignment here by its host FC port For adjacent assignments we click on the first assignment to be selected press and hold the Shift key and click on the last assignment to be selected This selects all assignments in between If for some reason one of the assignments just selected using the Shift key should not be modified we are also able to deselect this assignment by pressing the Ctrl key and clicking on it In the same way we can also add other particular assignments to the selection Once we have done this we go on and choose what we want to do with the as
57. a SignOn Drive Do you wish to continue Figure 5 13 Selecting SignOn drive dialog box As long as the LUN number of the SignOn drive becomes the LUN of the new logical drive the communications from the Manager to the Router will not be affected Another way to be certain that you do not lose your SignOn drive is not to use the SignOn drive to create logical drives However once some logical drives have been created a SLIC zone can be created to one or more of the newly created logical drives This logical drive can now be used as the SignOn drive and the previous drive is now available to be configured without any problems Implementing an Open IBM SAN 5 5 Composite drive A composite drive is a large drive that consists of two or more smaller drives The capacity of the composite drive is an aggregate of the capacities of all the smaller drives that are used to comprise this one large drive 5 5 1 Creating a composite drive To create a composite drive from the SLIC Manager select Tools gt Composite Drive Setup Wizard A dialog box Composite Drive List will appear Currently the list will be blank because there are no composite drives created Once there are composite drives created you will see a list of the drives Click the Next button and you will see the Members Selection window as shown in Figure 5 14 Composite Drive Setup Composite Drive Members Selection 700000 LOOO 700001 L001 To0002 L002 TO0003 L0
58. a particular ESS FC port Other steps rely on the completion of others In order to add ESS logical volumes to disk groups we need to perform two configuration steps Those are the configuration of some disk groups for RAID or JBOD and the definition of one or more host FC ports by its host type and WWPN The host FC port definition is needed because the process of adding volumes consists not only of creating the volumes but also of assigning them to a host FC port If there are existing ESS logical volumes we can also assign them to other host FC ports Now if both requirements have been met ESS logical volumes have been assigned and the ESS FC ports are defined we can access the volumes from the Fibre Channel attached host Of course the connectivity must be there and the host system has to be prepared also How to achieve this is discussed in other parts of this book 2 3 Configuring disk groups Now we will show how to configure the ESS for FC attachment in detail We choose to start our configuration with the disk groups followed by the configuration of the host FC ports The completion of both configuration steps enables us to add the ESS logical volumes later on Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 107 2 3 1 Performing the disk group configuration Pressing the Configure Disk Groups button takes us to the Fixed Block Storage panel as shown in Figure 2 38 Modify Host Systems Configure Hos
59. adapter to the case with the panel screw 6 Replace the computer case by tightening the screws on the case or use the clamp to secure the cover 1 10 10 Downloading the current Fibre Channel adapter driver 54 This section tells you how to install the port driver 1 2 NO an P w Plug in and restart your host system Go to the following Web site www emulex com From the Quick Links menu click Documentation Drivers and Software Click the host adapter type from the host adapter menu Click Drivers for Windows NT Click Specialized Drivers Click Fibre Channel Port xxxxx where xxxxx is the name of the adapter driver Click the Download Now button Implementing an Open IBM SAN 9 From the File Download window click the appropriate radio button and proceed as indicated To open this file from its current location go to step 9 To save this file to disk go to step 16 10 In the window for Winzip click agree 11 In the window for WinZip Wizard Welcome click Next 12 In the window for WinZip Wizard Select Zip File xxxxxxxx zip where XXXXXXXX is the name of the file highlight the file that you want to unzip 13 Click Next 14 In the window for WinZip Wizard Unzip click Unzip now A progress indicator window appears when the operation to unzip the file completes A window opens to display the following file names Lpscsi Lputilnt Oemsetup Readme Txtsetup oem 15 Double c
60. also available on CD ROMs Click the CD ROMs button on the Redbooks Web site for information about all the CD ROMs offered as well as updates and formats Related publications 359 360 Implementing an Open IBM SAN Special notices References in this publication to IBM products programs or services do not imply that IBM intends to make these available in all countries in which IBM operates Any reference to an IBM product program or service is not intended to state or imply that only IBM s product program or service may be used Any functionally equivalent program that does not infringe any of IBM s intellectual property rights may be used instead of the IBM product program or service Information in this book was developed in conjunction with use of the equipment specified and is limited in application to those specific hardware and software products and levels IBM may have patents or pending patent applications covering subject matter in this document The furnishing of this document does not give you any license to these patents You can send license inquiries in writing to the IBM Director of Licensing IBM Corporation North Castle Drive Armonk NY 10504 1785 Licensees of this program who wish to have information about it for the purpose of enabling i the exchange of information between independently created programs and other programs including this one and ii the mutual use of the information which has been exchan
61. and set the following parameters for servers with configurations that use JNI adapters sd_max_throttle This sd_max_throttle parameter specifies the maximum number of commands that the sd driver can queue to the host bus adapter driver The default value is 256 but you must set the parameter to a value less than or equal to a maximum queue depth for each LUN connected Determine the value using the following formula 256 LUNs per adapter The parameter shows thirty two 2105 LUNs attached to controller 1 cit d and forty eight 2105 LUNs attached to controller 2 c2t d The value for sd_max_throttle is calculated using the controller with the highest number of LUNs attached The sd_max_throttle parameter for the ESS LUNs in this example would be set by adding the following line to the etc system file set sd sd_max_throttle 5 sd_io_time This parameter specifies the timeout value for disk operations Add the following lines to the etc system file to set the sd_io_time parameter for the ESS LUNs set sd sd _io_time 0x78 sd_retry_count This parameter specifies the retry count for disk operations Add the following line to the etc system file to set the sd_retry_count parameter for the ESS LUNs set sd sd_retry_count 5 Chapter 1 Implementing Fibre Channel host adapter cards 45 46 maxphys This parameter specifies the maximum number of bytes you can transfer for each SCSI transaction The default value is 126976
62. by selecting the port from the drop down list as shown in Figure 2 116 160 Implementing an Open IBM SAN Configure Host Adapter Ports El Host Adapter Port Second Bus Connection optional SCSI Bus Co tion Bay 1 Adapter 1 Pot A ESCON Bay 1 Adapter 1 Port B SCO Bay 1 Adapter 2 Pot A SCSN SCSI IDs on Bus JB 4 Adapter 1 Port B Bay 4 Adpter2 Pot A SCSI Bay 4 Adapter 2 Port B Bay 4 Adapter 3 Port A Bay 4 Adapter 4 Port A Figure 2 116 Port selection drop down list SCSI port selected There is no configuration necessary for ESCON There are different configuration options for SCSI and Fibre Channel However we will focus on the FC part By selecting an FC port we are presented with the panel as shown in Figure 2 117 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 161 Configure Host Adapter Ports fl Host Adapter Port Boi ages Pot eC E Storage Server Atiributes Access Restricted Fibre Channel Access Mode FC Port Atiributes 10000000C9251126 World Wide Port Name Undefined Fibre Channel Topology Perform Configuration Update Cancel Configuration Update Figure 2 117 Configure Host Adapter Ports panel FC port selected The port we used is in bay 1 adapter 3 and is port A It is called A even if it is the only port on the adapter Understanding the Storage Server Attributes field As shown in F
63. class about high availability features After you configure your host for normal operating system access the 2105 acts as a normal disk device in the MC ServiceGuard configuration IBM recommends that you create volume groups that contain the volumes using the Hewlett Packard logical volume manager This method of disk management is more reliable easier and more flexible to manage than whole disk management techniques Creating volume groups also allows the implementation of PV Links Hewlett Packard s built in multipathing software for highly available disks such as the IBM 2105 To establish PV Links perform the following steps 1 Create the volume group using the path to the volumes that you want as the primary path to the data 2 Extend the volume group with the path to the volumes intended as alternate paths The logical volume manager reads the label on the disk and knows that it is an alternate path to one of the volumes in the group The logical volume manager labels the volume For example if a host has access to a volume on a 2105 with the device nodes c2t0d0 and c3t0d0 you can use the c2 path as primary and create the volume group using only the c2t0d0 path Chapter 1 Implementing Fibre Channel host adapter cards 25 3 Extend the volume group to include the c3t0d0 path When you issue a vgdisplay v command on the volume group it lists c3t0d0 as an alternate link to the data 1 8 Novell NetWare FC host system attach
64. computer Starting the Specialist To start the Specialist the server must be started first and then the client can be launched Figure 4 4 provides an example of the StorWatch SAN Data Gateway Specialist with server and client loaded onto the same Windows NT computer FS IBM StorWatch SAN Data Gatew Sea lt Client fo Netscape Communicator gt E Norton Antivirus gt Figure 4 4 StorWatch SAN Data Gateway Specialist startup Once the server has been launched you should see a window similar to Figure 4 5 Implementing an Open IBM SAN elcome to SAN Director Remote Management Copyright 2606 Pathlight Technology Inc All rights reserved KKK KK Centralized error handling initiated Log Filename SanmgrServerLog 6664 txt SNMP Initialized NetSessionManager instantiated RMI registry started from within server Host 9 113 24 99 Port 1099 Checking for other applications bound with URL prmi 9 113 24 99 18699 starfish No other Server URL bound in registry OK to proceed Trap receiver started UDP Port 162 Server logging on Server to Gateway heartbeat started Server to Client heartbeat started Ready Waiting for commands pmi 9 113 24 99 1699 starfish Figure 4 5 StorWatch SAN Data Gateway Specialist server The client software can now be launched If the server and client are not on the same PC then a dialog box will appear to allow you to enter in the IP address of the computer that
65. created NNN low order three characters of the ESS unit serial number or unique three character value entered using an ESS service panel menu option The menu option is found by using the following method a From Service Menu choose the option Configuration Options Menu b Take the option Change Show Control Switches c Highlight the option AS 400 LUN Serial Number Suffix d On the option Control Switch Value press F4 to list the available values Note The default value is the last three digits of the serial number for the ESS This might create problems on iSeries systems that have multiple ESSs attached to the same host system We recommended that you use the value Use_Box_S N Chapter 1 Implementing Fibre Channel host adapter cards 9 The following considerations need to be taken into account gt You cannot specify a LUN size of 4 190 GB LUN for the SCSI Fibre Channel protocol FCP attachment gt You can specify 1 32 LUNs for each attachment to an AS 400 or iSeries Fibre Channel protocol adapter gt Fibre Channel attached LUNS are identified as the 2105 device type on the iSeries host system gt You can place an AS 400 or iSeries volume in the ESS storage arrays according to the selected host system attachment type For a Fibre Channel attachment you must place the volumes in ESS RAID 5 storage arrays that have capacity available You can spread the volumes across arrays that are attached to multiple
66. disable LIN alerts here as well However the hub ports have some more options to configure The Bypassed checkboxes have the same effect as the blocking of a port with other McDATA products A bypassed port is not part of the loop and an attached loop device cannot communicate with other loop devices or other fabric attached node ports Port validation is used to verify that the port has serial technology and can provide details about the port The Auto LIP enables loop initialization every time a loop device enters or leaves the loop This is used to notify the other loop devices and the switch of their presence Using the Port List View To see the changes that have been made to the bridge and hub ports we select the Port List View and open the Configure Hub Ports window for illustration as shown in Figure 3 49 220 Implementing an Open IBM SAN Configure Hub Ports x Port Name Bypassed PortValidation Auto LIP_ LIN Alerts ao Woi ce eo g A a Ci a _ rn n O eo looo S O n n O aS i S g i g i oi e lo oo O n Kn O _ rn n O Da n O N RI i lt T Figure 3 49 Product Manager ED 6064 Port List View Port Properties We do not have any devices attached to the switch so no hub port is online at this moment in time Configuring the FC operating parameters Remember that the domain ID must be unique for each switch in a fabric so we will set the preferre
67. example if for management and security reasons the only communicating node ports are those that are explicitly allowed to In this case connecting node ports without defining them to a zone would prevent them from accessing other ports 3 6 Managing the fabric To view and manage the zones in the McDATA fabric we must open the EFC Fabric Manager The Fabric Manager is accessed by opening the Fabric View of the EFC Manager with select View gt Fabric as shown in Figure 3 54 and by clicking the fabric icons only one in our case McDATA Enterprise Fabric Connectivity Manager Figure 3 54 EFC Manager Fabric View There is a fabric icon displayed for each independent fabric and which consists of devices managed by the EFC Server Chapter 3 Implementing a SAN with McDATA 227 3 6 1 Using the Fabric Manager views The EFC Fabric Manager opens as a second window by selecting the Topology View The Topology View In our case we have one switch installed and so there is only one switch visible as shown in Figure 3 55 lt 2 McDATA Fabric Manager N Topology View O Zoning Fabric AWN Fabric Status Principal Switch ATA 10 00 08 00 88 20 00 0F Operational Domain ID 3 Configure 9 113 25 245 Figure 3 55 Fabric Manager Topology View with one device When switches become cascaded the topology view will then show the ISLs as a line between the switches We will see in 3 7 3 Setting up our zoned
68. for your host Fibre Channel adapter when you attach your host system to the ESS Chapter 1 Implementing Fibre Channel host adapter cards 69 If your host system uses more than one Fibre Channel adapter to connect to your ESS you must add multiple entries to the host system list for this host one for each Fibre Channel adapter Each adapter will have its own unique WWPN The format and content of the Fibre Channel port identifier are determined by the manufacturer of the link control facility for the applicable Fibre Channel port The identifier is an eight byte field which the Fibre Channel protocols use to uniquely identify the Fibre Channel port An example is the ESS Fibre Channel port You can manually assign a unique worldwide port name for the ESS by performing the steps in the following sections 1 12 2 Locating the WWPN for an AS 400 iSeries 70 To locate the WWPN for a AS 400 host system perform the following steps 1 On the screen for the AS 400 Main Menu panel type strsst 2 On the Start Service Tools STRSST Sign On panel type your service tools userid and service tools password 3 On the System Service Tools SST panel type 1 to select Start a service tool 4 On the Start a Service Tool panel type 7 to select Hardware service manager 5 On the Hardware Service Manager panel type 1 to select Packaging hardware resources systems frames cards 6 On the Packaging Hardware Resources panel type 9 t
69. formatting Adapter pair 4 Loop A Group 1 is formatting 08 78 68 88 complete complete complete complete Figure 2 48 Status Graphical View four disk groups in the process of formatting This discussion was just intended to show how it is done Now we continue from the point where we defined the disk groups 2 4 Creating and modifying host FC port definitions To fulfil the second condition to be able to define and assign ESS logical volumes we will define the host FC ports that are installed in the Fibre Channel attached hosts 116 Implementing an Open IBM SAN 2 4 1 Creating host FC port definitions From the Open System Storage panel we press the Modify Host Systems button as shown in Figure 2 49 Modify Host Systems Configure Host Adapter Poris Configure Disk Groups Modify Volume ASsignments Figure 2 49 Entry to the Modify Hosts Systems panel Viewing the Modify Host Systems panel We are now taken to the Modify Host Systems panel as shown in Figure 2 50 This panel consists of the Host Attributes entry fields and The Host Systems List table The Host Systems List represents each defined host FC port If a host has two Fibre Channel ports this appears as two entries in the Host Systems List As we can see there are no host FC ports defined at this time Modify Host Systems Host Attributes Nickname Host Type E R576000 z Host Attachment ly lity ae SCSI attached E
70. gt r Figure 2 47 Four disk groups configured Undefining disk groups or redefining disk groups It may be necessary to reconfigure disk groups They can be unconfigured or configured to another storage type If there is a disk group configured for RAID 5 it can be reformatted to JBOD or unconfigured Doing this is the same process as we did before First we select the disk group in the Available Storage table and then we have to choose Undefined or non RAID in the Disk Group Attributes field After we geta warning that all volumes on the selected disk group will be destroyed we can select the next disk group to be reconfigured After changing the attributes of the disk groups we perform the update A window pops up informing us that the process will take a while and that we can view the progress on the Status panel This is with four disk groups in the process of formatting as illustrated in Figure 2 48 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 115 Status Graphical View Machine status as of May 18 2001 4 37 15 PM PDT Cluster 1 Hosts Bays and Hosts Ports Cluster 2 H Refresh Data Problem Log Legend C Nermat O Problem Access to Data not Affected E Problem Access to Data Affected E Problem Access to Data Lost Information Adapter pair 4 Loop B Group 2 is formatting Adapter pair 4 Loop B Group 1 is formatting Adapter pair 4 Loop A Group 2 is
71. has the server software loaded If the server and client are on the same computer you will be automatically connected to this server After connection to the server is complete a dialog box will appear in which you can enter in a user name and password The IBM Storage Area Network Data Gateway provides a default administrator gt User Name StorWatch gt Password StorWatch The fields are case sensitive so they must be entered in as shown above A new administrator account should be set up by selecting Admin gt Add User from the toolbar After a new administrator account is created then the default user StorWatch is deactivated Note If a new administrator account has been created and the password is lost and no other account has administrator access then you will have to contact a service representative Chapter 4 Implementing the SAN Data Gateway 269 4 3 2 Using the StorWatch SAN Data Gateway Specialist Once you are logged in to the Specialist you must now connect to the SAN Data Gateway At this point a dialog box should appear requesting the IP address of the SAN Data Gateway As it connects it will download the information from the SAN Data Gateway and be presented on your window If a dialog box does not appear automatically select Tools gt Connect SAN Data Gateway or SAN Data Gateway Router from the toolbar This can also be used to connect to several Gateways or Routers from a single client session In F
72. have more than one Fibre Channel adapter installed you will see a screen that displays all the Fibre Channel adapters Scroll down to the adapter you want Press Enter From the Fast Util menu scroll down and select Select Host Adapter Scroll up and highlight Configuration Settings Press Enter From the Configuration Settings menu click Host Adapter Settings Write down the host adapter name for example 200000EOQ8B00C2D5 NO Or gt O 1 12 8 Locating the WWPN for a Sun host system To locate the WWPN for a Sun host system for a JNI Fibre Channel adapter card perform the following steps 1 Go to the root directory 2 Type dmesg more All the devices in the directory are displayed When you type dmesg more you might find the worldwide port name of other Fibre Channel adapters if the driver displays the worldwide port name during a restart Scan the output message file for fcaw or jnic and the 64 bit number if you have a different JNI Fibre Channel driver Then look for the worldwide port name for example 20000E06940028 Note 1 There is no method to locate the WWPN for a QLogic QLA2100F adapter installed on a Sun host system 2 If you have multiple host adapters installed you will see more than one WWPN Chapter 1 Implementing Fibre Channel host adapter cards 73 1 12 9 Locating the WWPN for a Windows NT host system To locate the WWPN for a Windows NT host system with a QLogic adapter perform the follo
73. in Figure 3 53 Amount of node ports N N N N Mi F 7 purple J Default Zone m o ert N 4 7 Active Zone Set he iis a ITSO_Zone_Set_1 A te oe r See T DN 4 Nonactive pesi Nonactive Pa i Zone Set _Zone Set E i 1 blue Ho E AIX_Zone_1 red Sh i NT_Zone_1 x i ey i pi i mo I es r ra f ra y 7 Soo eechece one or more ports of a node 2 Figure 3 53 Relationship of zone sets zones the default zone and node ports The node symbols here from servers and from the ESS represent one or more node ports and not necessarily the whole FC node with all ports This is because zones with McDATA are built up with node ports For example all three ESS symbols could be ports of the same ESS 226 Implementing an Open IBM SAN The solid blue red and purple areas represent areas where traffic is permitted The blue and the red zone represent the AIX and the NT zone to be defined in this topic The green dotted line around the zones represents the active zone set The purple area is the default zone In this example the default zone is enabled which makes it possible for all node ports that are not configured in a zone of the currently active zone set to communicate with each other There might be cases where it is appropriate to disable the default zone For
74. is designated as the master within the SLIC storage system fails the master designation will failover to next nearest Router This is accomplished within the communications between the Routers and it is done automatically When the new Router accepts becoming master it will maintain the master role if even the failed Router is replaced and rejoins the storage system The master role can be changed back to the original Router or to another Router if desired using the SLIC Manager software There is no capability to select a specific failover Router Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 353 5 10 3 Adding hosts 354 The SLIC storage system can be expanded to include more hosts whether they are homogeneous or heterogeneous It is recommended that as hosts are added each host is connected to its own and separate SLIC Router If more than one host was connected to a single Router there will be arbitration and performance issues Also it would have a single point of failure with the possibility of losing data access to many systems Homogeneous hosts If another host of is added and you would like to have both hosts access the same disks then some sort of access sharing software must be loaded onto both hosts If other hosts are added to the storage system and they will not share data but are connected for storage consolidation there are a few issues to be considered as the Router does not provide a LUN
75. is very easy because they are SSA disks and the rules for SSA disks apply here as well If there is a dummy drive in an existing SSA drawer then it can be replaced by a real drive If a new drawer has to be added the SSA cabling is changed to include this new drawer Because this is SSA this can be done on the fly As the SSA loop is broken the Router will still access all disks due to the structure of the SSA loop If possible we recommended that you stop host access and power down the loop In any case the rules regarding SSA disks and cabling must be adhered As disks are added to an existing loop the new disks will be recognized If all disks in the loop are used as single disks JBOD and have LUN numbers assigned the new disks added will have LUN numbers assigned to them automatically If there are any composite mirror instant copy or spare drives in the loop then the new disks will not have LUN numbers assigned and become general spares 5 10 2 Adding Routers By adding Routers we can increase the amount of storage a host can access and increase throughput On the rear panel of the Router there are two Fibre Channel GBIC ports that are available and act as a mini hub You can add a Fibre Channel cable from the second port on the existing Router to one of the ports on the second Router You are basically daisy chaining the Routers But since the ports on the Router act as a hub an arbitrated loop is created However in t
76. mark The check mark is toggled on and off by clicking in each square Figure 4 38 provides an example of LUN masking FA virtual Private SAN Access Settings ACTIVE Assigned LUNs EE On Line EE Off Line 17 18 19 20 21 22 23 24 25 26 27 28 29 30 unknown unknown unknown 10000000 c921da0a plymouth AIX fdewfsesi0 0xet 0 Emulex 10000000 29221802 4 gt New Host Data Original Host Data Close plymouth Hast Name plymouth New Host Host Type arx v AIX R i ee Apply Changes Host Connection dewfscsiO Oxet 0 Emulex idewfscesi0 Oxef 0 Emulex Host vv h 0000000 9221802 10000000 c9221302 Undo Changes Take Host Off Line Figure 4 38 Setting LUN masking The host plymouth has access to LUNs 17 to 24 but does not have access to LUNs 25 to 30 Conversely the host at the top has access to LUNs 25 to 30 but does not have access to LUNs 17 to 24 Using the scroll bar on the bottom we can scroll through all 255 available LUNs in the SAN Data Gateway and enable or disable access by adding or clearing the check mark The scroll bar on the right hand side allows us to scroll through the different hosts In this example there are only two hosts but there can be several more Chapter 4 Implementing the SAN Data Gateway 295 Once completed select Apply Changes and then Close The host system may now have to be restarted or some other method used
77. masking capability In UNIX systems the hosts will see all disk in the loop But if the specific volume is not mounted there will be no data integrity problems For Windows NT each host will write its own signature on all available disk Adding another Windows NT host to the loop will cause problems To allow a specific Router and host attached to that Router access to a specific disk or set of disks you can set Private Attributes on the disks Private Attributes is a setting within SLIC manager that can set a disk to only be accessed by a certain Router and in turn the host attached to that Router Note For more information and operation on the Private Attributes setting please refer to the SLIC Manager Installation and User Guide 310 605807 In all cases if extra control for disk access is required a third party software such as Tivoli SANergy must be used Heterogeneous hosts As the Router does not provide for LUN masking you must use the SLIC Manager Private Attribute setting or a third party software such as Tivoli SANergy to restrict and control host access to the disk The Private Attributes and Tivoli SANergy can be used together for added control Implementing an Open IBM SAN Related publications The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this redbook IBM Redbooks For information on ordering these publications see
78. name fv0341 37 bin Files of type Jal Files x Cancel Figure 4 20 Specifying location of the firmware Downloading the firmware into the SAN Data Gateway is a disruptive process so the Specialist displays a warning message as shown in Figure 4 21 Ef Attention i 2 Stop all I O with this SAN Data Gateway before downloading firmware Download file C temp SANDGwW034137 bin now Cee mo Figure 4 21 Warning message prior to downloading the firmware Once all I O activity is stopped you can click Yes to continue the process Implementing an Open IBM SAN Once the firmware process has been started the SAN Data Gateway Specialist displays a message as shown in Figure 4 22 File View Admin Tools Controls Help JD Current SAN Data Gateway Gateway world Wide Node Name 10000060 4516 ee SN IP Address 193 1 1 25 Serial Number 21081300937 Firmware Revision 3 41 31 Health Check Level 2 Health Check Interval 60 Log Size 2047 Receive Event Traps Enabled Serial Baud Rate 19200 Up Time 1 day 23 0 Download to SAN Data Gateway 193 1 1 25 in Progress please wait Figure 4 22 Download in progress This indicates that the firmware is being downloaded to the SAN Data Gateway The Specialist will then give the option to restart the SAN Data Gateway as shown in Figure 4 23 EA Attention x C SAN Data Gateway 193 1 1 25
79. of our Fabric Manager looks like that shown in Figure 3 69 Chapter 3 Implementing a SAN with McDATA 239 McDATA Fabric Manager O x uli View fa Configure Zoning View Default Zone Enabled ctive Zone Set _JITSO_Zone_Set_1 YNT_Zone_1 RPKAS3_C1B2A1 GLogic 20 00 00 E0 88 00 52 5E Emulex 10 00 00 00 09 20 CA E6 Save active zone set as N Deactivate zone set Figure 3 69 Fabric Manager Active Zone Set with one zone shown 240 We can see the zone set and the associated zone by its name and the configured host ports by their manufacturers name and the host adapter port associated WWPN Also we see the nickname for the ESS port which we configured earlier If we had not configured a nickname for the ESS port we would only see it as another Emulex adapter port as these are used as the Fibre Channel adapters in the ESS Modifying zone sets From within the Zoning View window we can also manipulate the zone sets for example deactivating a zone set or saving the zone set As an example we will copy the same zone set but assign it a different name as shown in Figure 3 70 and we will save it as ITSO_Zone_Set_2 Implementing an Open IBM SAN gt Save Active Zone Set As Ea ITSO_Zone_Set_2 ee Figure 3 70 Fabric Manager save active zone set as 3 6 3 Adding an AIX zone to the existing zone set We also have AIX hosts and we want to add a zone with the AIX s
80. of the Windows 2000 host until you need access to the data on the target volume Perform the LUN mapping after the PPRC operation and immediately before you need access to the data You must restart the host system before you can access the data on the target volume You can greatly reduce the time it takes for the host system to restart if you perform the LUN mapping Otherwise the time to restart could take 10 minutes per PPRC target volume 1 11 2 Installing the QLogic QLA2100F adapter card This section tells you how to attach an ESS to a Windows NT host system with the QLogic QLA2100F adapter card Single port Fibre Channel interfaces with the QLogic QLA2100F adapter card support the following loop modes gt Target gt Initiator gt Target and initiator Chapter 1 Implementing Fibre Channel host adapter cards 59 Note 1 The arbitrated loop topology is the only topology available for the QLogic QLA2100F adapter card When you install the QLA2100F adapter card on your host system IBM recommends that you install the card on a host system with four processors This ensures that you do not have a problem when you start the host system Perform the following steps to install the QLogic QLA2100F adapter card oa A UO N 8 9 Install the QLogic QLA2100F adapter card in the host system Connect the cable to the ESS port Restart the host system Press Alt Q to get to the FAST Util menu From the Con
81. on each of the ESS ports that can be used by that host 1 1 4 Targets and LUNs For Fibre Channel attachment each Fibre Channel host adapter can architecturally attach up to 256 LUNs The ESS supports only a maximum of 4096 LUNs divided into a maximum of 16 logical subsystems each with up to 256 LUNs If the software in the Fibre Channel host supports the SCSI command Report LUNs then you can configure all 4096 LUNs on the ESS to be accessible by that host Otherwise you can configure no more than 256 of the LUNs in the ESS to be accessible by that host 1 2 Attaching an ESS to a FICON channel This topic tells you how to configure the IBM Enterprise Storage Server for FICON attachment 1 2 1 Configuring the ESS for FICON attachment 4 You can perform a FICON channel attachment on the IBM 2105 Model F10 and F20 You cannot perform a FICON channel attachment on the IBM 2105 Model E10 and E20 When you attach an F10 or F20 to a FICON interface you must use the following host adapter feature codes gt Feature code 3021 This is a long wave laser adapter that includes a 31 m 100 ft 50 micron cable with duplex connectors Because the 3021 uses one of four slots in one of the four I O bays you can have a maximum of 16 adapters in the ESS This allows you to have a maximum of 16 FICON interface attachments Implementing an Open IBM SAN gt Feature code 3023 This is a short wave laser adapter that includes a 31 m 100 ft 6
82. on the IBM SAN Fibre Channel Switch Figure 4 41 shows a switch connected to port 4 of the Gateway and which has registered to the database Since we cannot load any host registration software onto the switch all other fields are left unknown PA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc File View Admin Tools Controls Help E 9 113 24 110 ITSO SAN Data Gateway lt 3 SCSI Channel lt 3 SCSI Channel gt SCSI Channel lt SCSI Channel gt Fibre Channel Fibre Channel Current SAN Data Gateway ITSO IP Address 9 113 24 110 Fibre Channel 4 Channel Description Fibre Channel Host 20fd0060 69201d4e Host Name unknown Host Type unknown Host Connection unknown Figure 4 41 Switch registration By selecting and highlighting the Fibre Channel port as shown in Figure 4 42 you will see in the right hand view pane that the port is now using a point to point or N_port connection that denotes a fabric login rather than a loop login Chapter 4 Implementing the SAN Data Gateway 299 Pa storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc Iof x File View Admin Tools Controls Help E 9 113 24 110 ITSO SAN Data Gateway lt 3 SCSI Channel 1 gt SCSI Channel 2 lt 3 SCSI Channel 3 SCSI Ch l 4 Fibre le 4 Channel Description Fibre Channel 4 Fibre Chann
83. optional 24 port 10 100 Base T ethernet hub to connect the switches to the EFC Server It can also be used to connect to other cabinets and or to the LAN Refer to Setting up the network environment on page 183 for further information on the network setup h gt One EFC Server which is a laptop computer running Windows NT 4 0 or higher It is mounted in a slide out tray in the middle of the cabinet Up to three cabinets can be managed with one EFC server the second and the third cabinet does not need to have its own EFC Server 182 Implementing an Open IBM SAN gt One 56 Kb s modem for service and support of the managed products gt One Zip drive mounted in the slide out tray This is used to back up the configuration information of the SAN It comes only with cabinets that ship with the EFC Server gt Dual AC power strips and dual AC power inputs or redundancy There is also one central power switch for all in the cabinet installed components For further information on installation and service of the Fabricenter refer to gt Fabricenter Equipment Cabinet Installation and Service Manual 620 000100 3 2 Setting up the environment The installation of the cabinet with the switches and the EFC server is straight forward They ship with all the necessary components After the physical installation of the switches we perform the network setup and make sure we can administer the devices remotely 3 2 1 Setting up the netw
84. or QLogic QLA2200F configuration To configure the host adapter card use the IBM TotalStorage ESS Specialist Chapter 1 Implementing Fibre Channel host adapter cards 63 1 11 7 Configuring for availability and recoverability This section describes how to ensure optimum availability and recoverability when you attach an IBM ESS to a Windows 2000 host system You must set the time out value associated with the supported host bus adapters to 240 seconds The setting is consistent with the configuration for IBM SSA adapters and disk subsystems when attached to Windows 2000 host system The host bus adapter uses the time out parameter to bound its recovery actions and responses to the disk subsystem The value exists in different places in the system configuration You can retrieve and use it in different ways depending on the type of host bus adapter The following instructions tell you how to modify the value safely in either the Windows 2000 registry or in the device adapter parameters 1 11 8 Setting the TimeOutValue registry 64 The following instructions tell you how to set the time out value registry 1 From the Run menu or command prompt type Regedt32 exe 2 Navigate to the following registry key HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services Disk 3 Look for the value called TimeOutValue If the value called TimeOutValue does not exist go to step 3a If the TimeOutValue exists go to step 4 Click Edit gt Add Value
85. paths set the path group to x Note x must be a minimum of two and cannot exceed a maximum of eight 1 2 5 Attaching to a FICON channel or a FICON channel path group 6 When you attach multiple controllers to a channel you can use a switch director for each controller or an ESCON or FICON channel that has a direct connection to the channel I O does not flow through all the other controllers before you get to the target controller I O goes directly to the target controller When multiple controllers are connected to a channel through a switch you create the logical equivalent of the parallel interconnection With the parallel interface and with the ESCON interface the channel and controller communicate to form a private connection None of the other controllers on the channel can communicate with the channel while this private connection is in place The private connection supports input and output between the channel and the controller It can run slowly depending upon the factors that affect the controller and the device The protocol does not allow any of the serially connected controllers to use any spare cycles The result is poor performance FICON does not support a private connection FICON performs frame or packet multiplexing A configuration with the serially connected controllers communicates with the controllers simultaneously It can multiplex I O operations across all controllers simultaneously No interface cycles a
86. provides the procedure to attach a Compaq Alpha server to an ESS The ESS supports the following Compag Alpha server models 2100 4100 8200 8400 YYY Yy 1 6 1 Attachment requirements 18 This section lists the requirements to attach the ESS to your host system gt Ensure that you have all of the items listed in Equipment requirements gt Check the logical unit number limitations for your host system See Table 2 gt Ensure that you have the documentation for your host system and the IBM Enterprise Storage Server User s Guide The User s Guide is on the compact disc that you receive with the ESS See the following Web site for details about the release level for your operating system www storage ibm com hardsoft products ess supserver htm Either you or an IBM service support representative SSR must perform the following tasks to install and configure an IBM ESS 1 An IBM SSR installs the IBM Enterprise Storage Server by using the procedures in the IBM Enterprise Storage Server Service Guide 2 Either you or an IBM SSR assigns the Fibre Channel hosts to the Fibre Channel ports on the ESS Note Use the information on the logical configuration work sheet in the IBM Enterprise Storage Server Configuration Planner that you should have previously filled out 3 Either you or an IBM SSR configures the host system for the ESS Use the instructions in your host system publications Note The IBM Subsystem Device Driv
87. serviceability For instance when connecting highly available clustered servers like RS 6000 with HACMP to highly available enterprise storage like the ESS the connectivity layer should have similar characteristics This is even more important when the SAN is used to connect many servers to storage An outage of the SAN could lead to the loss of access to data of all the connected servers Most components of the ED 6064 are hot pluggable field replaceable units FRU It supports features like internal failover to redundant FRUs and fault detection The maintenance firmware loads and the firmware activation can be done without downtime and without any impact to connected devices To notify service personnel in case of a failure a call home and an e mail notification feature is provided Using the ED 6064 in the datacenter it serves as the core device of the backbone of an enterprise wide SAN Other McDATA switches like the ES 3016 and ES 3032 then serve as edge switches or for connectivity to FC AL capable devices the ES 1000 can be attached The ED 6064 supports connectivity to S 390 with FICON and to open systems with FCP The ports are Generic Ports G_Port These ports when connected to another McDATA switch or director act as Expansion Ports E_Ports to set up inter switch links ISL Connected to hosts or storage devices they act as fabric ports F_Port Up to four ED 6064s together with an 24 port ethernet hub and the EFC se
88. sont z ne sort no sort z no sort ars z 601 184386 Device Adapter Pair 4 Open System 064 0 GB RAID Array Unassigned Chaster 1 Loop B Array 2 Vol 001 700 18486 Device Adapter Par 4 17 Op System 016 1 GB RAID Amay Fibre Chamel PC1_1 Chicter 2 Loop A ID 00 LUN 0001 Array 1 Vol 000 3701 18486 Device Adapter Pair4 17 Open System 064 0 GB RAID Amay Fibre Chamel Pel Chuster 2 Loop B ID 00 LUN 0003 array 1 Vol 001 600 18486 Device Adapter Pair 16 Open System 016 GB RAD Amay Fibre Chamel PC1_1 Chaster 1 Loop A I 00 LUN 0000 Figure 2 106 Placeholder for unassigned ESS logical volume selected Viewing changes on the Open System Storage panel If we use the Back button of our browser we return to the Open System Storage panel There we see that the volume is not displayed any more on any of our host FC ports This is shown in Figure 2 107 for the host FC port PC1_2 which now has only one volume assigned to it Open System Storage a Host Systems Nidmame Host Type Attachment Attachment WWPN or high or highs Assigned Volumes Total 1 volumes Yes 701 18486 Open System 64 0 GB RAD Amy Device Adapter Pair 4 LSS 017 Chaster 2 Loop B Array 1 Vol 001 Modify Host Systems Configure Host Adapter Poris Configure Disk Groups Modify Volume Assignments Figure 2 107 Open System Storage panel only one volume assigned to PC 1_2 154 Implementing an Open IBM SAN Vie
89. specified volumes have been successfully assigned to the specified target hosts OSON Figure 2 93 Volume assignments successfully created for specified host FC ports Implementing an Open IBM SAN If we press OK we do not change back to the Open System Storage panel Instead we see the new volume assignments to the host FC port PC1_1 as shown in Figure 2 94 Modify Volume Assignments a Yolume Assignments Print Table no sort gt no sort no sort no sort sma no sort no sort ars 600 18486 Device Adapter Pair 4 Open System 016 GB RAD Amay Fibre Charmel Chuster 1 Loop A ID 00 LUN 0000 Array 2 Vol 000 700 18486 Device Adapter Pair4 17 Open System 016 1 GB RAD Amay Fibre Charmel Cluster 2 Loop A ID 00 LUN 0001 Array 1 Vol 000 701 18486 Device Adapter Pair4 17 Open System 064 0 GBE RAD Amay Fibre Charmel Chaster 2 Loop B ID 00 LUN 0003 array 1 Vol 001 601 18486 Device Adapter Pair 4 Open System 064 06B RAID Amay Fibre Charmel Chater 1 Loop B I 00 LUN 0002 tio Action n Assign selected yolume s to target hosts Use same ID Lun in source and target C Unassign selected yolume s fror target hosts Perform Configuration Update Cancel Configuration Update Figure 2 94 Assignments for the host FC port PC1_1 Viewing changes on the Graphical View panel Back on the Storage Allocation Graphical View panel we now see that the host
90. switches the Fabric View of the EFC Manager looks like that shown in Figure 3 83 McDATA Enterprise Fabric Connectivity Manager Figure 3 83 EFC Manager two independent fabrics Here we have two independent fabrics which are not connected with ISLs Anyway it would look the same if for instance the ISL ports would have been blocked or would have been configured as an F_Port Also the zoning configuration could be incompatible Chapter 3 Implementing a SAN with McDATA 255 Connecting the switches Now we can connect the two switches with ISLs We are using two longwave ISLs between the two switches After successfully joining the fabrics we select View gt Fabric in the EFC Manager window The fabric view now looks like that shown in Figure 3 84 McDATA Enterprise Fabric Connectivity Manager Figure 3 84 EFC Manager Fabric View one merged fabric To see what the topology looks like now we navigate to the Topology View of the Fabric Manager by clicking the icon that represents the merged fabric in the main window as shown in Figure 3 84 The number 2 in the pentagon fabric icon indicates that we have two switches merged into one fabric 256 Implementing an Open IBM SAN Clicking this icon will open the Fabric Manager in a dedicated window with the Topology View as shown in Figure 3 85 lt 2 McDATA Fabric Manager dol x rt Topology View Fabric VN Fabric Status Principal Switch McDATA
91. the Storage Allocation Tabular View panel as shown in Figure 2 97 we see two rows for each of the two 64 GB sized volumes Once for the host FC port PC1_1 and once for PC1_2 Again the table does not represent the volumes but the assignments the volumes have if any The rightmost column indicates the sharing of the volumes as well Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 149 Storage Allocation Tabular View List of Assigned Volumes Print Table Perform Sort Graphical View PCI Lss 016 600 18486 Open System 016 1 GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 1 Loop A ID 00 LUN 0000 Array 2 Vol 000 PCL Lss 017 700 18486 Open System 016 1 GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 2 Loop A ID 00 LUN 0001 Array 1 Vol 000 PCI Lss 016 601 18486 Open System 064 0 GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 1 Loop B ID 00 LUN 0002 Array 2 Vol 001 Lss 017 701 18486 Open System o64 0GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 2 Loop B ID 00 LUN 0003 Array 1 Vol 001 Lss 016 601 18486 Open System 0640 GB Bay 1 Card3 Device Adapter Pair 4 FC Port A Cluster 1 Loop B ID 00 LUN 0000 Array 2 Vol 001 Lss 017 701 18486 Open System oss 0GB Bay 1 Card3 Device Adapter Pair 4 FC Port A Cluster 2 Loop B ID 00 LUN 0001 Array 1 Vol 001 Figure 2 97 Tabular View two volumes shared two not shared C
92. the main button panel from where we can access the viewing and configuration panels of the ESS Specialist Also from there we can connect to and troubleshoot the ESS Web Copy Service On the main window we can see the machine type machine model and serial number displayed Also we see the identification of the Fibre Channel ESS in the Fibre Channel fabric in the form of its World Wide Node Name WWNN Accepting the ESS site certificate By clicking on any one of the buttons to the left we are forced to login to the site If this is the first time that our browser is connecting to the ESS the browser will display a sequence of access security panels These are used to tell the browser that the site that it is pointing to should be considered as a secure site and that encrypted communication should be allowed The first two panels containing information on the site are shown in Figure 2 3 and Figure 2 4 New Site Certificate Netscape a Figure 2 3 New Site Certificate start window Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 79 New Site Certificate Netscape A Figure 2 4 New Site Certificate information window More information on the certificate including the certificate fingerprint and the time frame for which this certificate is valid can be displayed by pressing the More Info button as shown in Figure 2 5 X View A Certificate Netscape Figure 2 5 New Site Certificate More
93. the maximum number of FICON attachments is 16 That is the maximum number of host adapters you can configure in an ESS When you use an ESS host adapter to attach to FICON channels either directly or through a switch the adapter is dedicated to FICON attachment and may not be simultaneously attached to Fibre Channel protocol hosts When you attach an ESS to FICON channels through one or more switches the maximum number of FICON attachments is 128 per ESS adapter The directors provide very high availability with redundant components and no single points of failure or repair You can use the McDATA ED 6064 Enterprise Fibre Channel director or INRANGE FC 9000 Fibre Channel director You can use either director to attach Fibre Channel protocol hosts and devices in addition to the FICON hosts and devices For these configurations the Fibre Channel protocol hosts should communicate only with the Fibre Channel protocol devices The FICON hosts should communicate only with the FICON devices IBM recommends that you set up zones in the directors to guarantee that none of the Fibre Channel protocol hosts or devices can affect the FICON traffic When you attach FICON products to switches or directors note that switch cascading is not allowed You cannot configure a fabric of multiple interconnected directors and have a FICON channel attached to one director communicate to a FICON control unit attached to another director Chapter 1 Implementing Fib
94. to disable Copy Services Attention We recommend that you not disable Copy Services unless you are certain that there are no other options When you perform this function please be aware that You will lose any PPRC or FlashCopy tasks for which you have not received a successful completion message Established PPRC and FlashCopy relationships are maintained You cannot submit any additional command line interface CLI tasks until ESS Web Copy Services has initialized Disable ESS Web Copy Services server E For information on Trouble Shooting and Disaster Recovery see Copy Services Trouble Shooting and Disaster Recovery Figure 2 18 Tools help page Web Copy Services trouble shooting continued 2 1 4 Administer the ESS We will now introduce the administration of users on the ESS Using the User Administration panel Using the Users button we get the User Administration panel as shown in Figure 2 19 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 93 User Administration a User Permissions Total Users 1 no sort gt ine sort Y no sort 7 no sort Username tomah ministration DEFAULT ADMIN ID WILL BE REMOVED ee ee Figure 2 19 User Administration panel In our case there are no users configured other than the default user that we logged on with Using the Modify Users panel In the Modify Users panel as shown in Figure 2 20 we can add users with di
95. to the Gateway The data shown on the Gateway will have to be refreshed by selecting View gt Refresh SAN Data Gateway This will cause the updated data to be shown in the Specialist window The registration service will re register the host to the SAN Data Gateway at a default of 15 minute intervals This interval can be changed if so desired Previous to enabling the VPS feature you will have seen that the Specialist displayed a window similar to Figure 4 31 There is no key beside the Fibre Channel ports indicating that no host is recognized lt gt Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc File View Admin Tools Controls Help Q HB 9 113 24 246 febridge1 SAN Data Gateway lt SCSI Channel lt SCSI Channel lt SCSI Channel lt SCSI Channel No Data gt Fibre Channel gt Fibre Channel Figure 4 31 Specialist display without VPS enabled After the VPS is enabled and a host has registered with the Gateway all its information will load automatically into the database of the Gateway Figure 4 32 shows in the right hand side view pane the host name host type HBA and connection information and the unique WWN that was obtained automatically by host registration Chapter 4 Implementing the SAN Data Gateway 289 Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc Fie View Admin Tools Controls Help E 9
96. you can see the volumes by typing scu show edt To create the device special files type doconfig d No kernel rebuild is necessary When the ESS is configured ensure that you can see the disks from the Compaq system Wait for the system to restart or use the file command on the device special files During restart the following messages should be displayed emx0 at pcil slot 7 KGPSA BC Driver Rev 1 21 F W Rev 2 22X1 1 13 wwn 1000 0000 c922 d469 emx0 emx_assign_fcp_id nport at DID 0x21300 assigned tgt id 10 out of range for CAM scsil6 at emx0 slot 0 rz128 at scsil6 target 0 lun 0 LID 0 IBM 2105F20 1013 rzb128 at scsil6 target 0 lun 1 LID 1 IBM 2105F20 1013 rzc128 at scsil6 target 0 lun 2 LID 2 IBM 2105F20 1013 rzd128 at scsil6 target 0 lun 3 LID 3 IBM 2105F20 1013 rze128 at scsil6 target 0 lun 4 LID 4 IBM 2105F20 1013 rzf128 at scsil6 target 0 lun 5 LID 5 IBM 2105F20 1013 rzg128 at scsil6 target 0 lun 6 LID 6 IBM 2105F20 1013 rzh128 at scsil6 target 0 lun 7 LID 7 IBM 2105F20 1013 ooooooo When the host system completes the restart login as the root Use the file command to ensure that all the special files were created Use the file command to check the major number If there is a description of the disk you will not find the model of the disk Use the information from the output of the previous command or calculate the special file syntax This shows an example of what you see whe
97. 0 and F20 SC26 7295 IBM Enterprise Storage Server Host Systems Attachment Guide 2105 Models E10 E20 F10 and F20 SC26 7296 IBM Enterprise Storage Server SCSI Command Reference 2105 Models E10 E20 F10 and F20 SC26 7297 IBM Enterprise Storage Server System 390 Command Reference 2105 Models E10 E20 F10 and F20 SC26 7298 IBM Storage Solutions Safety Notices GC26 7229 Translated External Devices Safety Information SA26 7003 Electrical Safety for IBM Customer Engineers S229 8124 SLIC Router Installation and Users Guide 310 605759 SLIC Manager Installation and User Guide 310 605807 The JNI publications which are also relevant as further information sources are available on the Web at gt http www jni com Support installguides cfm These McDATA publications are also relevant as further information sources gt gt gt gt ED 5000 Director Planning Manual 620 005000 Enterprise Fabric Connectivity Manager User Manual 620 005001 ED 5000 Director User Manual 620 005002 ED 5000 Director Service Manual 620 005004 ED 6064 Director Planning Manual 620 000106 100 ED 6064 Director User Manual 620 000107 ED 6064 Director Installation and Service Manual 620 000108 Enterprise Fabric Connectivity Manager User Manual 620 005001 FC 512 Fabricenter Equipment Cabinet Installation and Service Manual 620 000100 ES 3016 Switch Planning Manual 620 000110 100 ES 3016 Switch User Manual 620 00011 1 Impl
98. 0 Implementing an Open IBM SAN To identify the ED 6064 to the EFC Manager to be managed we need to tell the EFC Manager the IP address of the ED 6064 This is accomplished by selecting Configure gt New product as shown in Figure 3 23 McDATA Enterprise Fabric Connectivity Manager Figure 3 23 EFC Manager New Product Selecting this takes us to the New Product entry field where we have to fill in the IP address of the director that we want to add This is shown in Figure 3 24 New Product Ea 9 113 25 247 Figure 3 24 Defining new ED 6064 with its IP address The ED 6064 was correctly installed in the network previously and now the EFC server can communicate with it Therefore the new director appears as an icon in the left area of the main window as shown in Figure 3 25 Chapter 3 Implementing a SAN with McDATA 201 McDATA Enterprise Fabric Connectivity Manager Figure 3 25 EFC Manager Product View new ED 6064 icon We can also see the IP address of the ED 6064 A green circle indicates that the switch is up and running with no known problems 3 3 5 Assigning nicknames to World Wide Port Names As with IP addresses and the DNS life can be made easier by defining nicknames for WWNs The names can be the DNS host name in the case of only one adapter in one host If there are more adapters in one device we recommend that the nickname should consist of the hostname and some extension to disting
99. 0 Lowest level of the Fibre Channel Physical standard covering the physical characteristics of the interface and media FC 1 Middle level of the Fibre Channel Physical standard defining the 8B 10B encoding decoding and transmission protocol FC 2 Highest level of the Fibre Channel Physical standard defining the rules for signaling protocol and describing transfer of frame sequence and exchanges FC 3 The hierarchical level in the Fibre Channel standard that provides common services such as striping definition FC 4 The hierarchical level in the Fibre Channel standard that specifies the mapping of upper layer protocols to levels below FCA Fiber Channel Association FC AL Fibre Channel Arbitrated Loop A reference to the Fibre Channel Arbitrated Loop standard a shared gigabit media for up to 127 nodes one of which may be attached to a switch fabric See also Arbitrated Loop FC CT Fibre Channel common transport protocol FC FG Fibre Channel Fabric Generic A reference to the document ANSI X3 289 1996 which defines the concepts behavior and characteristics of the Fibre Channel Fabric along with suggested partitioning of the 24 bit address space to facilitate the routing of frames FC FP Fibre Channel HIPPI Framing Protocol A reference to the document ANSI X3 254 1994 defining how the HIPPI framing protocol is transported via the fibre channel FC GS Fibre Channel Generic Services A reference to the document AN
100. 0 micron cable with duplex connectors When you use the 3023 adapter to perform a FICON channel attachment you must use the cables for FICON The adapters cannot be shared with any Fibre Channel protocol attachments Because the 3023 uses one of four slots in one of the four I O bays you can have a maximum of 16 adapters in the ESS This allows you to have a maximum of 16 FICON interface attachments If the attachments are all point to point you can attach directly to 16 FICON channels If you attach to a switch or director you can attach a maximum of 128 FICON channels per ESS FICON adapter For this scenario you must be able to attach to a number of hosts The ESS allows 256 logical paths per FICON link compared to just 64 for ESCON 128 logical paths per logical subsystem and 2048 logical paths for each ESS Before FICON you could only do a Fibre Channel connect for Fibre Channel protocol with feature code 3022 Feature code 3023 with a 9 micron single mode fiber optic cable increases the point to point distance from 500 m to 10 km The increased distance provides greater configuration options with IBM S 390 or zSeries processors with FICON host adapters 1 2 2 Attachment considerations This topic describes some things you should consider before you configure your system with a FICON interface 1 2 3 Setting up ESCON and FICON links If the system requires x ESCON links where x is the number of links to get the performance an
101. 00 Configure Operating Parameters Loop Mode This setting sacrifices the capabilities of the ES 1000 and should only be used when connecting legacy devices which do not support switched mode operations 3 5 Understanding the McDATA zoning concepts The advantage of a SAN and the accessibility of any storage anywhere raises issues which must be solved For example do we really want any device to have the ability to access all storage Zoning helps to split the SAN into logical parts by dividing a fabric into groups of node ports Members of a zone can only communicate with members in the same zone through port to port connections For instance zoning is used to separate groups of hosts with different operating systems from each other to prevent data used by one operating system from being corrupted by an accidental data transfer from another system Zoning is also used to separate part of the fabric for testing or for separating user groups for security and management reasons Another use of zoning could be the regulation of bandwidth by setting specific sets of node ports aside for use by tape devices for example Chapter 3 Implementing a SAN with McDATA 223 3 5 1 Zoning implementation There are different ways to implement the zoning for a fabric One difference is the enforcement of the zoning definitions For instance the enforcement is done through the name server table and the access to this information about connected node p
102. 01d4e FIBRE1 NT SesiPortt 1 1 0 Emulex 10000000 c920cae6 l New Host Data Original Host Data Close Host Name New Host Host Type NT v A Ch Host Connection pply Changes Host VV N Undo Changes Delete a Host Take Host Off Line Figure 4 50 Setting LUN access for the host FIBRE1 Once you select Apply Changes and then Close the new settings will be in effect For Windows NT to recognize the new devices it will have to be restarted so that it will do a rescan The SWITCH entry in the VPS database does not require any check marks to be set Because the WWN of the host is known and the switch WWPN is known LUN access is accomplished through the switch as if it was transparent Note LUN access is not only affected by the VPS and Zoning with the SAN Data Gateway there is also Zoning within the IBM SAN Fibre Channel Switch Be aware of the zone settings within the IBM SAN Fibre Channel Switch 306 Implementing an Open IBM SAN ESS considerations As you configure and allow access from host systems to volumes that are in the ESS through the Gateway you must consider how the volumes were created within the ESS Volumes in the ESS are assigned to a particular SCSI port in the ESS As they are assigned you also specify the host type that will access these volumes Through the SAN Data Gateway it is possible to assign volumes to a specific operating system in the E
103. 03 700004 L004 700005 LO05 TOOOO6 LOOGE T00007 LOO Available Drive Pool 35E68229 35E22D0B 35E69318 35E6848D 35E22D6C 35E6840E 35E68462 S5E6844E Drive Capacity MB Identify Add gt gt lt lt Remove Reset Composite Drive Members Capacity MB Cancel Figure 5 14 Composite Drive Member Selection window Chapter 5 Implementing the Vicom Fibre Channel SLIC Router From the Available Drive Pool list click a desired drive and then click the Add gt gt button The drive name will be added to the Member window An asterisk will appear on the left hand side of the drive that was selected in the Available Drive window to denote that the drive has been selected Each drive is added one ata time To remove a drive from the Member window select the desired drive and click the Remove lt lt button Below each window there is a Drive Capacity box As a drive is selected its capacity in megabytes is shown As you add more member drives to the Member window the Drive Capacity box will add all drive sizes together to provide a total capacity in megabytes This is shown in Figure 5 15 Composite Drive Setup Composite Drive Members Selection Available Drive Pool Composite Drive Members TOOOOOLOOD 35668229 T00001 35 22D0B T00001 L001 35E22D08 T00002 35E69318 T00002 L002 TO0003L003 35E6848D T00004L004 35E22D6C Identify TOOO05 L005 35E6840E T
104. 10 00 08 00 88 20 00 0F Operational Domain ID 3 View fa Configure Help aff Close i 9 113 25 245 9 113 25 246 Figure 3 85 Fabric Manager Topology View two switches defined and cascaded Moving the mouse cursor over the link indicates that the connection of the two switches consists of two ISLs Clicking either icon will open the Product Manager for the associated director We can also change the description of the icon by right clicking the ISL as shown in Figure 3 86 Close Display Options gt Product Name Network Address Domain ID O World Wide Nam X 9 113 25 245 9 113 25 246 Figure 3 86 Fabric Manager changing icon text Chapter 3 Implementing a SAN with McDATA 257 Currently we see the IP address displayed If the other connected switch was currently being accessed by means of another EFC server or it had not been defined to the EFC Server by its IP address the status will not be able to be determined by the our EFC Server Therefore the Topology View would look like that shown in Figure 3 87 lt 2 McDATA Fabric Manager OL x rit Topology View Fabric AWN Fabric Status Principal Switch McDATA 10 00 08 00 88 20 00 0F Operational Domain ID 1 View Pa Configure Help Close 9 113 25 246 Figure 3 87 Three switches cascaded one not defined to the EFC Manager We have put this only in for illustrat
105. 113 24 110 ITSO SAN Data Gateway current SAN Data Gateway ITSO lt 3 SCSI Channel 1 IP Address 9 113 24 110 lt 3 SCSI Channel 2 l a gt SCSI Channel 3 lt SCSI Channel 4 ee o z Fibre Channel 1 Channel Description Fibre Channel 4 Z Fibre Channel 4 gt Ms Fibre Channel Host 10000000 c922 1802 Host Name plymouth Host Type AIX Host Connection idewfscsi0 Oxef 0 Emulex Figure 4 32 Specialist after VPS enabled and host registration If no registration software is loaded on the host or is not available for a specific operating system for example a Fibre Channel switch only the WWN of the attached system will register to the VPS database all other fields will have unknown This is shown in Figure 4 33 PA Storwatche SAN Data Gateway Specialist 2000 Pathlight Technology Inc File View Admin Tools Controls Help Q E 9 113 24 110 ITSO SAN Data Gateway oS SCSI Channel 1 Current SAN Data Gateway ITSO gt SCSI Channel 2 IP Address 9 113 24 110 lt 3 SCSI Channel 3 a pees f Channel Description Fibre Channel 1 4 Fibre Channel 4 Fibre Channel Host 10000000 c921da0a Host Name unknown Host Type unknown Host Connection unknown Figure 4 33 Host system with no host registration software A diagram to depict the setup that was described is shown in Figure 4 34 Note that as the first dual Fibre Channel port on
106. 124 KB If the I O block size that you requested exceeds the default value the request is broken into more than one request The value should be tuned to the intended use and application requirements For maximum bandwidth set the maxphys parameter by adding the following line to the etc system file set maxphys 8388608 If you are using Veritas volume manager on the ESS LUNs you must set the VxVM max I O size parameter vol_maxio to match the maxphys parameter If you set the maxphys parameter to 8388608 add the following line to the etc system file to also set the VxVM I O size to 8 MB set vxio vol_maxio 16384 Emulex or QLogic adapters The following sections contain the procedures to set the Sun host system parameters for optimum performance on the ESS with the Emulex adapter 1 Type cd etc to change to the etc subdirectory 2 Back up the system file in the subdirectory 3 Edit the system file and set the following parameters for servers with configurations that only use Emulex adapters sd_io_time This parameter specifies the timeout value for disk operations Add the following line to the etc system file to set the sd_io_time parameter for the ESS LUNs set sd sd _io_time 0x78 sd_retry_count This parameter specifies the retrycount for disk operations Add the following line to the etc system file to set the sd_retry_count parameter for the ESS LUNs set sd sd_retry_count 5 maxphys This parameter specifies
107. 18486 Open System RAD Amy Device Adapter Pair 4 LSS 017 Chaster 2 Loop A 1 Vol 000 600 18486 Open System RAD Amy Device Adapter Pair 4 LSS 016 Chister 1 Loop amp 2 Vol 000 Modify Host Systems Configure Host Adapter Ports Configure Disk Groups Modify Volume Assignments Figure 2 84 FC port PC1_1 with two assigned volumes Now when we select the host FC port PC1_1 in the Host Systems field the associated volumes appear in the Assigned Volumes field with all the relevant details For host FC port PC1_2 the Assigned Volumes table is still empty Creating two more ESS logical volumes Now we do the same as we did before with the host FC port PC1_1 for PC1_2 We are going to create and assign two volumes of 64 GB one of them in disk group 1 and disk group 2 in loop B of the device adapter pair 4 This is done exactly like we did before with the host FC port PC1_1 so we only show the results Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 139 Viewing changes on the Graphical View panel Back on the Storage Allocation Graphical View panel we see how the panel now looks using the View All Storage mode shown in Figure 2 85 EseonNe PCII PC12 X TJ Dai Aai ai ai Figure 2 85 View All Storage mode The four areas in the four disk groups now represent the space that is used for ESS logical volumes We cannot see to which host FC port they are assigned To d
108. 2 Recommended Use inverted ALPA map and cause target assignment in private loop topology 2 Recommended for fabric Point to point mode only 4 Recommended for non fabric Arbitrated loop mode only zone rscn 0 Default 1 Recommended for fabric check name server for RSCNs In Table 1 9 we show the recommended configuration file parameters for the host bus adapters for the QLogic QLA2200F adapter Table 1 9 Recommended QLA2200F HBA settings Parameters Recommended settings a e r e 1 Clustered e SO 2 Direct connection C Chapter 1 Implementing Fibre Channel host adapter cards 43 1 9 16 Installing the IBM Subsystem Device Driver 44 The following instructions explain how to install the IBM Subsystem Device Driver from a compact disc You can use the IBM Subsystem Device Driver in conjunction with the IBM Copy Services command line interface program 1 Type ps ef grep vold to ensure that the volume manager is running This command displays the usr sbin vold process If it does not display type etc init d volmgt start 2 Insert the IBM Subsystem Device Driver CD into the CD ROM drive A File Manager window opens showing the paths for the Subsystem Device Driver package subdirectories Note You must be on the host console to see this window 3 Change to the subdirectory that contains the Subsystem Device Driver package a For Sun host hardware platforms limited to 32 bit mode and for all Sun ho
109. 2 seconds J Unsigned Java Applet Window Figure 2 54 Performing the port definition Implementing an Open IBM SAN A window appears which indicates that the configuration update was successful as shown in Figure 2 55 If the update had failed for any reason we would get an error message N Eg 1502 The Host Systern list was successfully modified ja Unsigned Java Applet Window Figure 2 55 Successfully added host FC port Pressing the OK button on this window will immediately take us back to the Open System Storage panel Viewing changes on the Open System Storage panel We now see the newly configured host FC ports in the Host Systems Table as shown in Figure 2 56 Open System Storage Attachment WWPN i O or high or high Assigned Volumes Total 0 volumes There are no volumes assigned to the currently selected host system Modify Host Systems Configure Host Adapter Ports Configure Disk Groups Modify Volume Assigamenis Figure 2 56 Fibre Channel host adapter port no volume assigned Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 121 122 As we select one of them we see that there are no ESS logical volumes currently assigned to the host FC ports Viewing changes on the Graphical View panel Now we would like to see what the Storage Allocation Graphical View panel looks like This is shown in Figure 2 57 EsconNet a BS a es OL es EL s
110. 200914 W Port Properties Eg Port Number Port Name Type Maintenance Technology Fibre Channel Address Port WN Attached Port WAN Block Configuration 10 100 km Configuration LIN Alerts Configuration Beaconing Link Incident Operational State Segmentation Reason Figure 3 43 Product Manager ED 5000 Port Card View Port Properties The other options to configure for example the operating mode the operating parameters and the ports are the same as with the ED 6064 so you can refer to 3 4 1 Managing the ED 6064 on page 205 for information on how to configure these 216 Implementing an Open IBM SAN 3 4 3 Managing the ES 3016 The Hardware View of the ES 3016 looks like that shown in Figure 3 44 ES 3016 _ oy x Hardware View ih ES 3016 Status Name jF J HEN Status Fully Operational Description Fibre Channel Switch State Online Location End User Premise please configure gt Configure z Oe ee AA AA SAA 2AA cA A 2AA CAA i A 15 13 tr LE FF mnm mnan man mnam mn ammm amn n mn an n amn an an mnn te emf He Front View Maintenance i Logs Po p 95 os TAE he a A m Power Supply Module Position 1 Rear View Cooling Fan Module Position 1 Figure 3 44 Product Manager ES 3016 Hardware View The other options available to configure for example the operating mode the operating parameters a
111. 2105 devices Chapter 1 Implementing Fibre Channel host adapter cards 13 After you install the ibm2105 rte file and all of the 2105 devices are reconfigured vary on the volume groups and remount the file systems The data on the file systems should be available again 1 4 4 Installing the 2105 host attachment package 14 Perform the following steps by using SMIT to install the IBM 2105 host attachment on your system Install the host attachment package from a compact disc or a diskette You must have superuser authority to complete the instructions Note The following procedure is an example The example uses dev cd0 for the address of the CD ROM drive Your address might be different 1 From your desktop window type smit install_update to go directly to the installation panel 2 Click Install and Update from the Latest Available Software and press Enter 3 Press F4 to open the Input Device Directory for Software window 4 Select the CD ROM drive that you are using for the installation for example dev cd0 5 Press Enter The Install and Update from the Latest Available Software window opens 6 Click Software to Install and press F4 7 Select Software Packages and press F7 The Install and Update from the Latest Available Software panel is displayed with the name of the software you selected to install 8 Check the default option settings to ensure that they are what you need 9 Press Enter to install the sof
112. 218 Implementing an Open IBM SAN iol x Hardware View ES 1000 Status Status Minor Failure State Online Description Fibre Channel Enterprise Connectivity Switch Bridge Port State Online Location End User Premise please configure Configure Name Front View Maintenance Properties Component Name Position Figure 3 46 Product Manager ES 1000 Hardware View failed fan module Configuring the FC ports The ES 1000 features eight H_Ports and one B_Port To configure the B_Port we select Configure gt Ports gt Bridge Port and get the Configure Bridge Port window shown in Figure 3 47 Configure Bridge Port X Name ISL to ED 6064 Blocked _ LIN Alerts V7 Figure 3 47 Product Manager ED 1000 Configure Bridge Port Chapter 3 Implementing a SAN with McDATA 219 Here the bridge port can be blocked and named and the LIN alerts can be disabled We already know that the name will show up in the Product Manager to identify the port A blocked bridge port just disables the connectivity of anything to the switch attached device to any fabric attached device To configure the hub ports we select Configure gt Ports gt Hub Ports and get the Configure Hub Ports window shown in Figure 3 48 Configure Hub Ports x Figure 3 48 Product Manager ED 1000 Configure Hub Ports We can name the ports and we can
113. 5 10 Disk drive properties Here you can see its SSA attributes its Fibre Channel attributes and its model type and serial number By clicking the Identify button the LED on the selected drive will begin to flash 5 4 2 Router properties To view the information on the Router go to the toolbar and select Properties gt SLIC Properties As shown in Figure 5 11 you will see the serial number of the Router its ID that was set in SW1 and its supported features 324 Implementing an Open IBM SAN SLIC Info Figure 5 11 SLIC Router properties 5 4 3 Setting Router to master As you move through the toolbar you may notice that most selections have been grayed out This is due to the fact that the Router is currently in a subordinate role and does not have access to create mirrors or composite drives This function is done by a Master Router There can be only one master in a SLIC loop This is used as more Routers and more disks can be added to the loop With several Routers in the same loop there needs to be a requirement where one system acts as the control and the others will follow and understand any configuration changes that may occur To set the Router into a master role select File gt Program Option from the top toolbar You will be presented a dialog box as shown in Figure 5 12 Program Option m E Figure 5 12 Setting the Router to master Chapter 5 Implementing the Vicom Fibre Channel SLIC Ro
114. 5 8 2 Creating the mirror 0 cece eee 345 5 8 3 Viewing mirror drive using composite drives 346 5 9 Reusing logical drives 0 0 et tee 347 5 9 1 Remove a logical drive 2 cee ee 347 5 9 2 Mapping a general spare 2 cee ee 349 5 9 3 Removing a mirror containing composite drive 349 5 10 Expanding the SLIC system 000 e eee eee 351 5 1021 Adding diSk 22 ace cae ee eo ae eae ae ee ae aa 351 5 10 2 Adding Routers 0 cece eee 351 5 10 3 Adding hosts 0 00 eee ee 354 Related publications 0 00 c eee es 355 IBM REGDOOKS isthe see Pag ie SA bee eae Ee AY be ae 355 Other resources 1 eee 355 Referenced Web sites 0 cc eee eee eee eee 358 How to get IBM Redbooks 0 0 cece eee 359 IBM Redbooks collections 0 000 eee eee eee 359 Special noticeS 0 tee 361 GIOS a ies soho ee ee ae NA ek BER lee ee eS 363 Nde is a ei ea Bee a be a Ga E a Ga oi Es a ee Abe a aaa 375 viii Implementing an Open IBM SAN Preface Do everything that is necessary and absolutely nothing that is not In this IBM Redbook which is an update and major revision of the previous version we have tried to consolidate as much of the critical information as possible while covering procedures and tasks that are likely to be encountered on a daily basis Each of the products described has m
115. 70 Implementing an Open IBM SAN As we can connect to several SAN Data Gateway systems from one client session select the particular Gateway you want and it will be highlighted in blue as shown in Figure 4 7 EA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc File View Admin Tools Controls Help Current SAN Data Gateway fcbridge1 3 mA eNOS Data Gateway World Wide Node Name 10000060 450D00BF IP Address 9 113 24 246 Serial Number 100012 Firmware Revision 3 40 10 Health Check Level 2 Health Check Interval 60 Log Size 214 Receive Event Traps Enabled Serial Baud Rate 19200 RID Tag 100012 Figure 4 7 Selecting from multiple SAN Data Gateways On the left hand side of the highlighted Gateway there is a small key and by selecting this it expands the view to show you all SCSI ports and installed Fibre Channel ports For example Figure 4 8 shows a Gateway with four SCSI ports and two Fibre Channel ports EA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc iof x File View Admin Tools Controls Help Current SAN Data Gateway ITSO o m scsI Channel 1 World Wide Node Name 10000060 45160E08 lt 3 SCSI Channel 2 IP Address 9 113 24 110 gt SCSI Channel 3 i S SCSI Channel 4 Serial Number 21081300724 T Fibre Channel 1 Firmware Revision 3 40 10 Fa Fibre Channel 4 Health Check Level 2 m Health Check Interval 15
116. 84 iSeries configurations 10 iSeries FC host 8 iSeries host system 8 ISL 207 246 250 258 372 ISL connections 251 J JBOD 109 115 JNI adapters 45 JNI FC64 1063 42 JNI FCI 1063 42 JNI PCI adapter 35 JNISBUS 36 Just a Bunch Of Disks 109 L LIC 88 LIC level 164 Licensed Internal Code 88 link extender 3 link incident 212 locating WWPN 69 logical drives 312 347 logical subsystems 4 logical unit number 162 Logical Volume Manager LVM 246 248 login 81 logon EFC manager 194 long wave ports 263 Loop 298 loop mode 222 LP8000 32 LUN 162 LUN access 305 LUN affinity 4 LUN masking 263 295 310 354 LUN support 284 LUNs 4 M Mapping a general spare 349 Mapping Physical Drives 314 mapRebuildDatabase 285 mapShowDatabase 294 mapWinnowDatabase 285 Master Failover 353 Index 377 Master Router 325 maximum distance 3 MC ServiceGuard 25 McDATA 175 McDATA define users 197 McDATA Enterprise Director ED 5000 175 McDATA Enterprise Fibre Channel Director 307 McDATA network 188 McDATA zoning 223 McDATA zoning concepts 223 MIB files 190 Mirror Capacity 334 mirror capacity 342 Mirror drive 342 mirror drive 332 Mirror Drive Dedicated Spare 334 Mirror Drive Properties 336 Modify Host Systems 117 Modify Users 94 multiple controllers 6 multiswitch fabric 246 249 254 multiswitch fabric solutions 246 multiswitch fabrics 251 N Name server enforced zoning 224 naming convention 159 Netscape 77
117. A PC running a terminal emulation program such as Windows HyperTerminal or NETTERM can be used The settings of the Service port are 19200 baud 8 data bits No parity 1 stop bit X on X off flow control VT 100 compatible terminal vvvvvy Chapter 4 Implementing the SAN Data Gateway 263 If a PC with terminal emulation is used a 9 pin female to 9 pin female null modem cable is required and is provided with the unit Once connected power on the SAN Data Gateway and the start up messages will appear and scroll across the window When the power on sequence has completed a prompt Gateway gt appears on the window as shown in Figure 4 3 3 sdg HyperT erminal File Edit View Call Transfer Help value 1 Oxffffffff esSrveInit value 0 0x0 amemInit Testing DDF PCI 0 DMA PageX Testing DDF PCI 1 DMA PageX Test PASSED Amem interrupt handler installed value 0 Ox0 sesintInit SAN Gateway Version 0340 Built Dee 23 1999 15 47 13 Gateway Oxclfce690 tShell VPS Feature NOT Enabled Data Mover is Disabled SCSI 3 DE Terminated SCSI 1 DE Terminated SCSI 4 DE Terminated SCSI 2 DE Terminated value 4444 OxlliSe lt e Done executing startup script ffs0 sna re Service Port Reflected Signal Test Starting shell Gateway gt Figure 4 3 IBM Storage Area Network Data Gateway startup If you type in help and then press Enter a list of available commands is provided
118. AN Also the EFC Manager serves as the entry point to the programs for managing the McDATA devices as well as the fabric that is built up using these devices The configuration programs needed for those tasks the Product Managers and the Fabric Manager are accessed through the EFC Manager In the following topics we access the EFC Manager and perform some of the administration tasks that have to be accomplished using the EFC Manager before we move on to the management of the devices and the fabric Chapter 3 Implementing a SAN with McDATA 193 3 3 1 Logging in to the EFC Manager The following administration and configuration steps can be done locally from the EFC Server or remotely using the workstation where we have just installed the EFC Manager client code Logging in to the EFC Manager on the EFC Server We logon to Windows NT on the EFC Server with the user ID Administrator and the password password both of which are case sensitive After logging on to Windows NT we get the login window for the Enterprise Fabric Connectivity Manager EFC Manager which is installed and operational on the system To start the EFC Manager we log on with the same user ID and password we used when logging on to Windows NT Administrator and password We are working locally on the EFC server and therefore we specify in the EFC Host Server entry field localhost which is shown in Figure 3 15 EFC Manager Login Administrator localhost M
119. BM TotalStorage Enterprise Storage Server 2105 F20 shown in Figure 2 1 First we introduce the ESS Web Interface including the functions to maintain configure and administer the ESS Then we perform storage configuration We describe the configuration for an ESS using RAID 5 for use in a Fibre Channel environment These functions are described in a task oriented manner We start with an unconfigured ESS and explain the configuration steps as we progress through our configuration The final goal is to gain access to the volumes from Fibre Channel attached hosts In greater detail we cover the configuration of the ESS disk groups host Fibre Channel ports host FC ports ESS Fibre Channel ports ESS FC ports and the ESS logical volumes to be accessed from the host FC ports We also modify volume assignments and make changes to the host FC port definition Copyright IBM Corp 2001 75 For further information on the configuration of the ESS especially for ESCON and SCSI attachment and the ESS Web Copy Services refer to the ESS documentation as described in Related information For more information on the ESS see these references on page 172 Figure 2 1 Enterprise Storage Server 76 Implementing an Open IBM SAN 2 1 Introducing the ESS Web Interface The Java based Web interface consists of two consoles the IBM TotalStorage Enterprise Storage Server Specialist ESS Specialist and the IBM TotalStorage Ente
120. Bay 1 Card3 Device Adapter Pair 4 FC Port A Cluster 2 Loop B ID 00 LUN 0001 Array 1 Vol 001 Figure 2 112 Tabular View four volume assignments three volumes Here we see that there is no longer any assignment for the volume we unassigned Unassigned volumes only show up in the Volume Assignments table in the Modify Volume Assignments panel Now as we have ESS logical volumes assigned to host FC ports and we have also made adjustments to the configuration there is only one step left to be performed 2 7 Configuring ESS FC ports The only configuration part left to enable us to access the volumes is the configuration of the ESS FC ports for the topology that the ports are going to connect to This configuration step does not depend on any other configuration so we left it until we had finished the volume configurations 158 Implementing an Open IBM SAN As we already know the selection of an entity in the Storage Allocation Graphical View panel changes the information in the Information frame of the panel Clicking on an icon of an ESS FC port in the ESS interfaces row displays information about the adapter There we see the physical location in the ESS the topology the port is configured for and the WWPN For any ESS FC port that we have not configured the window looks like that shown in Figure 2 113 Information L dapter Type FC host attachment I0 Bay i Adapter 3 Port A WWPN 1000000009251126 T
121. Because of this we can choose by selecting between Fibre Channel Point to Point and Fibre Channel Arbitrated Loop If a port is already configured for one topology and it has to be changed to another the port must first be undefined Then it is possible to choose the appropriate topology We can choose between Fibre Channel Arbitrated Loop for FC AL and Fibre Channel Point to Point for FC PP and for FC SW Some adapters for example the IBM FC6227 operate in arbitrated loop mode even though they are directly connected to an ESS This means that the ESS port will have to be configured in FC AL mode Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 167 As we have selected the topology for the selected ESS FC port we see a small red line directly below the icon of the just defined ESS FC port as shown in Figure 2 124 Reset Selected Port Fibre Channel Point to Point Figure 2 124 ESS FC port for Point to Point defined This indicates that the port definition has been changed We can now go on and select and define the other ports The red lines will remind us where we made definition changes Now we go on and define port three in bay four for FC SW and adapter three in bay two for FC AL The panel then indicates us what port definitions have been changed as shown in Figure 2 125 168 Implementing an Open IBM SAN Configure Host Adapter Ports a Host Adapter Port Buy 2 Adapter 3 Port A FC gt
122. Channel adapters The maximum number of Fibre Channel adapters supported is 16 for a total of 16 Fibre Channel ports 1 4 2 Installing the 2105 host attachment package This section provides the instructions to install the host attachment package for the ESS on your host system IBM recommends that you run the host attachment package on each host system attached to the ESS for which an installation script is provided Before installing the 2105 host attachment package Perform the following steps before you install the host attachment package 1 Attach the ESS to your host system See Attaching an ESS to an open systems host with SCSI adapters Turn on the host system and all attachments Ensure that you have root access Ensure that you have administrator knowledge ao fF oO Ensure that you have knowledge of the System Management Interface Tool SMIT 1 4 3 Replacing an older version of the 2105 installation package If you want to replace an older version of the host attachment package tar version and have data that exists on all configured 2105 disks the code prompts you to remove all ESS product related hdisk devices Perform the following steps to remove the devices 1 Run the umount command on the file system For example type umount t x where x is the file system name 2 Run the varyoffvg 2105 command for the volume group For example type varyoffvg s VGname 3 Type rmdev d1 on the command line to unconfigure the
123. E Emulex 10 00 00 00 C9 20 CA E6 Emulex 10 00 00 00 C9 20 E7 F3 Heip JAX Zone_1 Emulex 10 00 00 00 C9 20 DC 71 A Emulex 10 00 00 00 C9 20 E7 C7 KATE_FCSO Close R D Save active zone set as Deactivate zone set Figure 3 89 Active Zone Set corresponding to Figure 3 79 on page 250 We have now successfully completed all the steps necessary to cascade a McDATA switches with zoning 260 Implementing an Open IBM SAN Implementing the SAN Data Gateway In this chapter we describe the steps involved in planning and implementing the IBM Storage Area Network Data Gateway 2108 G07 The SAN Data Gateway is a hardware solution to allow connection of Fibre Channel ready host systems to attach to SCSI storage systems Copyright IBM Corp 2001 261 4 1 SAN Data Gateway The IBM Storage Area Network Data Gateway is an essential component of the SAN infrastructure It provides several benefits to bridge the legacy gap as storage products migrate from SCSI based attachments to Fibre Channel A diagram to show a SAN Data Gateway configuration using a single host is shown in Figure 4 1 Server fi Fibre Channel Gateway ooo F SCSI ESS Figure 4 1 SAN Data Gateway configuration The IBM Storage Area Network Data Gateway allows y
124. ESS logical volumes assigned to them on this disk group now show up in the host interfaces row and are also highlighted yellow In our case only the host FC port PC1_1 has a volume on this disk group assigned to it and therefore there is only the icon of this port visible Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 137 138 Again the Information frame changed the look to represent the general information of the disk group and is still not related to a specific host FC port The used space now shows up in the Assigned row instead of the Host Storage row This is shown in Figure 2 83 Information Disk Group 2 Storage Type RAID Array Track Format Fixed Block FB Host Storage 0 00 210 48GB 08 Assigned 16 10 210 48GB 8 Unassigned 0 00 210 48GB 0 Not Allocated 194 35 210 48GB 924 Figure 2 83 Information frame disk group selected Now we want to go on and define more volumes and assign them to the host FC port PC1_2 Viewing changes on the Open System Storage panel To perform this task we navigate all the way back to the Add Volumes panel From the Storage Allocation Graphical View panel we press the Open System Storage button Open System Storage This takes us to the Open System Storage panel as shown in Figure 2 84 Implementing an Open IBM SAN Open System Storage PC12 T Server Win NT 4 0 TEES aa or high Total 2 volumes uss Shared 7000
125. ESS means deleting the host FC port definition and its access profile 2 7 2 ESS managed ESS FC port WWPNs 164 Beginning with LIC level LBLD0312 there is a new function that allows the ESS to locally administer the WWPNs for the ESS FC ports This means the ESS FC ports will have WWPNs which do not change when replacing an adapter This is especially useful if SDD is used for multipathing and when zoning is implemented using the WWPNs of the ESS FC port Activating the WWPN naming convention The activation of this feature for all of the ESS adapters requires a 45 minute nonconcurrent service action and must be carried out by an IBM CE Once this feature has been activated by the CE this is done from the service menu by selecting 1 Select Configuration Options Menu 2 Select Change Show Control Switches 3 Fibre Channel WWPN Method Standard should be displayed and if so press the Enter key 4 Press PF4 select WWNN and then press Enter 5 When instructed IML the ESS From the time of activation onwards all built in ESS FC ports and all new ESS FC ports will have the locally administered WWPNs However even if the feature is not activated any replaced or added adapters will adopt the new locally administered WWPN Host and switch considerations After the CE has performed this service action and the naming convention has been successfully changed from Standard to WWNN there are some actions that will need to be pe
126. Emulex 10 00 00 00 C9 20 E7 C7 KATE_FCSO Emulex 10 00 00 00 09 20 E7 F3 Figure 3 75 Two zones in one zone set 244 Implementing an Open IBM SAN To apply the changes in the zone set we must activate it by selecting Actions gt Activate as shown in Figure 3 75 By activating or deactivating this zone set we activate or deactivate both zones at the same time After confirming that we want to start the activation and clicking OK on the resulting message we now have both zones active This is reflected in the Zoning View with an Active Zone Set which looks like that shown in Figure 3 76 lt 2 McDATA Fabric Manager OLX i Zoning View Default Zone Enabled View ctive Zone Set RA ITSO_Zone_Set_1 AINT_Zone_1 RPKAS3_C1B2A1 GLogic 20 00 00 E0 88 00 52 5E E Emulex 10 00 00 00 09 20 CA E6 AIX_Zone_1 Halip Emulex 10 00 00 00 C9 20 DC 71 Emulex 10 00 00 00 09 20 E7 C7 Configure 4i KATE_FCSO Emulex 10 00 00 00 C9 20 E7 F3 Close Save active zone set as N Deactivate zone set Figure 3 76 Fabric Manager with two zones shown We have now successfully created and activated a zone set with two zones Chapter 3 Implementing a SAN with McDATA 245 3 7 Building a multiswitch fabric The focus of McDATA is highly available connectivity in a data centric approach where the director was the core for connectivity of nodes However times changed beginning with the E_
127. FC node ports as zone members can be mixed Also node ports specified by their WWPN or switch ports specified by their number can be members of more than one zone 3 5 3 Zone management with zone sets From within the McDATA Fabric Manager we can specify up to 64 zone sets A zone set is a group of zones that can be activated and deactivated at the same time Each zone set can contain a maximum of 1023 zones and each zone can contain a maximum of 4096 members Only one zone set can be active at one time Activating an inactive zone will inactivate the currently active zone set Node ports that are not configured in a zone within the active zone set are considered as members of the default zone this makes up for a maximum of 1024 active zones The default zone can be disabled independently from the active zone Also if no zone sets are activated all node ports are in the default zone If the default zone is disabled while no zone set is active no node ports can communicate With the default zone enabled it is possible for all node ports in the default zone to communicate with each other in parallel to the currently active zone set Zone sets can be used to save different configurations for different tasks for example if we want to have certain node ports in the same zone for backup but not during normal operation Chapter 3 Implementing a SAN with McDATA 225 Our zoning example An example of how zones and zone sets are related is shown
128. FC port PC1_1 has volumes assigned to it on all four disk groups as shown in Figure 2 95 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 147 Figure 2 95 PC1_1 and ESS FC port selected In fact there is no volume configured on the ESS which is not assigned to this port This is indicated by the lack of any colored space on the disk group apart from the color of purple for the selected host FC port assigned volumes or green for unused space When a host FC port is selected there is no indication that two of the volumes are shared between both the defined host FC ports To see if ESS logical volumes are shared we have to select a disk group In Figure 2 96 we see a disk group selected that contains assigned volumes 148 Implementing an Open IBM SAN q Pell PCL gt EE EE EE EEE Figure 2 96 Disk group containing shared ESS logical volume s selected The red color indicates that it contains volumes that are assigned to the host FC ports that show up highlighted yellow in the host interfaces row When we compare this with Figure 2 95 we see that the amount of space used for this disk group is the same Also when we select the host FC port PC1_2 we will see the same amount of storage assigned to it which tells us that the volumes must be shared between the two Viewing changes on the Tabular View panel If we click on the Tabular View button and get
129. Figure 2 71 Volume Attributes frame ESS logical volume size of 16 2 GB selected 130 Implementing an Open IBM SAN Instead we use a volume size of 16 1 GB which allows us to place 26 of them in our selected disk groups To illustrate the process we only want to define two volumes here We enter the number of volumes in the entry field as shown in Figure 2 72 Volume Atiributes Select a Volume Size Number of Volumes Enter 1 to 26 2 Storage Type RAID 5 Array Figure 2 72 Volume Attributes frame ESS logical volume size of 16 1 GB selected Adding volume definitions to the New Volumes frame We press the Add button to place the two volumes in the New Volumes frame The volumes are now shown in the New Volumes Panel as shown in Figure 2 73 We could also add other volumes with different sizes to the list New Volumes i swe RAD a _lis19 62 ___lraws ary 34 00 GE 4 4 00 GB a Figure 2 73 New Volumes frame two volumes selected to be removed from frame Removing volume definitions from the New Volumes frame To remove unwanted changes from the list we simply highlight those volumes that we wish to remove from the list and press the Remove button Remove Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 131 Placing the volumes in selected disk groups Now as we have defined how many volumes and of what size we want to add we can also decide how the selected space should be us
130. Firmware upload has completed Do you want to restart the SAN Data Gateway Cape ne Figure 4 23 Message prior to restarting the SAN Data Gateway Chapter 4 Implementing the SAN Data Gateway 281 282 As restarting the SAN Data Gateway is a disruptive process the Specialist issues a warning as shown below in Figure 4 24 FA Warning Q Restarting the SAN Data Gateway may disrupt other user activity on this SAN Data Gateway Do you want to continue anyway Yep _no _No Figure 4 24 Warning message prior to restarting the SAN Data Gateway The Specialist will now return to the main screen and a message is displayed at the bottom of the screen as shown in Figure 4 25 indicating that the Gateway is in the process of restarting SEES EA StorWatch SAN Data Gateway Specialist 2000 Pathlight Technology File View Admin Tools Controls Help Current SAN Data Gateway Gateway World Wide Node Name 10000060 4516 IP Address 193 1 1 25 Serial Number 21081300937 Firmware Revision 3 41 31 Health Check Level 2 Health Check Interval 60 Log Size 2047 Receive Event Traps Enabled Serial Baud Rate 19200 Cr SAN Data Gateway 193 1 1 25 Restarting Please wait le Figure 4 25 SAN Data Gateway now restarting Implementing an Open IBM SAN Once the restart process is completed the Specialist displays the prompt shown in Figure 4 26 be
131. G_Port Generic Port a generic switch port that is either a Fabric Port F_Port or an Expansion Port E_Port The function is automatically determined during login Gateway A node on a network that interconnects two otherwise incompatible networks Gb s Gigabits per second Also sometimes referred to as Gbps In computing terms it is approximately 1 000 000 000 bits per second Most precisely it is 1 073 741 824 1024 x 1024 x 1024 bits per second GB s Gigabytes per second Also sometimes referred to as GBps In computing terms it is approximately 1 000 000 000 bytes per second Most precisely it is 1 073 741 824 1024 x 1024 x 1024 bytes per second GBIC GigaBit Interface Converter Industry standard transceivers for connection of Fibre Channel nodes to arbitrated loop hubs and fabric switches Gigabit One billion bits or one thousand megabits GLM Gigabit Link Module a generic Fibre Channel transceiver unit that integrates the key functions necessary for installation of a Fibre channel media interface on most systems Half Duplex A mode of communications allowing either transmission or reception of frames at any point in time but not both other than link control frames which are always permitted Hardware The mechanical magnetic and electronic components of a system e g computers telephone switches terminals and the like HBA Host Bus Adapter HIPPI High Performance Parallel Interface An ANSI stan
132. Implementing an Open IBM SAN Featuring the McDATA Portfolio Discover the latest additions to the IBM SAN family Enhance your skills while using an easy to follow format Grow with the new technology Jon Tate Brian Cartwright Sven Eichelbaum Thomas Jahn ibm com redbooks Red b ooks International Technical Support Organization Implementing an Open IBM SAN Featuring the McDATA Portfolio December 2001 SG24 6414 00 Take Note Before using this information and the product it supports be sure to read the general information in Special notices on page 361 First Edition December 2001 This edition applies to those IBM SAN hardware and software products described herein Comments may be addressed to IBM Corporation International Technical Support Organization Dept QXXE Building 80 E2 650 Harry Road San Jose California 95120 6099 When you send information to IBM you grant IBM a non exclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you Copyright International Business Machines Corporation 2001 All rights reserved Note to U S Government Users Documentation related to restricted rights Use duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corp Contents Preface 24 220 52 45 wee balay tet etl oe eee eee Oe aed Aa ix The team that wrote this redbook
133. Info window 80 Implementing an Open IBM SAN After closing the Information window we are asked about our decision to accept the certificate or not and if we would like to accept the certificate until it expires This is shown in Figure 2 6 pa New Site Certificate Netscape a Figure 2 6 New Site Certificate Accepting the certificate Logging in with the default user After completing the certification check the Login Window shown in Figure 2 7 will display The default user is storwatch and the default password is specialist Both are case sensitive and must be entered in lower case For security reasons it makes sense to change the default user and password to prevent unauthorized access Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 81 Username and Password Required x Enter username for EnterpriseStorage authorization at ospl8c0 sanjose ibm com User Name fstowatch Figure 2 7 Site login window The session will be valid as long as any browser window is open Therefore when the work has been performed and security is important we suggest closing the browser to log off from the ESS specialist Be aware that a problem within the browser could keep the browser process running even when all browser windows are closed This could lead to the possibility of unauthorized personnel accessing the ESS with the Web interface A reboot or a new logon to the workstation would solve the problem but
134. Intermix A mode of service defined by Fibre Channel that reserves the full Fibre Channel bandwidth for a dedicated Class 1 connection but also allows connection less Class 2 traffic to share the link if the bandwidth is available 1 0 Input output IP Internet Protocol IPI Intelligent Peripheral Interface Isochronous Transmission Data transmission which supports network wide timing requirements A typical application for isochronous transmission is a broadcast environment which needs information to be delivered at a predictable time JBOD Just a bunch of disks Jukebox A device that holds multiple optical disks and one or more disk drives and can swap disks in and out of the drive as needed L_Port Loop Port A node or fabric port capable of performing Arbitrated Loop functions and protocols NL_Ports and FL_Ports are loop capable ports LAN See Local Area Network A network covering a relatively small geographic area usually not larger than a floor or small building Transmissions within a Local Area Network are mostly digital carrying data among stations at rates usually above one megabit s Latency A measurement of the time it takes to send a frame between two locations LC Lucent Connector A registered Trademark of Lucent Technologies Link A connection between two Fibre Channel ports consisting of a transmit fibre and a receive fibre Link_Control_Facility A termination card that handles the logical and phy
135. LED will flash code 100 Power off the Router 9 Clear the node map Once completed the node map must be cleared This is done as described earlier by shorting ports A1 and A2 with an SSA cable Power on wait for code 060 to flash and then power off The drives are now ready to be assigned and used on a host You can also now setup mirror drives or composite drives within the Router This is done by setting the switches in SW2 to other modes For detailed information on setting the switches and selecting the other modes please refer to the SLIC Router Installation and Users Guide 310 605759 10 Perform host attach and power up sequence For a host to now recognize and use the disks set the dip switches in SW2 back to mode 3 this is normal host operation mode The Fibre Channel cable from the host can be connected to the Router If the SSA drives are not powered on do this now and this should be done before the Router Next the Router is powered on wait for the Status LED to stop flashing and remain on solid At this point the host can be powered on A check can be done to see that the SLIC Router is being recognized by the host adapter card On a Windows NT with a QLogic Fibre Channel adapter during boot up look for a prompt to enter the QLogic bios by entering in ALT Q At the BIOS window select Scan Fibre Devices A list of the Fibre Channel target IDs are presented scroll down to the ID that you set in SW1 You will see th
136. M sales representative 1 5 1 Attachment requirements This section lists the requirements for attaching the ESS to your host system Either you or an IBM service support representative SSR must perform the following tasks to install and configure an ESS 1 The IBM SSR installs the IBM ESS by using the procedures in the IBM Enterprise Storage Server Service Guide 2 Either you or the IBM SSR defines the Fibre Channel host system with the worldwide port name identifiers For information about how to locate the worldwide port name for an xSeries or an NUMA Q host system see 1 12 Locating the worldwide port name on page 69 3 Either you or the IBM SSR defines the Fiber Channel port configuration if you did not do it during the installation of the ESS or Fibre Channel adapters Note Use the information on the logical configuration work sheet in the IBM Enterprise Storage Server Configuration Planner that you previously filled out 4 Configure your host system for the ESS by using the instructions in your host system publications 1 5 2 xSeries and NUMA Q system requirements The ESS is supported on the xSeries and the NUMA Q host systems by a module of code that is incorporated into Service Pack 3 for PTX V4 5 2 To install Service Pack 3 16 Implementing an Open IBM SAN 1 Insert the Service Pack 3 compact disc into the CD ROM or CD R drive 2 Open the README file for instructions on installing Service Pack 3 In Ta
137. N value 69 X xSeries FC attachment 15 Z Zip drive 183 zone library 231 Zone management 225 Zone member definition 224 zone set 230 237 Zoning 286 296 306 zoning 202 263 310 Index 379 380 Implementing an Open IBM SAN Implementing an Open IBM SAN Featuring the McDATA Portfolio Redbooks llnn 2 0 5 spine 0 475 lt gt 0 875 250 lt gt 459 pages Implementing an Open IBM SAN Featuring the McDATA Portfolio Discover the latest additions to the IBM SAN family Enhance your skills while using an easy to follow format Grow with the new technology Do everything that is necessary and absolutely nothing that is not In this IBM Redbook we have tried to consolidate as much of the critical information as possible while covering procedures and tasks that are likely to be encountered on a daily basis Each of the products described has much much more functionality than we could ever hope to cover in just one redbook The IBM SAN portfolio is rich in quality products that bring a vast amount of technicality and vitality to the SAN world Their inclusion and selection is based on a thorough understanding of the storage networking environment that positions IBM and therefore its customers and partners in an ideal position to take advantage by their deployment In this redbook we cover the latest additions to the IBM SAN family focusing on the products from McDATA We sh
138. OOOO6 LOO6 35E68462 T00007 LOO 35E6844E lt lt Remove __eset_ Reset Drive Capacity MB Capacity MB a on lt Back Next gt Cancel Figure 5 15 Creating composite drive from available drives 328 Implementing an Open IBM SAN When all the desired drives are added click Next gt The Assigning Properties window opens as shown in Figure 5 16 Composite Drive Setup Wizard Assigning Composite Drive Properties oe lt Back Nen canes Figure 5 16 Assigning Composite Drive Properties window The properties that can be changed are the FC LUN and the Drive Name There will be a suggested LUN number in this field that can be accepted If not simply type in the desired LUN number The name can also be defined to the composite drive for easier identification with a limit of up to eight characters The Initialization Method box refers to whether or not to allow the operating system to write its signature on the composite drive Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 329 330 Click the Next gt button and a dialog box will appear as shown in Figure 5 17 to allow you to create another composite drive Click Yes If you would like to create another composite drive and the Composite Drive List window opens and the steps described above can be repeated Composite Drive Setup Wizard ex eme Figure 5 17 Completing the Comp
139. PN it will only see the volumes for which it is configured Once a host FC port is configured there are no differences TSO PC SUNW1 SUN kate fcs0 kate fes shok20cl gt 3307700 Figure 2 119 Anonymous host FC port icon in an ESS configured for Access_Any Understanding access profiles Whichever access mode is chosen any host FC port that has an access profile can access only those volumes that are defined in the profile Depending on the capability of the particular host operating system an access profile can contain up to 256 or up to 4096 volumes The setup of an access profile is transparent to the user when using the ESS Specialist to configure the host FC ports and ESS logical volumes in the ESS Configuration actions that affect the access profile are gt Configuring the host FC port in the ESS with its WWPN creates the access profile for that host FC port Initially the profile is empty That is it contains no ESS logical volume assignments The host FC port cannot access any ESS logical volumes that are already defined in the ESS Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 163 gt Adding new ESS logical volumes to the ESS the new volumes go to the host FC port that is selected gt Assigning ESS logical volumes to host FC ports means adding them to the access profile of the selected host FC port and to pre existing ESS logical volumes Removing a host FC port from the
140. Port capability of the McDATA G_Ports ED 5000 Now with their new core to edge product line of directors and switches they have paved the way to a more flexible distributed approach 3 7 1 Multiswitch fabric considerations 246 The planning of multiswitch fabrics depends on many things Are we going to have a local SAN in one site with up to 64 node ports connected Then we might not consider cascading our switches If we want to build a SAN to connect two sites together or if we want to have more ports in a single footprint cascading becomes a valued commodity Also if we want to extend the SAN to provide departmental user groups with access to centralized storage devices or to establish a centralized backup which does not affect the LAN cascading becomes a necessity Nevertheless we still might think about whether or not or to what extent we want to cascade switches The reason for this is that by using E_Ports we will sacrifice F_Ports Also with an extended fabric the ISLs can possibly become a bottleneck This will lead to the use of more ISLs which means even fewer F_Ports available for the attachment of devices That which seems easy in the first instance can get more complicated once we add the zoning concept load balancing and any bandwidth issues that may appear Examples for multiswitch fabric solutions There are many solutions which are only possible by using a multiswitch fabric For example disaster tolerant soluti
141. SAN Data Gateway Once a device has been assigned a LUN ID by the Gateway it will maintain that ID since it was written into the device map This is useful in case the device is lost or needs to be replaced Remove the old device set the new device to the same SCSI bus target and LUN as the old device and attach it to the same channel You must rescan the SAN Data Gateway SCSI bus for it to update its data You will notice that the replaced device has kept the same assigned LUN If a device is no longer attached or no longer required then the assigned LUN is also no longer required To free up this assigned LUN ID you can issue the mapWinnowDatabase command from the service terminal The existing devices will maintain their assigned LUN IDs If a complete rebuild of the SCSI device map is desired or required this can be done from the service terminal only You would issue the mapRebuildDatabase command This command deletes the existing device map and the SAN Data Gateway will restart When it is rebooted a new scan of the SCSI buses is done as if the system was brand new and LUN IDs will be assigned as described earlier Chapter 4 Implementing the SAN Data Gateway 285 When this command is issued you will also be given an option to clear the Virtual Private SAN VPS access settings Because this allows host access to specific LUNs and by issuing this command we may change the assigned LUN ID it is recommended that you always say Yes
142. SI X3 289 1996 describing a common transport protocol used to communicate with the server functions a full X500 based directory service mapping of the Simple Network Management Protocol SNMP directly to the Fibre Channel a time server and an alias server FC LE Fibre Channel Link Encapsulation A reference to the document ANSI X3 287 1996 which defines how IEEE 802 2 Logical Link Control LLC information is transported via the Fibre Channel FC PH A reference to the Fibre Channel Physical and Signaling standard ANSI X3 230 containing the definition of the three lower levels FC 0 FC 1 and FC 2 of the Fibre Channel FC PLDA Fibre Channel Private Loop Direct Attach See PLDA FC SB Fibre Channel Single Byte Command Code Set A reference to the document ANSI Glossary 365 X 271 1996 which defines how the ESCON command set protocol is transported using the fibre channel FC SW Fibre Channel Switch Fabric A reference to the ANSI standard under development that further defines the fabric behavior described in FC FG and defines the communications between different fabric elements required for those elements to coordinate their operations and management address assignment FC Storage Director See SAN Storage Director FCA Fibre Channel Association a Fibre Channel industry association that works to promote awareness and understanding of the Fibre Channel technology and its application and provides a means for i
143. SS but then have a host with a different operating system access to these volumes As an example look at Figure 4 48 on page 304 There we have a Windows NT and an AIX host The ESS was configured and the Gateway attached so that SCSI 2 was assigned Windows NT volumes and SCSI 3 was assigned AIX volumes It would be possible in the SAN Data Gateway to allow the NT host to access a LUN on SCSI 3 and the AIX host access to volumes on SCSI 2 Here is where the device map would again be helpful in determining what Gateway assigned LUNs should be assigned to each host Volumes within the ESS assigned to a particular SCSI port should be of the same host type 4 6 2 Connecting a McDATA Enterprise Fibre Channel Director The McDATA Director can be used to attach to the SAN Data Gateway The connection of the McDATA Director to the SAN Data Gateway is similar to the description provided previously in 4 6 1 Connecting an IBM SAN Fibre Channel Switch on page 297 The difference that can be seen when using the McDATA Director is that once connected the Director does not register the WWPN of the port connected to the Gateway visually to the VPS database Figure 4 51 provides an example of where a McDATA Director was connected to the Gateway on Fibre Channel port 4 Chapter 4 Implementing the SAN Data Gateway 307 Pa storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc Iof x File View Admin Tools Controls Help
144. Selection window opens The window on the left named Available Drive Pool contains a list off all drives that are candidates to participate in a mirror drive Select a drive by highlighting it and click the Add gt gt button The drive name will be added to the Member window An asterisk will appear on the left hand side of the drive just selected in the Available Drive window to denote that the drive has been selected A second or third drive can be added to create a 2 way or 3 way mirror respectively Each drive is added one at a time To remove a drive from the Member window select the desired drive and click the Remove lt lt button An example of adding two drives to create a 2 way mirror is shown in Figure 5 20 Mirror Drive Setup Wizard Mirror Drive Members Selection Available Drive Pool Mirror Drive Members T00000 LOOO 35E68229 T00003 35E6848D TOOO03LO03 35E6848D TO0004 35E22D6C TOO0004L004 35 22D6C 700005 L005 35E6840E TOOO06 L006 35E68462 Identity T00007 LOO 35E6844E T33025 L001 IT501 ARR 8689 Drive Capacity MB Mirror Capacity MB lt Back Next gt Cancel Figure 5 20 Mirror drive member selection Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 333 334 Below each window there is a Capacity window that will display the size of the available drive or of the mirror drive Each drive that participates in a mirror should be of equal
145. Self Extractor type a 15 Click Unzip When the unzip process completes you should see a message that says x files unzipped successfully where x equals the number of files you unzipped Chapter 1 Implementing Fibre Channel host adapter cards 51 16 Click OK 17 Click Close to close the window for WinZip Self Extractor 1 10 5 Installing the Fibre Channel adapter drivers Perform the following steps to install the Fibre Channel adapter drivers 9 YO Os eG IN a Note If you are installing the Fibre Channel adapter for the first time you must specify the correct topology You must also select the appropriate device mapping driver From your Windows NT desktop double click the icon for My Computer Double click the icon for Control Panel Double click the icon for SCSI Adapters In the SCSI Adapters window click the Drivers tab Click Add In the Install Drivers window click Have Disk In the Install from Disk window ensure that the drive letter in the field for Copy Manufacturer s Files From is the drive letter you specified to save the exe file to when you downloaded the driver previously Type the name of the current driver file in the field for Copy Manufacturer s Files From after the drive letter prompt Click OK 10 Click Cancel to exit 11 Restart your host system 1 10 6 QLogic QLA2100F or QLogic QLA2200F configuration To configure the host adapter card use the IBM TotalStorage ESS Specialis
146. UN ID numbers to the same volume This is because the Gateway upon discovery or scanning of the SCSI buses will view the volumes on each SCSI channel as separate volumes For further explanation on this refer to 4 4 2 Device discovery on page 284 If each LUN ID was then masked and zoned to different host systems it is vital that the hosts have some access sharing software loaded to control access and avoid data corruption If the LUN IDs were assigned to the same host then again software similar to SDD is required for the host to recognize that it has multiple paths to the same volume As stated earlier SDD is not supported on the SAN Data Gateway connection to an ESS Chapter 4 Implementing the SAN Data Gateway 309 4 7 3 Adding Fibre Channel switches 310 As switches are added to allow for more host attachments there are considerations about how many paths the host has to the SAN Data Gateway If we refer back to Figure 4 48 on page 304 there is a single path from the switch to the Gateway If another Fibre Channel path from the switch to the Gateway was added each host now has two paths to access the same LUNs Each host will see the volumes twice Once again to prevent the host from recognizing the same volume twice software similar to SDD is required Another option here is to utilize the zoning and LUN masking capabilities of the SAN Data Gateway This would ensure that certain volumes can only be accessed o
147. VPS Implementing an Open IBM SAN SAN connection 1 has access to the LUNs on SCSI channels 2 and 4 VPS will control access to LUNs on SCSI channels 2 and 4 for SAN connection 1 Since SAN 1 is not zoned for SCSI channel 1 and 3 it will not reach any LUNs on these channels Even if a LUN on SCSI 3 has been enabled for access to a host on SAN 1 in the VPS settings window the host will not see that LUN because of the zoned settings The same is true for SAN connection 4 A host connected here will access LUNs only on SCSI channels 1 2 and 3 but not channel 4 regardless of whether the VPS settings will allow it 4 6 Adding Fibre Channel fabric components The SAN Data Gateway is an integral component in a storage network As such you can also attach other SAN fabric components to the Gateway to increase the connectivity options in a SAN Hubs and switches can be easily added and allow many more systems local or remote to access the SCSI devices on the Gateway As switches provide more flexibility and hubs are mainly used to extend distances the following discussion will focus on switch implementation rather than hubs 4 6 1 Connecting an IBM SAN Fibre Channel Switch The IBM SAN Fibre Channel Switch provides either an 8 port or 16 port switch that can also be cascaded Allowing fabric connection Before connecting a switch to the SAN Data Gateway there is a setting that must be checked to allow proper fabric connection Fro
148. Viewing changes on the Graphical View panel To see the updates we have made we press the Storage Allocation button This takes us back to the Storage Allocation Graphical View panel There we select the host FC port that we configured This is shown in Figure 2 79 UL cL Cluster 2 HB VSS Figure 2 79 Host FC port selected This shows the volumes defined for our host FC port The small purple parts of both disk arrays represent the space that is filled with volumes that are assigned to the selected host FC port The green part indicates space that is not yet allocated Clicking on an ESS Fibre Channel port will draw lines to the volumes configured for the selected host Fibre Channel port This is shown in Figure 2 80 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 135 136 Figure 2 80 Host FC port and ESS FC port selected The Information field now displays information relating to the configuration of the ESS FC port which is currently undefined This information is useful later to see which ESS FC port is configured for the appropriate topology We show how to configure this in 2 7 Configuring ESS FC ports on page 158 After selecting one of the disk groups the display changes again Now the disk group has a thick border and the Information frame has changed too This is shown in Figure 2 81 Information Cluster L Adap
149. WITCH On Line PA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc IP Address Current SAN Data Gateway ITSO 9 113 24 110 Host Name Host Type Channel Description Fibre Channel Host Host Connection Fibre Channel 4 10000000 c920cae6 FIBRE1 NT 4 0 SP4 ScsiPortt 1 1 0 Emulex k Figure 4 47 Hosts and a switch on a Gateway port Chapter 4 Implementing the SAN Data Gateway 303 304 By selecting and highlighting the new NT host we can see its information which was automatically sent by the host registration process The configuration with two different hosts connected to the switch as described previously is shown in Figure 4 48 goug OOO Servers Ao ABS NT unknown FIBRE1 3 BEBE ae Fibre Channel 7 1 4 OuUoOU m Gateway iw As i scsi ESS AIX plymouth IBM Switch Figure 4 48 Adding two heterogeneous hosts to the switch Implementing an Open IBM SAN Device access To have the new NT host access some of the devices you need to set up the VPS Access parameters by selecting Controls gt Access Options gt Virtual Private SAN Figure 4 49 shows the switch and the two hosts in the VPS da
150. What this means specifically for this redbook is that as we have been working with Beta code some of the screen captures may be different from products that appear on the market today Preface Xi IBM trademarks The following terms are trademarks of the International Business Machines Corporation in the United States and or other countries e logo IBM AIX AS 400 BookMaster Current Early Enterprise Storage Server ESCON FICON FlashCopy iSeries Magstar Netfinity Notes NUMA Q Comments welcome xii Your comments are important to us Redbooks Redbooks Logo Cd OS 390 OS 400 pSeries PTX RS 6000 S 390 SANergy SP StorWatch System 390 TotalStorage Wave xSeries zSeries We want our IBM Redbooks to be as helpful as possible Send us your comments about this or other Redbooks in one of the following ways gt Use the online Contact us review redbook form found at ibm com redbooks gt Send your comments in an Internet note to redbook us ibm com gt Mail your comments to the address on page ii Implementing an Open IBM SAN Implementing Fibre Channel host adapter cards In this chapter we describe the steps involved in implementing Fibre Channel host adapter cards in an IBM TotalStorage Enterprise Storage Server ESS environment Fibre Channel is a 100 MBps full duplex serial communications technology to interconnect I O devices and host systems that are separated by tens of kilo
151. able to Connect to Copy Services Server message occurs when the primary Copy Services server does not respond to new activity or when it does not have complete information from all Copy Services clients When you receive this message take these corrective actions Sign off from ESS Specialist and close the browser window Open the browser and sign on to ESS Specialist Click Copy Services from the ESS Specialist Welcome panel If steps 1 and 2 are unsuccessful shut down and restart the workstation that is running your browser Open the browser and access the ESS Specialist again Click Copy Services from the ESS Specialist Welcome panel 0 A wN Note If steps 3 5 do not resolve the problem you need to reset ESS Web Copy Services Attention We recommend that you not perform a reset unless you are certain that there are no other recovery options When you perform this function please be aware that You will lose any PPRC or FlashCopy tasks for which you have not received a successful completion message Established PPRC and FlashCopy relationships are maintained You cannot submit any additional command line interface CLI tasks until ESS Web Copy Services has initialized Reset ESS Web Copy Services Top Determining which Copy Services server is the active server The active Copy Services Server is the ESS cluster that is currently running the Copy Services server code Find the active Copy Services server To
152. age Server User s Guide is on the compact disc that you receive with the ESS Implementing an Open IBM SAN gt Solaris 2 6 Solaris 7 and Solaris 8 require patches to ensure that the host and the ESS function correctly See Table 1 6 for the minimum revision level that is required for each Solaris patch ID Table 1 6 Solaris 2 6 7 and 8 minimum revision level patches for Fibre Channel sowisas soirs7 soars 105181 23 kernel update 106541 12 kernel update 108528 03 kernel update 105356 16 sd ssd drivers 106924 06 isp driver 109524 02 ssd driver 105580 16 glm driver 106925 04 glm driver 109657 01 isp driver 105600 19 105600 19 isp driver 105600 19 isp driver 107147 08 107147 08 pci driver e 107147 08 pci driver e 108974 03 108974 03 sd uata drivers uata drivers Not applicable 107458 10 dad sd ssd Not ose ies ae ne uata drivers Review the Sun host SCSI adapter device driver installation and configuration utility documents for additional Solaris patches that you might need gt See the following Web site for details about the release level for your operating system www storage ibm com hardsoft products ess supserver htm Either you or an IBM service support representative SSR must perform the following tasks to install and configure an ESS 1 The IBM SSR installs the ESS by using the procedures in the IBM Enterprise Storage Server Service Guide 2 Either you or an IBM SSR defines the Fibre Cha
153. ager software only go to slicmgr i386 client setup exe instead 5 3 2 Communicating to the Router For the SLIC Manager server software to communicate to the Router it requires space on a disk or several disks that are within the SSA loop This is referred to as a SLIC Zone To create space on a disk a file or partition depending on the operating system used is created for the Manager software to use To create this SLIC Zone a configuration file must be created or edited Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 317 Editing the configuration file When the software is loaded a sample configuration file called 7190 cfg is added in the C ibm7190 sdus directory This is a text file that can be viewed and edited by simple text editors such as Windows Wordpad Open up the 7190 cfg file and it will contain a sample of how the file should look Also note that on the left hand side the sign is entered in every line to mark it out as a comment This is shown in Figure 5 4 7190 cfg WordPad OF x File Edit View Insert Format Help pell SI al el S pu Service Utility Daemon Configuration File Syntax SLIC_name path SLIC_ Zone user logfile ibm7190 cOevent log QueryChangeInterval 10 he Comment Lines are declared using Example co path J IBM 7190 SFa K IBM7190 S5Fa QueryChangeInterval in seconds QueryChangeInterval 10 te Call Home Feature Suppo
154. anagement of all timers used within a Fibre Channel system Topology An interconnection scheme that allows multiple Fibre Channel ports to communicate For example point to point Arbitrated Loop and switched fabric are all Fibre Channel topologies T_Port An ISL port more commonly known as an E_Port referred to as a Trunk port and used by INRANGE TL_Port A private to public bridging of switches or directors referred to as Translative Loop Twinax A transmission media cable consisting of two insulated central conducting leads of coaxial cable Twisted Pair A transmission media cable consisting of two insulated copper wires twisted around each other to reduce the induction thus interference from one wire to another The twists or lays are varied in length to reduce the potential for signal interference between pairs Several sets of twisted pair wires may be enclosed in a single cable This is the most common type of transmission media ULP Upper Level Protocols UTC Under The Covers a term used to characterize a subsystem in which a small number of hard drives are mounted inside a higher function unit The power and cooling are obtained from the system unit Connection is by parallel copper ribbon cable or pluggable backplane using IDE or SCSI protocols UTP Unshielded Twisted Pair Virtual Circuit A unidirectional path between two communicating N_Ports that permits fractional bandwidth WAN Wide Area Netwo
155. ancy Raid 5 Level 5 RAID support Striping with parity Repeater A device that receives a signal on an electromagnetic or optical transmission medium amplifies the signal and then retransmits it along the next leg of the medium Responder A Fibre Channel term referring to the answering device Router 1 A device that can decide which of several paths network traffic will follow based on some optimal metric Routers forward packets from one network to another based on network layer information 2 A dedicated computer hardware and or software package which manages the connection between two or more networks See also Bridge Bridge Router 370 Implementing an Open IBM SAN SAF TE SCSI Accessed Fault Tolerant Enclosures SAN A Storage Area Network SAN is a dedicated centrally managed secure information infrastructure which enables any to any interconnection of servers and storage systems SAN System Area Network term originally used to describe a particular symmetric multiprocessing SMP architecture in which a switched interconnect is used in place of a shared bus Server Area Network refers to a switched interconnect between multiple SMPs SC Connector Subscriber Connector A fiber optic connector standardized by ANSI TIA EIA 568A for use in structured wiring installations Scalability The ability of a computer application or product hardware or software to continue to function well as it or its context is
156. and functions as an entry point for all common management and monitoring tasks The devices are to be configured using the specific Product Managers and the fabric configuration such as the zoning configuration is done from the Fabric Manager For detailed information about the EFC Manager and how to use it refer to the McDATA Enterprise Fabric Connectivity Manager User Manual The EFC manager is running correctly but to use the EFC Manager from a remote workstation we need to download and install the code on our workstation This can be a PC running Windows NT an AIX a Solaris HP UX or LINUX workstation In our case this will be a PC running Windows NT Accessing the EFC Manager client installation software The code is downloaded from the EFC server The download and installation of the EFC Manager is done using a Web and Java based installation procedure All we need is a Web browser and we will use Netscape Navigator In the Uniform Resource Locator field URL of the Navigator we point to the address of the EFC server 9 113 25 247 to access the initial page on our EFC server This takes us to the start page for the remote EFC Manager client installation as shown in Figure 3 10 where we can choose the operating system of our remote workstation Implementing an Open IBM SAN McDATA Enterprise Fabric Connectivity Management Install EFC Manager remote client application Download SNMP MIB files Install EFC Manager
157. ared before or we might want to unassign volumes to keep them unused for later reuse We cover all this in the following topics 2 6 1 Sharing ESS logical volumes between two host FC ports We click on the Modify Volume Assignments button as shown in Figure 2 88 Modify Host Systems Configure Host Adapter Ports Configure Disk Groups Modify Volume Assignments Figure 2 88 Entry point for modifying volume assignments This takes us to the Modify Volume Assignments panel as shown in Figure 2 89 Modify Volume Assignments Volume Assignments Print Table ne sort z no sort x no sort z no sort z ne sort no sort no sort no sort z 600 184386 Device Adapter Pair 4 Open System 016 168 RAD Amay Fibre Chamel Pel Cluster 1 Loop A ID 00 LUN 0000 Array 2 Vol 000 601 18486 Device Adapter Pair 4 Open System 064 0 GBE RAD Amay Fibre Chamel PC1_2 Chuster 1 Loop B ID 00 LUN 0000 Array 2 Vol 001 7700 18486 Device Adapter Par 17 Open System 016 GB RAD Amay Fibre Chamel PEL Cluster 2 Loop A ID 00 LUN 0001 Array 1 Vol 000 701 18486 Device Adapter Par 17 Open System 064 0 GBE RAD Amay Fibre Chamel PC12 Chister 2 Loop B ID 00 LUN 0001 tio Action Assign selected yolume s to target hosts Use same ID Lun in source and target C Wnassion selected yolume s from target hosts Perform Configuration Update Cancel Configuration Update Figure 2 89 Four vol
158. as Twinax Shielded Twisted Pair or Coax Enterprise Network A geographically dispersed network under the auspices of one organization Entity In general a real or existing thing from the Latin ens or being which makes the distinction between a thing s existence and it qualities In programming engineering and probably many other contexts the word is used to identify units whether concrete things or abstract ideas that have no ready name or label ESCON Enterprise System Connection Exchange A group of sequences which share a unique identifier All sequences within a given exchange use the same protocol Frames from multiple sequences can be multiplexed to prevent a single exchange from consuming all the bandwidth See also Sequence F_Node Fabric Node a fabric attached node F_Port Fabric Port a port used to attach a Node Port N_Port to a switch fabric Fabric Fibre Channel employs a fabric to connect devices A fabric can be as simple as a single cable connecting two devices The term is most often used to describe a more complex network utilizing hubs switches and gateways Fabric Login Fabric Login FLOGI is used by an N_Port to determine if a fabric is present and if so to initiate a session with the fabric by exchanging service parameters with the fabric Fabric Login is performed by an N_Port following link initialization and before communication with other N_Ports is attempted FC Fibre Channel FC
159. ata Gateway 293 294 SCSI to LUN map Prior to setting the LUN masking it makes sense to prepare a list that has each LUN and shows which host is allocated to that LUN To assist in this process the Gateway has a map that provides a cross reference of the actual SCSI target and ID to the Gateway s assigned LUN number To access this map you must access the service terminal from the serial port as described earlier in 4 2 Installation on page 263 Once connected type in the command mapShowDatabase The database lists not only devices that are presently connected but also devices that have previously been connected If a previously attached device is later reattached it is assigned back to its previous address Figure 4 37 shows the output returned to the service terminal ITSO gt mapShowDatabase devId Type Chan tId tLun UID 666 SNA 127 127 127 6666666 6 4516 Ge 68 661 SCSI 601 666 666 26166666 45166e 68 662 SCSI 661 666 661 26200066 45166e 68 663 SCSI 681 661 666 26366666 45166e 68 664 SCSI 601 661 661 2040006 6 45166e 68 665 SCSI 661 662 666 26566666 45166e 68 666 SCSI 661 662 661 206 60066 4516 8e 68 687 SCSI 6681 663 666 26766666 45166e 68 668 SCSI 681 663 661 208 6006 6 4516 6e 68 669 SCSI 661 664 666 26966666 4516 Ge 68 616 SCSI 6081 664 661 2020006 6 45166e 68 611 SCSI 601 665 666 26b66666 45166e 68 612 SCSI 681 665 661 2 6c 0006 6 4516 6e 68 613 SCSI 661 666 666 26066666 45166e 68 614 SCSI 6681 666 661 2 Ge
160. ation Update button Perform Configuration Update A warning message appears stating that this will be a time consuming action as shown in Figure 2 41 Warning 1402 Time intensive Action The requested configuration update will take approximately 1 to 3 minutes to complete Would you like to continue and perform the update Figure 2 41 Warning window time consuming action 110 Implementing an Open IBM SAN How time consuming this will be depends on how many disk groups are to be configured at once Pressing the OK button executes the script which changes the configuration and gives us a progress window where we can see which arrays are initializing as shown in Figure 2 42 N Performing Configuration Update x Defining RAID Array ssa04 Blue 2 Estimated Remaining Time 30 seconds J Unsigned Java Applet Window Figure 2 42 Progress window RAID configuration After completing the configuration the ESS Specialist informs us of the success as shown in Figure 2 43 N x 2202 The requested disk group configuration has been performed successfully J Unsigned Java Applet Window Figure 2 43 Status window successful disk group configuration We have to press the OK button here which takes us back to the Open System Storage panel Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 111 Viewing changes on the Graphical View panel From here we can continue wit
161. ble 1 5 we show the NUMA Q system requirements Support for Copy Services on PTX V4 5 2 requires a special Technology Pack You can obtain the Technology Pack through an IBM sales representative who handles your xSeries and NUMA Q purchases Table 1 5 xSeries and NUMA Q system requirements for the ESS 1 5 3 Installing the IOC 0210 54 adapter card Perform the following steps to install the OC 0210 54 adapter card 1 Contact your IBM SSR to install the OC 0210 54 adapter card in the ESS 2 Connect the cable to the ESS port The SSR establishes the private LAN connection between both clusters on the ESS the Ethernet hub and the ESS personal computer console Preconfigured multimode optical cables are available to connect the ESS to the NUMA Q host system The 8m 24 ft cable might be required The way you connect the cable to the ESS through the Fibre Channel switch depends on the level of I O throughput For information about connection schemes see the Fibre Channel Subsystems Installation Guide at the following Web site techdocs sequent com staticpath shsvccd start htm 3 Restart the server 1 5 4 Configuring the OC 0210 54 adapter card To configure the OC 0210 54 adapter card contact your IBM SSR or see the IBM Enterprise Storage Server Web Interface User s Guide Chapter 1 Implementing Fibre Channel host adapter cards 17 1 6 Compaq host system FC attachment This topic describes the host system requirements and
162. button to start the download is covered until we grant the rights as shown in Figure 3 12 InstallAnywhere Web Installer Netscape File Edit View Go Communicator Help sx Bookmarks Location http 9 113 25 247 EFC_ClientInstall install htm N Java Security ioj x FY JavaScript or a Java applet from Zero G Software Incorporated N is requesting additional privileges Granting the following is high risk Starting programs stored on your computer I Remember this decision Identity verified by VeriSign Class 3 CA Commercial Content Sottware Publisher Certificate McDATA Enterprise Fabric Connectivity Manager Figure 3 12 EFC Manager client installation granting additional rights This warning message appears because for security reasons a Java applet is not allowed to perform the tasks mentioned above You should only allow Java programs to perform like this from trusted sources Chapter 3 Implementing a SAN with McDATA 191 If we do not grant the additional privileges we would have to download the installer to our local workstation and execute it After granting the rights the button to start the InstallAnywhere Web Installer appears and we are able to start the installation as shown in Figure 3 13 InstallAnywhere Web Installer Netscape Iof x File Edit View Go Communicator Help E V2 ateassOR n Z a Bookmarks A Location http 9 113 25 247 EFC_ClientInstall instal
163. can be configured just like the other ports as we described in Configuring the FC ports on page 210 From here we can assign a name reflecting the usage of the ports check the checkbox for extended distance buffering and verify and change the port definitions In our example illustrated in Figure 3 82 ports 0 and 1 are both able to build ISLs Port one is already defined as an E_Port and port 2 is a G_Port that will recognize that it has to act as an E_Port Chapter 3 Implementing a SAN with McDATA 253 Ea Configure Ports G_PORT G_PORT G_PORT G_P G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT oOoOoO0 NNAK oO NKE E LA O R O O Y R O E P Oooo RIR Q uv pil 4 G_PORT _ G_PORT _ G_PORT fa paar M OOOOO00000 DoOoOoOoDoOOO0000 0 NANARNRKRKRK K oO oO Figure 3 82 EFC Manager Configure Ports Other prerequisites for a multiswitch fabric To be able to successfully establish a multiswitch fabric other prerequisites apply The operating parameters resource allocation time out value R_A_TOV and error detection time out value E_D_TOV must be the same and the zoning configuration must be compatible Verifying the compatibility of the zoning configuration Once the switches are connected with ISLs the adjacent switches exchange their zoning information and merge it to a single active zone set This resulti
164. capacity If you select a drive that has a greater capacity and add it to the mirror the mirror capacity will still be the smaller of the two and the rest of the capacity of the larger drive will be unused For example if you added a 18 GB drive to the mirror in Figure 5 20 the Mirror Capacity window would still show the capacity of 8 696 MB Approximately half of the 18 GB drive will be unused After all drives have been added click Next gt and you will be able to adda dedicated spare drive to the mirror if desired Highlight one of the remaining available drives click Add gt gt and its name will appear in the Mirror Drive Dedicated Spare window as shown in Figure 5 21 Mirror Drive Setup Wizard Mirror Drive Members Selection Available Drive Pool m Miror Drive Dedicated Spares T00000 LOOO 35E68229 TO0005 35E6840E TOOO03LO003 35E6848D TO0004L004 35E22D6C TOOOO5LOO5 35E6840E TOOO06 LOOG 35E68462 Identify T00007 LOO S5E6844E lt lt Remove Reset Drive Capacity MB Mirror Capacity MB 8689 8689 lt Back Next gt Cancel Figure 5 21 Adding a dedicated spare Click the Next gt button and the properties of the mirror drive can be changed The properties that can be changed are the FC LUN and the Drive Name There will be a suggested LUN number in this field that can be accepted If not simply type in the desired LUN number A name can also be defined to
165. ced Adapter Settings menu press the Down Arrow to highlight LUNs per target then press Enter Use the Down Arrow to find and highlight 256 Press Enter Press Esc To save the changes click Yes Press Enter 10 Restart the server 1 10 3 Installing the QLogic QLA2200F adapter card This section tells you how to attach an ESS to a Windows NT host system with the QLogic QLA2200F adapter card Single and dual port Fibre Channel interfaces with the QLogic QLA2200F adapter card support the following public and private loop modes gt YYY Yy Target Public initiator Private initiator Target and public initiator Target and private initiator Perform the following steps to install the QLogic QLA2200F adapter card D OV Be ON 8h Install the QLogic QLA2200F adapter card in the host system Connect the cable to the ESS port Restart the server Press Alt Q to get to the FAST Util menu From the Configuration Settings menu select Host Adapter Settings From the Host Adapter Settings menu set the following parameters and values a Host adapter BIOS Disabled b Frame size 2048 c Loop reset delay 5 minimum d Adapter hard loop ID Disabled Chapter 1 Implementing Fibre Channel host adapter cards 49 50 7 From the Advanced Adapter Settings menu press the Down Arrow to highlight LUNs per target Press Enter Set the parameters and values from the Advanced Adapter Settings menu as follows Execution thrott
166. changed in size or volume For example the ability to retain performance levels when adding additional processors memory and or storage SCSI Small Computer System Interface A set of evolving ANSI standard electronic interfaces that allow personal computers to communicate with peripheral hardware such as disk drives tape drives CD_ROM drives printers and scanners faster and more flexibly than previous interfaces The table below identifies the major characteristics of the different SCSI version SCSI Ver eed ee de 16 15 12 SCSI 3 SCSI 3 consists of a set of primary commands and additional specialized command sets to meet the needs of specific device types The SCSI 3 command sets are used not only for the SCSI 3 parallel interface but for additional parallel and serial protocols including Fibre Channel Serial Bus Protocol used with IEEE 1394 Firewire physical protocol and the Serial Storage Protocol SSP SCSI FCP The term used to refer to the ANSI Fibre Channel Protocol for SCSI document X3 269 199x that describes the FC 4 protocol mappings and the definition of how the SCSI protocol and command set are transported using a Fibre Channel interface Sequence A series of frames strung together in numbered order which can be transmitted over a Fibre Channel connection as a single operation See also Exchange SERDES Serializer Deserializer Server A computer which is dedicated to one task SES SCSI Enc
167. created as an Instant Copy Drive in 5 7 1 Creating an Instant Copy drive on page 338 has been removed and is now a general spare 348 Implementing an Open IBM SAN 5 9 2 Mapping a general spare You will notice in Figure 5 35 that the general spare does not have a LUN number assigned to it To get a new LUN number for this drive you select the drive and click the Properties button The Drive Properties window appears select the Change FC button A dialog box opens as shown in Figure 5 36 Modify Fibre Channel Mapping Ea Original Mapping A New Mapping LUN N OK Cancel Figure 5 36 Mapping a general spare The Original Mapping box will indicate that no LUN was assigned previously Click the Get New Mapping button and the next sequential available LUN number will appear in the New Mapping box Click OK The drive will now appear in the Physical Drive window of the Control Center This can also be used to modify the LUN number on an existing mapped drive as well as remove the LUN number to unmap a drive and create a general spare It is not necessary to map a general spare A general spare can be used to creating a composite mirror or copy drive Mapping a general spare will create a drive that has a LUN number that can then be used by the host 5 9 3 Removing a mirror containing composite drive The mirror in this case was made from logical drives on their own Once the mirror is removed t
168. cted 128 Implementing an Open IBM SAN 2 5 2 Adding ESS logical volumes step two Pressing the Next button we are taken to the second step of defining the volumes This is the Add Volumes 2 of 2 panel shown in Figure 2 69 This is where we define how many volumes of what size we want to place sequentially on or spread across all prior selected disk groups Add Volumes 28 of 2 Maximum Volume Size 210 45 GB 0 00 GB X Volume Atiributes Select a Volume Size rs Number of Volumes preet _ Storage Type Volume Placement Place volumes sequentially starting in first selected storage area Spread volumes across all selected storage areas a Perform Configuration Update Cancel Configuration Update Figure 2 69 Add Volumes 2 of 2 panel two RAID 5 disk groups to be used At the top of the panel we see the Available Free Space area We can see the available capacity and the maximum volume size of the disk groups we selected Those numbers are in the row corresponding to the storage type we configured in the Configure Fixed Block Storage panel Because we did not configure and select any disk group for JBOD the Available Capacity and Maximum Volume Size column show both an available free space of zero Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 129 Note An ESS logical volume can be as big as we want it to be within the boundaries of one disk group In our case
169. d SLIC name as in Figure 5 8 IBSSLIC Manager 1 0 9 1 150 96 itso File Tools Properties View Help Figure 5 8 SLIC Manager title bar Implementing an Open IBM SAN 5 4 Using SLIC Manager You can now look to see that all communications are working properly by going to the toolbar and selecting Tools gt Control Center A dialog box will appear as shown in Figure 5 9 Control Center 3S5E68229 TOOOOL 3SEZ22D0B TOOOOZ 3S5E69318 TOOOO3 3SE6848D TOOO04 3SEZ2D6C TOOOOS 3SE6840E ACREA mAnANnA Figure 5 9 Control Center window In the Physical Drive box the drives that are on the SSA loop can be seen This window will be useful as you start to create mirrors and composite drives because it provides a summary of all drives Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 323 5 4 1 Drive properties You can get detailed information on each drive Select the drive so that it is highlighted and then select Properties A dialog box will appear with the drive s information as shown in Figure 5 10 Physical Drive Properties Target frooooo x Number Cancel SSA ID 35E68229 Chanae FC SSA Node 2 SSA LUN FC ID 34 FC LUN Capacity m agag MB 8689 0 0 Vital Product Data Vendor IBM Unit Serial Number 68050021 Model Number 09B Product Type DRYC Microcode ong Used As pee is currently used as a public mapped physical drive Figure
170. d We use the Add button to add some nicknames as shown in Figure 3 26 4 10 00 08 00 88 40 C0 AD 10 00 00 00 C9 20 DC 71 10 00 00 00 C9 20 E7 C7 10 00 00 00 C9 20 CA 83 10 00 00 00 C9 20 DA 2B 10 00 00 00 C9 20 48 CD faa Delete OK Cancel Figure 3 26 EFC Manager Configure Nicknames Add Nickname Chapter 3 Implementing a SAN with McDATA 203 After adding some nicknames the window looks like that shown in Figure 3 27 A Configure Nicknames WordWideName Nickname RPKA93_C1B3A1 10 00 00 00 C9 20 DA 2B RPKA93_C1 B2A1 ms oome om const Figure 3 27 EFC Manager Configure Nicknames nicknames assigned Doing this is similar to using a hosts file on an IP host In our simple case it might be tempting to work with the WWN and to skip or ignore the task of assigning nicknames However as more devices attach maintaining the fabric with names is more convenient and will be easier than figuring out which WWN belongs to which machine After assigning the nicknames the Node List View of the Product Manager then shows the names of those that are currently attached With a growing SAN it becomes more and more important to be able to distinguish between the node ports 3 4 Managing the devices using the Product Manager 204 Now we can configure the devices for the McDATA SAN the ED 6064 the ED 5000 the ES 3016 and the ES 1000 The Product Manager provides di
171. d availability attributes you want you must consider the number of ESCON you need For example you can map four ESCON links to a single FICON link and maintain approximately equivalent performance If the ESCON channel use is low you can map six or eight ESCON links to a single FICON link 1 2 4 Multipathing for ESCON and FICON Consider the difference between the path groups when you compare FICON to ESCON For example for ESCON you can configure four or eight paths per path group from a host to an ESS For ESCON you want at least four paths in the path group to maximize performance Most ESCON controllers implement channel command execution that partially synchronizes the lower DASD interface with the upper channel interface This channel command only allows you a very short time to reconnect The consequence is reconnections that fail Chapter 1 Implementing Fibre Channel host adapter cards 5 When you have eight paths in the path group it minimizes the number of missed reconnections Increasing the number of path groups does not minimize the number of missed reconnections substantially If you use eight paths in path groups you can increase the overall throughput For FICON controllers there is no synchronization between the lower DASD interface and the upper channel interface The number of paths in the path group depend on the throughput requirement If it takes x paths to satisfy the throughput requirement where x is the number of
172. d domain ID to 4 which is unique in our fabric Chapter 3 Implementing a SAN with McDATA 221 222 To change the operating parameters we first have to set the ED 1000 offline To set the switch offline which will terminate all FC operations we select Maintenance gt Set Online State as shown in Figure 3 50 ia Set Online State x Figure 3 50 Product Manager ED 1000 Set Online State Now we can go on and configure the operating parameters by selecting Configure gt Operating Parameters which takes us to the Configure Operating Parameters window shown in Figure 3 51 Configure Operating Parameters Figure 3 51 Product Manager ED 1000 Configure Operating Parameters We have already discussed time out values previously however here the R_A_TOV applies to the bridge port only For the ES 1000 we can also change the loop mode the switch is in In switched mode which is the default the switch enables frame transmission through multiple port pairs with full bandwidth Also if an unmanaged hub is installed the looplets that are created operate independently on their connected hub port This enables up to eight loops to communicate independently over the bridge port connected fabric node ports Implementing an Open IBM SAN We can also change the behavior of the ES 1000 to act a normal FC AL hub by changing the mode to Shared as shown in Figure 3 52 Configure Operating Parameters x Figure 3 52 ED 10
173. dard defining a channel that transfers data between CPUs and from a CPU to disk arrays and other peripherals HMMP HyperMedia Management Protocol HMMS HyperMedia Management Schema the definition of an implementation independent extensible common data description schema allowing data from a variety of sources to be described and accessed in real time regardless of the source of the data See also WEBM HMMP HSM Hierarchical Storage Management A software and hardware system that moves files from disk to slower less expensive storage media based on rules and observation of file activity Modern HSM systems move files from magnetic disk to optical disk to magnetic tape HUB A Fibre Channel device that connects nodes into a logical loop by using a physical star topology Hubs will automatically recognize an active node and insert the node into the loop A node that fails or is powered off is automatically removed from the loop HUB Topology see Loop Topology Hunt Group A set of associated Node Ports N_Ports attached to a single node assigned a special identifier that allows any frames containing this identifier to be routed to any available Node Port N_Port in the set In Band Signaling This is signaling that is carried in the same channel as the information Also referred to as inband Information Unit A unit of information defined by an FC 4 mapping Information Units are transferred as a Fibre Channel Sequence
174. default to arbitrated loop Note If you connect the ESS directly to the host system the option you select must match the port connections on the ESS However if you connect through a switch the options do not need to match the port connections because the ESS is point to point The appropriate HBA on the server must also support point to point connection on a direct connection Currently disparate vendors do not function properly in a direct point to point connection This statement is not true if you connect through a switch because the ESS is point to point 12 Press Esc 13 Save the changes Highlight Yes 14 Restart the server 1 9 12 Downloading the current Fibre Channel adapter driver Perform the following steps to load the current driver onto the QLogic adapter card 1 Go to the following Web site www qlogic com Chapter 1 Implementing Fibre Channel host adapter cards 39 From the home page click Driver Download Click Use QLogic Drivers Click Fibre Channel Adapter Drivers and Software In table click QLA22xx drivers From the menu for Software and Drivers available for click Solaris From the table for QLA22xx Driver Download Page Solaris Sparc 2 6 2 7 2 8 and Current released Sparc driver PCI to FC Adapter click Link to Driver Be 1 SOT Pe Ge a 8 Download the file and save as required 1 9 13 Installing the Fibre Channel adapter drivers Perform the following steps to install the Fibre Chan
175. des Target Public initiator Private initiator Target and public initiator Target and private initiator YYYY Y The ESS supports increased connectivity with the use of Fibre Channel SCSI FCP and FICON directors Specific details on status availability and configuration options for the Fibre Channel directors supported by the ESS are available on the Web site www storage ibm com hardsoft products ess supserver htm Perform the following steps to install the adapter card 1 Turn off and unplug the computer 2 Remove the computer case 3 Remove the blank panel from an empty PCI bus slot 4 Insert the host adapter board into the empty PCI bus slot Press firmly until seated 5 Secure the mounting bracket for the adapter to the case with the panel screw Implementing an Open IBM SAN 6 Replace the computer case by tightening the screws on the case or use the clamp to secure the cover 1 9 3 Downloading the current Emulex Fibre Channel adapter driver This section tells you how to install the Emulex driver 1 2 N ODO oO f Plug in and restart your host system Go to the following Web site www emulex com From the left navigation menu for Quick Links click Documentation Drivers and Software From the Fibre Channel menu select the adapter model Click Drivers for Solaris Click SCSI IP v4 xxx where xxx equals the level of the driver for Solaris Click Download Now for an Intel dr
176. device adapters gt You cannot place an AS 400 or iSeries volumes in an ESS non RAID storage array gt You cannot share an AS 400 or iSeries volume with more than one Fibre Channel system attachment gt The number of volumes that you can create is determined by the attachment type and by the available ESS storage array capacity gt You can create 1 32 LUNs for a Fibre Channel attachment 1 3 4 Recommended configurations for the AS 400 or iSeries IBM recommends the following configurations gt Install the 2766 adapter card in the AS 400 iSeries system unit or the HSL PCI I O towers Feature code 2766 is an IOA I O adapter Important Do not use more than two 2766 adapter cards for each AS 400 or iSeries tower The following must be taken into account 1 Only one 2766 adapter is supported per I O processor IOP and requires a dedicated IOP No other I O adapters are supported under the same IOP 2 Only two 2766 adapters are supported per a multi adapter bridge 10 Implementing an Open IBM SAN 1 3 5 Software requirements for the IBM OS 400 operating system Release V3R1 0 and later releases of the OS 400 or iSeries operating system support 4 GB and 8 GB capacity disk drives In Table 1 3 we list the required program temporary fixes PTFs for OS 400 or iSeries versions that do not include the PTFs in the base code Table 1 3 OS 400 program temporary fixes for V3R1 0 through V4R1 4 Operating System Versio
177. devices to be unique Implementing an Open IBM SAN 3 2 2 Installing the EFC Manager client on remote workstations We use the out of band management of the McDATA devices using the corporate intranet There are two access methods provided This is the management with the EFC Manager applications for all McDATA switches and the management through the embedded web server of the ED 6064 ES 3032 ES 3016 and the ES 1000 Why we use the EFC Manager The web interface does not allow every configuration to be made and also makes only management of one device possible Also to use the web interface the switch itself must have an IP connection to the computer from where we want to access the web interface with the web browser but this is not always what we want We are going to use the EFC Manager to complete our tasks For example the Web interface of the ED 6064 is shown in Figure 3 9 t ED 6064 1 Netscape File Edit View Go Communicator Help es Ee SEOS py wt Bookmarks 4 Location TT37ERRE s htm v yi ai Status Operational State Online Name ED 6064 1 Configure Monitor Operations Front View Rear View Figure 3 9 Web interface of the ED 6064 unit view Chapter 3 Implementing a SAN with McDATA 187 3 2 3 Introduction to the EFC Manager 188 The EFC Manager is a centralized tool for the McDATA network It is a Java based GUI that shows a graphical view of all managed devices
178. dge Router A device that can provide the functions of a bridge router or both concurrently A bridge router can route one or more protocols such as TCP IP and bridge all other traffic See also Bridge Router Broadcast Sending a transmission to all N_Ports on a fabric Channel A point to point link the main task of which is to transport data from one point to another Channel I O A form of I O where request and response correlation is maintained through some form of source destination and request identification CIFS Common Internet File System Class of Service A Fibre Channel frame delivery scheme exhibiting a specified set of delivery characteristics and attributes 363 Class 1 A class of service providing dedicated connection between two ports with confirmed delivery or notification of non deliverability Class 2 A class of service providing a frame switching service between two ports with confirmed delivery or notification of non deliverability Class 3 A class of service providing frame switching datagram service between two ports or a multicast service between a multicast originator and one or more multicast recipients Class 4 A class of service providing a fractional bandwidth virtual circuit between two ports with confirmed delivery or notification of non deliverability Class 6 A class of service providing a multicast connection between a multicast originator and one or more multicast recipients with co
179. drive will flash In both cases a dialog box appears to allow you to stop the flashing 5 7 Instant Copy drive Instant Copy is a feature that allows a drive to become part of a mirror synchronize to the latest data and then detach from the mirror The drive can then be used to back up the data or used elsewhere if desired Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 337 5 7 1 Creating an Instant Copy drive 338 To create an Instant Copy drive select Tools gt Instant Copy Drive Setup Wizard You will see a dialog box Instant Copy Drive List that will be blank If there were copy drives created it would display the names of the drives Click the Next gt gt button and the Instant Copy Drive Members Selection window is displayed The window on the left named Available Drive Pool contains a list off all drives that are candidates to become a copy drive Select a drive by highlighting it and click the Add gt gt button The drive name will be added to the Member window An asterisk will appear on the left hand side of the drive just selected in the Available Drive window to denote that the drive has been selected An example is shown in Figure 5 25 Instant Copy Drive Setup Wizard Instant Copy Drive Member Selection Available Drive Pool m Instant Copy Drive Member T00000 LOOO 35E 68229 TOOO06 35E68462 35E 68462 ToOOoo LOO 35E6844E 733025 L001 ITS01 Identify Add gt gt lt lt Remove
180. ds My account gt Select a country IBM SAN Data Gateway Storage Home Announcement letters Reference information Press release Supported servers Downloads Storage Solutions Storage Networking SAN Data Gateway 2108 GO7 SANNASASCSI Disk Storage Systems Firrnware Download Main Page Tape amp Optical Storage 2108 607 SAN Data Gateway Firmware Code Downloads to Attach Storage Software Storage Media Windows NT and QLogic PCI Fibre Channel Host Bus Adapters For 2105 Enterprise Storage Server and FCTAPE for RMSS Magstar MP and Magstar Tape Attach with the Longwave Option Thought Leadership News amp Events Please View First readme be Create a Firmware Directory and Storage Support e ESS 1 0 only Download Firmware Level 3 40 16 bin file size 1 081 344 bytes e all others Download Firmware Level 3 41 37 hin file size 1 069 056 bytes e DPP Firmware procedures for 3 41 37 e 3 41 37 Release Notes Figure 4 17 Downloading the SAN Data Gateway firmware 278 Implementing an Open IBM SAN From this screen we selected the Windows NT version and we will save this into a directory for downloading into the SAN Data Gateway at a later stage From the main screen of the SAN Data Gateway Specialist you can check the current Firmware Revision level as shown in Figure 4 18 FA StorWatch SAN Data Gateway Specialist 2000 Pathlight Technology Mi E3 File View Ad
181. e Channel There is one target per iSeries adapter The naming convention for the iSeries now describes models 270 and 8xx which attach through an FC adapter 2766 Use migration tower 5035 or 5077 for the model 8xx You can also make a connection using a 6501 with SCSI cables 8 Implementing an Open IBM SAN 1 3 2 Attachment requirements for the AS 400 or iSeries This section lists the requirements for attaching the ESS to your host system 1 2 Ensure that you have all of the items in the equipment list Obtain the documents for the IBM AS 400 or iSeries host system from the following Web site publib boulder ibm com pubs html as400 infocenter htm See the following Web site for details about program temporary fixes PTFs that you need to install on your AS 400 or iSeries host system www storage ibm com hardsoft products ess supserver htm 4 Check the LUN limitations for your host system 5 Contact your IBM service support representative to install and configure the IBM ESS 1 3 3 Attachment considerations This section lists the attachment considerations for an AS 400 or iSeries host system The following must be taken into account gt You can specify a LUN serial number that is eight characters For example you can specify a LUN serial number OLLLLNNN where The LUN serial number is eight characters in the format OLLLLNNN where LLLL a unique volume number assigned by the ESS when the LUN is
182. e Enterprise Storage Server configuration 171 Storage Allocation Graphical View Click on a Host or Array to see paths lt EsconNet PC1_1 Clear View View All Storage Tabular View ia 10000000C9251126 Topology Point to Point Lt Rs iets 390 Storage Open System Storage Figure 2 131 Storage allocation now completed 172 We see that the host FC port PC1_2 is restricted to see the one volume it has left through one FC port which is configured for point to point Related information For more information on the ESS see these references IBM Enterprise Storage Server Introduction and Planning Guide 2105 Models E10 E20 F10 and F20 GC26 7294 gt Introduces the product and lists the features you can order It also provides guidelines on planning for the installation and configuration of the ESS IBM Enterprise Storage Server User s Guide 2105 Models E10 E20 F10 and F20 SC26 7295 gt Provides instructions for setting up and operating the ESS IBM Enterprise Storage Server Host Systems Attachment Guide 2105 Models E10 E20 F10 and F20 SC26 7296 gt Provides guidelines for attaching the ESS to your host system Implementing an Open IBM SAN IBM Enterprise Storage Server SCSI Command Reference 2105 Models E10 E20 F10 and F20 SC26 7297 gt Describes the functions of the ESS It provides reference information for UNIX and AS 400 hosts such as channel commands sense bytes a
183. e Fibre Channel adapter drivers 40 1 9 14 Configuring host device drivers 00000 0c eee 40 1 9 15 Tuning HBA configuration files 00 0 0 e eee eee 41 1 9 16 Installing the IBM Subsystem Device Driver 44 1 9 17 Setting the Sun host system parameters 45 1 10 Windows NT 4 0 FC host system attachment 2 47 1 10 1 Attachment requirements 0 000 ee 47 1 10 2 Installing the QLogic QLA2100F adaptercard 48 1 10 3 Installing the QLogic QLA2200F adapter card 49 1 10 4 Downloading the current Fibre Channel adapter driver 51 1 10 5 Installing the Fibre Channel adapter drivers 52 1 10 6 QLogic QLA2100F or QLogic QLA2200F configuration 52 1 10 7 Configuring for availability and recoverability 52 1 10 8 Setting the TimeOutValue registry 0 2 00 eee 53 Implementing an Open IBM SAN 1 10 9 Installing Emulex LP8000 adapter cards 53 1 10 10 Downloading the current Fibre Channel adapter driver 54 1 10 11 Installing the Fibre Channel adapter drivers 55 1 10 12 Parameter settings for the Emulex LP8000 on Windows NT 56 1 10 13 Verifying the configuration 0 0c eee eee eee 58 1 10 14 Verifying networking 0 aaaea aaa 58 1 11 Windows 2000 FC host system attachment
184. e WWN of the SLIC Router Exit the bios and the system will reboot Once the system has started you use a method to ensure that the host has access to all the drives This is different depending on the operating system of the computer For Windows NT select Start gt Programs gt Administrative Tools gt Disk Administrator This tool will report that new disks have been found and will be added to the system Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 315 5 3 SLIC Manager software 316 Rather than using the dip switches to configure the features another option is to use the SLIC Manager software The SLIC Manager also provides configuration monitoring and management capabilities of the SLIC Router and the SSA drive loop The SLIC Manager can be setup to allow remote access if desired The Manager software consists of server and client portions The server includes a daemon service and a user interface The client has the user interface only The server portion must be loaded on the host that is directly attached to the Router as the daemon service is started from here The daemon must reside on the host that is directly connected to the Router This host can also be used to run the Manager software for local access The client software can be loaded on to any computer running a supported operating system that can communicate to the host with the daemon service running It must communicate to the server host usi
185. e a directory called SD_CDROM type mkdir SD_CDROM to create a new directory 2 Insert the compact disc into the CD ROM drive 3 Mount the drive as a file system 4 Type ioscan fnkC disk Look for the device name on the list with a name of either compact disc or DVD Type mount o cdcase dev dsk c_t_d_ SD_CDROM Replace dev dsk c_t_d_ with the device special file found in step 4 5 Type swinstall s SD_CDROM hp common IBMis depot Implementing an Open IBM SAN 6 From the Software Selection window click IBMis_tag 7 From the Action menu click Mark for Install 8 When you see the word Yes next to the IBMis_tag product go to the Action menu and click Install 9 When the analysis completes with no errors Status Ready click OK 10 Click Yes in the Confirmation window to begin the installation A window opens notifying you that the installation is complete and that the system needs to be restarted 11 Click OK to continue 1 7 3 Configuring the IBM 2105 for clustering This section describes how to configure a Hewlett Packard host system for clustering The steps to configure MC ServiceGuard with the IBM 2105 are the same as the steps in the Hewlett Packard high availability documentation located at the following Web site www docs hp com hpux ha index html If you are not familiar with the steps in the Hewlett Packard documentation IBM recommends that the system administrator attend the Hewlett Packard
186. e drives but instead of having Fibre Channel LUN numbers assigned to them they are shown as belonging to a mirror with the name CompMir You can highlight the CompMir drive and click the Properties button All the same functions that were described in 5 6 2 Mirror drive properties on page 336 are available 5 9 Reusing logical drives At some point the composite mirror and instant copy logical drives that have created may be no longer required The logical drive can be removed so that the member drives that made up the logical drive can then be used individually or reconfigured to make new logical drives 5 9 1 Remove a logical drive To remove a logical drive you access the Control Center by selecting Tools gt Control Center from the top toolbar At the Control Center window select the logical drive composite mirror or copy that you want to remove Select the Remove Logical Drive button on the right hand side and a dialog box appears that will ask you to confirm that you want to remove the logical drive Once it is removed the member drives will become general spares and will show up in the General Spare Drive window of the Control Center This is shown in Figure 5 35 Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 9347 Control Center 733282 ITSOm T33025 ITSOL TOOOOO 35E68229 TOOOO 3SE684AE TOOOOS 35E68462 Figure 5 35 Removing a logical drive The logical drive that was
187. e ee a Figure 2 57 Four disk groups two host FC ports The two host FC ports we just have configured now show up with their nicknames in the host interface row Although we could have used longer nicknames they would have been truncated which would make them very hard to identify The only way would be to click on them and catch their names along with other information like the WWPN and the type of the host system on the Information window shown in Figure 2 58 Information Nickname PCi 1 WYP HT 200000E08B00CCSB Attachment Fc Description Operating System PC Server Win NT 4 0 or higher Figure 2 58 Information window host FC port in PC server Implementing an Open IBM SAN Clicking on the host FC port icon also shows that the port would be able to access volumes through each of the eight installed ESS FC ports if they were all connected to the SAN and no zoning in the fabric would prevent them from accessing the ESS FC ports This is illustrated in Figure 2 59 with lines drawn from the selected host FC port to each installed ESS FC port The involved components also get highlighted yellow cL UL cL Figure 2 59 Selected host FC port no ESS FC port restrictions 2 4 2 Modifying a host FC port definition Each one of the settings that we applied before for instance the nickname or the WWPN can be modified from within the Modify Host Systems panel
188. e host system the option you select must match the port connections on the ESS However if you connect through a switch the options do not need to match the port connections because the ESS is point to point The appropriate HBA on the server must also support point to point connection on a direct connection Currently disparate vendors do not function properly in a direct point to point connection This statement is not true if you connect through a switch because the ESS is point to point 12 Press Esc 13 Save the changes Highlight Yes 14 Restart the server 1 10 4 Downloading the current Fibre Channel adapter driver Perform the following steps to load the current driver onto the QLogic adapter card 1 Go to the following Web site www qlogic com From the home page click Driver Download Click Use QLogic Drivers Click IBM Enterprise Subsystems Division approved drivers Click IBM Approved QLA22xx drivers or IBM Approved QLA21xx drivers Click Link to Driver for Windows NT In the window for File Download click Save this Program to Disk COON Oo Or ON Insert a floppy diskette into your floppy disk drive 9 In the field for Save in change the drive letter to A 10 Create a folder called Temp in the Save As window 11 Click Save 12 When the download completes click Open Folder 13 From the A window double click the icon for the driver file you downloaded to the floppy diskette 14 In the window for WinZip
189. e page click Driver Download Click Drivers Click Fibre Channel Adapter Drivers Click QLA2xxx drivers Click Novell NetWare Click QLogic Vx xxx where Vis the version and x xxx is the version level of the file name A QO a ON 8 In the Save As window find the current driver file xxxxxxx exe where XXXXXXX is the driver file name Note We recommend that you save the file to a floppy diskette 9 Click Save 10 Close the Web site 11 From your host system Start menu click Run 12 In the Run window ensure that the drive letter in the field is the same as the drive letter where you saved the xxxxxxx exe file If no drive letter appears type the letter of the drive where you saved the driver file 13 Type the driver file name after x where x is the drive letter you specified to save the file 14 Type the directory name where you want to put the file Click Zip 15 Click OK to unzip the current driver file 1 8 4 Installing the Fibre Channel adapter drivers Perform the following steps to install the Fibre Channel adapter drivers 1 From the NetWare server console type nwconfig for NetWare 5 0 or 5 1 or load install for NetWare 4 x 2 Select Driver Options 3 Select Configure Disk and Storage Device Drivers 4 Inthe SCSI Adapters window click the Drivers tab Chapter 1 Implementing Fibre Channel host adapter cards 29 5 Click Select an additional driver 6 Press the Insert key 7 Insert a flo
190. each physical LUN If you create a PVID sector 0 of a LUN and you delete all hdisks from the system with the rmdev command you must restart the system If you want to restore all multiple paths for all LUNS use the cfgmgr command for each Fibre Channel adapter 1 5 IBM eServer xSeries or IBM NUMA Q FC attachment This topic tells you how to attach an ESS to an xSeries or an IBM NUMA Q host system with Fibre Channel adapters We also tell you how to install and configure the l OC 0210 54 adapter card Note You must use the switched fabric topology to attach the ESS to either an xSeries or to an IBM NUMA Q host system Chapter 1 Implementing Fibre Channel host adapter cards 15 The ESS also offers the following interim support for Fibre Channel attachment Feature Code 3019 With the feature code 3019 you can attach an ESS to an xSeries or an IBM NUMA Q host system through the NUMA Q Fibre Channel to SCSI bridge This feature code includes one SCSI adapter that you purchase and a no cost loan of a NUMA Q Fibre Channel to SCSI bridge IBM requires that you sign a loan agreement for the bridge Note Feature code 3019 is not a standard feature To get feature code 3019 contact your IBM sales representative For more information about how to attach an xSeries or a NUMA Q host system with Fibre Channel adapters see the NUMA Q ESS Integration Release Notes and the Fibre Channel Subsystem Installation Guide To obtain a copy see your IB
191. eceive with the ESS See the following Web site for details about the release level for your operating system www storage ibm com hardsoft products ess supserver htm Either you or an IBM SSR must perform the following tasks to install and configure an ESS 1 The IBM SSR installs the ESS by using the procedures in the IBM Enterprise Storage Server Service Guide 2 Either you or an IBM SSR defines the Fibre Channel host system with the worldwide port name identifiers Chapter 1 Implementing Fibre Channel host adapter cards 47 3 Either you or an IBM SSR defines the Fiber Channel port configuration if you did not do it during the installation of the ESS or Fibre Channel adapters Note Use the information on the logical configuration work sheet in the IBM Enterprise Storage Server Configuration Planner that you should have previously filled out You or an IBM SSR configures the host system for the ESS by using the instructions in your host system publications Notes 1 The IBM Subsystem Device Driver 1 2 1 supports the Windows NT 4 0 host system in a clustering environment To have failover protection on an open system the IBM Subsystem Device Driver requires a minimum of two Fibre Channel adapters The maximum number of Fibre Channel adapters supported is 16 for a total of 16 Fibre Channel ports 2 To improve performance IBM recommends that you map to the LUNs for the target volumes of the Windows NT host until you
192. ed This happens for example when we select a specific disk group or when we press the View All Storage button Yellow Unassigned Disk storage that contains ESS logical volumes that were assigned to host FC ports before and then were unassigned Those ESS logical volumes can be assigned to any host FC ports Green Not Allocated Disk storage that contains no ESS logical volumes This storage can be used to define and assign ESS logical volumes We will explain more details of the Storage Allocation Graphical View panel later on as we progress with our configuration and the panel shows the information relating to our configuration changes Using the Storage Allocation Tabular View panel To get a detailed view of the ESS logical volumes later on we will use the Tabular View button to get to the view as shown in Figure 2 34 Tabular View Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 103 Storage Allocation Tabular View List of Assigned Volumes Print Table Perform Sort Graphical View no sort no sort no sant z no sort no sont x no sort no sort no sort Host SSID uss cu_ Vetume Type Size Host adapter Location Share Figure 2 34 Tabular View no ESS logical volumes configured As expected the table that contains the detailed description of all volume assignments made is empty right now 2 2 2 Using the Open System Storage panel 104 To start
193. ed Adapter Settings menu as follows Execution throttle 100 Fast command posting Enabled gt 4 GB addressing Disabled for 32 bit systems LUNs per target 0 Enable LIP reset No Enable LIP full login No oaoT5p Note In a clustering environment set Enable LIP full login to Yes Enable target reset Yes Login retrycount 20 minimum Port down retrycount 20 minimum Driver load RISC code Enabled Enable database updates No x TO 38 Implementing an Open IBM SAN Disable database load No m IOCB allocation 256 n Extended error logging Disabled might be enabled for debugging Note The Enable LIP reset Enable LIP full logon and Enable target reset parameters control the behavior of the adapter when Windows NT tries to do a SCSI bus reset You must perform a target reset to make cluster failovers work Use the SCSI bus device reset option to clear SCSI reservations 8 Press Esc to return to the Configuration Settings menu 9 From the Configuration Settings menu scroll down to Extended Firmware Settings Press Enter 10 From the Extended Firmware Settings menu scroll down to Connection Options to open the Option and Type of Connection window 11 Select one of the following options a 0 Loop only b 1 Point to point preferred setting c 2 Loop preferred If you cannot use arbitrated loop then default to point to point d 3 Point to point otherwise loop If you cannot use point to point
194. ed for the placement of the volumes The two choices we have are shown in the Volume Placement frame This is shown in Figure 2 74 Volume Placement Place volumes sequentially starting in first selected storage area Figure 2 74 Volume Placement frame spreading volumes selected Here we can choose whether we want to place the volumes sequentially on all selected disk groups or if we want to spread the volumes over all selected disk groups Placing volumes sequentially means that in our case the two 16 1 GB volumes would both be placed on the first selected disk group If we wanted to configure a large number of 16 1 GB volumes this would mean that the first 13 of them would be placed on the first disk group and the following would start to fill the second disk group In contrast to this spreading volumes across all selected storage areas means exactly what it says In our case one of our two 16 1 GB volumes is going to be placed on each selected disk group Performing the configuration update Our panel now looks like that shown in Figure 2 75 just before we apply the configuration changes by pressing the Perform Configuration Update button 132 Implementing an Open IBM SAN Add Volumes 2 of 2 Available Free Space 20 90 GB 210 45 GB 0 00 GE 0 00 GB X Volume Atiributes New Volumes Select a Volume Size Number Volume Size Storage Type no smoes An a 6106B8 RAIDS amy total 322068 d o ooo
195. ed here will always show the status of the configuration of the ESS There are two panels one that illustrates the configuration graphically and one that shows it in an tabular view Using the Storage Allocation Graphical View panel Using the Storage Allocation button we get the Storage Allocation Graphical View panel as shown in Figure 2 21 Storage Allocation Storage Allocation Graphical View Clear View View Al Storage Tabular View Click on a Host or Array to see paths m 390 Storage Open System Siorage P I Figure 2 21 Graphical View unconfigured ESS with ESCON SCSI and FC 96 Implementing an Open IBM SAN In this panel we get the logical view and the status of the installed and configured storage related components of the ESS These are the parts of the ESS that need to be configured for ESS logical volumes to be accessible from host FC ports The panel is interactive which means as we select different entities on this panel the panel will reflect the configuration of the ESS according to the selected entity Those can be the host interface icons the ESS interface icons the SSA device adapter icons and the disk group rectangles Also the View All Storage button allows us to see the status of all configured disk groups at once View All Storage To start with our ESS is unconfigured and in the screen shots that follow we will show how the panel will change Us
196. el 4 World Wide Port Name 20040060 45160E08 Z 20f40060 69201d4e unknown seral Number 00010072 Current SAN Data Gateway ITSO IP Address 9 113 24 110 Media Short Wave Optical Firmware Revision 2 01 11 Port Type point to point N_Port Loop ID Frame Size 2048 Port Mode Public Target Only Connection Point to Point Only Max Speed 100 Mb sec Status Ready Figure 4 42 Switch port login You can also check the port on the switch by accessing the switch configuration from a Web browser to ensure that the port has registered and is communicating properly Figure 4 43 shows that in this example port 7 of the switch was used to connect to the Gateway Note that the WWPN is the same as in the Specialist window and that the port type is F_port fe Port Information for IBM_2109_FC_Switch2 o alalalals e 7 Port World Wide Name 20 07 00 60 69 20 1d 4e Port Status Online Port Module for GBIC Module id Port Type F Port PortStats Figure 4 43 IBM SAN Fibre Channel Switch port settings 300 Implementing an Open IBM SAN Changing the switch information From the VPS Access Settings window it is possible to change the unknown information of the switch Select Controls gt Virtual Private SAN and select the entry that has the WWN of the switch You can now change the information to further describe the switch or other pertinent information if desired This is shown in Figure 4 44
197. emark of Ziff Communications Company in the United States and or other countries and is used by IBM Corporation under license ActionMedia LANDesk MMX Pentium and ProShare are trademarks of Intel Corporation in the United States and or other countries UNIX is a registered trademark in the United States and other countries licensed exclusively through The Open Group SET SET Secure Electronic Transaction and the SET Logo are trademarks owned by SET Secure Electronic Transaction LLC Other company product and service names may be trademarks or service marks of others Implementing an Open IBM SAN Glossary 8B 10B A data encoding scheme developed by IBM translating byte wide data to an encoded 10 bit format Fibre Channel s FC 1 level defines this as the method to be used to encode and decode data transmissions over the Fibre channel Adapter A hardware unit that aggregates other I O units devices or communications links to a system bus ADSM ADSTAR Distributed Storage Manager Agent 1 In the client server model the part of the system that performs information preparation and exchange on behalf of a client or server application 2 In SNMP the word agent refers to the managed system See also Management Agent AIT Advanced Intelligent Tape A magnetic tape format by Sony that uses 8mm cassettes but is only used in specific drives AL See Arbitrated Loop ANSI American National Standards Institute The pri
198. ementing an Open IBM SAN These QLogic publications are also relevant as further information sources gt gt gt ES 3016 Switch Installation and Service Manual 620 000112 ES 3032 Switch Planning Manual 620 0001 18 000 ES 3032 Switch User Manual 620 0001 17 000 ES 3032 Switch Installation and Service Manual 620 0001 16 000 ES 1000 Switch Planning Manual 620 000102 000 ES 1000 Switch User Manual 620 000103 ES 1000 Switch Installation and Service Manual 620 000105 QLA2200 Hardware Manual FC0151103 00 QLA2200 Hardware Manual FC0151103 00 QLA2100 Software Manual FC0153301 00 QLA2100 Hardware Manual FC0151102 00 QMS V1 Installation Guide FC0051104 00 QLview for Fibre Operations Guide FC0051101 00 QLconfig Operations Guide FC0051 102 00 Related publications 357 Referenced Web sites 358 These Web sites are also relevant as further information sources gt www storage ibm com ibmsan index htm IBM Enterprise SAN gt www pc ibm com ww netfinity san IBM Storage Area Networks Nefinity Servers gt www storage ibm com hardsoft products sangateway supserver htm IBM SAN Data Gateway gt www storage ibm com hardsoft products tape ro3superserver htm IBM SAN Data Gateway Router gt www storage ibm com hardsoft products fcss fcss htm IBM Fibre Channel RAID Storage Server gt www storage ibm com hardsoft products ess ess htm Enterprise Storage Server gt www cdp com Columbia Data Products Inc
199. emsetup Readme Txtsetup cem 14 Double click Readme to get the instructions to install the Fibre Channel adapter driver Print the Readme file 15 In the window for WinZip Wizard Unzip Complete click Close 16 Ensure that the name of the file you want to download is displayed in the window 17 Click Save to download and unzip the file to your hard drive A window opens that indicates the progress of the download operation When the progress indicator window closes the download is complete 1 11 11 Installing the Fibre Channel adapter drivers 66 Perform the following steps to install the Fibre Channel adapter drivers Note If you are installing the Fibre Channel adapter for the first time you must specify the correct topology You must also select the appropriate device mapping driver From your desktop click Start Settings Double click Control Panel Double click SCSIAdapters Click the Drivers tab gee G0 ND se Implementing an Open IBM SAN 5 Click Add to create a list of drivers A window opens that indicates the progress When the window closes you should see a window called Install Driver 6 From the Install Driver window click Have Disk 7 Enter the path to the driver file that you downloaded and click OK 8 To install the driver highlight the line that lists the driver you want and click OK Note The driver affects every adapter in the system If you have more than one adapter tha
200. ent switches 254 administer MCDATA SAN 196 administrator 269 Advanced Options 276 AdvFS 22 Agent 267 AIX host system 15 anonymous host 163 arbitrated loop 167 Assign Fibre Channel Target 314 Assigned Volumes 104 Assigning LUN IDs 285 Attaching hosts 303 B B Port 219 bandwidth 143 bandwidth issues 246 bottlenecks 246 Copyright IBM Corp 2001 bridge 16 bridging 372 C callhome 86 channel access mode 162 channel command 5 channel path group 6 Client 267 clustering 25 Combining Composite And Mirroring 342 Compag Alpha server 18 Compaq host FC attachment 18 Compaq Tru64 UNIX 19 composite drive 327 342 as members of a mirror 345 properties 331 Configure Host Adapter Ports 159 Control Center 323 Copy Services 90 core device 177 corporate LAN 183 Create General Spares 315 create user for telnet to San Data Gateway 265 Creating A Composite Drive 327 Creating A Mirror Drive 332 Creating a SLIC Zone 320 Creating an Instant Copy drive 338 D dedicated LAN 186 Detach Instant Copy Drive from a Mirror 342 detached node ports 235 Device discovery 284 device identification 200 director 176 director identification 208 director offline 213 disk group 113 disk groups 115 132 disk pooling 75 distances 3 375 DNS 185 202 domain 252 domain address manager 252 domain ID 252 Domain ID conflict 253 Domain Name System 185 E ED TOV 254 E Port 207 246 ED 5000 175 ED 6064 7 176 177 EFC login 195
201. er The same applies to the Fabric View of the EFC Manager We can switch to it by using the View button on the panel as shown in Figure 3 18 196 Implementing an Open IBM SAN 3 3 3 Defining users on the EFC Manager First we want to define users on the EFC Manager because we do not want the Administrator user ID to be used remotely so we will create a new user and use that for remote access We can define up to 16 users for the EFC Manager but only a maximum of four can log on concurrently With the user of the EFC Manager running locally on the EFC server there can be five sessions open concurrently To the left there is a panel from where we can access the different management and monitoring functions From the Product View we go to Configure gt Users on the button panel on the left side of the window as shown in Figure 3 19 W McDATA Enterprise Fabric Connectivity Manager olx ii Product View View New product Users ie Configure i Logs xe Maintenance io Help na Logout Exit Figure 3 19 EFC Manager Product View Chapter 3 Implementing a SAN with McDATA 197 We are presented with a list of defined users and the options to add users modify existing users view the rights of a user and delete users We will add another user by clicking the New button and then specifying the name password and description of the new user Also this window is used to spec
202. er 1 Implementing Fibre Channel host adapter cards 57 1 10 13 Verifying the configuration The following tells you how to determine whether or not your Windows NT 4 0 host system is configured for storage 1 From the Windows NT desktop right click Start 2 Partition new Fibre Channel drives with Microsoft Disk Administrator See your Windows NT documentation for more instructions 3 Click Explore and verify that you can see the Fibre Channel drives 4 Select a large file for example a 9 MB file and copy it to a Fibre Channel drive 1 10 14 Verifying networking The following tells you how to determine whether or not your Windows NT 4 0 host system is configured for networking 1 From the Windows NT desktop click Start Programs Command Prompt 2 From the command line ping a known TCP IP address 1 11 Windows 2000 FC host system attachment This topic tells you how to attach an ESS to a Windows 2000 host system with the following Fibre Channel adapters gt QLogic QLA2100F adapter card gt QLogic QLA2200F adapter card gt Emulex LP8000 adapter card 1 11 1 Attachment requirements This section lists the requirements for attaching the ESS to your host system gt Check the LUN limitations for your host system gt Ensure that you have the documentation for your host system and the IBM Enterprise Storage Server User s Guide the User s Guide is on the compact disc that you receive with the ESS See the fo
203. er does not support the Compaq open system in a clustering environment To have failover protection on an open system the IBM Subsystem Device Driver requires a minimum of two adapters You can run the Subsystem Device Driver with one Fibre Channel adapter but you have no failover protection The maximum number of adapters supported is 32 Implementing an Open IBM SAN 1 6 2 Compaq Tru64 UNIX Version 4 0x host system In this topic we explain how to install and configure a Tru64 UNIX Version 4 0x host system Before you configure the ESS volumes ensure that the system and Fibre Channel adapter cards are at the minimum supported firmware revision 1 6 3 Verifying the Compaq configuration The following procedures tell you how to verify the configuration for the host adapter cards and firmware for a Compaq host system 1 From the console prompt type show version This is an example of what you see when you type the show version command version V5 8 2 21 Jul 2000 17 16 08 2 Type view var adm messages to display the log file that shows the system version and the version of the Fibre Channel adapter cards This is an example of how the firmware version and the host adapter is displayed Sep 21 14 17 10 osplcpq ds20 vmunix Firmware revision 5 8 Sep 21 14 17 10 osplcpq ds20 vmunix KGPSA adapter Driver Rev 1 09 F W Rev 2 22X1 1 13 wwn 1000 0000 c922 d469 1 6 4 Operating system device recognition You can access the di
204. er settings you must change the parameter settings with the port utility and restart your host system 9 Click Yes to restart the host system 10 After you restart your host system click Start Settings 11 Double click Control Panel 12 Double click SCSI Adapters 13 Click the Drivers tab and verify that the Emulex SCSI driver is present and started 14 Click the Devices tab and verify that the host adapter is on the list 1 10 12 Parameter settings for the Emulex LP8000 on Windows NT In Table 1 10 we show the recommended host bus adapter configuration file parameters for an Emulex LP8000 adapter The settings are for an IBM ESS model F20 that is attached through a switch using the fabric automap SCSI devices port driver and an IBM ESS model F20 that is attached directly using arbitrated loop automap SCSI devices port driver Table 1 10 Recommended LP8000 settings for NT Point to point Not checked disabled for direct attach Not shown for the fabric attach Register for state change Checked enabled Use report LUNs Checked enabled 56 Implementing an Open IBM SAN Parameters Recommended settings Use name server after RSCN Checked enabled if fabric attached using soft zoning Not checked disabled Maximum Number of LUNs Equal to or greater than the number of the ESS LUNs available to the host bus adapter ioianGuewoeem Renee Topology Point to point fabric Arbitrated loop direct connect Chapt
205. ere will be a number of installations that would still like information associated with the ED 5000 For these reasons we will honor our commitment to the ED 5000 After a short introduction of the FC product line and some considerations regarding the network setup and remote management setup we go on to describe the McDATA SAN setup We do not carry out every task for example setting up for SNMP nor do we describe every single step in its entirety However we show how we built and managed our McDATA fabric in a task oriented way We want to build a single switch fabric with one ESS and one Windows NT server Later on we will extend the setup with more hosts for example RS 6000 Once this is established we will build zones and add other switches to build a cascaded fabric The hosts are already attached in our environment and so is the ESS In the following topics we introduce the McDATA products that have been selected for inclusion in the IBM portfolio 3 1 1 ED 6064 Fibre Channel Director 176 The ED 6064 shown in Figure 3 1 is the new second generation Fibre Channel director from McDATA Figure 3 1 ED 6064 Implementing an Open IBM SAN With its 64 ports minimum 32 and its high availability features it is the flagship of the McDATA product line It aims at the highly available enterprise computing environment where every part of the infrastructure has to meet the same demands of reliability availability and
206. es Volumes Logical subsystems Administration E E E Exit Copyright IBM Corporation 1998 2000 Licensed Materials Property of IBM All Rights Reserved IBMis a registered trademark of the IBM Corp U S Govemment Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp Figure 2 16 ESS Web Copy Services introduction panel Using the Tools help page Using the Tools button we get a help page with embedded action links for troubleshooting the ESS Web Copy Services Tools As mentioned before the ESS Web Copy Services is a separate server program running on an ESS cluster which is accessed through a different browser window than the ESS Specialist However the ESS Specialist provides this panel for troubleshooting which makes sense because the ESS Specialist might not be affected from the problem the ESS Web Copy Services server might have The helpfile with embedded action links we get is shown in Figure 2 17 and continued in Figure 2 18 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 91 Tools Copy Services Trouble Shooting and Disaster Recovery Recovering from an Unable to Connect to the Copy Services Server message Determining which Copy Services server is the active server Reset to primary Reset to backup Disable Recovering from an Unable to Connect to the Copy Services Server message An Un
207. ess window changing the topology Figure 2 128 shows a successful topology change of the ports N xi 2104 The specified port has been configured successfully jar Unsigned Java Applet Window Figure 2 128 Information window successful topology change Pressing the OK button takes us back to the Open System Storage panel Viewing changes in the Graphical View panel The changed topology settings are reflected in the Storage Allocation Graphical View panel Now when we click on one of the ESS FC ports that we just configured the information frame reflects the changes to the topology Implementing an Open IBM SAN For port three in bay one which is now configured for use with FC Point to Point this is shown in Figure 2 129 For port three in bay two which is now configured for use with FC Arbitrated Loop this is shown in Figure 2 130 Information Adapter Type FC host attachment I0 Bay EE Adapter 3 Port A WWE H 10000000C9251126 Topology Point to Point Figure 2 129 Information frame ESS FC port topology Point to Point Information WYP H 10000000C9251260 Topology Arbitrated Loop Figure 2 130 Information frame ESS FC port topology Arbitrated Loop We have now prepared the ESS to provide storage to our hosts We have arrived at the end of journey Here is our last picture of the Storage Allocation Graphical View panel shown in Figure 2 131 Chapter 2 IBM TotalStorag
208. eway its LUN number assigned will be something completely different An example is shown in Figure 4 36 EA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc Fie View Admin Tools Controls Help lt S SCSI Channel 2 M Disk Device 0 0 9 Disk Device 0 1 M Disk Device 1 0 9 Disk Device 1 1 M Disk Device 2 0 M Disk Device 2 1 M Disk Device 3 0 M Disk Device 3 1 Current SAN Data Gateway ITSO IP Address Channel Description Device Description 9 113 24 110 SCSI Channel 2 Disk Device 6 1 B Disk Device 4 0 ack iota mah 3 N 9 Disk Device 4 1 anne D Disk Device 5 0 Target ID l 6 M Disk Device 5 1 Device LUN 1 9 Disk Device 6 0 ee 4 Disk Device 8 0 ewe A i See ite aa Serial Number 625FC142 i Capacity 1 953 151 Blocks B Disk Device 9 1 piece Sia oes 9 Disk Device 10 0 a 9 Disk Device 10 1 Removable No B Disk Device 11 0 idi Bicone 20 nesa na aome Status Operational 9 Disk Device 12 1 SCSI Channel 3 Figure 4 36 SCSI LUN assignment In this example the disk device attached has a SCSI target of 6 and LUN ID of 1 When it was recognized by the SAN Data Gateway the Gateway assigned LUN number 38 to this device This Gateway s assigned LUN number corresponds to the assigned LUN number that appears on the top of the VPS settings window as shown Figure 4 38 on page 295 Chapter 4 Implementing the SAN D
209. fferent access levels 94 Implementing an Open IBM SAN Modify Users al User Account User List Usename Access Level IP Address Ra Password Verification Add gt Access Level Administration aA IP Address Range Optional a Heyyy Comments Optional Perform Configuration Update Cancel Configuration Update Figure 2 20 Modify Users panel The access levels are View Viewing the status and the configuration Operation Viewing the status and the configuration and performing operation functions Configuration Viewing the status and the configuration performing operation and configuration functions Administration Viewing the status and the configuration performing operation configuration and administration functions After the first administrative user is defined on the ESS the default user will be removed If all administration users have been or get deleted the default user will be restored after 30 minutes Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 95 2 2 Starting the Open Systems Storage Configuration In the topics that follow we will guide users through the storage and Fibre Channel environment related parts as we progress through and build the configuration The tasks performed here will affect the way the ESS presents itself in our SAN and to the SAN attached Fibre Channel hosts 2 2 1 Viewing the storage configuration status The panels describ
210. fferent options for every device type to be configured which reflect the specific hardware and the configuration options that the devices provides For instance the switch ES 3016 does not feature all of the high availability features of the ED 6064 and the ES 1000 has to be configured for FC AL only options We only configure options that are necessary for our SAN for instance the operating parameters We do not cover administration tasks such as configuring SNMP Implementing an Open IBM SAN Also the Product Manager presents the different front and back views of the devices in the Hardware View These are interactive views which display the status of monitored units for instance if they have failed Additionally clicking a unit opens a window with more information about the unit 3 4 1 Managing the ED 6064 We click the ED 6064 icon in the Product View to open the Product Manager Using the interactive Hardware View This opens the Product Manager in its own window with the Hardware View as shown in Figure 3 28 This illustrates the different types of monitored interactive parts as they show up when we move the mouse cursor over them im ED 6064 View Configure iai Close di A z A olx ED 6064 Status Name Status Fully Operational State Online Description Fibre Channel Director Location End User Premise please configure h j i Cooling Fan Module Pos
211. field From the list highlight and click Fibre Channel Attached In the Hostname IP Address field type the hostname Click the Down Arrow to the right of the World Wide Port Name field 10 Select the worldwide port name from the list 11 Click Perform Configuration Update 1 12 4 Locating the WWPN for an RS 6000 and pSeries host system To locate the WWPN for an RS 6000 or pSeries host system perform the following steps 1 2 Login as root Type Iscfg v1 fcsx where x is the adapter number The network address is the Fibre Channel adapter port WWPN value Note The Iscfg v1 fesx ROS level identifies the Fibre Channel adapter firmware level 1 12 5 Locating the WWPN for a Compaq host system To locate the WWPN for a Compaq host system perform the following steps 1 From the console prompt type P0 gt gt gt wwidmgr show ada Following is an example of what is displayed Chapter 1 Implementing Fibre Channel host adapter cards 71 Probing timeout item adapter WWN Cur Topo Next Topo 0 pga0 0 0 7 1 1000 0000 c922 d469 FABRIC FABRIC 1 pgb0 0 0 8 1 2000 0000 c922 6a63 FABRIC FABRIC 9999 All of the above If you receive the following error wwidmgr available only prior to booting Reinit system and try again Type P00 gt gt gt init and repeat the wwidmgr command If you receive the following error wwidmgr No such command If you see this message type P00 gt gt set mode diag and type the ww
212. figuration Settings menu select Host Adapter Settings From the Advanced Adapter Settings menu press the Down Arrow to highlight LUNs per target and then press Enter Use the Down Arrow to find and highlight 256 Press Enter Press Esc To save the changes click Yes Press Enter 10 Restart the server 1 11 3 Installing the QLogic QLA2200F adapter card This section tells you how to attach an ESS to a Windows 2000 host system with the QLogic QLA2200F adapter card Single and dual port Fibre Channel interfaces with the QLogic QLA2200F adapter card support the following public and private loop modes 60 YYYY Y Target Public initiator Private initiator Target and public initiator Target and private initiator Perform the following steps to install the QLogic QLA2200F adapter card 1 2 3 Install the QLogic QLA2200F adapter card in the host system Connect the cable to the ESS port Restart the server Implementing an Open IBM SAN 4 Press Alt Q to get to the FAST Util menu 5 From the Configuration Settings menu select Host Adapter Settings 6 From the Host Adapter Settings menu set the following parameters and values a Host adapter BIOS Disabled b Frame size 2048 c Loop reset delay 5 minimum d Adapter hard loop ID Disabled 7 From the Advanced Adapter Settings menu press the Down Arrow to highlight LUNs per target Press Enter Set the parameters and values from the Advanced Adapte
213. fore refreshing the display Ef Attention x gt SAN Data Gateway 193 1 1 25 has finished restarting Les ve Figure 4 26 Restart completed message Once the Specialist has finished refreshing we can see that the firmware revision level has been updated successfully as shown in Figure 4 27 Ef StorWatch SAN Data Gateway Specialist 2000 Pathlight Technology Mi E3 File View Admin Tools Controls Help HB 193 1 1 25 Gateway SAN Data Gateway Current SAN Data Gateway Gateway World Wide Node Name IP Address 193 1 1 25 Serial Number 21081300937 Firmware Revision 3 41 37 Health Check Level 2 Health Check Interval 60 Log Size 2047 Receive Event Traps Enabled Serial Baud Rate 19200 Up Time 00 03 10 Done downloading SAN Data Gateway 193 1 1 25 data Figure 4 27 New firmware revision level Chapter 4 Implementing the SAN Data Gateway 283 4 4 SCSI devices The four SCSI ports on the SAN Data Gateway support Differential Ultra Wide SCSI devices It will automatically negotiate speed for wide or narrow bus width devices as well as standard fast and ultra speeds The SAN Data Gateway provides a termination on each of its SCSI buses The termination can be separately disabled if so desired from the StorWatch SAN Data Gateway Specialist window 4 4 1 LUN support The SAN Data Gateway provides support for up to 256 LUNs Each SCSI channel supports up to 15 SCSI targets and
214. g redundant SCSI connections Implementing an Open IBM SAN 4 7 1 Single host with multiple Fibre Channel adapters A host can have several adapters installed If each adapter is assigned to different LUNs using the SAN Data Gateway there are no contention issues As each adapter is assigned specific LUNs it cannot see or access any other LUNs that may be present However there may be situations where the adapters are used to perform load balancing and failover much like the SCSI connections from a host to the ESS that are in place today As the host in the SCSI situation requires the Subsystem Device Driver SDD on each host this is also true when using the Fibre Channel adapters Software similar to SDD is required in the host for it to recognize that it may have two or more paths to the same volume If this was not loaded on the host the host would recognize the volumes as being different and there will be contention problems and data corruption As SDD is currently only supported on SCSI adapters and not with Fibre Channel adapters it is also not supported when using the SAN Data Gateway to connect to an ESS 4 7 2 Multiple SCSI connections The SAN Data Gateway can have all four SCSI channels connected to a single ESS A volume in the ESS can be assigned to more than one SCSI port in the ESS If these SCSI ports that have the same volume assigned to it are connected to a SAN Data Gateway the Gateway will assign multiple L
215. g the Vicom Fibre Channel SLIC Router 311 5 1 SLIC Router features 0 eee 312 5 2 Installing the SLIC Router 2 0 0 0 0 eee eee 313 5 3 SLIC Manager software 0 00 cece tee 316 5 3 1 Installing the SLIC Manager software 0 0 005 317 5 3 2 Communicating to the Router 000 c eee eee eee 317 5 3 3 Starting the SLIC Manager 0 cee eee eee eee 322 5 4 Using SLIC Manager 0 00 ee 323 5 4 1 Drive properties 0 0 ee 324 Contents vii 5 4 2 Router properties 0 0 0 ee ete teens 324 5 4 3 Setting Router to master 0 0 00 eee eee 325 5 4 4 The SignOn drive oere ereliai ee ee 326 5 5 Composite drive ned 0 327 5 5 1 Creating a composite drive 0 eee eee 327 5 5 2 Composite drive properties 0 cee eee eee 331 5 62 Miror fs Ase asi eet ok nice Aah hg teeny Hen attra ae as 332 5 6 1 Creating a mirror drive 2 0 ee 333 5 6 2 Mirror drive properties 2 2 0 eee eee 336 5 7 Instant Copy drive 1 6 ete 337 5 7 1 Creating an Instant Copy drive 0 2 eee 338 5 7 2 Instant copy drive properties 0 0 00 eee eee eee 339 5 7 3 Adding an Instant Copy Drive toa mirror 2 340 5 7 4 Detach Instant Copy Drive from a mirror 0005 342 5 8 Combining composite and mirroring 0 e ce eee ee 342 5 8 1 Creating a second composite drive 0 0 eee eee eee 343
216. g to change as we are now prepared to add volumes 2 5 Creating and assigning ESS logical volumes As mentioned before adding volumes to the disk groups and assigning them to the newly defined host FC ports is done in one process It involves two steps using the Add Volume panels 2 5 1 Adding ESS logical volumes step one From the Open System Storage panel we use the Add Volumes button to start the definition of volumes on the newly configured disk groups as shown in Figure 2 64 Modify Host Systems Configure Host Adapter Ports Configure Disk Groups Add Volumes X Modify Volume Assignments Figure 2 64 Entry to the Add Volumes 1 of 2 panel 126 Implementing an Open IBM SAN This takes us to the Add Volumes 1 of 2 panel as shown in Figure 2 65 Add Volumes 1 of 2 Click on a Host or Array to see paths E E E RL Je m D Figure 2 65 Add Volumes 1 of 2 panel with host FC port PC1_1 selected Selecting host FC port for the volume assignment From here we select the host FC port PC1_1 that we just have defined We also have to select one of the ESS FC ports Figure 2 66 before we can go to the next panel IRs aa jaa Figure 2 66 host FC port and the ESS FC port selected Logically there is no reason to have to select a specific ESS FC port because we can reach the ESS logical volumes through every properly configured ESS FC port Even in the case of the host FC p
217. ge Server configuration 87 Viewing the Licensed Internal Code panel Using the Licensed Internal Code button we get the Licensed Internal Code panel as shown in Figure 2 13 Licensed Internal Gode Licensed Internal Code LIC Levels Cluster LIC Source Vasin o Aivi Date Chaser 1 Active LIC gogo tsa Chuster1 Previous LIC goss ta Caster 1 Weenie fasoss o Cister Acie LIC gogo 00a Custera weenie oso Licensed Feature Codes RE 4 2 Extended Remote Copy p to 16 0 TB 390 0 9469 TB 5 390 Peer to Peer Remote Copy PPRC p to 16 0 TB ESS 2 2095 TB ESS A AANE MT Aree Licensed Internal Code mA a Figure 2 13 Licensed Internal Code panel 88 Here we can see the LIC levels of the ESS clusters and the licensed feature codes that include all additional ESS functionality like copy services Implementing an Open IBM SAN 2 1 3 Configuring the ESS Following we introduce the panels that serve as entry points to the logical configuration of the ESS and link to the ESS Web Copy Services Viewing the Storage Allocation Graphical View panel Using the Storage Allocation button we get the Storage Allocation Graphical View panel shown in Figure 2 14 Storage Allocation Storage Allocation Graphical View Clear View View All Storage Tabular View E Click on a Host or Array to see paths TEE LVELLEEE EVEL a il COOLED L i ia obo
218. ged should contact IBM Corporation Dept 600A Mail Drop 1329 Somers NY 10589 USA Such information may be available subject to appropriate terms and conditions including in some cases payment of a fee The information contained in this document has not been submitted to any formal IBM test and is distributed AS IS The use of this information or the implementation of any of these techniques is a customer responsibility and depends on the customer s ability to evaluate and integrate them into the customer s operational environment While each item may have been reviewed by IBM for accuracy in a specific situation there is no guarantee that the same or similar results will be obtained elsewhere Customers attempting to adapt these techniques to their own environments do so at their own risk Any pointers in this publication to external Web sites are provided for convenience only and do not in any manner serve as an endorsement of these Web sites Copyright IBM Corp 2001 361 362 The following terms are trademarks of other companies C bus is a trademark of Corollary Inc in the United States and or other countries Java and all Java based trademarks and logos are trademarks or registered trademarks of Sun Microsystems Inc in the United States and or other countries Microsoft Windows Windows NT and the Windows logo are trademarks of Microsoft Corporation in the United States and or other countries PC Direct is a trad
219. h our configuration To see how the Storage Allocation Graphical View panel now looks we press the Storage Allocation button on the left of the screen Storage Allocation The panel shown in Figure 2 44 now illustrates the representation of the two disk groups between the SSA device adapter pair four in loop A It is the view of the panel with the disk group in cluster one selected Figure 2 44 Disk group section configured disk group selected 112 Implementing an Open IBM SAN The rectangle representing the disk group is green to show that this is empty storage We also see that the host FC port icon row is empty When selecting a particular disk group the row will only present and highlight those host FC port icons that have ESS logical volumes assigned to it in the selected disk group Because there is no host FC port defined there cannot be any ESS logical volume defined and assigned When the disk group is selected the Information field to the right of the panel shows specific information such as the location of the disk group the type of storage the disk group is configured for and the available and allocated capacity This is shown in Figure 2 45 Information al 4 A 2 Storage Type RAID Array Track Format Fixed Block FB Host Storage 0 00 210 48GB 0 Assigned 0 00 210 48GB 0 Unassigned 0 00 210 48GB 0 Not Allocated 210 45 210 48GB 1008 Figure 2 45 Information
220. hannels 1 and 2 but not to SCSI channels 3 and 4 To change the settings click any box and the check mark will toggle on and off All combinations are possible Once the desired settings are selected click OK For the new zone settings to take effect the SAN Data Gateway must be restarted 4 5 2 Virtual Private SAN The IBM Storage Area Network Data Gateway also provides LUN masking through a feature called Virtual Private SAN VPS This provides a granular restriction of host access to specific LUNs while utilizing and sharing the same connectivity paths through the SAN Data Gateway VPS keeps track of Fibre Channel hosts by using their unique World Wide Name In this way if a switch is attached the Gateway will also keep track of it because the switch also has a unique World Wide Name VPS also includes a host registration service so that when a host is attached its unique WWN is registered to the Gateway to provide information on the host and its status Enabling VPS The Virtual Private SAN feature has to be enabled because it comes disabled from the factory To enable it make sure the desired SAN Data Gateway is highlighted if more than one appears in your Specialist window Select Controls gt Feature Enable gt Virtual Private SAN as shown in Figure 4 29 PA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc File View Admin Tools Virtual Private SAN Gateway ITSO
221. he adapter to the case with the panel screw 6 Replace the computer case by tightening the screws on the case or use the clamp to secure the cover Implementing an Open IBM SAN 1 9 9 Downloading current JNI SBUS Fibre Channel adapter driver This section tells you how to download the JNI SBUS Fibre Channel adapter driver 1 2 O5 0 ND O Rn Plug in and restart your host system Go to the following Web site www jni com From the navigation menu at the top of the page click Drivers From the menu for Locate Driver by Product click FC64 1063 From the menu for FCI 1063 find the section for Solaris JNI Click few pkg In the dialog box for File Download click Save this file to disk Click OK In the Save As dialog box create a temporary folder Click Save When you click Save a window displays that shows the progress of the download 10 When the download completes click Close 11 If you downloaded the driver file from a Sun host system go to Installing the JNI SBUS Fibre Channel adapter driver If you downloaded the driver file from a non Sun host system transfer the drive file to a Sun host system 1 9 10 Installing the JNI SBUS Fibre Channel adapter driver Perform the following steps to install the JNI SBUS Fibre Channel adapter drivers 1 Go to the following Web site www jni com 2 From the navigation menu at the top of the page click Drivers 3 From the menu for Locate Driver by Product
222. he composite drives that made up the mirror will return to the Composite Drive window as viewed from the Control Center Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 349 However since each composite drive had its attributes changed as it became a member of the mirror it will no longer be mapped The composite drives will show up as UnMapped in the Control Center window This is shown in Figure 5 37 The mirror created in 5 8 2 Creating the mirror on page 345 was removed Control Center Storage Departments Mirror Drive Instant Copy Drive T33282 ITSOm Properties Identify p Composite Drive T33025 ITS01 T3302 ITS03 Physical Drive TOOOOO 35E68229 General Spare Drive Figure 5 37 UnMapped composite drives 350 The existing composite drives ITSO1T and ITSO3 cannot be mapped or given a new LUN number at this point Each logical composite drive must be removed as well This will cause the composite drive to be removed and its member drives to become general spares Once they are general spares the drives can be used to recreate the composite drive or to create new logical drives Implementing an Open IBM SAN 5 10 Expanding the SLIC system The SLIC storage system can be expanded to add more SSA disks or more SLIC Routers Each SLIC storage system can support up to 64 SSA disks and have 16 Routers 5 10 1 Adding disk To add disk to an existing SLIC system
223. he host bays however does affect access to data which is identified by a darker color Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 83 Viewing the Status Problem Log panel To get a detailed view on the problems encountered we use the Problem Log button on the upper right of the screen and get the Status Problem Log panel as shown in Figure 2 9 Problem Log Status Problem Log a Refresh Data Graphical View Problem log as of May 3 2001 9 58 36 AM PDT Problem Id 2 Reporting Cluster 1 Problem Description MFE FAILURE Problem Age This problem occurred 2 times on May 2 2001 5 38 42 PM PDT and on May 3 2001 9 55 28 AM PDT Problem Status Service Action is Required Service Status pending service User Action not defined Probable Cause HARDWARE FAILURE Problema Id 4 Reporting Cluster 1 Problem Description MFE FAILURE Problem Age This problem occurred 2 times on May 2 2001 5 38 42 PM PDT and on May 3 2001 9 55 27 AM PDT Problem Status Service Action is Required Service Status pending service x Cancel the selected problem Figure 2 9 Status Problem Log panel Using the Graphical View button we are able to go back to the graphical view 84 Implementing an Open IBM SAN Viewing the Problem Notification panel Using the Problem Notification button we get the Problem Notification panel shown in Figure 2 10 Problem Notificati
224. he steps described above can be repeated Click Finish when you have created all the desired copy drives Up to this point the configuration has been kept within the SLIC Manager software When the Finish button is clicked the SLIC Manager will now communicate to the Router to complete the process and update the Router to control the drives 5 7 2 Instant copy drive properties You can go to the Control Center window by selecting Tools gt Control Center The copy drive that was created above can now be seen in the Mirror Drive Instant Copy window as shown in Figure 5 27 Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 339 Control Center 733282 ITSOm PUBLIC T33283 copyl PUBLIC IC T33025 ITSOL TOOOOO 35E68229 TOOOO 3SE6S84AE Figure 5 27 Control Center with Instant Copy Drive Notice that in the information provided for the copy drive there is an IC included to distinguish between mirror drives and copy drives within this window 5 7 3 Adding an Instant Copy Drive to a mirror To add or detach the copy drive from a mirror you select and highlight the mirror drive and then click the Properties button The Mirror Drive Properties window opens as shown in Figure 5 24 on page 337 Click the Add Member button and the Add Mirror Member window opens as shown in Figure 5 28 340 Implementing an Open IBM SAN Add Mirror Member T00000 LOOO 35E68229 T0000 LOO 35E684AE T33025 ITsol T33283 co
225. hese are the panels that are accessed through the buttons displayed on the left of the screen Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 77 2 1 1 Logging on to the ESS Specialist Here we will detail the steps to log on to the ESS Specialist Viewing the Introduction panel Once connected to one of the ESS clusters either reloading the Web page using the Reload button of the Web browser or clicking the Introduction button will take us to the introduction panel of the ESS Specialist as shown in Figure 2 2 introduction Seascape Web User Interface Netscape File Edit View Go Communicator Help ite tansacsoz py i G7 Bookmarks E Location http ospl8c1 sanjose ibm com StorWatch Enterprise Storage Server Specialist Solutions Welcome to IBM StorWatch Enterprise Storage Server Specialist Introduction Status Problem Notification Communications Storage Allocation Users Licensed Internal Code Figure 2 2 Introduction panel of the ESS specialist 78 Implementing an Open IBM SAN Machine Type 2105 Machine Model F20 Serial Number 075 18486 WWHH 5005076300C085CE Copyright 12M Corp 1998 2000 Licensed Materials Property of IBM All Rights Reserved IBM is a registered trademark of the IBM Corp U S Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp To the left we see
226. his scenario there is only one Fibre Channel cable from the host to the Router and it is a single point of failure Another option is to add a second Fibre Channel host adapter that will connect to the other Router This provides a high availability feature because there are now two paths to the storage system Software must be used for automatic failover and load balancing between the two Fibre Channel host adapters Failover also can be done manually if so desired Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 351 On the SSA side there are a few options available Each Router can have its own SSA loop so that each one can support 64 SSA disks In this way storage capacity is scalable because it can be increased by adding more Routers This is shown in Figure 5 38 Server Fibre Channel SSA Disks SSA Disks Figure 5 38 Increasing storage capacity The other option is to have each additional Router added to the same SSA loop Throughput to the SSA loop will increase because each Router can access the disks for multiple simultaneous operations This configuration is shown in Figure 5 39 Server Fibre Channel SSA Disks SSA Disks Figure 5 39 Increasing throughput 352 Implementing an Open IBM SAN Installing additional Routers With the existing Router and storage system powered on 1 The node map on the new
227. hown in Figure 2 31 Disk groups can also be selected to show the state of the selected storage Then the host interface row will only show the host FC ports that have ESS logical volumes assigned to that exist on this particular disk group Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 101 EsonNe PCI PCL gt pl n n Figure 2 31 Disk groups view all storage mode To show the state of the disk groups which contain ESS logical volumes assigned to a particular host FC port we select the host FC port first and then one of the yellow highlighted ESS FC ports which is shown in Figure 2 32 Figure 2 32 Disk groups storage assigned to selected host FC port 102 Implementing an Open IBM SAN There are different colors to indicate the state of the disk groups At the upper right of the screen shown in Figure 2 33 a legend is displayed which explains what the different colors in the disk groups represent Figure 2 33 Legend of the disk group status colors The colors indicate the following Purple Host Storage Disk storage that contains ESS logical volumes that are assigned to a specific selected host FC port This displays only if a host FC port is selected first Red Assigned Disk storage that contains ESS logical volumes that are assigned to other than the selected host FC port or that are assigned to any host FC port when no host FC port was select
228. ides an interface that supports 100 Mbps full duplex data transfer Table 1 1 Fibre Channel cables om oee OOOO eee ao rein onean OOOO eemo oner ec ec Te into corey 50m 790 For Fibre Channel the maximum distance between fabric switches fabric hubs and link extenders and a host Fibre Channel port or an ESS Fibre Channel port is limited to 11 km 6 mi The maximum distance might be greater than 11 km 6 mi when a link extender provides appropriate target initiator or controller emulation functions such that the length of the connection perceived by the ESS does not exceed 11 km 6 mi Link extenders with emulation functions should not be used on links over which synchronous PPRC operations are performed because of the additional path delay introduced by these units Chapter 1 Implementing Fibre Channel host adapter cards 3 1 1 3 LUN affinity For Fibre Channel attachment LUNs have an affinity to the host s Fibre Channel adapter through the world wide port name WWPN for the host adapter In a switched fabric configuration a single Fibre Channel host could have physical access to multiple Fibre Channel ports on the ESS In this case you can configure the ESS to allow the host to use either gt All physically accessible Fibre Channel ports on the ESS gt Only a subset of the physically accessible Fibre Channel ports on the ESS In either case the set of LUNs that are accessed by the Fibre Channel host are the same
229. idmgr command again If the system is already running you can find the WWPN in the log file var adm messages 2 Type fgrep wwn var adm messages Note The worldwide port names are recorded at each system startup This is an example of typing var adm messages Nov 9 09 01 16 osplcpq ds20 vmunix KGPSA BC Driver Rev 1 21 F W Rev 2 22X1 1 13 wwn 1000 0000 c922 d469 Nov 10 10 07 12 osplcpq ds20 vmunix KGPSA BC Driver Rev 1 21 F W Rev 2 22X1 1 13 wwn 1000 0000 c922 d469 Nov 13 17 25 28 osplcpq ds20 vmunix KGPSA BC Driver Rev 1 21 F W Rev 2 22X1 1 13 wwn 1000 0000 c922 d469 Nov 14 11 08 16 osplcpq ds20 vmunix KGPSA BC Driver Rev 1 21 F W Rev 2 22X1 1 13 wwn 1000 0000 c922 d469 Nov 15 10 49 31 osplcpq ds20 vmunix KGPSA BC Driver Rev 1 21 F W Rev 2 22X1 1 13 wwn 1000 0000 c922 d469 1 12 6 Locating the WWPN for a Hewlett Packard host system 72 To locate the WWPN for a Hewlett Packard host system perform the following steps 1 Go to the root directory 2 Type ioscan fn more 3 Look under the description for the Fibre Channel Mass Storage adapter Implementing an Open IBM SAN For example to look for the device path name dev td1 type femsutil dev tdl where dev td1 1 12 7 Locating the WWPN for a Novell NetWare host system To locate the WWPN for a Novell NetWare host system with a QLogic adapter perform the following steps 1 Restart the server 2 Press Alt Q to get the FAST Util menu If you
230. ify the rights that the new user should have This is shown in Figure 3 20 g WA McDATA Enterprise Fabric Connectivity Manager Product View Configure Users xj E View Description a Administrator System Administrator User name Thomas i Password hata Confirm Password e Logs Description remote administrator x Maintenance Rights Granted Rights Available New Mot fiview Product Administrator System Administrator lt lt Add Operator Maintenance ae LogoutExit Figure 3 20 EFC Manager Configure Users New User To assign rights to the user we click one of the Rights Available choices and click the Add button The rights are System Administrator Product Administrator Operator Maintenance View YYYY Y 198 Implementing an Open IBM SAN The System Administrator right grants access to every control and configuration task that needs to be performed from within the EFC Manager and can be viewed as the highest level of authority It only has view rights while operating in a product manager application Here we need the Product Administrator right to perform changes All new users initially have view rights and this cannot be removed For a table of user rights of product manager functions refer to the Enterprise Fabric Connectivity Manager User Manual To change the settings for a use
231. igure 2 118 the Storage Server Attributes field also known as the logical unit number LUN access mode which specifies the channel access mode can only be changed by an IBM SSR using the service terminal Storage Server Attributes Access Restricted Fibre Channel Access Mode Figure 2 118 Storage Server Attributes field ESS configured for Access_Restricted 162 Implementing an Open IBM SAN There are two Fibre Channel Access Modes to which the ESS can be configured gt Access_Any In Access_Any mode any host FC port that is not defined in the ESS Specialist can access all non AS 400 ESS logical volumes In Access Any mode the ESS Specialist displays an anonymous pseudo host FC port icon which is shown in Figure 2 119 and which is taken from another ESS because the one we used here is configured for Access_Restricted An anonymous host FC port is not a real host FC port in disguise and connected to the storage server It represents all host FC ports if any that are connected to the ESS and that are not configured on the ESS The anonymous host FC ports do not have an access profile defined You can access specific ESS logical volumes that are defined in the ESS by host FC ports that are not identified by the ESS gt Access_Restricted In Access_Restricted mode a connected host FC port which is not configured with the WWPN cannot access any ESS logical volume When this host FC port gets configured by using the WW
232. igure 4 6 we show the initial view once a connection to a SAN Data Gateway is established and the data has been downloaded PA storwatche SAN Data Gateway Specialist 2000 Pathlight Technology Inc x File View Admin Tools Controls Help aj a Current SAN Data Gateway ITSO World Wide Node Name 10000060 45160E08 IP Address 9 113 24 110 Serial Number 21081300724 Firmware Revision 3 40 10 Health Check Level 2 Health Check Interval 15 Log Size 2047 Receive Event Traps Enabled Serial Baud Rate 19200 Figure 4 6 StorWatch SAN Data Gateway Specialist initial view The left side of the window shows the SAN Data Gateway unit we are connected to and the right side provides product data information You will also notice that the toolbar will have options available that were previously greyed out You can now connect to another SAN Data Gateway disconnect from a SAN Data Gateway enable and access the Zoning and VPS features restart the Gateway and also refresh the data to your window by downloading it again These options become available when a SAN Data Gateway is highlighted As you begin to add SAN Data Gateway systems or drill down into a particular Gateway by selecting and highlighting different channels or ports different options will become available and other options will become greyed out and unavailable Be aware of what system channel or port is highlighted as you move through the toolbar 2
233. igure 5 2 SW1 dip switches For example by setting switch 2 and 0 down a value of 5 is represented All other switches would be in the up position By setting a switch down its value is added To change a number that was previously set on a Router power must be cycled to the Router for the change to take effect Map the physical drives Before powering on again SW2 must be set to mode 3 with switch 0 and 1 set down and all other switches set up The Router is powered on the Status LED will flash rapidly to rediscover the disks and the SSA drive LEDs should be on solid Once completed the status LED will be solid and the drives are now considered to be mapped physical drives The Router is powered off Implementing an Open IBM SAN 7 Create general spares The mode on SW2 is changed to mode 12 to set all drives to be general spares Mode 12 is represented by setting switch 2 and 3 down and the rest turned up Power on the Router again the Status LED will flash After approximately one minute the LED will flash code 100 to indicate it has completed The Router is again powered off 8 Format the drives The Router is set to mode 14 switch 1 2 and 3 down on SW2 to format all disk drives Power on the Router depending on the number of drives the format process will take anywhere from 30 to 60 minutes During this time the Status LED will flash rapidly and the SSA drive LEDs will flash When it has completed the Status
234. ing the host interfaces row The top row shown in Figure 2 22 presents symbols for the host interfaces that have access to the ESS lt EsconNet gt Figure 2 22 Host interfaces row without any configured host interface In the case of hosts with Fibre Channel connectivity there will be an icon like the one shown in Figure 2 23 for each host FC port that is defined in the ESS with its World Wide Port Name WWPN The same applies to defined SCSI attached hosts Figure 2 23 Open systems host port icon There is no host FC port configured at this time therefore in Figure 2 22 there is no icon shown For ESCON attachment if installed there is a placeholder icon for all connections The host interface icons can be selected which will change the view of the panel to represent the configuration according to the selected host interface Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 97 98 Using the ESS interfaces row Below the host interface row we see the row with icons for the ESS installed interface adapters shown in Figure 2 24 oe Pe eG EE BE Figure 2 24 Installed ESS interfaces row The row is divided into four columns to show the location in the ESS interface bays Our ESS is equipped with four ESCON adapters and four SCSI adapters with one of them in each bay and 8 Fibre Channel adapters with two of them in each bay For a Fibre Channel ESS which also has t
235. ion we will indicate our use of the configuration panel buttons by pointing the mouse on the button Using the proper order of configuration steps This is an introduction to the dependencies that some configuration steps have Our ESS is not configured so we show where we start the configuration What we want to achieve is to prepare the ESS to provide some ESS logical volumes to host FC ports Some of the configuration steps have to be done prior to others Figure 2 37 shows the dependencies of the configuration steps Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 105 f y Configure Disk Groups Modify Host Systems aoe _ 7 Configuring disk groups and S 4 7 aad defining host FC ports to be able to add ESS logical volumes oN E Ca b la N i 1 i Y y Modify Volume Assignments x 4 S 7 mas 7 Configuring the ESS FC ports Lg a for FC SW or FC AL Adding ESS logical volumes to 2 77 DS disk groups and assigning them to a Ty host FC ports i Configure Host Adapter Ports w Accessing the assigned ESS logical volumes Figure 2 37 ESS configuration dependencies 106 Implementing an Open IBM SAN One step that is independent from the others is the configuration of the ESS FC ports for FC SW or FC AL For this we have to know what type of FC topology we want to connect with
236. ion reasons We now see a second ISL but there is no green circle around the third switch This is because the EFC Manager is not able to retrieve any information about the device This device cannot be managed using the product manager 258 Implementing an Open IBM SAN We disconnected the undefined switch and go back to the Port List View of the cascaded switches as shown in Figure 3 88 ED 6064 ED 6064 1 Ea Port Properties ISL to ES 3016 1 000000 McDATA 20 04 08 00 88 20 00 0F Not logged in Unblocked m Uv i Fotoos oee wo SSS S w SSS S wo SCS Oooo o Figure 3 88 ED 6064 with one E_Port online We now see that port 0 is online as an E_Port which shows us that this is the port that is used for our ISL We also see the names we assigned to the ISL ports By clicking the row of a port in this case port 0 it returns us detailed information about this port Port 1 is not yet used as an ISL port and we can see that it is not online Chapter 3 Implementing a SAN with McDATA 259 After activating the zone set the Zoning View of the merged fabric now looks like that shown in Figure 3 89 This shows the Active Zone Set of our fabric corresponding to Figure 3 79 on page 250 McDATA Fabric Manager O x rit Zoning View Default Zone Enabled View ctive Zone Set pas _JITSO_Zone_Set1 Configure INT_Zone_ RPKAS3_C1B2A1 QLogic 20 00 00 E0 88 00 52 5E
237. ions Note The IBM Subsystem Device Driver 1 1 3 supports the Hewlett Packard host system in a clustering environment To have failover protection on an open system the IBM Subsystem Device Driver requires a minimum of two Fibre Channel adapters The maximum number of Fibre Channel adapters supported is 16 for a total of 16 Fibre Channel ports 1 7 2 Installing the 2105 host install script file 24 This section provides the instructions to install the 2105 host install script file from a compact disc for the ESS on your host system Before installing the 2105 host install script file connect the host system to the ESS See Attaching an ESS to an open systems host with SCSI adapters Install the 2105 host install script from a compact disc You must have superuser authority to complete these instructions The following must be taken into account 1 You can only install and run the IBM 2105 set queue depth program version 2 7 1 00 on HP UX operating system 10 01or later 2 If an ESS was used with the SAN Data Gateway on a Hewlett Packard host system and the LUNs were created as Fibre Channel devices by spoofing HP UX and describing the ESS device types as Sun or other non Hewlett Packard Fibre Channel device types the LUNs created under this false ID must be deleted and recreated as Hewlett Packard device types Perform the following steps to install the 2105 host install script from a compact disc 1 If you do not already hav
238. ions are grayed out except for SCSI Channel Once selected a dialog box will appear as shown in Figure 4 14 and display the settings for the SCSI channel Max LUNs per ID 32 Host ID k F eB Channel Mode Initiator Target Identify SCSI Channel MaxIDs perbus 16 OK Cancel Max Speed Ultra 20Mhz Advanced Options Figure 4 14 SCSI channel parameters Selecting the Advanced Options button displays a dialog box as shown in Figure 4 15 These settings are not typically changed and may disrupt normal operations so you should consult a service representative before changing any Advanced Options 276 Implementing an Open IBM SAN Pa Advanced SCSI Channel Options x v Bus Reset On Power Up 1 v Alternate Initiator ID Termination v Enabled Reset OK Cancel Figure 4 15 Advanced SCSI parameters Fibre Channel parameters are displayed in a similar fashion Highlight a Fibre Channel port and select Controls from the toolbar you will notice that now all options are grayed out except the Fibre Channel option By selecting this a dialog box will display the parameters that can be changed for the Fibre Channel port selected If any of the settings as shown in Figure 4 16 are changed the SAN Data Gateway must be restarted PA Set Fibre Channel Parameters x LoopID v Sot x _ FC Tape Frame Size 512 1024 2048 ISP2200 Port Mode Target Initiator Port Mode
239. irror The Copy drive can now be accessed by another host 5 8 Combining composite and mirroring 342 The SLIC Manager can also be used to combine the two features of the Router You can create a mirror drive using composite drives A mirror can have drive members of different sizes but the actual mirror capacity will be the smaller of the drive sizes Implementing an Open IBM SAN 5 8 1 Creating a second composite drive To provide an example of a mirror using only composite drives another composite drive is required The example shown in Figure 5 31 shows that drive 6 and 7 were used to create another composite drive Composite Drive Setup Composite Drive Members Selection TOOOOOLOOO 35E68229 TOOOOE 35E68462 TOOO06 LOOG 35E68462 TOOO0 35E6844E TOOOO7 LOO 356844 Figure 5 31 Creating composite drive to be used in a mirror Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 343 Follow the steps to create a composite drive as described in 5 5 Composite drive on page 327 Once created you can view the Control Center window by selecting Tools gt Control Center from the toolbar Figure 5 32 shows that there are now two composite drives Control Center T33282 ITSOm T33025 ITS0L 733027 ITSO3 TOOOOO 3SE68229 Figure 5 32 Control Center with two composite drives 344 Implementing an Open IBM SAN 5 8 2 Creating the mirror The mirror can now be created by selec
240. iscover what volumes are assigned to PC1_2 we select this host FC port At this stage we see that the two disk groups have purple spaces on them which means they are assigned to the selected host FC port 140 Implementing an Open IBM SAN We select the host PC1_2 and we see that lines now appear connecting the host port ESS FC port and storage volumes This is shown in Figure 2 86 lt EsconNe PC1_1 gt Figure 2 86 Host FC port and ESS FC port selected Viewing changes on the Tabular View panel Now we will look at the Storage Allocation Tabular View panel We reach this from here using the Tabular View button on the top right of the panel This shows detailed information on all host FC ports assigned ESS logical volumes in one table as shown in Figure 2 87 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 141 Storage Allocation Tabular View List of Assigned Volumes Print Table Perform Sort Graphical View Pell LSS 016 600 18486 Open System 016 1 GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 1 Loop A ID 00 LUN 0000 Aray 2 Vol 000 Pell LSS 017 700 18486 Open System 016 1 GB Fibre Charmel Device Adapter Pair 4 FC Port A Cluster 2 Loop A ID 00 LUN 0001 Array 1 Vol 000 PC12 LSS 016 601 18486 Open System 064 0 GB Fibre Charmel Device Adapter Pair FC Port A Cluster 1 Loop B ID 00 LUN 0000 Array 2 Vol 001 PC12 Lss 017 701 18486 Open System
241. it If the Manager cannot access the first SLIC zone it would try the next zone in the order it was entered in the path statement For the naming conventions used on other operating systems to create a SLIC Zone refer to the SLIC Manager Installation and User Guide 310 605807 The userlogfile will define a file with which you can view logged events The QueryChangelnterval sets the time in seconds that the daemon will poll the Router The recommended time set here is 10 Ensure that at the end of every line a semi colon is used and that if several SLIC Zones are created a comma separates them Save and exit the file Implementing an Open IBM SAN Installing the SLIC Manager daemon With the configuration file edited and a SLIC Zone created the daemon service can be installed and run To install the service in Windows NT open a DOS prompt and go to C ibm7190 sdus Type in slicd install and the daemon will be installed Starting the SLIC Manager daemon To start the daemon service select Start gt Settings gt Control panel from Windows NT Double click the Services icon Scroll down until you see Vicom SLIC Manager select and highlight it You will see two columns to the right to indicate its status To start the service click the Start button and it will take a few moments to complete Once it is done you will see the word Started in the Status column If the Startup column contains the word Automatic no furthe
242. it has a TCP IP connection to the server One or more clients can connect to a server The client provides the user interface to allow the management and configuration of the SAN Data Gateway The server and client can be installed on to the same computer The StorWatch SAN Data Gateway Specialist supports the following operating systems gt Windows 95 98 2000 and NT 4 0 with SP5 or later gt AIX ver 4 3 3 or later gt Solaris 2 6 or later Chapter 4 Implementing the SAN Data Gateway 267 4 3 1 Installing StorWatch Specialist 268 The Specialist software is not bundled with the SAN Data Gateway The Specialist software is downloaded using a Web browser by going to the IBM Storage Area Network Data Gateway Web site http www storage ibm com hardsoft products sangateway support forml htm This will take you to a registration window Enter the required information and select Submit Information A license agreement window is shown and once reviewed select agree The Download Main Page window will load Then select the specific operating system platform Review the readme txt file for the latest information and instructions before installing This Web site also contains all the latest firmware for the SAN Data Gateway and supported host bus adapters The StorWatch SAN Data Gateway Specialist software file is a self extracting file Once it has been downloaded execute or run the file and it will automatically load onto your
243. ith McDATA 185 Network setup with switches configured in a dedicated LAN We suggest for security and availability reasons using the optional Ethernet hub to establish a dedicated Ethernet to connect the EFC server with the switches This is illustrated in Figure 3 8 Remote EFC Manager client Private Ethernet Ethernet Hub McDATA LAN K secondary network interface EFC Server i Corporate LAN i primary network interface 2o00 Loopswitch SO DooooooG Switch aXe slae aie niela Director Ls Be Cabinet Figure 3 8 Suggested McDATA network setup 186 The arrows indicate the route for the remote EFC Manager client to access the EFC Server As we can now see the McDATA supplied hub is not part of the corporate LAN This solution could be used in environments where it is the corporate policy not to attach additional network devices like hubs to the LAN The interface of the EFC Server that the corporate LAN is going to connect to has to be the primary interface and has to have a valid corporate network setup The secondary network interface does not have to be changed because it only connects to the private ethernet hub The network information for the first switch does not need to be changed as well Of course when we add the other switches we will change the IP addresses for the new
244. ition 0 G_Port Module GSF1 Slot 1 ports 4 7 a a La Le a Lm Le Gs Power Supply Module Position 1 Front View Rear View Figure 3 28 Product Manager ED 6064 Hardware View Chapter 3 Implementing a SAN with McDATA 205 At the top of the window we see the operational status of the switch itself The switch is fully operational and online The Front View and the Rear View of the unit show the installed components The graphics representing the components of the switch are interactive which means by selecting them we are able to view more information or to perform configuration or maintenance actions They are also monitored so that we have a graphical representation of the failed part in the front and rear view Using the interactive port card view As we can see there are 8 port cards installed which makes a total of 32 ports Clicking one of the port cards opens the Port Card View as shown in Figure 3 29 lol x Port Card View FRUName G_Port Module GSF1 Position Slot 7 FPM 0 State Active Beaconing oft oo PartNumber 470 000439 004 E Serial Number 80451226 Port Number Port Name Type Fibre Channel Address Port WAAN Attached Port WAWN Block Configuration 10 100 km Configuration LIN Alerts Configuration Beaconing Link Incident Operational State Segmentation Reason Figure 3 29 Product
245. iver or Download Now for a SPARC driver From the File Download window click Save this file to disk 9 Click OK 10 In the Save As window click Save A window that shows the progress of the download is displayed 11 When the download completes click Close Note If you downloaded the driver file to a host system other than a Sun you must transfer the file to the Sun host system Otherwise go to Installing the Emulex LP8000 Fibre Channel adapter drivers 1 9 4 Installing the Fibre Channel adapter drivers Perform the following steps to install the Fibre Channel adapter drivers 1 2 3 Login as root Type emlxtemp to create a temporary directory Type cd emlxtemp to change the directory to the temporary directory If you are downloading the file from the FTP site or have the file on the CD ROM go to step 5 Type etc init d volmgt stop and then unmount dev fd to copy the tar file from a floppy diskette Copy or download the device driver file to the temporary directory Chapter 1 Implementing Fibre Channel host adapter cards 33 34 6 If the file is in the format of filename tar Z type uncompress filename tar Z 7 Type tar xvf Ipfc sparc tar to untar the drive file from the temporary directory 8 Type pkgadd d pwd to install the package Note An installation script displays that prompts you to answer a number of questions For each question enter the appropriate response Or
246. l htm McDATA Enterprise Fabric Connectivity Manager Recommended Installation for Your Platform Start Installer for Windows 95 98 NT installer created with InstallAnywhere by Zero G Software inc Copyright 1998 www ZeroG com Figure 3 13 EFC Manager client installation starting the installation After clicking the button to start the installation process the software starts downloading to our local machine and begins the installation The same installation would begin after executing the installer named medataClientInstall exe 192 Implementing an Open IBM SAN We now follow the instructions to install the EFC Manager client After confirming the licence agreement we get information about which version we are going to install as shown in Figure 3 14 D McDATA Enterprise Fabric Connectivity Manager iof x Important Information Please read before continuing This will install Version 03 01 00 Click Next to continue or Exit to cancel Exit Previous i Figure 3 14 EFC Manager client installation EFC Manager version The final step is to tell the installation program where to put the program files 3 3 Managing the environment using the EFC Manager In our environment we have an ED 6064 and the EFC server installed both have valid IP addresses and are accessible through the corporate intranet The EFC Manager is used for fabric specific administration of the McDATA S
247. l parameters for the director for example the preferred domain ID This is shown in Figure 3 41 Ea Configure Operating Parameters xi rete Figure 3 41 Product Manager ED 6064 Configure Operating Parameters The BB_Credit of 60 enables the support for up to 100 km distance between two ports The R_A_TOV is a time out value for operations that depend on the maximum time that frames can be delayed and still be delivered The E_D_TOV defines the time that the director waits for a response before declaring an error condition Both time out values must be the same for all switches in order to build a multiswitch fabric The switch priority is used to define the principal switch in a multiswitch fabric The lower the number the higher the priority An important setting here is the Preferred Domain ID The domain ID has to be unique for each switch or director within a multiswitch fabric If we add a switch or director to our SAN it will retrieve the domain ID from the principal switch If the domain ID that is preferred is already in use by another switch the switch will get another unused ID However when two fabrics join and they recognize a domain ID conflict the fabric build process will fail If other switches or directors join the fabric there will be a rerouting delay This is to ensure that frames are delivered in the correct order in a multiswitch fabric Also the routes through the fabric will be recalculated to make sure that the
248. le 100 Fast command posting Enabled gt 4 GB addressing Disabled for 32 bit systems LUNs per target 0 Enable LIP reset No Enable LIP full login No oa95p Note In a clustering environment set Enable LIP full login to Yes Enable target reset Yes Login retrycount 20 minimum Port down retrycount 20 minimum Driver load RISC code Enabled Enable database updates No Disable database load No IOCB allocation 256 Extended error logging Disabled might be enabled for debugging Note The Enable LIP reset Enable LIP full logon and Enable target reset parameters control the behavior of the adapter when Windows NT tries to do a SCSI bus reset You must perform a target reset to make cluster failovers work Use the SCSI bus device reset option to clear SCSI reservations 8 Press Esc to return to the Configuration Settings menu 9 From the Configuration Settings menu scroll down to Extended Firmware Settings Press Enter 10 From the Extended Firmware Settings menu scroll down to Connection Options to open the Option and Type of Connection window 11 Select one of the following options a 0 Loop only b 1 Point to point preferred setting c 2 Loop preferred If you cannot use arbitrated loop then default to point to point d 3 Point to point otherwise loop If you cannot use point to point default to arbitrated loop Implementing an Open IBM SAN Note If you connect the ESS directly to th
249. lect Add Detached Node We get a data entry field where we insert the WWPN of the port as shown in Figure 3 63 NT Zone 1 RPKAG3_C1B2A1 Domain 1 Port 2 Emulex 10 00 00 00 09 20 DC 71 Port 3 Emulex 10 00 00 00 C9 20 E7 C Port 4 Emulex 10 00 00 00 C9 20 E7 F3 Port 5 KATE_FCSO Port 6 RPKA93_C1B2A1 Port 7 RPKA93_C1B3A1 r Add Detached Node 10 00 00 00 09 20 CA E6 Figure 3 63 Fabric Manager Add Detached Node They become instantly restricted to the zone in which we have defined them when they are connected We choose to specify the WWPN to define them to the zone because we want them to be members of the zone regardless of which switch port they are going to be connected to This will also make it easier should we need to rearrange the cabling at any stage or in the event of a failure Chapter 3 Implementing a SAN with McDATA 235 Saving the zone While trying to save the zone using the Save Zone button we got an error message This is because of the spaces in the zone name as shown in Figure 3 64 NT Zone 1 RPKA93_C1B2A1 Domain 1 QLogic 20 00 00 E0 88 00 52 5E Port 2 Emulex 10 00 00 00 C9 20 DC 71 Emulexe10 00 00 00 C9 20 CA E6 Port 3 Ernulex 10 00 00 00 C9 20 E7 C7 Port 4 Emulex 10 00 00 00 C9 20 E7 F3 PortS KATE_FCSO Port 6 RPKAS3_C1B2A1 Port RPKAS3_C1B3A1 Figure 3 64 Fabric Manager incorrect zone name This is not allowed so to circumvent this problem we changed it to NT_Zone_1
250. letion of the fabric login process and prior to the FC 4 level operations with the destination port N_Port Login may be either explicit or implicit Name Server Provides translation from a given node name to one or more associated N_Port identifiers NAS Network Attached Storage a term used to describe a technology where an integrated storage system is attached to a messaging network that uses common communications protocols such as TCP IP NDMP Network Data Management Protocol Network An aggregation of interconnected nodes workstations file servers and or peripherals with its own protocol that supports interaction Network Topology Physical arrangement of nodes and interconnecting communications links in networks based on application requirements and geographical distribution of users NFS Network File System A distributed file system in UNIX developed by Sun Microsystems which allows a set of computers to cooperatively access each other s files in a transparent manner NL_Port Node Loop Port a node port that supports Arbitrated Loop devices NMS Network Management System A system responsible for managing at least part of a network NMSs communicate with agents to help keep track of network statistics and resources Node An entity with one or more N_Ports or NL_Ports Non Blocking A term used to indicate that the capabilities of a switch are such that the total number of available transmission paths is eq
251. lick Hex Click OK 4 If the value exists and is less than 0x000000f0 240 decimal perform the following steps to increase it to Oxf0 92959 Click TimeOutValue Click Edit gt DWORD For data click f0 For radix click hex Click OK 5 Exit the Regedt32 program 6 Restart your Windows NT server for the changes to take effect 1 10 9 Installing Emulex LP8000 adapter cards This section tells you how to attach an ESS to a Windows NT host system with Emulex LP8000 adapter cards Single and dual port Fibre Channel interfaces with the Emulex LP8000 adapter cards support the following public and private loop modes Chapter 1 Implementing Fibre Channel host adapter cards 53 YYYY Y Target Public initiator Private initiator Target and public initiator Target and private initiator The ESS supports increased connectivity with the use of Fibre Channel SCSI FCP and FICON directors Specific details on status availability and configuration options for the Fibre Channel directors supported by the ESS are available on the Web www storage ibm com hardsoft products ess supserver htm Perform the following steps to install the Emulex LP8000 adapter card al o Turn off and unplug the computer 2 Remove the computer case 3 4 Insert the host adapter board into the empty PCI bus slot Press firmly until Remove the blank menu from an empty PCI bus slot seated Secure the mounting bracket for the
252. lick Readme to get the instructions to install the Fibre Channel adapter driver Print the Readme file 16 In the window for WinZip Wizard Unzip Complete click Close 17 Ensure that the name of the file you want to download is displayed in the window 18 Click Save to download and unzip the file to your hard drive A window opens that indicates the progress of the download operation When the progress indicator window closes the download is complete 1 10 11 Installing the Fibre Channel adapter drivers Perform the following steps to install the Fibre Channel adapter drivers Note If you are installing the Fibre Channel adapter for the first time you must specify the correct topology You must also select the appropriate device mapping driver From your desktop click Start Settings Double click Control Panel Double click SCSI Adapters Click the Drivers tab gee G0 NDS ss Chapter 1 Implementing Fibre Channel host adapter cards 55 5 Click Add to create a list of drivers A window opens that indicates the progress When the window closes you should see a window called Install Driver 6 From the Install Driver window click Have Disk 7 Enter the path to the driver file that you downloaded and click OK 8 To install the driver highlight the line that lists the driver you want and click OK Note The driver affects every adapter in the system If you have more than one adapter that requires different paramet
253. llowing Web site for details about the release level for your operating system www storage ibm com hardsoft products ess supserver htm 58 Implementing an Open IBM SAN Either you or an IBM SSR must perform the following tasks to install and configure an ESS 1 The IBM SSR installs the ESS by using the procedures in the IBM Enterprise Storage Server Service Guide 2 You or an IBM SSR defines the Fibre Channel host system with the worldwide port name identifiers 3 You or an IBM SSR defines the Fiber Channel port configuration if you did not do it during the installation of the ESS or Fibre Channel adapters For the list of worldwide port names see 1 12 Locating the worldwide port name on page 69 Note Use the information on the logical configuration work sheet in the IBM Enterprise Storage Server Configuration Planner that you should have previously filled out 4 Either you or an IBM SSR configures the host system for the ESS by using the instructions in your host system publications Note 1 The IBM Subsystem Device Driver 1 2 1 does not support the Windows 2000 host system in a clustering environment To have failover protection on an open system the IBM Subsystem Device Driver requires a minimum of two Fibre Channel adapters The maximum number of Fibre Channel adapters supported is 16 for a total of 16 Fibre Channel ports 2 To improve performance IBM recommends that you map to the LUNs for the target volumes
254. losure Services ANSI SCSI 3 proposal that defines a command set for soliciting basic device status temperature fan speed power supply status etc from a storage enclosures Single Mode Fiber In optical fiber technology an optical fiber that is designed for the transmission of a single ray or mode of light as a carrier Itis a single light path used for long distance signal transmission See also Multi Mode Fiber SMART Self Monitoring and Reporting Technology SM Single Mode See Single Mode Fiber SMF Single Mode Fiber In optical fiber technology an optical fiber that is designed for the transmission of a single ray or mode of light as a carrier It is a single light path used for long distance signal transmission See also MMF SNIA Storage Networking Industry Association A non profit organization comprised of more than 77 companies and individuals in the storage industry SN Storage Network See also SAN SNMP Simple Network Management Protocol The Internet network management protocol which provides a means to monitor and set network configuration and run time parameters SNMWG Storage Network Management Working Group is chartered to identify define and support open standards needed to address the increased management requirements imposed by storage area network environments SSA Serial Storage Architecture A high speed serial loop based interface developed as a high speed point to point connection for pe
255. m the SAN Data Gateway Specialist select the Fibre Channel port that will have the switch connected Select Control gt Fibre Channel and the Set Fibre Channel Parameters window appears as shown in Figure 4 40 Chapter 4 Implementing the SAN Data Gateway 297 Ff Set Fibre Channel Parameters x Loop ID v Soft v FC Tape Frame Size 512 1024 2048 ISP2200 Port Mode Target Initiator Target and Initiator Connection Options Loop Loop Preferred Pointto Point Point to Point Preferred Identify Channel OK Cancel Figure 4 40 Fibre Channel port setting for switch attachment By default the setting in the Connection Options box will have Loop enabled For switch or fabric connection select Point to Point and then select OK The SAN Data Gateway must be restarted for the change to take effect Note Connection Options box does not appear the Fibre Channel module installed will support loop connection only and will not support fabric connection The module must be replaced or select a port that will support fabric connection A Fibre Channel cable can be connected from the switch to the port on the Gateway The data to the Specialist must be refreshed by selecting and highlighting the Gateway and then select View gt Refresh SAN Data Gateway 298 Implementing an Open IBM SAN Switch registration With VPS enabled the switch will register with the database the WWPN of the port
256. mary organization for fostering the development of technology standards in the United States The ANSI family of Fibre Channel documents provide the standards basis for the Fibre Channel architecture and technology See FC PH Arbitration The process of selecting one respondent from a collection of several candidates that request service concurrently Arbitrated Loop A Fibre Channel interconnection technology that allows up to 126 participating node ports and one participating fabric port to communicate ATL Automated Tape Library Large scale tape storage system which uses multiple tape drives and mechanisms to address 50 or more cassettes Copyright IBM Corp 2001 ATM Asynchronous Transfer Mode A type of packet switching that transmits fixed length units of data Backup A copy of computer data that is used to recreate data that has been lost mislaid corrupted or erased The act of creating a copy of computer data that can be used to recreate data that has been lost mislaid corrupted or erased Bandwidth Measure of the information capacity of a transmission channel Bridge 1 A component used to attach more than one I O unit to a port 2 A data communications device that connects two or more networks and forwards packets between them The bridge may use similar or dissimilar media and signaling systems It operates at the data link level of the OSI model Bridges read and filter data packets and frames Bri
257. ment This topic describes how to attach a Novell NetWare host system to an IBM ESS with the following adapter cards gt QLogic QLA2100F gt QLogic QLA2200F Note The IBM SAN Fibre Channel Switch 2109 S08 and IBM SAN Fibre Channel Switch 2109 S16 are supported for Novell NetWare The IBM SAN Data Gateway 2108 Model G07 is not supported for Novell NetWare 1 8 1 Installing the QLogic QLA2100F adapter card 26 This section tells you how to attach an ESS to a Novell NetWare host system with the QLogic QLA2100F adapter card Single port Fibre Channel interfaces with the QLogic QLA2100F adapter card support the following loop modes gt Target gt Initiator gt Target and initiator Note The arbitrated loop topology is the only topology available for the QLogic QLA2100F adapter card Perform the following steps to install the QLogic QLA2100F adapter card Note The following steps are an example of a configuration The configuration for your adapter might differ Install the QLogic QLA2100F adapter card in the host system Connect the cable to the ESS port Restart the server Press Alt Q to get to the FAST Util menu From the Configuration Settings menu click Host Adapter Settings Oils Bn gt None Implementing an Open IBM SAN 7 8 9 From the Advanced Adapter Settings menu press the Down Arrow to highlight LUNs per target Press Enter Press the Down Arrow to find and highlight 256 Press Enter Pres
258. menting an Open IBM SAN Ea Configure Ports Name Blocked G_PORT OO NR R G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT NUNN Ns Q E pal o OoOoOoO0000 OOOO O 000 00 NUNN RI uv 3 a o G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT G_PORT aaor KI NNN n ooo noo 5 6 T ON a B a 13 15 m CE ao Figure 3 36 Product Manager ED 6064 Configure Ports The port number is automatically assigned and cannot be changed We can specify a port name here but this is only useful if the cabling on the port does not change that often The port name then appears in the Product Manager to identify the port for example in the Port Properties dialog box Of more interest here is the ability to block specific ports or to use extended distance buffering when connecting remote sites with channel extenders and to define the port type The ports are by default G_Ports which means they behave according to the node ports attached to them For example a G_Port will act as an E_Port if connected to another switch port We can specify here the port type as shown in Figure 3 37 so that certain ports can only be used as E_Ports for ISLs or as F_Ports for connectivity to node ports Chapter 3 Implementing a SAN with McDATA 211 ia Configure Ports Port Name Blocked 10 100 kml LIN Alerts m any port
259. meters Copyright IBM Corp 2001 1 1 Fibre Channel Fibre Channel transfers information between the sources and the users of the information This information can include commands controls files graphics video and sound Fibre Channel connections are established between Fibre Channel ports that reside in I O devices host systems and the network that interconnect them The network consists of elements like switches hubs bridges and repeaters that are used to interconnect the Fibre Channel ports The ESS architecture supports three basic topologies gt Point to point gt Switched fabric gt Arbitrated loop Before you start check that the Fibre Channel host has the correct Fibre Channel host bus adapters installed or at least has slots available for them Fora list of operating systems and the host bus adapters for Fibre Channel attachment see following the Web site www storage ibm com hardsoft products ess supserver htm 1 1 1 Fibre Channel cables and adapter types 2 Use feature code 3022 for the short wave Fibre Channel host adapter card Feature code 3022 comes with a complimentary 31 m 101 ft 50 micron multimode fibre cable You can also use a 62 5 micron fiber optic cable with the short wave Fibre Channel card For a 50 micron multimode fiber optic cable use a cable length of 2 m 500 m 6 5 ft 1640 ft For a 62 5 micron multimode fiber optic cable use a cable length of 2m 175m 6 5 ft 575 ft
260. min Tools Controls Help E 193 1 1 25 Gateway SAN Data Gateway Current SAN Data Gateway Gateway World Wide Node Name 10000060 4516 IP Address 193 1 1 25 Serial Number 21081300937 Firmware Revision 3 41 31 Health Check Level 2 Health Check Interval 60 Log Size 2047 Receive Event Traps Enabled Serial Baud Rate 19200 Figure 4 18 SAN Data Gateway Firmware Revision Level New versions of the SAN Data Gateway can be downloaded as shown in Figure 4 19 by selecting the Controls option and then selecting the Update Firmware option 1 0 x File View Admin Tools Help rome prane ent SAN Data Gateway Gateway Access Options P d Wide Node Name 10000060 4516 SNMP Community Strings idress 193 1 1 25 ToT al Number 21081300937 SCSI Channel are Revision 3 41 31 Fibre Channel th Check Level 2 Device Mapping th Check Interval 60 Size 2047 2ive Event Traps Enabled Restart SAN Data r eway Pl Baud Rate 19200 Identify SAN Data Gateway Figure 4 19 Updating the SAN Data Gateway firmware Chapter 4 Implementing the SAN Data Gateway 279 280 The SAN Data Gateway Specialist will then prompt for the location of the new firmware as shown in Figure 4 20 This is the file that was downloaded from the SAN Data Gateway Web site previously Select a Firmware File RES Look in a SANDE e e Overall readme txt readme txt sw20502 txt 5 v034137 bin R File
261. mplementers to support the standards committee activities FCLC Fibre Channel Loop Association an independent working group of the Fibre Channel Association focused on the marketing aspects of the Fibre Channel Loop technology FCP Fibre Channel Protocol the mapping of SCSI 3 operations to Fibre Channel Fiber Optic Refers to the medium and the technology associated with the transmission of information along a glass or plastic wire or fiber Fibre Channel A technology for transmitting data between computer devices at a data rate of up to 4 Gb s It is especially suited for connecting computer servers to shared storage devices and for interconnecting storage controllers and drives FICON Fibre Connection A next generation I O solution for IBM S 390 parallel enterprise server FL_Port Fabric Loop Port the access point of the fabric for physically connecting the user s Node Loop Port NL_Port FLOGI See Fabric Log In Frame A linear set of transmitted bits that define the basic transport unit The frame is the most basic element of a message in Fibre Channel communications consisting of a 24 byte header and zero to 2112 bytes of data See also Sequence 366 Implementing an Open IBM SAN FSP Fibre Channel Service Protocol The common FC 4 level protocol for all services transparent to the fabric type or topology Full Duplex A mode of communications allowing simultaneous transmission and reception of frames
262. multiswitch fabric on page 251 what this looks like The Zoning View To change to the Zoning View we select the View button as shown in Figure 3 55 In Figure 3 56 we show the Zoning View of the Fabric Manager 228 Implementing an Open IBM SAN McDATA Fabric Manager Mm x Zoning View i Default Zone Enabled View ctive Zone Set A fe Configure Help The active zone set does not currently match any of the stored zone sets amp Save active zone set as Deactivate zone set Figure 3 56 Fabric Manager Zoning View no zone set active The main window will display the active zone set but at this moment in time there are no active zone sets From here the active zone set can be deactivated or saved with another name Also we can see if the default zone is enabled or not In the topics that follow we show how to set up zoning in our environment For these tasks it is not important which view we are in 3 6 2 Zones zone sets and zoning We want to have one ESS and two Netfinity servers defined in a zone which is shown in Figure 3 57 Chapter 3 Implementing a SAN with McDATA 229 230 paT ee NT_Zone_1 ae Netfinity NT Server ESS PUR N rid Peg 200 Ooo nn nn on nn 200 ooo Shortwave fiber O l oooooop ED 6064
263. n Level V3R1 0 SF44131 V3R2 0 SF44132 Releases V4R2 0 V4R3 0 and V4R4 0 also support 18 GB and 36 GB capacity logical unit numbers with the PTFs shown in Table 1 4 Table 1 4 OS 400 program temporary fixes for V4R2 0 and higher Operating System Version Level V4R2 0 SF44114 MF21961 MF21975 V4R3 0 MF21962 MF21979 MF21963 MF21978 1 4 IBM RS 6000 or pSeries FC host system attachment This topic describes the host system requirements and provides the procedures to attach an ESS to any of the following IBM RS 6000 pSeries host system IBM RS 6000 Series Parallel SP Complex pSeries SP Complex host system YYY Yy Chapter 1 Implementing Fibre Channel host adapter cards 11 Note For an RS 6000 and pSeries host system you can use two topologies gt Point to point switched fabric topology gt Arbitrated loop topology The RS 6000 and pSeries host system does not support more than one host bus adapter on the loop The RS 6000 and pSeries host system does support a direct connection of the RS 6000 and pSeries host system to an ESS using the Fibre Channel arbitrated loop protocol 1 4 1 Attachment requirements This section lists the requirements for attaching the ESS to your host system gt Ensure that you have all of the items listed in the Equipment requirements gt Ensure that you have the installation script files These files are on the diskette and the compact disc you receive with the ESS gt En
264. n also select and highlight each SCSI Channel You will notice that as you do this the information window on the right side will provide data that is unique to that SCSI channel as shown in Figure 4 10 PA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc File View Admin Tools Controls Help WB 9 113 24 110 ITSO SAN Data Gateway Q 7 Current SAN Data Gateway ITSO Disk Device 0 0 IP Address 9 113 24 110 M Disk Device 0 1 J Disk Device 1 0 _ fF Disk Device 1 1 Channel Description SCSI Channel 1 B Disk Device 2 0 Channel Type Differential B Disk Device 2 1 Termination Enabled B Disk Device 3 0 Channel Mode Initiator M Disk Device 3 1 Host ID 7 9 Disk Device 4 0 EA 2 Disk Device 4 1 Bok Device a Max Speed Ultra 20Mhz B Disk Device 5 1 Status Operational P Disk Device 6 0 l Disk Device 6 1 Max ID s per Bus 16 B Disk Device 8 0 Max LUN s per ID 32 B Disk Device 8 1 B Disk Device 9 0 B Disk Device 9 1 M Disk Device 10 0 Disk Device 10 1 M Disk Device 11 0 M Disk Device 11 1 B Disk Device 12 0 Figure 4 10 SCSI channel data Chapter 4 Implementing the SAN Data Gateway 273 Information pertaining to a particular disk device is shown in Figure 4 11 PA Storwatch SAN Data Gateway Specialist 2000 Pathlight Technology Inc ioj x File View Admin Tools Controls Help E 9 113 24 110 ITSO
265. n one Fibre Channel Gateway port and by a particular host Also available is to add zoning within the switch The switch Fibre Channel ports can be zoned so that the host only has one path to the SAN Data Gateway This would be used in combination with the zoning and LUN masking features of the SAN Data Gateway Implementing an Open IBM SAN Implementing the Vicom Fibre Channel SLIC Router The Vicom Fibre Channel SLIC Router 7139 111 enables all IBM 7133 7131 and 3527 SSA Serial Disk Systems to attach to host systems using Fibre Channel host adapters and drivers This allows you to protect your investment in SSA disk while being able to create and build a SAN infrastructure The Vicom Fibre Channel SLIC Router replicates data across or within serial disk systems simultaneously mirroring two or three copies of data without host involvement With global hot disk sparing data is automatically rebuilt if a mirrored disk fails In this way the Vicom Fibre Channel SLIC Router improves performance and data availability while simplifying storage operations In the following sections we cover these topics SLIC Router features on page 312 Installing the SLIC Router on page 313 SLIC Manager software on page 316 Using SLIC Manager on page 323 Composite drive on page 327 Mirror drive on page 332 Instant Copy drive on page 337 Combining composite and mirroring on page 342 vvvvvvvy
266. n you type file dev rrz 128c dev rrz128c character special 8 262146 SCSI 16 2105F20 disk 1024 SCSI ID 0 SCSI LUN 0 dev rrzb128c character special 8 262210 SCSI 16 2105F20 disk 1025 SCSI ID 0 SCSI LUN 1 dev rrzcl28c character special 8 262274 SCSI 16 2105F20 disk 1026 SCSI ID 0 SCSI LUN 2 dev rrzd128c character special 8 262338 SCSI 16 2105F20 disk 1027 SCSI ID 0 SCSI LUN 3 dev rrzel28c character special 8 262402 SCSI 16 2105F20 disk 1028 SCSI ID 0 SCSI LUN 4 Implementing an Open IBM SAN dev rrzfl28c character special 8 262466 SCSI 16 2105F20 disk 1029 SCSI ID 0 SCSI LUN 5 dev rrzgl28c character special 8 262530 SCSI 16 2105F20 disk 1030 SCSI ID 0 SCSI LUN 6 dev rrzhl28c character special 8 262594 SCSI 16 2105F20 disk 1031 SCSI ID 0 SCSI LUN 7 If a special file does not have a disk associated with it the output of the file command will only show the part concerning the major number No disk model is displayed This is an example showing a disk model dev rrzhl28c character special 8 262594 Type disklabel rz128 to see if the disks have a valid disklabel Then type dev rrz128a The following shows an example of the output from these commands type SCSI disk 2105F20 label flags dynamic_geometry bytes sector 512 sectors track 64 tracks cylinder 30 sectors cylinder 1920 cylinders 1017 sectors unit
267. nagement Station A host system that runs the management software Mb s Megabits per second Also sometimes referred to as Mbps In computing terms it is approximately 1 000 000 bits per second Most precisely it is 1 048 576 1024 x 1024 bits per second MB s Megabytes per second Also sometimes referred to as MBps In computing terms it is approximately 1 000 000 bytes per second Most precisely it is 1 048 576 1024 x 1024 bits per second Meter 39 37 inches or just slightly larger than a yard 36 inches Media Plural of medium The physical environment through which transmission signals pass Common media include copper and fiber optic cable Media Access Rules MAR MIA Media Interface Adapter MIAs enable optic based adapters to interface to 368 Implementing an Open IBM SAN copper based devices including adapters hubs and switches MIB Management Information Block A formal description of a set of network objects that can be managed using the Simple Network Management Protocol SNMP The format of the MIB is defined as part of SNMP and is a hierarchical structure of information relevant to a specific device defined in object oriented terminology as a collection of objects relations and operations among objects Mirroring The process of writing data to two separate physical devices simultaneously MM Multi Mode See Multi Mode Fiber MMF See Multi Mode Fiber In optical fiber technology an
268. name m 0 1 2 3 4 5 Figure 3 37 Product Manager ED 6064 Configure Ports port type Also link incident LIN alerts can be disabled here A link incident is a problem on a link which is visible in the Link Incident Log It is indicated with a small yellow triangle next to the port To view the LIN log go to Logs gt Link Incident Log as shown in Figure 3 38 c ED 6064 ED 6064 1 Configure Maintenance iol xi Hardware View ED 6064 Status Name ED 6064 1 Status Fully Operational Description Fibre Channel Director State Online 6 3 01 10 53 41 AM 6 3 01 10 53 41 AM 6 3 01 10 53 41 AM 6 1 01 6 19 19 PM 6 1 01 6 19 19 PM 6 1 01 6 19 19 PM 6 1 01 5 21 38 PM 6 1 01 5 21 38 PM 6 1 01 5 21 38 PM 6 1 01 4 47 48 PM Location Loss of Signal or Loss of Signal or Loss of Signal or Loss of Signal or Loss of Signal or Loss of Signal or Loss of Signal or Loss of Signal or Loss of Signal or Loss of Signal or SAN JOSE Bld 51 3rd Floor Loss of Synchronization Loss of Synchronization Loss of Synchronization Loss of Synchronization Loss of Synchronization Loss of Synchronization Loss of Synchronization Loss of Synchronization Loss of Synchronization Loss of Synchronization Export Clear l Refresh i Close Figure 3
269. nd error recovery procedures IBM Enterprise Storage Server System 390 Command Reference 2105 Models E10 E20 F10 and F20 SC26 7298 gt Describes the functions of the ESS and provides reference information for System 390 hosts such as channel commands sense bytes and error recovery procedures ESS Web Interface User s Guide for ESS Specialist and ESS Copy Services SC26 7346 gt Provides instructions for using the IBM TotalStorage Enterprise Storage Server Web interface ESS Specialist IBM Storage Solutions Safety Notices GC26 7229 gt Provides translations of the danger notices and caution notices that IBM uses in ESS publications IBM Enterprise Storage Server Configuration Planner SC26 7353 gt Provides work sheets for planning the logical configuration of the ESS This book is not available in hard copy This book is only available on the following Web site http www storage ibm com hardsoft products ess refinfo htm IBM Enterprise Storage Server Quick Configuration Guide SC26 7354 gt Provides flow charts for using the TotalStorage Enterprise Storage Server Specialist The flow charts provide a high level view of the tasks the IBM service support representative performs during initial logical configuration You can also use the flow charts for tasks that you might perform during modification of the logical configuration The hard copy of this booklet is a 9 inch by 4 inch fanfold Chapter 2 IBM TotalStorage
270. nd the ports are the same as with the ED 6064 and ED 5000 so refer to 3 4 1 Managing the ED 6064 on page 205 for information on how to configure these 3 4 4 Introduction to the ES 1000 Product Manager In the topics that follow we describe the major configuration options that are necessary covering those that are different from what we have already seen with the ED 6064 ED 5000 and ES 3016 Chapter 3 Implementing a SAN with McDATA 217 Maintenance As with all the other Hardware Views of McDATA products the Hardware View of the ES 1000 loop switch features a Front View and a Rear View of the device Using the interactive Hardware View This view is used to show the state of the monitored components of the switch and can also be used to gather more information As we can see our switch has four GBICs installed Figure 3 45 illustrates the different types of monitored parts of the switch that are highlighted by the mouse cursor Biel Eg Hardware View ES 1000 Status Status Fully Operational Name State Online Description Fibre Channel Enterprise Connectivity Switch Bridge Port State Online Location End User Premise please configure Front View C 13a tis a a pan an a a pa p Connector Position 1 Fan Position 2 Figure 3 45 Product Manager ES 1000 Hardware View As an example for a switch with a failed fan the Hardware View looks like that shown in Figure 3 46
271. need access to the data on the target volume Perform the LUN mapping after the PPRC operation and immediately before you need access to the data You must restart the host system before you can access the data on the target volume You can greatly reduce the time it takes for the host system to restart if you perform the LUN mapping Otherwise the time to reboot could take 10 minutes per PPRC target volume 1 10 2 Installing the QLogic QLA2100F adapter card 48 This section tells you how to attach an ESS to a Windows NT host system with the QLogic QLA2100F adapter card Single port Fibre Channel interfaces with the QLogic QLA2100F adapter card support the following loop modes gt Target gt Initiator gt Target and initiator Notes 1 The arbitrated loop topology is the only topology available for the QLogic QLA2100F adapter card 2 When you install the QLA2100F adapter card on your host system IBM recommends that you install the card on a host system with four processors This ensures that you do not have a problem when you start the host system Implementing an Open IBM SAN Perform the following steps to install the QLogic QLA2100F adapter card OF OIE a 302 O 8 9 Install the QLogic QLA2100F adapter card in the host system Connect the cable to the ESS port Restart the host system Press Alt Q to get to the FAST Util menu From the Configuration Settings menu select Host Adapter Settings From the Advan
272. nel adapter drivers Note If you are installing the Fibre Channel adapter for the first time you must specify the correct topology You must also select the appropriate device mapping driver l Go to the following Web site www qlogic com From the home page click Driver Download Click Use Qlogic Drivers button Click Fibre Channel Adapter Drivers and Software In the table for Qlogic Fibre Channel Adapters click QLA22xx From the menu for Software and Drivers available for click Solaris From the table for QLA22xx Driver Download Page Solaris Sparc 2 6 2 7 2 8 and Current released Sparc driver PCI to FC Adapter click Read Me OD OW see E 2 NS This action displays the contents of the Read Me file which contains the instructions to install the driver file 8 Update the parameter file if necessary See Table 1 9 on page 43 1 9 14 Configuring host device drivers The following procedures tell you how to update the Solaris SCSI driver configuration file to enable access to target and LUN pairs configured on the ESS 40 Implementing an Open IBM SAN 1 Change to the directory by typing cd kernel drv 2 Back up the sd conf file in this subdirectory 3 Edit the sd conf file to add support for the target and LUN pairs that are configured on the host system The following is an example of the lines that you would add to the file to access LUNs 0 7 on target 8 name sd class scsi target 0 lun 0 name sd cla
273. nfirmed delivery or notification of non deliverability Client A software program used to contact and obtain data from a server software program on another computer often across a great distance Each client program is designed to work specifically with one or more kinds of server programs and each server requires a specific kind of client program Client Server The relationship between machines in a communications network The client is the requesting machine the server the supplying machine Also used to describe the information management relationship between software components in a processing system Cluster A type of parallel or distributed system that consists of a collection of interconnected whole computers and is used as a single unified computing resource Coaxial Cable A transmission media cable used for high speed transmission It is called coaxial because it includes one physical channel that carries the signal surrounded after a layer of insulation by another concentric physical channel both of which run along the same axis The inner channel carries the signal and the outer channel serves as a ground 364 Implementing an Open IBM SAN Controller A component that attaches to the system topology through a channel semantic protocol that includes some form of request response identification CRC Cyclic Redundancy Check An error correcting code used in Fibre Channel DASD Direct Access Storage Device an
274. ng TCP IP This allows remote access to the Router and the storage loop See Figure 5 3 Server gt Remove Access ee aa ooo suc TCP IP Manager mas Local Access SLIC DAEMON and Manager Fibre Channel SUC w SSA Disks z Figure 5 3 SLIC Manager access Implementing an Open IBM SAN The SLIC Manager has a graphical user interface GUI and a command line interface CLI available for Windows NT systems UNIX systems will only have the command line interface available The following installation and configuration examples will detail using the GUI from a Windows NT platform To review the commands that are available for UNIX platforms and installation instructions on other operating systems please refer to the SLIC Manager Installation and User Guide 310 605807 5 3 1 Installing the SLIC Manager software The SLIC Manager software can run on many operating systems The following discussion will describe an installation on a Netfinity 5500 with Windows NT 4 0 To install the SLIC Manager server software for local access the Vicom Utilities CD ROM is placed in the CD drive Select Start gt Run and Browse the CD drive Go to slicmgr i386 server setup exe and click OK Follow the prompts displayed on the window to install the Manager software This will install the daemon service also For remote or client access the daemon service is not required To load the Man
275. ng higher bandwidth using multiple N_Ports in parallel to transmit a single information unit across multiple levels STP Shielded Twisted Pair Storage Media The physical device itself onto which data is recorded Magnetic tape optical disks floppy disks are all storage media Switch A component with multiple entry exit points ports that provides dynamic connection between any two of these points Switch Topology An interconnection structure in which any entry point can be dynamically connected to any exit point In a switch topology the available bandwidth is scalable T11 A technical committee of the National Committee for Information Technology Standards titled T11 I O Interfaces It is tasked with developing standards for moving data in and out of computers Tape Backup Making magnetic tape copies of hard disk and optical disc files for disaster recovery Tape Pooling A SAN solution in which tape resources are pooled and shared across multiple hosts rather than being dedicated to a specific host 372 Implementing an Open IBM SAN TCP Transmission Control Protocol a reliable full duplex connection oriented end to end transport protocol running on top of IP TCP IP Transmission Control Protocol Internet Protocol a set of communications protocols that support peer to peer connectivity functions for both local and wide area networks Time Server A Fibre Channel defined service function that allows for the m
276. ng zone set now applies to every switch of the merged fabric Fabrics can be joined when none of them is zoned when one of them is zoned or when both of them are zoned Not zoned means no zone set is active and the default zone is enabled 254 Implementing an Open IBM SAN 1 If none of the fabrics are zoned no zoning information will be exchanged and the result will be a multiswitch fabric with no zoning 2 If one of the fabrics is zoned the active zone set will propagate across the fabric and the result will be a multiswitch fabric with the zoning information of the former standalone fabric which was zoned before 3 If both of the fabrics are zoned the zoning will only work if the configurations are compatible If the zone configurations are not compatible the E_Ports of the switches become segmented which means they cannot carry traffic from node ports but they can still carry management traffic Zoning configurations are compatible if one of the two requirements are met The active zone names of each fabric to be merged are unique if the zone members are not identical The active zone names of each fabric to be merged can be identical if the zone members are identical as well In our case the director fabric is zoned the switch fabric is not This means that the active zoning information will propagate across the fabric and the two independent fabrics will join to form a multiswitch fabric Prior to connecting the
277. nit is rebooted The reboot can occur from a power off or by issuing the reboot command During the reboot you will see that the IP address is set and now enabled Gateway gt ethEnable Write complete Ethernet will be enabled on next boot value 0 0x0 Gateway gt _ 4 2 2 Using Telnet on the SAN Data Gateway If a user would prefer to telnet to the SAN Data Gateway rather than by using the service terminal port after initial setup this can be done First you must create a user from the service terminal by using the userAdd command Enter the login name and password using the quotes and comma ITSO gt userAdd itso residency value 0 0x0 ITSO gt _ Chapter 4 Implementing the SAN Data Gateway 265 You cannot telnet to the Gateway and use the service port at the same time When you telnet to the Gateway the service port on the rear of the unit will stop its communications After you end the telnet session then the service port will become available again 4 2 3 Startup sequence 266 You must start up the SAN Data Gateway and the attached host and target devices in a specific order When you add or remove SCSI devices or update firmware you must restart The following procedures describe the situations and order of procedure when you restart the SAN Data Gateway Before you restart the SAN Data Gateway you must stop all input and output I O activity between the host and SCSI devices 1 SCSI device
278. nloaded installer program once installation is complete Download HP UX Installer The EFC Manager remote client application will run on AIX version 4 3 3 or later Please make sure the required AIX fixes have been installed prior to installing the EFC Manager application Click the button below to download and save the installer program to your hard disk After the IBM ALIX download is complete run the following command sh medataClientInstall bin then follow the install prompts You may delete the downloaded installer program once installation is complete Download AIX Installer Figure 3 10 Start page for remote EFC Manager client installation Chapter 3 Implementing a SAN with McDATA 189 Download Linux Installer femgmt mib n J0 mib es 1000 mib Figure 3 11 Start page for remote EFC Manager client installation continued From here we can also download the SNMP MIB files later on 190 Implementing an Open IBM SAN Downloading and installing the EFC Manager client We will install the EFC Manager client software on a Microsoft Windows NT system so we select that option After doing so we are taken to the next Web page to start the download and installation procedure Immediately we are prompted to grant additional privileges to the Java based installation software First we have to grant the right to start programs and then grant the right to read modify or delete files The
279. nly if that leaves enough ports to accommodate the rest of the environment and its expansion When more ports and even higher availability are desired this solution can be extended with another director at each site Even though a director is highly available using two independent fabrics red and blue removes the director itself as an single point of failure and may not always be regarded as a paranoia Implementing an Open IBM SAN This is shown in Figure 3 78 local site remote site open systems servers open systems servers OO oo oopoo opoo oo Ou heartbeat ED 606e4 20000000 t DOUDOO0U HOOOOOOO ISL s OOO ED 6064 t OOOO ae 2G a ae HOOQUUUOU DOU DOOOOOOO DOOOUOOO ae ee a6 Ess 000 mu ma En ma Oooo ess l l l Figure 3 78 Using two independent fabrics for high availability The arrows indicate a possible route for the data to get to both parts of the mirrored sets In this setup there is no single point of failure at a device level and even if one site completely fails the other site will take over operation immediately In our example for a multis
280. nnel host system with the worldwide port name identifiers 3 Either you or an IBM SSR defines the Fiber Channel port configuration if you did not do it during the installation of the ESS or Fibre Channel adapters Note Use the information on the logical configuration work sheet in the IBM Enterprise Storage Server Configuration Planner you should have previously filled out Chapter 1 Implementing Fibre Channel host adapter cards 31 4 Either you or an IBM SSR configures the host system for the ESS by using the instructions in your host system publications Note The IBM Subsystem Device Driver does not support the Sun host system in a clustering environment To have failover protection on an open system the IBM Subsystem Device Driver requires a minimum of two Fibre Channel adapters The maximum number of Fibre Channel adapters supported is 16 for a total of 16 Fibre Channel ports The two IBM Subsystem Device Drivers for Sun host systems support gt Sun host hardware platforms limited to 32 bit mode and all Sun host systems running Solaris 2 6 gt Sun host hardware platforms with 64 bit mode capabilities running Solaris 7 or Solaris 8 1 9 2 Installing the Emulex LP8000 adapter card 32 This section tells you how to attach an ESS to a Windows NT host system with the Emulex LP8000 adapter card Single and dual port Fibre Channel interfaces with the Emulex LP8000 adapter card support the following public and private loop mo
281. ns remove selected ESS logical volume assignments for the selected host FC ports The Target Hosts field now lists the host FC ports to which the assignments belong to Here we select both host FC ports to remove the assignments This is shown in Figure 2 101 Action i Target Hosts Assign selected volume s to target hosts J Use same ID iLun in source and target Fe Unassign selected volume s from target hosts Figure 2 101 Removing volume assignments from both host FC ports 152 Doing so makes the warning message shown in Figure 2 102 appear stating that this action will cause ESS logical volumes to become isolated for the selected host FC port N Volume Assignments x A Warning 1865 Potential LUN isolation problem The specified action will cause one or more LUNs to become isolated for the selected target host This may prevent the host from accessing the affected LUNs J Unsigned Java Applet A Figure 2 102 Warning window one volumes to be isolated from host FC ports After pressing the Perform Configuration Update button a second warning window will show up as shown in Figure 2 103 This time the window gives us the choice to abort the configuration update Implementing an Open IBM SAN N Yolume Assignments x A Warning 1866 Potential LUN isolation problem The specified action will cause one or more LUNs to become isolated in one or more of the selected target hosts This may prevent
282. o point otherwise loop If you cannot use point to point default to arbitrated loop Note If you connect the ESS directly to the host system the option you select must match the port connections on the ESS However if you connect through a switch the options do not need to match the port connections because the ESS is point to point The appropriate HBA on the server must also support point to point connection on a direct connection Currently disparate vendors do not function properly in a direct point to point connection This statement is not true if you connect through a switch because the ESS is point to point 2 Press Esc 3 Save the changes Highlight Yes 4 Restart the server 1 11 4 Downloading the current Fibre Channel adapter driver 62 Perform the following steps to load the current driver onto the QLogic adapter card 1 Fay OO N SOW R SG aN Go to the following Web site www qlogic com From the home page click Driver Download Click Use QLogic Drivers Click IBM Enterprise Subsystems Division approved drivers Click IBM Approved QLA22xx drivers or IBM Approved QLA21xx drivers Click Link to Drivers In the window for File Download click Save this Program to Disk Insert a floppy diskette into your floppy disk drive In the field for Save in change the drive letter to A 0 Create a folder called Temp in the Save As window Implementing an Open IBM SAN 11 Click Save 12 When the download comple
283. o select the System Expansion unit 7 On the Packaging Hardware Resources panel type 8 to select Multiple Function IQA 8 On the Logical Resources Associated with a Packaging Resource panel type 5 to select Multiple Function IOA 9 On the Auxiliary Storage Hardware Resource Detail panel locate the field name for Port worldwide name Note the number in the right hand column Note If you have exchanged a 2766 Fibre Channel IOA in the iSeries system the IBM 2105 ESS disk unit subsystem must be updated to use the worldwide port name of the new 2766 IOA You can find the name in the port worldwide name field on the iSeries system by displaying detail on the 2766 IOA Logical Hardware Resource information in Hardware Service Manager in SST DST Implementing an Open IBM SAN 1 12 3 Locating the WWPN for an IBM eServer or IBM NUMA Q host To locate the WWPN for a NUMA Q host system with an IOC 0210 54 adapter perform the following steps from the IBM Enterprise Storage Specialist 1 From the Enterprise Storage Specialist Welcome panel click Storage Allocation From the Storage Allocation graphical view panel click Open System Storage 3 From the Open System Storage panel click Modify Host Systems 4 In the Host Nickname field type the nickname a OO 9 In the Host Name field click either IBM NUMA Server WinNt or IBM NUMA Server UNIX from the list Click the Down Arrow to the right of the Host Attachment
284. o serve a few SCSI and ESCON attached hosts this is a fairly balanced setup As opposed to the host interfaces row the icons shown in the ESS interfaces row represent adapters not ports If an adapter type for instance a SCSI adapter features two ports we have still one icon We can also see how many ports a specific adapter type offers We can see that ESCON and SCSI adapters are dual ported and the FC adapters are single ported For clarity we use the term ESS FC port in this redbook even when talking about the adapter itself The ESS interface adapter icons can also be selected which will change the view of the panel For instance it will display information of the type and configuration of the adapter Graphically the representation of the adapters is different to help to distinguish between them The different representations of the adapters are shown in Figure 2 25 Figure 2 26 and Figure 2 27 Figure 2 25 ESS ESCON adapter with two ports Implementing an Open IBM SAN A l Figure 2 26 ESS SCSI adapter with two ports Figure 2 27 ESS FC adapter with one port Viewing the association between host ports and ESS ports In the ESS we do not tie a host FC port to a Fibre Channel port in the ESS which was what we did with the SCSI adapters Every host FC port within the Fibre Channel fabric will be identified by its WWPN and can access data through every ESS FC port unless other mea
285. o the empty PCI bus slot Press firmly until seated o Secure the mounting bracket for the adapter to the case with the panel screw 6 Replace the computer case by tightening the screws on the case or use the clamp to secure the cover 1 11 10 Downloading the current Fibre Channel adapter driver This section tells you how to install the port driver 1 Plug in and restart your host system 2 Go to the following Web site www emulex com From the Quick Links menu click Documentation Drivers and Software Click the host adapter type from the host adapter menu Click Drivers for Windows 2000 Click Fibre Channel Port v5 1 27a5 Click the Download Now button NOP Oo Chapter 1 Implementing Fibre Channel host adapter cards 65 8 From the File Download window click the appropriate radio button and proceed as indicated To open this file from its current location go to step 9 To save this file to disk go to step 16 9 In the window for Winzip click I agree 10 In the window for WinZip Wizard Welcome click Next 11 In the window for WinZip Wizard Select Zip File xxxxxxxx zip where XXXXXXXX is the name of the file highlight the file that you want to unzip 12 Click Next 13 In the window for WinZip Wizard Unzip click Unzip now A progress indicator window appears when the operation to unzip the file completes A window opens to display the following file names Lpscsi Lputilnt O
286. oint to point fabric Arbitrated loop direct connect 68 Implementing an Open IBM SAN 1 11 13 Verifying the configuration The following tells you how to determine whether or not your Windows 2000 host system is configured for storage 1 2 From the Windows 2000 desktop right click Start Partition new Fibre Channel drives with Microsoft Disk Administrator See your Windows 2000 documentation for more instructions 3 Click Explore and verify that you can see the Fibre Channel drives 4 Select a large file for example a 9 MB file and copy it to a Fibre Channel drive 1 11 14 Verifying networking The following tells you how to determine whether or not your Windows 2000 host system is configured for networking 1 2 From the Windows 2000 desktop click Start Programs Command Prompt From the command line ping a known TCP IP address 1 12 Locating the worldwide port name This topic tells you how to locate the WWPN value for a host system Fibre Channel adapter for the following operating systems vvvvvvrvvy AS 400 iSeries NUMA Q and xSeries RS 6000 and pSeries Compaq Hewlett Packard 9000 Novell NetWare Sun Windows NT Windows 2000 1 12 1 Fibre Channel port name identification The WWPN consists of exactly 16 hexadecimal characters 0 9 and A F It is used by the ESS to uniquely identify the Fibre Channel adapter card that is installed in your host system The ESS automatically finds the WWPN
287. oll to and select the adapter tree in bay 1 to limit the host FC port PC1_2 to this ESS FC port We could also select any other port in addition to the one we have chosen To update the Host Systems List table we press the Modify button Modify The restriction is now reflected in the FC Ports column shown in Figure 2 62 Host Systems List Nidmame _ HotType an _ w Hostname Address FC Ports POL PC Server Win NT 4 0 or higher Fibre Charmel attached 200000meBo0ccsB A installed ports per2 PC Server Win NT 4 0 orhigher Fibre Charmel attached 2100000088017862 sss Bay 1 Card 3 Pot A Figure 2 62 Host Systems List with restricted host FC port PC 1_2 Now we perform the configuration update which makes the changes we made active Viewing changes on the Graphical View panel Back on the Storage Allocation Graphical View panel we will see that the changes made are also graphically reflected This is shown in Figure 2 63 We see that a line is drawn from the host FC port PC1_2 to the ESS FC port three in bay one Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 125 EsconNe PC1_1 gt Figure 2 63 Selected host FC port restricted to one ESS FC port It shows us also that there are no ESS logical volumes currently assigned to the selected host FC port This is indicated by the color of the disk group which indicates that no volume exists This is goin
288. on Problem Notification Email and Pager Notification tet 9 1 201 440 8777 61398 no Alpharemmeric SNMP Notification MIB Read Access Disabled SNMP Trap Destination Modi El Mody SNMP Figure 2 10 Problem Notification panel From within this panel we can configure the various types of problem notification provided with the ESS The options available are e mail pager and Simple Network Management Protocol SNMP Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 85 Viewing the Communications panel Using the Communications button we get the Communications panel as shown in Figure 2 11 Gommunications Communications ai TEPAP Cluster 1 Cluster 2 Hostname ospl8c0 ospl8cl IP Address 9 113 20 70 9113 20 71 Subnet Mask 255 255 254 0 255 255 254 0 Default Router 9 113 21 254 9 113 21 254 Domain sanjose ibm com sanjose ibra com Domain Name Server 9 113 42 250 9 113 42 250 Remote Support Call Home Status Disabled Remote Service Access Status Disabled Modify Remote Support Reset PE Password Figure 2 11 Communications panel Here we can view the network information for which the ESS is configured and verify if the Call Home feature and Remote Service Access is enabled Also using the Reset PE Password button we can reset the PE password Only users with administration or configuration levels of authority can modify these panels The network settings cann
289. one members are specified either by the switch port numbers and with it the node ports connected to it or by the WWPN of a node port The WWNNs are not used for zoning definition Zone member definition by WWPN WWPN based zoning has the advantage that we can rearrange the node ports on the switch ports without affecting the definition of the zones This is important for instance if spare ports of switches are used In case of a switch port failure the cabling can then be changed without redefining the zone Implementing an Open IBM SAN On the other hand we have to change the zoning definition every time we change a member in a zone or if we have to replace an FC HBA or an FC adapter of another FC node Note The ESS can now be configured to administer the WWPNs of the ESS FC ports locally which means they get WWPN based on the locations in the ESS interface bays So with zoning based on WWPNs even in the case of the replacement of an ESS FC adapter the WWPN does not change and therefore the zoning definitions do not have to be changed Zone member definition by switch port number Switch port number based zoning consists of specifying the domain and the port number of the switch It requires us to change the zoning definition every time we change the cabling to the node ports but we can change to other node ports or exchange node ports without having to redefine the zone Mixing the two approaches The two approaches to define
290. one to an ESS port The Netfinity host ports we are going to define in the zone are currently detached so they do not show up In our example we chose to add the two detached Netfinity ports and one ESS port to a zone Three ESS ports and three RS 6000 ports are already connected to the switch To assign one ESS port to the zone we drag and drop the WWPN associated with the ESS port to the left part of the window Adding members by domain and switch port number We could also add attached or detached node ports to the zone by selecting the Add by port number button and choosing the domain and switch port they are connected to or are going to be connected to We now illustrate that we could specify the members in one zone based on the WWPN and other members based on the switch port they are connected to as shown in Figure 3 62 gt New Zone NT Zone 1 RPKAS3_C1B2A1 3 Domain 1 Domain 1 Port 1 Port 0 Domain 1 Port 8 Port 1 Port 2 Emulex 10 00 00 00 C9 20 DC 7 N Port 3 Emulex 10 00 00 00 C9 20 E7 Port 4 Emulex 10 00 00 00 C9 20 E7 F Port 5 Port6 Port Port9 Port 10 Port11 Figure 3 62 Fabric Manager Add by port number 234 Implementing an Open IBM SAN Adding detached node ports to the zone We also define the detached Netfinity host ports to the zone by using this window This can be done by specifying the WWPN of the ports and adding them to the zone To perform this task we use the Actions button and se
291. onnected with three longwave ISLs between one ED 6064 and one ES 3016 At the remote site are the AIXD zone with three AIX servers and one ESS that is also a member of the NT zone This example can be used to establish a mirrored set from within the Windows NT Disk Administrator with one local copy of the data and one remote Conversely the AIX zone is limited to the devices at their site 250 Implementing an Open IBM SAN Limits for McDATA multiswitch fabrics The McDATA fabric supports up to 31 interconnected switches managed from one EFC Server the domain IDs range is from 1 to 31 Although we can connect many switches the hop count supported by McDATA is limited to three due to the delay that is applied traversing every switch The hop count with McDATA is equal to the number of ISL connections traversed between the source and the destination Note In IP networking a hop count means the number of connectivity devices for instance routers in between the source and destination This makes up the difference of one more hop in IP networking than in FC networks with the same amount if interconnect devices IBM supports with its McDATA products only a homogenous SAN environment This means that only McDATA switches are supported as switching elements in a McDATA SAN 3 7 3 Setting up our zoned multiswitch fabric We will use one ED 6064 and one ES 3016 for our zoned cascading example We configure both switches as we did before Fir
292. ons that are using a SAN can be built upon a McDATA SAN but only when connecting two sites We need switches at both sites to back up one site completely Disaster tolerance and high availability of the host systems and the storage can be established together using a multiswitch fabric and open system hosts using Logical Volume Manager LVM mirroring together with clustering software such as HACMP for AIX or Veritas Cluster Server To further extend the availability two footprints parallel independent fabrics could be used Implementing an Open IBM SAN Building upon the disaster tolerant and highly available approach the SAN can be extended to become a core to edge approach especially if more hosts in the company need access to the SAN for example for storage consolidation where there is a need to provide access to distributed hosts to resources in the data center For hosts that do not need the RAS or bandwidth provided by directors the McDATA switches connected to the directors serve as connectivity to the SAN backbone This is useful if a company wants to get rid of those hundreds of smaller departmental servers for example file servers Disk consolidation which is possible with a corporate wide SAN can be seen as the first step for server consolidation Of course just the connectivity of user groups to centralized disk storage does not replace a file serving solution but with IBM NAS Gateways which are dedicated file servers wi
293. onverting volume assignments table in HTML format To view the table offline or to print it this panel features the Print Table button Print Table Then a window as shown in Figure 2 98 will appear advising that the information is going to be displayed in another browser window A 2203 Displaying configuration data in another window The configuration data in printable format is being displayed in another browser window The browsers print function may then be used to print the data far Unsigned Java Applet Window Figure 2 98 Information window opening another browser window 150 Implementing an Open IBM SAN Now the content of the table is displayed in HTML format as shown in Figure 2 99 Host SSID LSS LCU Volume Type Size Host Adapter Location Shared PC1_1 LS5 016 600 18486 Open System 016 1 GB Fibre Channel Device Adapter Pair4d No FC Port A Cluster 1 Loop A ID 00 LUN 0000 Array 2 ol 000 PC1_1 LS5 017 700 18486 Open System 016 1 GB Fibre Channel Device Adapter Paird No FC Port A Cluster 2 Loop A ID 00 LUN 0001 Array 1 ol 000 PC1_1 L38 016 601 18486 Open System 064 0 GB Fibre Channel Device Adapter Pair4 Yes FC Port A Cluster 1 Loop B ID 00 LUN 0002 Array 2 ol 001 PC1_1 LS5 017 701 18486 Open System 064 0GB Fibre Channel Device Adapter Pair4 Yes FC Port A Cluster 2 Loop B ID 00 LUN 0003 Array 1 ol 001 PC1_2 LS5 016 601 18486 O
294. opology Undefined Figure 2 113 Information frame ESS FC port topology undefined 2 7 1 Defining the topology for ESS FC ports Pressing the Configure Host Adapter Ports button takes us to the Configure Host Adapter Ports panel as shown in Figure 2 114 Modify Host Systems Configure Host Adapter Ports Configure Disk Groups AJ Modify Volume Assignments Figure 2 114 Entry point for configuring ESS FC ports Again the naming convention in the ESS Specialist can be a little misleading The ESS has built in Fibre Channel adapters which provides the connectivity to the SAN An ESS in its simplest form is a Fibre Channel attached storage device not a host We will refer to such a device as an ESS FC port to avoid any confusion Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 159 Selecting the interface port to be configured The Configure Host Adapter Ports panel is shown in Figure 2 115 Configure Host Adapter Ports Host Adapter Port Lian ace oe No configuration is necessary for ESCON host adapter ports Perform Configuration Update Cancel Configuration Update Figure 2 115 Configure Host Adapter Ports panel ESCON port selected From this panel we select the port of the ESS interface adapters to be configured depending on the type of the adapter We can select the ports by clicking on the icons of the adapter left or right on any adapter with two ports or
295. optical fiber that is designed to carry multiple light rays or modes concurrently each at a slightly different reflection angle within the optical core Multi Mode fiber transmission is used for relatively short distances because the modes tend to disperse over longer distances See also Single Mode Fiber SMF Multicast Sending a copy of the same transmission from a single source device to multiple destination devices on a fabric This includes sending to all N_Ports on a fabric broadcast or to only a subset of the N_Ports on a fabric multicast Multi Mode Fiber MMF In optical fiber technology an optical fiber that is designed to carry multiple light rays or modes concurrently each at a slightly different reflection angle within the optical core Multi Mode fiber transmission is used for relatively short distances because the modes tend to disperse over longer distances See also Single Mode Fiber Multiplex The ability to intersperse data from multiple sources and destinations onto a single transmission medium Refers to delivering a single transmission to multiple destination Node Ports N_Ports N_Port Node Port A Fibre Channel defined hardware entity at the end of a link which provides the mechanisms necessary to transport information units to or from another node N_Port Login N_Port Login PLOGI allows two N_Ports to establish a session and exchange identities and service parameters It is performed following comp
296. ork environment First we need to think about how we want to integrate the McDATA switches into our network environment Do we want the EFC server accessible through our corporate intranet or do we only want to access it locally Second do we want to establish a dedicated network segment to connect the switches with the EFC server or do we want to connect the hub that connects the switches with the EFC Server to the LAN as well Network setup with switches configured in the corporate LAN We want to be able to reach the EFC server through the network which is also reachable from remote using IP so we need to connect the EFC server to the LAN Also we chose to install the McDATA switches in our laboratory network as well This configuration is shown in Figure 3 7 Chapter 3 Implementing a SAN with McDATA 183 Ethernet Hub i i primary i network H interface EFC Server ESNE Loopswitch eae Switch l PEEReEES Director i x Remote i EFC Manager client i i i Cabinet Figure 3 7 McDATA network setup with ethernet hub part of the LAN 184 This is achieved using the ethernet hub which is supplied with the Fabricenter equipment rack We connect the EFC Server and the switches to the hub and hook up the hub to the corporate LAN The arrows indicate the route for the remote EFC Manager client to access the EFC ser
297. ort PC1_2 that we restricted to a specific ESS FC port this would not make any difference Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 127 Selecting the disk groups for the volume placement By clicking on a port we can now see the storage that we can use to define volumes on This is shown in Figure 2 67 Add Volumes 1 of 2 Click on a Host or Array to see paths Information Total Free Space 641 80 Largest block of contigu Bay 1 Adapter 3 Port Selected Ranks Cluster 1 Adapter Cluster 2 Adapter Cluster 1 Adapter Cluster 2 Adapter h h h h Figure 2 67 Add Volumes 1 of 2 panel with disk group status shown There are different colors to indicate which state the disk groups are in In our case none of the four disk groups that we configured contains an ESS logical volume This is indicated by a green color Only disk groups that contain unallocated storage can be used to add volumes In Figure 2 67 no disk group has been manually selected by us This means that all of them are automatically selected for the next step of the process of defining and assigning volumes Which disk groups are selected is shown in the Information window of the panel However we mark the two disk groups for use in the next step by clicking on these This highlights them with a border as shown in Figure 2 68 Figure 2 68 One disk group sele
298. orts or through additional frame flow control is enforced through the route table in the switch Name server enforced zoning McDATA uses name server zoning which is implemented by authorizing or restricting access to name server information The name server database on McDATA switches contains pertinent information about the node ports logged in to the switch The main purpose of the name server is to provide this information to attached node ports about the other node ports in the fabric The attached node port does not need to probe every destination for information Instead it logs in with the name server and requests information on attached node ports With name server zoning established the port that asks for information will only get back information about ports from within the same zone This is also called soft zoning because the name server enforces the zones but there is no control of the real data flow Route table enforced zoning In contrast to this hardware enforced zoning restricts the frame flow to zone members on a route table based in the switch hardware ASIC Route table zoning is an additional layer of security to protect against node ports that do against the accepted methods of communication with switches probe FC addresses for information Future microcode releases of McDATA products will introduce route table zoning The definition will be done from within the Fabric Manager 3 5 2 Zone member definitions 224 Z
299. ose Host Name unknown unknown New Host Host Type unknown v unknown Host Connection unknown unknown social a Host WANN 10000000 c921da0a 10000000 c921da0a Undo Changes Delete a Host Take Host Off Line Figure 4 35 VPS host settings The Host information can now be entered in the left hand column labeled New Host Data The Original Host Data column displays the values before any changes are made Once completed select Apply Changes and then Close This window can also be used to enter in host information for a host that has not yet connected to the SAN Data Gateway Select New Host and then enter in the WWN and other parameters that are available You must at minimum enter in a WWN Also when entering in the number a colon must be used to separate the first four bytes from the last four bytes Also you will notice that the host description in the top can change color If the information is in blue then the host is offline If the host information is in black then it is online The VPS feature allows an administrator to quickly view the host information and status at a central location 292 Implementing an Open IBM SAN Setting up a Virtual Private SAN Remember that the SAN Data Gateway assigns its own LUN numbers and it does so in a sequential order An attached disk device may have a SCSI target of 1 with a LUN ID of 4 but when recognized by the SAN Data Gat
300. osite Drive setup Click Finish when you have created all the desired composite drives Up to this point the configuration has been kept within the SLIC Manager software When the Finish button is clicked the SLIC Manager will now communicate to the Router to complete the process and update the Router to control the drives The Host system must re scan for devices or restart to be able to see the composite drive Implementing an Open IBM SAN 5 5 2 Composite drive properties If you view the Control Center again by selecting Tools gt Control Center as shown in Figure 5 18 the newly created composite drive is listed in the Composite Drive box Control Center T33025 TOOOOO 35E68229 TOOOO3 35E6848D TOOOO4 3SEZZ2D6C TOOOOS 3SE6840E TOOOOS 35E68462 TOOOO 35E684AE Figure 5 18 Control Center with composite drive Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 331 Select the composite drive and then click the Properties button The Composite Drive Properties dialog box opens as shown in Figure 5 19 Composite Drive Properties Composite Drive Selection T00001 TOOOoZ m Composite Drive Members Ir arget SSA UID I Function Pei m Composite Drive Tool Box 35EZ2ZD0B 35E69318 Identify Member Identify Composite j Drive Name rrso Change Composite Drive Characteristics Capacity MB 17378 PUBLIC Number of Members 2
301. ot be changed from within the ESS Specialist An IBM Service Support Representative SSR must perform this task using the service terminal 86 Implementing an Open IBM SAN Generating a new PE password Resetting the PE password means actually that you generate a password for Product Engineers PE which they can use to access the ESS from remote for repair actions By pressing the Reset PE Password button a warning window will appear and after clicking the Yes button the window with the new PE password will be displayed This password grants the PE unlimited access to the ESS LIC and the ESS configuration files for 168 hours 7 days Using the Remote Support Modification panel Using the Modify Remote Support button we get the Remote Support Modification panel shown in Figure 2 12 Remote Support Modification Call Home Enable Enable Remote Access Password maa Password Verification aaa Perform Configuration Update Cancel Configuration Update Figure 2 12 Remote Support Modification panel The Remote Support Modification panel allows us to enable or disable the Call Home feature and the Remote Service Access In the event of failure of an ESS component the Call Home feature enables the ESS to dial to the IBM service center The Remote Service Access enables an SSR to dial into the ESS to perform a limited set of non disruptive diagnostic activities Chapter 2 IBM TotalStorage Enterprise Stora
302. ou to gt Protect legacy storage equipment while utilizing the latest host servers with Fibre Channel support 262 Implementing an Open IBM SAN gt Expand connectivity to storage devices with use of IBM SAN hubs switches and directors gt Perform channel zoning and LUN masking capability to allow access at a volume level gt Overcome the distance limitations of SCSI based host systems using longwave ports that support distances up to 10 km gt Utilize the StorWatch SAN Data Gateway Specialist which is an easy to use interface for managing and controlling access of host systems to storage devices The SAN Data Gateway is available as a rack mount unit or as a stand alone tabletop unit The gateway model provides two shortwave Fibre Channel ports and four Ultra SCSI Differential ports to attach disk or tape storage devices One or two Fibre Channel cards dual port shortwave and or single port longwave may be added for a maximum of six shortwave ports or two shortwave and two longwave ports If you are using the dual port shortwave cards Figure 4 2 depicts the port assignment numbers for the optical interfaces SAN Connection Port Number Assignments Figure 4 2 SAN connection port assignment 4 2 Installation Before any server or device connection is made to the SAN Data Gateway you need to power on the unit and connect a service terminal to the 9 pin Service port located on the rear right hand side of the unit
303. ound and can be downloaded at the same Web site that the StorWatch SAN Data Gateway Specialist was downloaded from http www storage ibm com hardsoft products sangateway support forml htm After completing the registration and license agreement the Download Main page is displayed Select the operating system software subheading and look for HOSTSW View the read me file for the latest information Download the software and install it onto the host that will be attaching to the SAN Data Gateway Follow the instructions provided in the read me file For Windows NT the file is a self executing file so it can be executed or run as any exe file As it runs through the install make sure to select SAN Explorer and VPS Registration Service as shown in Figure 4 30 Select Components In the options list below select the checkboxes for the options that you would like to have installed The disk space fields reflect the requirements of the options you have selected IV SAN Explorer MA Pathlight VPS Registration Service Disk Space Required 183k Disk Space Remaining 3101079 k Figure 4 30 Loading VPS Registration software on Windows NT Implementing an Open IBM SAN Once installed the service runs automatically and does not require further administrator interaction Communicating with the Gateway Once the host is attached to the Gateway and restarted the registration service will communicate
304. ow how they can be implemented in an open systems environment and we focus on the Fibre Channel protocol FCP environment in particular We address some of the key concepts that they bring to the market and in each case we give an overview of those functions that are essential to building a robust SAN environment SG24 6414 00 ISBN 0738424773 TLL t A Redbooks INTERNATIONAL TECHNICAL SUPPORT ORGANIZATION BUILDING TECHNICAL INFORMATION BASED ON PRACTICAL EXPERIENCE IBM Redbooks are developed by the IBM International Technical Support Organization Experts from IBM Customers and Partners from around the world create timely technical information based on realistic scenarios Specific recommendations are provided to help you implement IT solutions more effectively in your environment For more information ibm com redbooks
305. p Reset to primary Use the reset to primary button to restart Copy Services with the primary server as the active server Attention We recommend that you not perform a reset unless you are certain that there are no other recovery options When you perform this function please be aware that You will lose any PPRC or FlashCopy tasks for which you have not received a successful completion message Established PPRC and FlashCopy relationships are maintained You cannot submit any additional command line interface CLI tasks until ESS Web Copy Services has initialized You lose all the tasks that were created and saved during the time the active server was the backup server Reset ESS Web Copy Senices Reset to backup Use the reset to backup button to restart Copy Services with the backup server as the active server Figure 2 17 Tools help page Web Copy Services trouble shooting 92 Implementing an Open IBM SAN Attention We recommend that you not perform a reset unless you are certain that there are no other recovery options When you perform this function please be aware that You will lose any PPRC or FlashCopy tasks for which you have not received a successful completion message Established PPRC and FlashCopy relationships are maintained You cannot submit any additional command line interface CLI tasks until ESS Web Copy Services has initialized Reset ESS Web Copy Senices Disable Use the disable button
306. pen System 064 0 GB Bay 1 Card 3 Device Adapter Pair4 Yes FC Port A Cluster 1 Loop B ID 00 LUN 0000 Array 2 ol 001 PC1_2 LSS 017 701 18486 Open System 064 0 GB Bay 1 Card3 Device Adapter Pair4 Yes FC Port A Cluster 2 Loop B ID 00 LUN 0001 Array 1 ol 001 Figure 2 99 HTML file List of Assigned Volumes table list of existing assignments It can now be printed from within the browser or it can also be saved as an HTML file for later viewing 2 6 2 Removing volume assignments from host FC ports The second configuration change regarding the volume assignments we want to show is removing the assignments of the ESS logical volume in disk group two of loop B of the SSA device adapter pair 4 from both host FC ports Again we click on the Modify Volume Assignments button as shown in Figure 2 100 Modify Host Systems Configure Host Adapter Ports Configure Disk Groups Add Volumes Modify Volume Assignments Figure 2 100 Entry point for modifying volume assignments Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 151 Removing the assignments of one ESS logical volume First as we did in Selecting ESS logical volume assignments for modification on page 144 we select the volume assignments for both host FC ports Then when the Action field becomes available we select the radio button to Unassign selected volume s from target hosts which mea
307. placed Clear Router Node Mapping To begin the Router installation the first step is to clear the Node Mapping table This is done by shorting the SSA ports on the rear of the Router Plug in an SSA cable from port A1 to A2 on the back of the Router and power it on Clearing the table will take only seconds and when completed the Status LED on the front of the Router will flash a code 060 The Router is now powered off the SSA shorting cable is removed and the SSA disks are attached Connect SSA disks to Router All the disks to be used are to be connected together to form a complete SSA loop with the Router included All dip switches in SW1 should be in the down position On SW2 dip switches 0 and 1 are set in the down position all other switches in dip switch 2 should be turned up This is considered mode 3 Power on the Router the Status LED will begin to flash rapidly as it searches the SSA loop to recognize all the disk drives This may take approximately 1 minute to complete Once the Status LED has stopped flashing and is solid the process is complete and the Router is powered down Perform Router Subsystem Diagnostic test A Subsystem Diagnostic test is now run on the disk drives called mode 15 This tests the disk drives for spindle spin up read tests and nondestructive write tests The Router is set for mode 15 by setting switches 0 1 2 and 3 on SW2 to the down position and the rest turned up The Router is now
308. ppy diskette with the QLogic drivers into the A drive of the NetWare server Press Enter The available driver is displayed 8 Select the driver for the QLogic card and press Enter 9 Select Modify driver parameters and enter the slot number of the QLogic card into the slot number parameter 10 Set the Scan All Luns parameter to Yes 11 Press Tab and select Save Parameters and Load Driver 12 Exit the nwconfig or install utility 13 If storage has already been assigned to the server from the ESS Specialist type SCAN FOR NEW DEVICES SCAN ALL LUNS and LIST DEVICES The ESS hosted volumes are displayed in the devices list Create volumes using the nwconfig utility if necessary 1 8 5 ESS QLogic QLA2100F 2200F host adapter card To configure the host adapter card use the IBM TotalStorage ESS Specialist 1 9 Sun FC host system attachment This topic tells you how to change the Sun system kernel Before you start you must meet several attachment requirements 1 9 1 Attachment requirements 30 This section lists the requirements for attaching the ESS to your host system gt Ensure that you have all the equipment you need gt Ensure that there are enough Fibre Channel adapters installed in the server to handle the total LUNS you want to attach The maximum LUNs per adapter in a Fibre Channel arbitrated loop topology is 50 gt Ensure that you have the documentation for your host system and that the IBM Enterprise Stor
309. press Enter to each question to accept the default setting 9 Specify the package number or press Enter to accept all packages 10 Type y or n to answer the prompt that reads Rebuild manual pages database for section 7d y n If you typed y go to step 11 Note Rebuilding the manual pages can take up to ten minutes If you do not want to build the manual pages type n You can run the command later 11 At the prompt that reads Use IP networking over Fibre Channel y n type y or n If you typed y go to step 12 12 Type the name of the network host name for the adapter Note The network host name identifies the host adapter on a Fibre Channel network and is associated with a unique IP address 13 Edit the etc hosts file to add the IP address to the host name Note If you have more than one adapter in the system you must create a hostname pfn file for each adapter 14 At the prompt that reads Do you want to continue with the installation of lt Ipfc gt Type y to proceed with the installation or type n to undo all the settings and end the installation 15 At the prompt that reads Select package s you wish to process or all to process all packages default all q Type q Note We recommend that you configure the host adapter parameters before you shut down and restart the host system 16 At the system prompt type shutdown to restart the host system 17 Login as root Implementing an Open IBM SAN
310. pt fille 24 1 7 3 Configuring the IBM 2105 for clustering 04 25 1 8 Novell NetWare FC host system attachment 05 26 1 8 1 Installing the QLogic QLA2100F adapter card 26 1 8 2 Installing the QLogic QLA2200F adapter card 27 1 8 3 Loading the current Fibre Channel adapter driver 29 1 8 4 Installing the Fibre Channel adapter drivers 29 1 8 5 ESS QLogic QLA2100F 2200F host adapter card 30 1 9 Sun FC host system attachment 000000e eee eee 30 1 9 1 Attachment requirements 2 0 0 eee ee 30 1 9 2 Installing the Emulex LP8000 adapter card 32 1 9 3 Downloading the current Emulex Fibre Channel adapter driver 33 1 9 4 Installing the Fibre Channel adapter drivers 33 1 9 5 Installing the JNI PCI adapter card 00 ee eee 35 1 9 6 Downloading the current JNI PCI Fibre Channel adapter driver 35 1 9 7 Installing the JNI PCI Fibre Channel adapter driver 36 1 9 8 Installing the JNI SBUS adapter card 20 0085 36 1 9 9 Downloading current JNI SBUS Fibre Channel adapter driver 37 1 9 10 Installing the UNI SBUS Fibre Channel adapter driver 37 1 9 11 Installing the QLogic QLA2200F adaptercard 38 1 9 12 Downloading the current Fibre Channel adapter driver 39 1 9 13 Installing th
311. pyl Figure 5 28 Add Mirror Member display Select and highlight the copy drive from the Available Drive Pool window click the Add Member button and the name of the copy drive will appear in the New Mirror Member window This is shown in Figure 5 29 Add Mirror Member Tooo00 LOOO 35E68229 T0000 LOO 35E684AE T33025 ITsol 733283 copyl Figure 5 29 Adding drive members to a mirror Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 341 Click the OK button and the Mirror Drive Properties will now reflect the change as shown in Figure 5 30 Mirror Instant Copy Drive Properties x Mirror Instant Copy Drive Selection OK T33282 ITSOm Looz Cancel Drive Members Tool Box rar get SSA UID Function T00003 35E6848D T00004 35E22D6C Delete Member Identify Mirror T33283 copyl T0000S 35E6840E Drive Characteristics Identify Member Capacity MB 8689 FC LUN B Drive Name frrsom Number of Change Members Figure 5 30 Mirror drive properties with copy drive attached Click OK to complete the process 5 7 4 Detach Instant Copy Drive from a mirror To detach or split off the copy drive from the mirror the procedure is similar except at the Mirror Drive Properties window select Delete Member A window will appear that displays all current members of the Mirror Select the Copy drive and then delete it from the M
312. r for instance to change the password we go to Configure gt Users With the Modify button we are presented with a window similar to the New window where we can change our password and the user rights This is shown in Figure 3 21 g 5 McDATA Enterprise Fabric Connectivity Manager rw Product View Configure Users Ea View aT Description Administrator System Administrator A itso ITSO Jon Tate Thomas remote administrator Configure Modify User x z User name Jer Password e EAA Confirm Password 1 a Description remote administrator New Modify Rights Granted Rights Available System Administrator Product Administrator lt lt Add Operator Maintenance T LogoutExit E Figure 3 21 EFC Manager Configuring Users Modify User Chapter 3 Implementing a SAN with McDATA 199 Once the new user has been defined we can login to the EFC server with the newly created user ID and password 3 3 4 Identifying devices to the EFC Manager We have to identify the devices that are going to be configured and monitored through this EFC Manager Those devices then cannot be maintained with another EFC Manager After logging on to the EFC server the Product View opens with no devices installed as shown in Figure 3 22 5 McDATA Enterprise Fabric Connectivity Manager Figure 3 22 EFC Manager Product View no switches defined 20
313. r Settings menu as follows Execution throttle 100 Fast command posting Enabled LUNs per target 0 Enable LIP reset No a b c gt 4 GB addressing Disabled for 32 bit systems d e f Enable LIP full login No Note In a clustering environment set Enable LIP full login to Yes g Enable target reset Yes h Login retrycount 20 minimum i Port down retrycount 20 minimum j Driver load RISC code Enabled k Enable database updates No Disable database load No m IOCB allocation 256 n Extended error logging Disabled might be enabled for debugging Note The Enable LIP reset Enable LIP full logon and Enable target reset parameters control the behavior of the adapter when Windows NT tries to do a SCSI bus reset You must perform a target reset to make cluster failovers work Use the SCSI bus device reset option to clear SCSI reservations 8 Press Esc to return to the Configuration Settings menu 9 From the Configuration Settings menu scroll down to Extended Firmware Settings Press Enter Chapter 1 Implementing Fibre Channel host adapter cards 61 10 From the Extended Firmware Settings menu scroll down to Connection 1 1 1 1 Options to open the Option and Type of Connection window 1 Select one of the following options a 0 Loop only b 1 Point to point preferred setting c 2 Loop preferred If you cannot use arbitrated loop then default to point to point d 3 Point t
314. r action is required If not click the Startup button and change the Startup Type to Automatic This will have the daemon service start automatically during a reboot This is shown in Figure 5 6 Services Service Status Startup Telephony Service Manual TRMM API Server Manual Start TSM Serverl Manual TSM Server2 Manual TSM Server3 Manual UPS Manual e Windows Installer Manual Workstation Started Automatic World Wide Web Publishing Service Started Automatic Vicom SLIC Daemon service Started Automatic Continue Startup Hw Profiles Startup Parameters rr SS Hep Figure 5 6 SLIC daemon start up in Windows NT Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 321 5 3 3 Starting the SLIC Manager 322 To start the Vicom SLIC Manager software select Start gt Programs gt Vicom gt Vicom SLIC Manager The software will load and a dialog box will appear In the box with the heading Hostname enter in the name or IP address of the host the daemon service is running Enter in the SLIC name you entered in when editing the 7190 cfg file An example is shown in Figure 5 7 SDU Connect x SS ee fo 1 150 96 Cancel SLIC Name fitso Find Connection History Figure 5 7 SLIC connection window Click OK and the software will begin to communicate to the Router You will notice that the top title bar of your window will now include the host name an
315. rating Mode x Open Systems Interop Mode McDATA Fabric 1 0 v O 390 oa eel Figure 3 34 Product Manager ED 6064 Configure Operating Mode Chapter 3 Implementing a SAN with McDATA 209 210 The mode can be set to Open Systems or to S 390 Setting this mode only affects the operating mode used to manage the director but not its port operation This means that both FCP and FICON devices can communicate in each of the two operating modes Note The mode cannot be changed to Open Systems if the inband FICON management server is enabled McDATA provides with the ED 6064 an Open Systems Interop Mode which can also be activated using this window shown in Figure 3 35 ia Configure Operating Mode x Figure 3 35 Product Manager ED 6064 Configure Operating Mode Open Fabric If the Interop Mode is configured for Open Fabric 1 0 any open fabric compliant switch can be connected Those are then visible in the EFC Manager and the Fabric Manager and can be zoned from within the Fabric Manager However these switches cannot be managed through the Product Manager In this mode McDATA Fabric 1 0 the connectivity is restricted to McDATA switches Connected non McDATA switches will be marked as Invalid Attachment Configuring the FC ports To configure the options relating to each port we select Configure gt Ports We are now presented with the Configuration Ports window which is shown in Figure 3 36 Imple
316. re Channel host adapter cards 7 The FICON architecture prohibits this capability The reason for the restriction is because the base S 390 and zSeries I O architecture uses a single byte for addressing the I O devices This one byte I O address is not compatible with the Fibre Channel 3 byte port address The FICON solution to this problem is to disallow switch cascading 1 3 IBM iSeries FC host system attachment This topic describes the host system requirements and provides the procedure to attach your IBM AS 400 or iSeries host system to the IBM Enterprise Storage Server ESS with Fibre Channel adapters Note The IBM AS 400 or iSeries host systems do not support serially interconnected host systems attached to the ESS They also do not support serially interconnected ESS attachments to a single port on the host adapter Your IBM AS 400 or iSeries host systems support the ESS as a peripheral device The ESS presents individual 2105 LUNs to the AS 400 or iSeries host system You do not need to perform manual tasks to assign LUN addresses as the ESS will do it automatically during configuration Note You cannot use the IBM Subsystem Device Driver on the AS 400 or iSeries host system 1 3 1 Host limitations for the iSeries In Table 1 2 we show a description of the LUN assignments for the iSeries host system Table 1 2 iSeries host system limitations Host system LUN Configuration notes assignments per target iSeries Fibr
317. re wasted because of the private connection You can serially connect controllers with FICON The next question though is whether or not it is OK to serially connect DASD control units with tape controllers Tape generally performs much larger I O operations at any instant in time Therefore even with FICON when you have Tape I O running you can temporarily lockout some DASD I O Hence it is still better not to put tape and DASD on the same FICON channel Implementing an Open IBM SAN 1 2 6 Attaching an ESS to FICON channels You can use the following FICON adapters with the IBM S 390 Enterprise Storage Servers gt Feature code 2314 This is the long wave laser adapter gt Feature code 2316 This is the short wave laser adapter You can use the following FICON adapters with the IBM S 390 or zSeries system gt Feature code 2315 This is the FICON long wave laser adapter This adapter has two ports per adapter This adapter is a 9 micron single mode cable but you can use it with a 62 5 micron multimode cable when you attach mode conditioning cables at each end gt Feature code 2318 This is the FICON short wave laser adapter This adapter has two porters per adapter The short wave laser adapter supports the 50 and 62 5 micron multimode cable You can attach the FICON channels directly to an ESS or you can attach the FICON channels to a Fibre Channel switch When you attach the FICON channels directly to an ESS
318. reflecting the new locally administered WWPN In Figure 2 122 we show the WWNN of the ESS that is used and modified when this feature is enabled Welcome to IBM StorWatch Enterprise Storage E Server Specialist Machine Type 2105 Machine Model F20 Serial Number IBM FCA13 WWHH 5005076300C00C0OD Figure 2 122 WWWNN of the ESS with locally administered WWPNs What we also see in the information frame is that this is an ESS which has ESS FC ports that are also FICON capable This adapter indicates that it is configured for FCP and not for FICON 166 Implementing an Open IBM SAN 2 7 3 Configuring host FC ports for FC SW and FC AL Now as we have selected the first ESS FC port we are going to configure this and two other ports to be able to communicate with our host FC ports The first two ports we configure for use in a switched fabric environment and the second are for use in an arbitrated loop environment Selecting the topology for the ESS FC ports The pull down list in the FC Port Attributes field as shown in Figure 2 123 is for selecting the topology the port is going to be connected to FC Port Attributes 1000000009251126 World Wide Port Name Fibre Channel Topology Undefined r Fibre Channel Foint to Point Fibre Channel Arbitrated Loop Figure 2 123 Pull down list selected port currently undefined The selected ESS FC port in bay one adapter three we start with is unconfigured
319. ress of the download 10 When the download completes click Close Chapter 1 Implementing Fibre Channel host adapter cards 35 11 If you downloaded the driver file from a Sun host system go to Installing the JNI PCI Fibre Channel adapter driver If you downloaded the driver file from a non Sun host system transfer the drive file to a Sun host system 1 9 7 Installing the JNI PCI Fibre Channel adapter driver Perform the following steps to install the JNI PCI Fibre Channel adapter drivers T Go to the following Web site www jni com 2 From the navigation menu at the top of the page click Drivers 3 From the menu for Locate Driver by Product click FCI 1063 4 From the menu for FCI 1063 find the section for Solaris JNI Click readme txt 5 Print the readme txt file 6 Follow the instructions in the readme txt file to install the JNI PCI adapter card 7 Update the parameter list See Table 1 7 on page 42 8 Restart the host system 1 9 8 Installing the JNI SBUS adapter card This section tells you how to attach an ESS to a Sun host system with the JNI SBUS adapter card 36 Perform the following steps to install the JNI SBUS adapter card f o Turn off and unplug the computer 2 Remove the computer case 3 4 Remove the blank panel from an empty SBUS slot Insert the host adapter board into the empty SBUS slot Press firmly until seated Secure the mounting bracket for t
320. rformed on the attached hosts and in some cases the fabric components in order to allow the host FC adapter to successfully login using the new WWPN Implementing an Open IBM SAN These actions are host dependent With respect to the fabric components if WWPN zoning has been implemented then it will be necessary to update every instance of the WWPN in the switches and or directors The WWPNs of the adapter are built from the WWNN of the ESS and the location of the adapter in the ESS interface bays This is done using the pattern shown in Figure 2 120 World Wide Port Name 50 05 07 63 00 C3 0C 0D C4 C3 C2 C1 CC CB CA C9 C8 C7 C6 C5 DO CF CE CD Interface Bay 1 Interface Bay 2 Interface Bay 3 Interface Bay 4 World Wide Node Name 50 05 07 63 00 CO 0C 0D XX XX XX XX XX YY xx xx Figure 2 120 Pattern for the generation of the WWPNs of the ESS FC ports Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 165 The Information frame on the Storage Allocation Graphical View panel reflects the new WWPNs of the ESS we have used for this illustration which is shown in Figure 2 121 Adapter Type FC host attachment FCP Capable I0 Bay 1 Adapter 2 Port aA WWPH 5005076300C30C0D Topology Point to Point Figure 2 121 Information Frame
321. ripherals particularly high speed storage arrays RAID and CD ROM storage by IBM ST Straight Tip connector Also known as Stick and Twist Star The physical configuration used with hubs in which each user is connected by communications links radiating out of a central hub that handles all communications StorWatch Expert These are StorWatch applications that employ a 3 tiered architecture that includes a management interface a StorWatch manager and agents that run on the storage resource s being managed Expert products employ a StorWatch data base that can be used for saving key management data e g capacity or performance metrics Expert products use the agents as well as analysis of storage data saved in the data base to perform Glossary 371 higher value functions including reporting of capacity performance etc over time trends configuration of multiple devices based on policies monitoring of capacity and performance automated responses to events or conditions and storage related data mining StorWatch Specialist A StorWatch interface for managing an individual fibre Channel device ora limited number of like devices that can be viewed as a single group StorWatch specialists typically provide simple point in time management functions such as configuration reporting on asset and status information simple device and event monitoring and perhaps some service utilities Striping A method for achievi
322. rk A network which encompasses inter connectivity between devices over a wide geographic area A wide area network may be privately owned or rented but the term usually connotes the inclusion of public shared networks WDM Wave Division Multiplexing A technology that puts data from different sources together on an optical fiber with each signal carried on its own separate light wavelength Using WDM up to 80 and theoretically more separate wavelengths or channels of data can be multiplexed into a stream of light transmitted on a single optical fiber WEBM Web Based Enterprise Management A consortium working on the development of a series of standards to enable active management and monitoring of network based elements Zoning In Fibre Channel environments the grouping together of multiple ports to form a virtual private storage network Ports that are members of a group or zone can communicate with each other but are isolated from ports in other zones Glossary 373 374 Implementing an Open IBM SAN Index Numerics 1 way mirror 332 2766 adapter 10 2 way mirror 332 3527 311 3 way mirror 332 7131 311 7133 311 A access levels 94 access profile 163 Access_Any 163 Access_Restricted 163 active zone sets 229 active zoning configuration 239 adapter types 2 Add Volumes 126 Adding an Instant Copy Drive to a Mirror 340 Adding Disk 351 Adding Hosts 354 Adding Routers 351 Adding SCSI devices 285 adjac
323. roups connected to the A loop of the device adapter pair 4 as RAID array To do this we select the first disk group we want to configure and select Raid Array from the Storage Type pull down menu The storage type as shown in Figure 2 39 can be RAID Array or non RAID Non RAID means the disks are going to be configured as just a bunch of disks JBOD Disk Group Atiribuies Perform oe Update Cancel Configuration Update Figure 2 39 Open systems storage types Doing this also changes the Track Format to Fixed Block FB in the Track Format pull down menu After doing this we select the second disk group in the other cluster and also select Raid Array The Modification column of the panel as shown in Figure 2 40 shows that we have made changes Defined and the Capacity column shows that our disk groups are still unformatted In this case formatted to the ESS means it is not formatted as either a RAID array or as non RAID Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 109 Fixed Block Storage a PU DT T LOOps hy TOU a a Undefined on Untomnatted 254 80 GB cae NED coats a Oe aa Sei fae Disk Group Atiribuies fram Amay z Storage Type Foea Block FB bai Track Format Perform Configuration Update Cancel Configuration Update Figure 2 40 Disk groups defined for RAID 5 Performing the configuration update To apply the changes made we press the Perform Configur
324. rprise Storage Server Web Copy Services ESS Web Copy Services The ESS Specialist is used for querying the status of the ESS and for displaying defining and modifying the operation configuration and administration of the ESS The ESS Web Copy Services is used for querying the status of remote operations and performing tasks with the advanced copy functions FlashCopy and Peer to Peer Remote Copy PPRC of more than one ESS We will cover configurations performed using the ESS specialist Accessing the ESS specialist To access the ESS specialist we use the Netscape Navigator and point it to the hostname or IP address of any of the two ESS clusters in the Uniform Resource Locator URL field The Web browser than connects to the Web server in the ESS cluster which handles the requests from the browser Since the programs that run in the Web browser window are Java applets the Java Virtual Machine JVM used by the browser needs to be capable of supporting the applets Browsers that are supported by the ESS Web Interface are gt Netscape Navigator 4 04 with JDK 1 1 fixpack 4 05 with JDK 1 1 fixpack 4 06 4 5x 4 7x gt Microsoft Internet Explorer 4 x with JVM 4 0 or 5 0 5 x with JVM 4 0 or 5 0 The ESS Specialist does not support Netscape Navigator 6 0 Other Browsers might work but are not currently supported by IBM We show a short overview of the configuration panels of the ESS Specialist T
325. rt The Call Home Feature allows the user to be notified through the email when a user designated SRNs occur The designated email address the profile for the email program used and SRNs must be defined in this file Syntax system email userif femail addr com user2 email addr com profile email program name srn N srn number N 2nd srn number Se k SH SH SHH HE e For Help press F1 NUM 4 Figure 5 4 Sample configuration file 318 Implementing an Open IBM SAN This file can now be edited to be used as the configuration file for your SLIC system Begin by deleting the sign on the lines that contain the sample configuration The rest of the information can be entered in as shown in Figure 5 5 A description of each entry field is also provided i 7190 cfg WordPad of x File Edit View Insert Format Help Dane seh Hea S SDU Service Utility Daemon Configuration File Syntax itso path F IBM 7190 S5Fa userlogfile c ibm7190 itsoevent log QueryChangeInterval 10 he Comment Lines are declared using Example c0 path J IBM7190 SFa K IBM 7190 SFa QueryChangeInterval in seconds Quer yChange Interval 10 Ye Call Home Feature Support The Call Home Feature allows the user to be notified through the email when a user designated SRNs occur The designated email address the profile for the email program used and SRNs must be defined in this file
326. rver can reside in the Fabricenter Equipment Cabinet The ED 6064 is managed and monitored through the Enterprise Fabric Connectivity Manager EFC Manager which runs at the Enterprise Fabric Connectivity Server EFC Server The EFC Manager server can be accessed locally with the EFC Server or through an EFC Manager client installed on another local or remote workstation The EFC Manager serves as a central point of control for up to 36 McDATA products Also some management can be done through a browser pointed to the embedded Web server on the EFC server For in depth information on the ED 6064 also see the McDATA ED 6064 manuals provided with the switch McDATA ED 6064 Director Planning Manual 620 000106 McDATA ED 6064 Director User Manual 620 000107 McDATA ED 6064 Director Installation and Service Manual 620 000108 McDATA ED 6064 Director Fabric Connectivity Manager User Manual 620 005001 YYY Yy Chapter 3 Implementing a SAN with McDATA 177 3 1 2 ED 5000 Fibre Channel Director 178 The ED 5000 shown in Figure 3 2 is a Fibre Channel switch with a maximum of 32 ports Figure 3 2 ED 5000 Most parts of the switch are hot pluggable field replaceable units FRU The design is geared towards high reliability and availability The switch supports features like internal failover to redundant FRUs and fault detection The maintenance firmware loads and upgrades can be done without downtime and a call home fea
327. s Turn on the SCSI devices You must turn on all SCSI devices attached to the SAN Data Gateway before you initially turn on or restart the SAN Data Gateway 2 SAN Data Gateway The SAN Data Gateway scans the SCSI buses when it starts If you add or remove SCSI devices after the Gateway has started the Gateway will not detect the changes You can invoke an SCSI rescan or restart operation from either the StorWatch SAN Data Gateway Specialist client or the service terminal 3 Fibre Channel host Before you turn on or restart the hosts that are connected with Fibre Channel to the SAN Data Gateway you must wait until the SAN Data Gateway has finished starting You will know the Gateway has finished starting when the ready light on the front panel blinks at frequency intervals of one second e Some operating systems provide you with software methods that allow you to add or remove SCSI devices dynamically after the host has started To ensure reliable operation restart the host If you update SAN Data Gateway firmware you must restart the Gateway to use the new firmware To ensure compatibility between the firmware features or functions and the host restart the host If you update SCSI device firmware the SAN Data Gateway Explorer application does not display the new firmware version until the SAN Data Gateway has issued an SCSI inquiry The SCSI inquiry occurs when the Gateway rescans the SCSI buses The SCSI inquiry also occurs when
328. s Esc To save the changes click Yes Press Enter 10 Restart the server 1 8 2 Installing the QLogic QLA2200F adapter card This section tells you how to attach an ESS to a Novell NetWare host system with the QLogic QLA2200F adapter card Single and dual port Fibre Channel interfaces with the QLogic QLA2200F adapter card support the following public and private loop modes gt YYY Yy Target Public initiator Private initiator Target and public initiator Target and private initiator Perform the following steps to install the QLogic QLA2200F adapter card aR ond Note The following steps are an example of a configuration The configuration for your adapter might differ Install the QLogic QLA2200F adapter card in the host system Connect the cable to the ESS port Restart the server Press Alt Q to get to the FAST Util Command panel From the Configuration Settings menu click Host Adapter Settings and set the parameters and values from the Host Adapter Settings menu as follows a Host adapter BIOS Disabled b Frame size 2048 c Loop reset delay 5 minimum d Adapter hard loop ID Disabled From the Advanced Adapter Settings menu press the Down Arrow key to highlight LUNs per target then press Enter Set the parameters and values from the Advanced Adapter Settings menu as follows Chapter 1 Implementing Fibre Channel host adapter cards 27 229 5 p ao m n Execution throttle
329. self is not unique to be able to reach the hosts given we need a fully qualified DNS host name which consists of the DNS host name and the DNS domain it is in gt Gateway address 9 113 25 254 This is the default router which has to be known to the IP stack to route to a destination outside the current LAN using IP The director needs to have following information too to be accessible from the management software For the ED 6064 this is for example gt IP address 9 113 25 246 gt Subnet mask 255 255 254 0 gt Gateway address 9 113 25 254 The network information for the ED 6064 ED 3016 and the ES 1000 is done using a maintenance computer connected to the switch through the serial port Refer to the Installation and Service Manual of the switch on how to change the network information To set the network information on an ED 5000 we would use the operator panel We can scroll though the information displayed on the panel with the Advance button To change specific information we display it using this button As we want to change it we click the Clear button to get a cursor in the entry field With the Detail button we increment the value of the field we have activated Clicking the Clear button again gets us to the next field to change If all entries are correct we use the Entry button to save the changes This has to be done with the IP address the Subnetmask and the Gateway address Chapter 3 Implementing a SAN w
330. sical control of the Fibre Channel link for each mode of use LIP A Loop Initialization Primitive sequence is a special fibre channel sequence that is used to start loop initialization Allows ports to establish their port addresses Local Area Network LAN A network covering a relatively small geographic area usually not larger than a floor or small building Transmissions within a Local Area Network are mostly digital carrying data among stations at rates usually above one megabit s Login Server Entity within the Fibre Channel fabric that receives and responds to login requests Glossary 367 Loop Circuit A temporary point to point like path that allows bi directional communications between loop capable ports Loop Topology An interconnection structure in which each point has physical links to two neighbors resulting in a closed circuit In a loop topology the available bandwidth is shared LVD Low Voltage Differential Management Agent A process that exchanges a managed node s information with a management station Managed Node A managed node is a computer a storage system a gateway a media device such as a switch or hub a control instrument a software product such as an operating system or an accounting package or a machine ona factory floor such as a robot Managed Object A variable of a managed node This variable contains one piece of information about the node Each node can have several objects Ma
331. signments using the Action field Creating new volume assignments for selected host FC port With the radio button we decide if we want to create a new volume assignment using the volume associated with selected assignments or remove both selected volume assignments We want to create new assignments to share the volumes and so we select the corresponding radio button shown in Figure 2 91 Unassign selected volume s from target hosts Figure 2 91 Adding assignments to other available host FC ports selected Selecting this allows us to choose the host FC port from those displayed in the Target Hosts field We have only the host FC port PC1_1 available for this action If there were to be more host FC ports configured we would have to choose and select the one on which we want the assignments altered by highlighting its name Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 145 146 Performing the configuration update To apply the changes we press the Perform Configuration Update button The progress bar indicates that the configuration update is taking place as shown in Figure 2 92 N Performing Configuration Update x Modifying Yolume Set Configuration 1 Estimated Remaining Time 1 seconds fa Unsigned Java AppletWindow Figure 2 92 Progress window creating volume assignments If successful we get the message shown in Figure 2 92 N Volume Assignments Ea 2106 The
332. sks in the special files You can find the special files in the dev directory The disk block special file starts with rz and the character disk special file starts with rrz Compaq Tru64 UNIX uses the following syntax to identify the disk special files r rz L B P In this syntax gt L LUN letter If the LUN is 0 no letter is specified for the LUN You can specify LUNs 2 7 for letters b h gt B Bus number multiplied by 8 plus the target number gt P Disk partition from a h Following is an example of the output that is displayed from boot log or the scu show edt command This shows a disk at LUN 0 bus SCSI 16 target 0 r rz LUN 0 16 8 0 a h rz128a rz128b rz128c rz128d rz128e rz128f rz128g rz128h rrz128a rrz128b rrz128c rrz128d rrz128e rrz128f rrz128g rrz128h Chapter 1 Implementing Fibre Channel host adapter cards 19 20 You do not need to perform any special operations on the Compaq system to view the ESS volumes Ensure that the host Fibre Channel is already configured If it is not configured you must perform the instructions that come with the card to install the driver Make all the hardware connections configure the ESS and restart the host system If you can see the disks when you restart all the special files are created automatically If you cannot restart the host system you can configure the devices manually by typing scu scan edt You can check to see if
333. ss scsi target 0 lun 1 name sd class scsi target 0 lun 2 name sd class scsi target 0 lun 3 name sd class scsi target 0 lun 4 name sd class scsi target 0 lun 5 name sd class scsi target 0 lun 6 name sd class scsi target 0 lun 7 Note Do not add duplicate target and LUN pairs Type reboot r from the Open Windows window to shut down and restart the Sun host system with the kernel reconfiguration option or type boot r from the OK prompt after you shut down The Fibre Channel adapters that are supported for Sun attachment to the ESS are capable of full fabric support IBM recommends that all Fibre Channel driver configurations include worldwide port name worldwide node name port ID or host bus adapter binding of target LUN pairs Binding of target LUN pairs implements the Solaris SCSI driver configuration file or in the Fibre Channel host bus adapter configuration file installed by the adapter software package Refer to the vendor adapter documentation and utilities for detailed configuration instructions 1 9 15 Tuning HBA configuration files Fibre Channel host bus adapter configuration files are tunable for host system reliability and performance Chapter 1 Implementing Fibre Channel host adapter cards 41 See Table 1 7 for the recommended configuration settings for the host bus adapter for a JNI FC64 1063 and a JNI FCI 1063 Table 1 7 Recommended JNI HBA settings fca_nport 0 Defa
334. st we define the director with its EFC Server and then we define the switch to the same EFC Server and configure it with the Product Manager After defining the switch to the EFC Server the Product View now looks like that shown in Figure 3 80 McDATA Enterprise Fabric Connectivity Manager Figure 3 80 EFC Manager with two managed switches Chapter 3 Implementing a SAN with McDATA 251 252 To include the second switch in the fabric of the first we basically need to connect the switches with longwave or shortwave Fibre Channel cables The fabric building process itself is transparent to us as the switches will recognize the connection and automatically configure the G_Ports to be used as E_Ports However there are some configuration options that need to be set up or reviewed before connecting the switches Setting the switch priority In every multiswitch fabric one switch has responsibility for the domain address manager functionality This principal switch controls the allocation and distribution of the domain IDs for all connected switches in the fabric The principal switch is the one with the highest switch priority ranging from 1 highest priority to 255 lowest priority If switches share the same value for the priority the one with the WWN lowest numerical value becomes the principal switch To change the switch priority we also use the Configure Operating Parameters window as shown in Figure 3 81 ia Configure
335. st systems running Solaris 2 6 type cd cdrom unnamed_cdrom Sun32bit b For Sun host hardware platforms with 64 bit capabilities running Solaris 7 or Solaris 8 type cd cdrom unnamed_cdrom Sun64bit 4 Type pkgadd d to initiate the Package Add menu 5 Select the option number for the IBM DPO driver IBMdpo and press Enter 6 Select y to continue the installation for all prompts until the package installation is complete 7 Select q and press Enter to exit the package options menu 8 Type cd to change back to the root directory 9 Type eject cdrom and press Enter to remove the Subsystem Device Driver CD Edit the profile file in the root directory and add the lines shown below to include the IBM DPO subdirectory in the system path PATH PATH opt IBMdpo bin export PATH The IBM DPO driver subdirectory will be automatically added to the path when the system is restarted Implementing an Open IBM SAN 1 9 17 Setting the Sun host system parameters The following sections contain the procedures to set the Sun host system parameters for optimum performance on the ESS with the following adapters gt gt gt JNI Emulex QLogic JNI adapters The following sections contain the procedures to set the Sun host system parameters for optimum performance on the ESS with the JNI adapter 1 2 3 Type cd etc to change to the etc subdirectory Back up the system file in the subdirectory Edit the system file
336. stalled ports Bay 1 Card 3 Port A Bay 1 Card 4 Port A Figure 2 52 Host Attributes frame host interface type selection The IP Address is only used by the StorWatch Enterprise Storage Server Expert It is used to show which host FC ports are in a specific IP host We will not be using the Expert for our example so we leave the entry field empty By pressing the Add button we add the specified host FC port to the Host Systems List We do the same for a second host FC port as shown in Figure 2 53 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 119 Host Systems List Nidmame Host Type SSCs tachment S WWPN HostnameTP Address FC Pots POL PC Server Win NT 4 0 or higher Fibre Charmel attached 200000meBo0ccsB AM installed ports per2 PC Server Win NT 4 0 or higher Fibre Charmel attached 2100000088017862 AM installed ports Figure 2 53 Host Systems List host FC ports defined 120 This host FC port can belong to the same system or we can define ports for other systems Performing the configuration update Adding ports to the list puts together a script in the background which is executed by pressing the Perform Configuration Update button Perform Configuration Update A progress bar informs us about the steps that are being executed as shown in Figure 2 54 N Performing Configuration Update x Locking Yolume Set Configuration 2 Estimated Remaining Time
337. sure that you have 1 MB minimum of hard disk space available to install the AIX host attachment package gt Ensure that you have the documentation for your host system and the IBM Enterprise Storage Server User s Guide The User s Guide is on the compact disc that you receive with the ESS For details about the release level for your operating system see the following Web site www storage ibm com hardsoft products ess supserver htm Either you or an IBM service support representative SSR must perform the following tasks to install and configure an ESS 1 The IBM SSR installs the ESS by using the procedures in the IBM Enterprise Storage Server Service Guide 2 Either you or an IBM SSR defines the Fiber Channel port configuration if you did not do it during the installation of the ESS or Fibre Channel adapters Note Use the information on the logical configuration work sheet in the IBM Enterprise Storage Server Configuration Planner that you previously filled out 3 Either you or an IBM SSR configures the host system for the ESS Use the instructions in your host system publications 12 Implementing an Open IBM SAN 4 Either you or an IBM SSR checks the LUN limitations for the RS 6000 and pSeries See Table 2 Note The IBM Subsystem Device Driver supports RS 6000 and pSeries host systems in a clustering environment To have failover protection on an open system the IBM Subsystem Device Driver requires a minimum of 2 Fibre
338. sures are taken We will see later during the ESS configuration that we can restrict host FC ports through which ESS FC port it will be able to access ESS logical volumes To show the independence of the port the selected host FC port is graphically connected to each ESS FC port as shown in Figure 2 28 In this example we will assume that we already have two host FC ports configured to illustrate this point Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 99 100 HISD 088 i088 EE Figure 2 28 FC host port selected In contrast to this the host SCSI ports have an affinity to the ESS SCSI ports which is visible by selecting a host SCSI port as shown in Figure 2 29 EsconNe PC11 PCL EOMER EL es eB J Figure 2 29 SCSI host port selected Using the disk group section The two ESS clusters with the SSA device adapters and the SSA loops with the disk groups are shown below the ESS Fibre Channel ports This is shown in Figure 2 30 and is how it looks if there is no disk group configured Implementing an Open IBM SAN OL Fe EI see a Figure 2 30 SSA device adapters without any disk group configured Again we are anticipating the configurations that are to be made later To graphically show the state the disk groups are in we press the View All Storage button on the upper right of the panel This is s
339. systems storage solutions across multiple platforms and customer bases He holds a Dipl Ing degree in Computer Science from the Staatliche Studienakademie Sachsen Thanks to the following people for their invaluable contributions to this project Scott Drummond IBM Storage Subsystems Division Emma Jacobs Yvonne Lyon Deanna Polm Sokkieng Wang International Technical Support Organization San Jose Center Henry Caudillo Mac Diller Glenda Fuller Mike Hrencecin Ronda Hruby Robert Moon Tammy Sokol Peter Thurston Diana Tseng Karen Ward Rainer Wolafka Michelle Wright John Young Ruoyi Zhou IBM Storage Subsystems Division x Implementing an Open IBM SAN Richio Aikawa Jon Krueger Emulex Corporation Dave Burchwell Jack Consoli Richard Kurzban Mike Naylor INRANGE Technologies Corporation Chris Burke JNI Corporation Rob Jones QLogic Corporation Philipp Alexander StorAdvantage Special notice This publication is intended to help systems and storage administrators install IBM SAN portfolio equipment The information in this publication is not intended as the specification of any programming interfaces that are provided by any of the SAN hardware and software components contained herein See the PUBLICATIONS section of the IBM Programming Announcement for the SAN hardware and software components contained herein for more information about what publications are considered to be product documentation Attention
340. t 1 10 7 Configuring for availability and recoverability 52 This section describes how to ensure optimum availability and recoverability when you attach an IBM ESS to a Windows NT host system You must set the time out value associated with the supported host bus adapters to 240 seconds The setting is consistent with the configuration for IBM SSA adapters and disk subsystems when attached to a Windows NT host system Implementing an Open IBM SAN The host bus adapter uses the time out parameter to bound its recovery actions and responses to the disk subsystem The value exists in different places in the system configuration You can retrieve and use it in different ways depending on the type of host bus adapter The following instructions tell you how to modify the value safely in either the Windows NT registry or in the device adapter parameters 1 10 8 Setting the TimeOutValue registry The following instructions tell you how to set the time out value registry 1 From the Run menu or command prompt type Regedt32 exe 2 Navigate to the following registry key HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services Disk 3 Look for the value called TimeOutValue If the value called TimeOutValue does not exist go to step 3a If the TimeOutValue exists go to step 4 g m oa05p Click Edit gt Add Value For ValueName click TimeOutValue For data type click REG_DWORD Click OK For data click f0 For radix c
341. t Adapter Ports Configure Disk Groups Modify Volume Assignments Fixed Block Storage a Undomnatted 254 80 GB Undomnatted 254 80 GB Disk Group Atiribuies desi gt Storage Type Perform Configuration Update Cancel Configuration Update Figure 2 38 Fixed Block Storage panel no disk groups configured Using the Fixed Block Storage panel The Available Storage table lists all of the available physical storage in the ESS with its location storage type track format and capacity As we can see when we scroll down the table no disk array has been formatted at this time 108 Implementing an Open IBM SAN Note The disk groups should not be mistaken for the eight packs which are the physical disk packages that are installed in the ESS The disk groups are logical groups that consist of disks from two eight packs four disks from each of the two This is the reason why it is only possible to upgrade the ESS in steps of two eight packs The unformatted size of the disk groups is 254 8 GB This is equivalent to seven disks of a capacity of 36 4 GB each In the ESS we have two spare disks per SSA loop In our ESS we have sixteen disk groups four per device adapter pair and two per SSA loop This is the reason why every one of our disk groups contains one spare disk This makes up the total unformatted capacity of 254 8 GB per disk group Defining two disk groups for RAID 5 We are going to define the disk g
342. t requires different parameter settings you must change the parameter settings with the port utility and restart your host system 9 Click Yes to restart the host system 10 After you restart your host system click Start Settings 11 Double click Control Panel 12 Double click SCSI Adapters 13 Click the Drivers tab and verify that the Emulex SCSI driver is present and started 14 Click the Devices tab and verify that the host adapter is on the list 1 11 12 Parameter settings for the Emulex LP8000 on Windows 2000 In Table 1 11 we show the recommended host bus adapter configuration file parameters for an Emulex LP8000 adapter The settings are for an IBM ESS model F20 that is attached through a switch using the fabric automap SCSI devices port driver and an IBM ESS model F20 that is attached directly using arbitrated loop automap SCSI devices port driver Table 1 11 Recommended LP8000 settings for Windows 2000 Point to point Not checked disabled for direct attach Not shown for the fabric attach Register for state change Checked enabled Use report LUNs Checked enabled Chapter 1 Implementing Fibre Channel host adapter cards 67 Parameters Recommended settings Use name server after RSCN Checked enabled if fabric attached using soft zoning Not checked disabled Maximum Number of LUNs Equal to or greater than the number of the ESS LUNs available to the host bus adapter ioianGuewoeem Renee Topology P
343. tabase As plymouth was previously connected direct to the Gateway its settings have been maintained but now that it is reconnected it is back online The NT host does not have any LUN access yet FA virtual Private SAN Access Settings ACTIVE Assigned LUNS plymouth AIX fdevitsesiO Oxef 0 Emulex 10000000 c9221802 unknown SWITCH unknown 20fd0060 69201d4e FIBRE1 NT SesiPort1 1 1 0 Emulex 10000000 c920cae6 New Host Data Original Host Data FIBRE Host Name FIBRE New Host Host tyne INT Ly NT 4 0 5P4 __NowHtost Host Connection ScsiPortt 1 1 0 Emule SesiPartt 1 1 0 Emulex Apply Changes Host WN 0000000 c920cae6 10000000 c920cae6 Undo Changes Delete a Host Take Host Off Line Figure 4 49 VPS Access window with switch and two hosts Chapter 4 Implementing the SAN Data Gateway 305 A check mark in the box allows a host access to a LUN or clear the box if you want to restrict access as described in Setting up a Virtual Private SAN on page 293 Figure 4 50 shows the host plymouth with access to assigned LUNS 17 to 24 and the NT host FIBRE1 is now set with access to LUNs 25 to 30 FA Virtual Private SAN Access Settings ACTIVE Assigned LUNs EE On Line MB Off Line 17 18 19 20 21 22 23 24 25 26 27 28 29 30 plymouth AIX fdeviftsesiO0 Oxef 0 Emulex 10000000 9221802 unknown SWITCH unknown 20fd0060 692
344. ter 4 Loop A Disk Group 2 Storage Type RAID Array Track Format Fixed Block FE Host Storage 16 10 210 48GB 84 Assigned 0 00 210 48GB 0 Unassigned 0 00 210 48GB 08 Not Allocated 194 35 210 48GB 928 Figure 2 81 Information frame host FC port and disk group selected Implementing an Open IBM SAN The items that have changed on the disk group information since our last visit are the Host Storage row and the Not Allocated row Host Storage is the space that now has an ESS logical volume of 16 1GB assigned to the selected host FC port Not Allocated means the space that can be used to define other ESS logical volumes on Last but not least we can also click on the disk array without selecting a host FC port first The panel s look changes again when only the disk group is selected This is shown in Figure 2 82 PCL gt EE OTEEOTEEHEE Figure 2 82 Disk group selected To deselect everything that is currently selected we press the Clear View button on the top of the panel or we can click on the host FC port that is selected Then we select the disk group in cluster one Notice that the part of the disk group that was purple before has changed to red This is because we did not specify that we are interested in the volumes that are assigned to a particular host FC port Instead we now see the storage that is allocated to any of the host FC ports The host FC port icons that have
345. tes click Open Folder 13 From the A window double click the icon for the driver file you downloaded to the floppy diskette 14 In the window for WinZip Self Extractor type a 15 Click Unzip When the unzip process completes you should see a message that says x files unzipped successfully where x equals the number of files you unzipped 16 Click OK 17 Click Close to close the window for WinZip Self Extractor 1 11 5 Installing the Fibre Channel adapter drivers Perform the following steps to install the Fibre Channel adapter drivers 9 PENOY OM ee 00 NS re Note If you are installing the Fibre Channel adapter for the first time you must specify the correct topology You must also select the appropriate device mapping driver From your Windows 2000 desktop double click the icon for My Computer Double click the icon for Control Panel Double click the icon for SCSI Adapters In the SCSI Adapters window click the Drivers tab Click Add In the Install Drivers window click Have Disk In the Install from Disk window ensure that the drive letter in the field for Copy Manufacturer s Files From is the drive letter you specified to save the exe file to when you downloaded the driver previously Type the name of the current driver file in the field for Copy Manufacturer s Files From after the drive letter prompt Click OK 10 Click Cancel to exit 11 Restart your host system 1 11 6 QLogic QLA2100F
346. th Fibre Channel interface more options become available at both ends of the spectrum McDATA directors and the 16 port and 32 port switches do not support loop devices directly but by extending the fabric with the loop switch this makes the attachment of legacy loop only devices and loop only tapes possible 3 7 2 Solutions for high availability and disaster tolerance An example of a solution that provides high availability with disaster tolerance is shown in Figure 3 77 Chapter 3 Implementing a SAN with McDATA 247 248 local site remote site open systems server open systems server OOO OOO ea heartbeat m ki E E apAogAgp E2 6064 ED 6064 Bopo De lt a LW ISL s Sa m oo OOO ess ESS o EE EE o Figure 3 77 LVM mirroring using the SAN This is a setup which consists of the same configuration at both the local and the remote site Both sites can be up to 10 km apart when using 9 micron fiber optic cable The open systems server cluster for example can consist of two or more RS 6000 with HACMP The mirroring can be done with the native LVM on AIX Another solution can be SUN servers running for example the Veritas Cluster Server and the Veritas Volume Manager Due to the high availability of the McDATA ED 6064 one may be sufficient but o
347. that you receive with the ESS Ensure that you have 1 MB minimum of hard disk space available to install the 2105inst script file Check the LUN limitations for your host system see Table 2 Ensure that you have the documentation for your host system and the IBM Enterprise Storage Server User s Guide The User s Guide is on the compact disc that you receive with the ESS See the following Web site for details about the release level for your operating system www storage ibm com hardsoft products ess supserver htm Either you or an IBM service support representative SSR must perform the following tasks to install and configure an ESS 1 The IBM SSR installs the ESS by using the procedures in the IBM Enterprise Storage Server Service Guide Either you or an IBM SSR defines the Fibre Channel host system with the worldwide port name identifiers For the list of worldwide port names see 1 12 Locating the worldwide port name on page 69 Either you or an IBM SSR defines the Fiber Channel port configuration if you did not do it during the installation of the ESS or Fibre Channel adapters Note Use the information on the logical configuration work sheet in the IBM Enterprise Storage Server Configuration Planner that you previously filled out Chapter 1 Implementing Fibre Channel host adapter cards 23 4 Either you or an IBM SSR configures the host system for the ESS by using the instructions in your host system publicat
348. the StorWatch SAN Data Gateway Specialist client application or the service terminal rescans the SCSI buses Implementing an Open IBM SAN Currently up to eight different hosts can be attached to each Fibre Channel port If all six ports are installed then 48 different hosts can attach to the SAN Data Gateway 4 3 StorWatch SAN Data Gateway Specialist The StorWatch SAN Data Gateway Specialist software provides remote capability for all management configuration and event notification It is comprised of three parts gt Agent gt Server gt Client Agent The agent is embedded in the operating system of each SAN Data Gateway to provide a stand alone manageable host The StorWatch SAN Data Gateway Specialist software uses SNMP to set and retrieve information that controls the operation of the Agent The Specialist also uses SCSI over TCP to allow updates to the Gateway and target device Server The server is a Java application that runs on a host and is used to maintain communication with the agents and acts as an intermediary between the agent and the client The server coordinates the request from multiple clients to manage multiple gateways or agents Multiple clients can share data the server already knows about and the server receives all traps from the agent and forwards them to the clients that are registered to receive them Client The client is a Java application that operates from any compatible computer as long as
349. the director in the main window This is useful to distinguish among a number of installed directors This information is not yet configured To configure this information we select Configure gt Identification and are presented with a dialog window with data entry fields as shown in Figure 3 32 m Configure Identification ED 6064 1 Fibre Channel Director SAN JOSE Bld 51 3rd Floor End User Contact please configure Acana _concoi Figure 3 32 Product Manager ED 6064 Configure Identification After activation the display of the main window changes and places the name of the director in the title bar and the name description and location displayed in the window as shown in Figure 3 33 This information is used in various locations of the Product Manager to identify the selected director Implementing an Open IBM SAN ma ED 6064 ED 6064 1 of Xx mE Hardware View ED 6064 Status Name ED 6064 1 view Status Fully Operational Description Fibre Channel Director 3 State Online Location SAN JOSE Bld 51 3rd Floor Configure a H Maintenance Help ofl Front View Rear View Figure 3 33 ED 6064 Hardware View changed director information Configuring the operating mode The ED 6064 features the capability to change the operating mode To configure it we select Configure gt Operating Mode and get the Operating Mode window as shown in Figure 3 34 Ea Configure Ope
350. the hosts from accessing the affected LUNs Are you sure that you want to proceed with this action Unsigned Java Applet Window Figure 2 103 Warning window two volumes to be isolated from host FC ports We press the Yes button to proceed with the update and get a progress bar and a message window as shown in Figure 2 104 and as we already know from the other actions we have done using this panel N Performing Configuration Update Eg Modifying Yolume Set Configuration 2 Estimated Remaining Time 1 seconds J Unsigned Java Applet Window Figure 2 104 Progress window applying assignment changes In Figure 2 105 we are told that the volume assignments have been successfully removed N Yolume Assignments x 2107 The specified volumes have been successfully unassigned from the specified target hosts ja Unsigned Java Applet Window Figure 2 105 Information window volume assignments successfully removed Now the Volume Assignments table shows the just unassigned volume This table represents the assignments made for ESS logical volumes not the volumes themselves An exception is if volumes are not assigned to any host FC port Then there will be one placeholder row that can be used to create an assignment This row selected is shown in Figure 2 106 Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 153 Volume Assignments Print Table no sort gt no sort no sort x no
351. the Gateway is used it is numbered as input 1 and 4 A description on the Fibre Channel port numbering was shown in Figure 4 2 on page 263 290 Implementing an Open IBM SAN Servers ooo DOU unknown Gateway OO OU OO plymouth Fibre ply Channel 1 4 ooog mmm 1 2 3 SCSI ESS Figure 4 34 SAN Data Gateway with two hosts Adding host and connection information The host name and host type and connection information can be added manually by selecting the VPS feature and modifying the data To do this select the desired SAN Data Gateway so that it is highlighted Select Controls gt Access Options gt Virtual Private SAN and you will enter into the VPS settings window The hosts and their information will appear on the left hand side Chapter 4 Implementing the SAN Data Gateway 291 Select the host to be modified and the information is transferred to the bottom part of the window where the modifications can take place as shown in Figure 4 35 BA Virtual Private SAN Access Settings ACTIVE Assigned LUNs EE On Line EE Off Line 0 1 2 3 4 5 6 7 8 9 10 11 12 13 unknown unknown unknown 10000000 0921da0a plymouth AIX fdevifsesi0 Oxef 0 Emulex 10000000 c9221802 New Host Data Original Host Data ch
352. the maximum number of bytes you can transfer for each SCSI transaction The default value is 126976 124 KB If the I O block size that you requested exceeds the default value the request is broken into more than one request The value should be tuned to the intended use and application requirements For maximum bandwidth set the maxphys parameter by adding the following line to the etc system file Implementing an Open IBM SAN set maxphys 8388608 If you are using Veritas volume manager on the ESS LUNs you must set the VxVM max I O size parameter vol_maxio to match the maxphys parameter If you set the maxphys parameter to 8388608 add the following line to the etc system file to also set the VxVM I O size to 8 MB set vxio vol_maxio 16384 1 10 Windows NT 4 0 FC host system attachment In this topic we tell you how to attach an ESS to a Windows NT host system with the following Fibre Channel adapters gt gt gt QLogic QLA2100F adapter card QLogic QLA2200F adapter card Emulex LP8000 adapter card This topic also tells you how to install download and configure the adapter cards 1 10 1 Attachment requirements This section lists the requirements for attaching the ESS to your host system gt gt Check the LUN limitations for your host system Ensure that you have the documentation for your host system and the IBM Enterprise Storage Server User s Guide the User s Guide is on the compact disc that you r
353. the mirror drive for easier identification with a limit of up to eight characters The Initialization Method box refers to whether or not to allow the operating system to write its signature on the Mirror drive Implementing an Open IBM SAN The Assigning Mirror Drive Properties window is shown in Figure 5 22 Mirror Drive Setup Wizard Assigning Mirror Drive Properties Setup Summary Type 2 way Simple Mirror FC ID Logical Drive ID 2 FC LUN 2 Target Number 733282 Drive Name jiTsOm Capacity 8689 MB Initialization Method Primary Member None x C Do Not Initialize Quick Initialize wees Figure 5 22 Mirror drive properties Click the Next gt button and a dialog box appears to allow you to create another mirror drive Click Yes if you would like to create another mirror drive and the Mirror Drive List window opens and the steps described above can be repeated Click Finish when you have created all the desired mirror drives Up to this point the configuration has been kept within the SLIC Manager software When the Finish button is clicked the SLIC Manager will now communicate to the Router to complete the process and update the Router to control the drives If Quick Initialize in the Initialization Method box was selected the Router will take a short period of time to write the host signature and build the mirror During this time if you try to communicate to the Router yo
354. there is another method This method involves ending the process with the Task Manager There will be a process netscape exe in the Processes panel which can be closed with the End Process button 2 1 2 Operating the ESS 82 Here we introduce the panels that we use to view the status of the ESS for instance viewing the problem log and performing operation functions for example changing the remote service access and resetting the PE password Implementing an Open IBM SAN Viewing the Status Graphical View panel Using the Status button we get to the Status Graphical View panel as shown in Figure 2 8 Status Graphical View al Machine status as of May 3 2001 10 12 57 AM PDT Legend C nma O Proble Access to Data not Affected 1 Problem Access to Data Affected B Prohten Access to Data Lost Cluster 1 Information Bay 4 Sexvice Hode Bay 4 Adapter 1 Port L Service Hode Bay 4 Adapter 2 Port BR Service Hode Bay 4 Adapter 3 Port A Service Hode Bay 4 Adapter 4 Port BR Service Hode Cluster 2 Figure 2 8 Status Graphical View panel This panel allows us to quickly check for any errors in the ESS To demonstrate the features of the Status Graphical View panel and the Status Problem Log panel we show them on a different ESS that is currently in service What we see is a problem detected in the storage arrays with access to data not affected The other problem detected within t
355. ting Tools gt Mirror Drive Setup Wizard When the Member Selection window appears select the composite drives as members of a mirror Figure 5 33 shows where composite drives ITSO1 and ITSO3 are selected as members of a mirror Mirror Drive Setup Wizard Mirror Drive Members Selection Available Drive Pool Mirror Drive Members TOOOO0LO00 35668229 733025 L001 ITSO1 733025 L001 ITSO1 733027 L003 ITSO3 733027 L003 1T503 Identify lt lt Remove Reset kiemo ECA Drive Capacity MB Mirror Capacity MB a a lt Back Next gt Cancel Figure 5 33 Creating mirror drive from two composite drives Continue through the Mirror Drive Setup Wizard to complete the process as described in 5 6 Mirror drive on page 332 Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 345 5 8 3 Viewing mirror drive using composite drives With the Mirror Drive Setup Wizard completed you can now view the Control Center window once again as shown in Figure 5 34 T33282 ITSOm T33540 CompMir 733025 ITSOLl CompMir T33027 ITSO3 CompMir TOOOOO 35E68229 Figure 5 34 Control Center with mirror drive using two composite drives 346 Implementing an Open IBM SAN In the Mirror Drive window you can see the new mirror drive that was created above and named CompMir In the Composite Drive window you can see that there are still the two composit
356. to rescan the bus for the host to detect that it now has access to new devices Any combination is allowed so if the same LUN is to be shared by two different hosts a check mark for that LUN must be set for both If this is the case the host systems must have a device sharing software installed to control access to the disk device for data integrity As each Fibre Channel port can support up to 8 eight different hosts there can be up to 48 hosts attached to the SAN Data Gateway They can all share the same four SCSI channels By using the Virtual Private SAN feature you can ensure that only the LUNs you desire a certain host to use will be accessed and that no other host will access them 4 5 3 Combining Zoning and Virtual Private SAN 296 If Virtual Private SAN is enabled and LUNs have been allocated to specific hosts then zoning is not necessary or required The Channel Zoning window can remain at the default settings with all Fibre Channel ports accessing all SCSI channels However they can work in combination to add an extra level of control and security If zoning is added then VPS can only control the LUNs that are included in its access zone Figure 4 39 shows a zoned SAN Data Gateway Channel Zoning Setting x SCSI Channel 1 Fu ch SAN Connection1 J iyi IJ SAN Connection 4 v y v x Check the SCSI Channel box to allow Access OK Cancel Figure 4 39 Combining channel zoning and
357. to this option If not a host may access a volume that you do not want it to access and be restricted from a volume that it had access to previously The system administrator must rebuild the VPS settings if enabled to allow host access to the desired LUNs 4 5 SAN Data Gateway access options The SAN Data Gateway includes two features that are helpful in providing control and security of host access to SCSI devices gt Zoning gt Virtual Private SAN or LUN masking 4 5 1 Zoning 286 Channel zoning is a feature included with the IBM Storage Area Network Data Gateway Zoning allows you to restrict access between SAN Fibre Channel connections and SCSI channels The default settings allow all SAN connections to access all SCSI channels Configuring zoning To configure zoning and you must be an administrator select Control gt Access Options gt Channel Zoning from the toolbar Figure 4 28 shows a zoned SAN Data Gateway Channel Zoning Setting x SCSI Channel 1 2 3 4 SAN Connection 1 v iv SAN Connection4 v v Check the SCSI Channel box to allow Access OK Cancel Figure 4 28 IBM Storage Area Network Data Gateway channel zoning Implementing an Open IBM SAN A check mark will allow access and as shown in Figure 4 28 you can see that SAN connection 1 has access to SCSI channels 3 and 4 but not to SCSI channels 1 and 2 SAN connection 4 has access to SCSI c
358. toon Eee Figure 3 15 Logging in to the EFC Manager on the EFC Server 194 Implementing an Open IBM SAN Remote login to the EFC Manager After finishing the installation of our client workstation there will be a shortcut to the EFC Manager on the desktop as shown in Figure 3 16 My Computer EFC Manager Figure 3 16 EFC Manager icon on remote workstation By double clicking this icon we get the login window for the EFC Manager Now we use the default username and password and the IP address of the EFC server to login as shown in Figure 3 17 EFC Manager Login Administrator 9 113 25 247 xi Figure 3 17 Remote login in to the EFC Manager Chapter 3 Implementing a SAN with McDATA 195 3 3 2 Administering the SAN using the EFC Manager After a successful login we can move on to administer the McDATA SAN Following are examples of the options that we can configure using the EFC Manager After logging on to the EFC Manager it opens with the Product View shown in Figure 3 18 McDATA Enterprise Fabric Connectivity Manager Product View Product Fabric Session Configure i Logs xe Maintenance ES Help na LogoutExit Figure 3 18 EFC Manager Product View no switches defined To the left there is a panel that allows us to perform various configuration and monitoring tasks The main window is empty because there are no devices configured on the EFC Manag
359. ture is also provided The Director is managed through the EFC Manager which runs on the EFC Server This PC is shipped as part of the ED 5000 package For in depth information on the McDATA also see the McDATA ED 5000 manuals provided with the switch Implementing an Open IBM SAN 3 1 3 ES 3032 and ES 3016 fabric switches The ES 3032 and the ES 3016 shown in Figure 3 3 are 32 and 16 Port FC switches that support FC switched fabric RN S e mus Se Set SY Oe Oe a we pe os a HRRNREHRERERES Figure 3 3 ES 3032 and ES 3016 They can be used to build up departmental SAN s or SAN s that do not need the high availability of directors Also they could serve as edge switches connected to a director serving at the core of the SAN backbone The ports are G_Ports that act as F_Ports when connected to FC nodes or as E_Ports if connected to another switch The switches can be used as desk top units or they can reside in the Fabricenter Equipment Cabinet or a standard 19 inch rack Both switches are managed through the EFC Manager which runs on the EFC Server Limited management is also possible through the embedded web server Further information about the switches can be found in the manuals provided with the switches Chapter 3 Implementing a SAN with McDATA 179 3 1 4 The ES 1000 loop switch 180 The ES 1000 shown in Figure 3 4 is a fabric loop switch Figure
360. tware SMIT responds with the following question Are you sure 10 Press Enter to continue The installation process may take several minutes A message is displayed when the installation process is complete 11 Press Enter to continue The installation process may take several minutes A message is displayed when the installation process is complete 12 Press F10 when the installation process is complete 13 Exit from SMIT Implementing an Open IBM SAN 14 Remove the compact disc 15 Shut down the host system 16 Turn on the host system 1 4 5 Verifying the ESS configuration To verify the configuration of the ESS on the AIX host system type the following command Isdev Cc disk grep 2105 A list of all IBM ESS devices is displayed as shown in the following example hdisk3 Available 30 68 01 IBM FC2105F20 hdisk4 Available 30 68 01 IBM FC2105F20 hdisk5 Available 30 68 01 IBM FC2105F20 These indicate that the installation is successful If a device is listed as another type of device the message shown below is displayed This message indicates that the configuration was not successful hdisk3 Available 30 68 01 Other FCSCSI disk device hdisk4 Available 30 68 01 Other FCSCSI disk device hdisk5 Available 30 68 01 Other FCSCSI disk device 1 4 6 ESS devices with multiple paths per LUN The ESS supports multiple path configurations for a LUN This means that you can have multiple hdisks available on the AIX server for
361. u may experience a slower than normal response Chapter 5 Implementing the Vicom Fibre Channel SLIC Router 335 5 6 2 Mirror drive properties If you go to the Control Center window by selecting Tools gt Control Center you will see that the mirror drive is now displayed in the Mirror Drive window This is shown in Figure 5 23 Control Center T33282 ITSOm T330Z5 ITSOL TOOOOO 35E68229 TOOOOS 35E68462 TOOOO 35E684AE Figure 5 23 Control Center with Mirror Drive 336 Implementing an Open IBM SAN If you select and highlight the mirror drive and then click the Properties button the Mirror Properties window opens and you can see the information in the mirror drive Figure 5 24 shows an example of the properties of the mirror drive Mirror Instant Copy Drive Properties x Mirror Instant Copy Drive Selection Cancel if Drive Members Tool Box frarget SSA UID I Function Add Member Identify Heber T00003 35E6848D A T00004 35E22D6C Delete Member Identify Mirror T0O000S5 35E6840E s Drive Characteristics Capacity MB 8689 PUBLIC FC LUN B Drive Name rrsom Number of 3 Change Members Figure 5 24 Mirror Drive Properties Clicking on the Identify Mirror button will cause the LED on the actual SSA drives that belong to the mirror to flash If a member drive is selected and the Identify Member button is chosen then the LED only on that
362. ual to the number of ports Therefore all ports can have simultaneous access through the switch Non L_Port A Node or Fabric port that is not capable of performing the Arbitrated Loop functions and protocols N_Ports and F_Ports are not loop capable ports Operation A term defined in FC 2 that refers to one of the Fibre Channel building blocks composed of one or more possibly concurrent exchanges Optical Disk A storage device that is written and read by laser light Optical Fiber A medium and the technology associated with the transmission of information as light pulses along a glass or plastic wire or fiber Ordered Set A Fibre Channel term referring to four 10 bit characters a combination of data and special characters providing low level link functions such as frame demarcation and signaling between two ends of a link Originator A Fibre Channel term referring to the initiating device Out of Band Signaling This is signaling that is separated from the channel carrying the information Also referred to as outband Peripheral Any computer device that is not part of the essential computer the processor memory and data paths but is situated relatively close by A near synonym is input output I O device Petard A device that is small and sometimes explosive PLDA Private Loop Direct Attach A technical report which defines a subset of the relevant standards suitable for the operation of peripheral devices s
363. uch much more functionality than we could ever hope to cover in just one redbook The IBM SAN portfolio is rich in quality products that bring a vast amount of technicality and vitality to the SAN world Their inclusion and selection is based on a thorough understanding of the storage networking environment that positions IBM and therefore its customers and partners in an ideal position to take advantage by their deployment In this redbook we cover the latest additions to the IBM SAN family which includes products from companies such as Brocade INRANGE and McDATA We show how they can be implemented in an open systems environment and we focus on the Fibre Channel protocol FCP environment in particular We address some of the key concepts that they bring to the market and in each case we give an overview of those functions that are essential to building a robust SAN environment The team that wrote this redbook This redbook was produced by a team of specialists from around the world working at the International Technical Support Organization San Jose Center Jon Tate is a Project Leader for SAN TotalStorage Solutions with the International Technical Support Organization San Jose Center Before joining the ITSO in 1999 he worked in the IBM Technical Support Center providing level 2 support for IBM storage products Jon has 16 years of experience in storage software and management services and support and he is an IBM SAN Certified
364. uch as disks and tapes on a private loop PLOGI See N_Port Login Point to Point Topology An interconnection structure in which each point has physical links to only one neighbor resulting in a closed circuit In point to point topology the available bandwidth is dedicated Port The hardware entity within a node that performs data communications over the Fibre Channel Glossary 369 Port Bypass Circuit A circuit used in hubs and disk enclosures to automatically open or close the loop to add or remove nodes on the loop Private NL_Port An NL_Port which does not attempt login with the fabric and only communicates with other NL Ports on the same loop Protocol A data transmission convention encompassing timing control formatting and data representation Public NL_Port An NL_Port that attempts login with the fabric and can observe the rules of either public or private loop behavior A public NL_Port may communicate with both private and public NL_Ports Quality of Service QoS A set of communications characteristics required by an application Each QoS defines a specific transmission priority level of route reliability and security level RAID Redundant Array of Inexpensive or Independent Disks A method of configuring multiple disk drives in a storage subsystem for high availability and high performance Raid 0 Level 0 RAID support Striping no redundancy Raid 1 Level 1 RAID support mirroring complete redund
365. uish between both of them This will help later when we have to identify devices for instance when we set up zoning This is especially true because the ESS has Emulex adapters built in We have other Emulex adapters in our SAN so it would be useful to distinguish between the ones in workstations and the ones found in the ESS For the ESS we chose as an example RPKA93_C1B2A1 This means the ESS RPKAQ3 with the FC port in Cluster one Bay two and Adapter one We use the information to include specific adapters in a zone However this is not our only means of restricting access to volumes on the ESS On the ESS every ESS logical volume is normally accessible through every FC port However we can restrict the host FC ports that are configured in the ESS to only see ESS logical volumes through specific ESS FC ports This means that those ports can only access the volumes assigned to it through those ESS FC ports We explain this in more detail in Chapter 3 Implementing a SAN with McDATA on page 175 202 Implementing an Open IBM SAN Including ESS FC adapters within specific zones might be useful when we want to influence the bandwidth that a specific group of host FC ports members of a zone can get and through which bay we want the data to go For our example we configure a nickname for one RS 6000 and two for the ESS This is done by selecting Configure gt Nicknames which opens the window without any nicknames configure
366. ult Initializes on a loop 1 Recommended for fabric Initializes as an N_Port public loop 0 Default Recommended Initializes according to which fca_nport is set as disabled ip_disable 0 Default IP side of the driver is enabled 1 Recommended for fabric IP side of the adapters is completely disabled failover See the following Web site for details on how to set the parameter setting www storage ibm com hardsoft products ess supserver htm busy_retry_delay 500 Recommended Delay between retries after device returns a busy response for a command scsi_probe_delay 5000 Recommended Delay before SCSI probes are allowed during startup See Table 1 8 for recommended host bus adapter configuration file parameters for an Emulex LP8000 adapter Table 1 8 Recommended Emulex LP8000 HBA settings Recommended settings 1 Default Automatically assigns SCSI IDs to FCP targets 1 Default Turn on FCP lun queue depth 16 Recommended when there are less then 17 LUNs per adapter Set value 256 Total LUNs per adapter when there are more than 16 LUNs per adapter If your configuration includes more than one LP8000 adapter per server calculate the lun queue depth value using the adapter with the most LUNs attached no device delay 15 Recommended Delay to failback and I O network on 0 Default Recommended for fabric Do not turn on IP networking 1 Turn on IP networking 42 Implementing an Open IBM SAN scan down
367. ume assignments one for each existing volume Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 143 The Volume Assignments table provides a comprehensive overview of all configured volume associations We can also sort the table specifying the column which we want to use as sort criteria The rows do not represent the volumes Instead there will be a row for each association that a volume has as we will see later on There is an Action field which is grayed out and a Target Hosts field which is empty when no volume association is selected Now we show their interaction Figure 2 90 shows the two assignments of the 64 GB volumes assigned to host FC port PC1_2 Both assignments are selected and ready for modification Volume Assignments Print Table no sort gt gt no sort no sort gt no sort no sort gt no sort arst gt Vome Location SS Vohume Type Size Storage Type Host Port Host Nidmames a a 1 Vol 000 600 18486 Device Adapter Pair 4 Open System 016 1 GB RAID Aray Fibre Charmel Pcl Chaster 1 Loop A ID 00 LUN 0000 2 Vol 000 601 18486 Devin Adapter Pair 4 Open System 064 0 GBE RAD Amy Fibre Charmel miae 1 Loop B 00 LUN 0000 2 Vol 001 701 18486 Device Adapter Pair 4 Open System 064 0 GB RAD Amay Fibre Charmel Charter 2 Loop B ID 00 LUN 0001 1 Vol 001 Action Assign selected volume s to target hosts R Use same ID Lun in source and target
368. up to 32 LUN per target This is subject to the overall total of 256 available The first LUN LUN 0 is used for the Gateway for control and command purposes That leaves 255 allowable LUN addresses to be used for attaching SCSI devices to the four SCSI ports Note Do not attach more than 255 LUNs to the SAN Data Gateway Exceeding the 255 limit will cause unpredictable results The SCSI devices must be previously set up in your host prior to attaching to the SAN Data Gateway For example if an IBM Enterprise Storage Server is to be used as the target device then all the volume or LUN assignments must be completed Also the volumes should be assigned to the appropriate SCSI port in the ESS Attach the SCSI cable from the SCSI device to a SCSI port on the Gateway 4 4 2 Device discovery 284 Once attached the SAN Data Gateway can be restarted or powered on to perform a discovery of the attached devices If this was done after the initalizeBox command from the service terminal then the initial discovery will be carried out in a specific order The buses are scanned in order from 1 to 4 and each bus is scanned from SCSI target 0 to 15 and LUN 0 to 32 for each ID As a device is discovered it is assigned a specific LUN number by the SAN Data Gateway This numbering will begin at LUN number 1 zero is reserved for the SAN Data Gateway control and continues sequentially as devices are discovered Implementing an Open IBM SAN The SAN Data
369. using 36 4 GB disks we can have a maximum volume size of 210 45 GB Looking at the Information window on the Storage Allocation Graphical View panel we see 210 48 GB Selecting the storage type To create RAID 5 volumes we have to click on the RAID 5 Array row shown in Figure 2 70 420 90 GB 0 00 GB Figure 2 70 Available Free Space frame RAID 5 storage entry selected If no storage type has been selected the Volume Attributes field on the left hand side shows only a volume size of zero Choosing the size and number of volumes Once we have selected RAID 5 Array as the storage type we can choose the size and the number of the ESS logical volumes that we want to configure We are able to choose the size of the volumes granularity beginning from 0 1 GB up to the total capacity of our disk group which is 210 45 GB with a granularity of 0 1 GB We want to define four volumes with 16 1 GB each The reason for the volumes being exactly 16 1 GB is that we want to all volumes the same size without wasting any space Defining volumes with a little less or a little more space will mean that we will either fill the remaining space with smaller volumes or waste space For example with a volume size of 16 2 GB we could only define 24 of them in two disk groups which is shown in Figure 2 71 Volume Atiributes Select a Volume Size 16 0GB a 16 1GB z Number of Volumes Enter 1 to 24 Storage Type RAID 5 Aray
370. uter 325 Click in the Always Master box so that a check mark appears Once you click OK the Router will then be set as the master You will notice that now all options in the toolbar are available and can start to use the features of the SLIC Router By placing a check mark in the Auto Start box the SLIC Manager will automatically connect to the Router defined in the Connection window as seen in Figure 5 7 on page 322 5 4 4 The SignOn drive 326 When the SLIC zone was created to be used as the communication path a disk file or partition was created on a specific disk within the SSA loop As you begin to access the features of the SLIC Router it should be known which disk was used to create the SLIC zone This disk is considered to be the SignOn drive In the topics 5 5 Composite drive on page 327 and 5 6 Mirror drive on page 332 we describe creating composite and mirror drives and you will see that the properties of the individual physical drives may change As they become part of a logical drive they take on the properties of this logical drive If the SignOn drive is used to create a logical drive its attributes may change and you may lose the communication path that was created in the SLIC zone When you select the SignOn drive as a member of a logical drive a dialog box will be displayed as in Figure 5 13 to remind you that the attributes of this drive may be affected SLIC Manager 1 0 The selected device is
371. ver As we can see the McDATA supplied ethernet hub in the cabinet is now part of our LAN The switches and the EFC Server could also be connected to another ethernet hub in the LAN for instance when the corporate policy does not allow the installation of more networking equipment However there is a possible security issue when connecting the switches to the corporate LAN with or without using the McDATA supplied hub To set up the EFC server we used the following network information gt IP address 9 113 25 247 The unique address of the EFC Server in the corporate intranet We use it with a Web browser to install the EFC manager on a remote workstation and to access the EFC Server from the remote workstation Implementing an Open IBM SAN gt Subnetmask 255 255 254 0 Our intranet is divided into several subnets The Subnetmask is used to distinguish between the net part and the host part of the IP address The host needs this information to know how to treat the addresses it uses gt Domain Name System DNS host name EVT3 Numbers for example IP addresses are sometimes difficult for people to remember Therefore a service called the Domain Name System is used to assign host names to IP addresses and it makes the destination transparent and reachable with an easy to remember host name gt DNS domain name sanjose ibm com The name says that the DNS is using a hierarchy of domains for addressing The host name it
372. window for RAID 5 configured disk group Here we see that the capacity of the disk groups that are configured as RAID array has changed to 210 48 GB This is mainly because of the space for the redundancy information that is now spread over the disks in the disk group and because of the RAID configuration information Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 113 Defining two more disk groups for RAID 5 We will configure two more disk groups and so we therefore navigate back to the Fixed Block Storage panel In Figure 2 46 we show what the Available Storage table looks like with the two disk groups in loop A of the fourth adapter pair for RAID configured This is prior to performing the configuration update of the next two disk groups Fixed Block Storage Disk Group Attributes Undefmed e el Fixed Block FB Undomnatted 254 80 GB Fixed Block FB Undomnatted 254 80 GB v Storage Type Faea Block FB z Track Format Perform Configuration Update Cancel Configuration Update Figure 2 46 Two disk groups configured two defined and two undefined 114 After we have performed the configuration update we go back to the Storage Allocation window to see how it now looks as a result of our changes Implementing an Open IBM SAN Viewing changes on the Graphical View panel Device adapter pair number four and the connected SSA loops now look like that shown in Figure 2 47 EsconNet
373. wing changes on the Graphical View panel Now we want to see the changes on the Storage Allocation Graphical View panel Figure 2 108 and Figure 2 109 show the selected host FC ports PC1_1 and PC1_2 with the disk groups that contain volumes that are assigned to it ai fe a a i Figure 2 109 No volume assignment to PC1_2 in disk group 2 of cluster 1 loop B Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 155 The space of the disk groups that contains ESS logical volumes that are assigned to the selected host FC port show up in purple and unused space in green Both host FC ports have no ESS logical volumes assigned to them in the disk group in cluster 1 adapter pair four loop B This is indicated by the absence of colors However on the particular disk group space is allocated for volumes This means that there is an existing volume or more which is not yet assigned to any host FC port To make this allocated space visible we press the View All Storage button and see all the allocated space on the disk groups This is shown in Figure 2 110 EsconNe PC11 PC1 2 B2 Figure 2 110 Unassigned volume s in disk group 2 of cluster 1 loop B Allocated but unassigned volumes are indicated by the yellow colored space in the disk group The space in the other disk groups that contains allocated and assigned volumes shows up in the color red
374. wing steps 1 2 PY Qe OW SBS 20 Restart the server Press Alt Q to get the FAST Util menu If you have more than one Fibre Channel adapter installed a panel displays all the Fibre Channel adapters Scroll down to the adapter you want Press Enter From the Fast Util menu scroll down and select Select Host Adapter Scroll up and highlight Configuration Settings Press Enter From the Configuration Settings menu click Host Adapter Settings Write down the host adapter name for example 200000EO8B00C2D5 1 12 10 Locating the WWPN for a Windows 2000 host system To locate the WWPN for a Windows 2000 host system with a QLogic adapter perform the following steps 74 1 2 MO NOAA O Restart the server Press Alt Q to get the FAST Util menu If you have more than one Fibre Channel adapter installed all the Fibre Channel adapters are displayed Scroll down to the adapter you want Press Enter From the Fast Util menu scroll down and select Select Host Adapter Scroll up and highlight Configuration Settings Press Enter From the Configuration Settings menu click Host Adapter Settings Write down the host adapter name for example 200000E08B00C2D5 Implementing an Open IBM SAN IBM TotalStorage Enterprise Storage Server configuration One benefit of a SAN is to implement disk pooling To do this successfully we need an easy to manage storage server with a Fibre Channel attachment This is the I
375. witch fabric shown in Figure 3 79 we are not focusing on clustering What we want to show is how to apply zoning in a multiswitch fabric Chapter 3 Implementing a SAN with McDATA 249 f Ss rd beers Pi ESS NT Se RPKA93_C1B2A1 Qlogic 20 00 00 E0 8B 00 52 5E a NT_Zone_1 5 na nu nn nu ooo Tag l ooo Sia 1 t I S I N i NT a k Emulex 10 00 00 00 C9 20 CA E6 Ooo ee 2000 b El N p Wi gt E ES 3016 Gaaeaooo IXE s P local site it LW ISL s 4 yr ee ee ee remote site me ke ete ee n Ser 7 m A aee e ED 6064 HHH N 7 ae S ae N Gitmo o at ig e N ge 4 Sie ia ae j d Ooo j 200 Se d i E i 1 ae i k 1 ooo ie aif i ooo re ESS UN m _ Emulex 10 00 00 00 C9 20 E7 F3 z as a 200 OEE e ipa ni gamar RS6K 000 F Emulex 10 00 00 00 C9 20 DC 71 l hs a Fs ee RS6K 7 wa Emulex 10 00 00 00 C9 20 E7 C7 P Ties e RS6K KATE_FCSO noe i AlX_Zone_1 Figure 3 79 Our zoned multiswitch fabric Our NT zone spans over both sites with two ESSs and two Netfinity s One ESS is at the local site and the other is at the remote site Both sites are c
376. with the configuration of the ESS we press the Open System Storage button as shown in Figure 2 35 This is the door to the configuration of open systems storage It will lead us to the Open System Storage panel as shown in Figure 2 36 The S 390 Storage button is also accessible because there are ESCON cards installed 8 390 Storage Open System Storage S Figure 2 35 Entry for open systems storage configurations Using the Open System Storage Panel The Open System Storage panel consists of the Hosts Systems table the Assigned Volumes table and the configuration panel buttons We will see shortly that those two tables are showing the defined host FC ports and to the selected host FC port the assigned ESS logical volumes as shown in Figure 2 36 Implementing an Open IBM SAN Open System Storage Host Systems Nidname Host Type Attachment WWPN Hosiname IPAddrss No Host System is currently defined Assigned Yolumes Total 0 volumes No Host System is currently defined therefore no volume is assigned Modify Host Systems Configure Host Adapter Ports Configure Disk Groups Modify Volume Assignments Figure 2 36 Open System Storage panel no host FC ports defined The configuration panel buttons at the bottom are the entry points to all of our storage related configuration tasks The Open System Storage panel is like a hub from where we start every open systems storage configuration In this sect
377. wo D UEN f Open System Storage 2 5 an 3 3 an i Figure 2 14 Storage Allocation Graphical View panel This is the start panel for host and storage based configurations This panel represents an ESS without anything configured Beginning with 2 2 Starting the Open Systems Storage Configuration on page 96 we will start with this unconfigured ESS and show how to configure the ESS for our SAN in detail Chapter 2 IBM TotalStorage Enterprise Storage Server configuration 89 90 Using the Copy Services link Using the Copy Services button we link to the copy services server Copy Services We have to login to gain access just like we did for the ESS Specialist This opens the Java based Web interface for the ESS Web Copy Services server ina dedicated Navigator window connects to it and loads the Java applets as shown in Figure 2 15 N IBM Copy Services OY x Connecting to Copy Services Server please wait Ey Unsigned Java Applet Window Figure 2 15 Loading copy services server applets Once connected we get the introduction panel for the copy services configuration options as shown in Figure 2 16 Implementing an Open IBM SAN Seascape Copy Services Netscape ile Edit View Go Communicator Help Riran wt Bookmarks 4 Location https 9 113 24 131 html rsCopyServices html StorWatch ESS Web Copy Services Solutions Welcome to IBM StorWatch Copy Servic
378. y on line storage device a disc drive or CD ROM DAT Digital Audio Tape A tape media technology designed for very high quality audio recording and data backup DAT cartridges look like audio cassettes and are often used in mechanical auto loaders typically a DAT cartridge provides 2GB of storage But new DAT systems have much larger capacities Data Sharing A SAN solution in which files on a storage device are shared between multiple hosts Datagram Refers to the Class 3 Fibre Channel Service that allows data to be sent rapidly to multiple devices attached to the fabric with no confirmation of delivery dB Decibel a ratio measurement distinguishing the percentage of signal attenuation between the input and output power Attenuation loss is expressed as dB km Disk Mirroring A fault tolerant technique that writes data simultaneously to two hard disks using the same hard disk controller Disk Pooling A SAN solution in which disk storage resources are pooled across multiple hosts rather than be dedicated to a specific host DLT Digital Linear Tape A magnetic tape technology originally developed by Digital Equipment Corporation DEC and now sold by Quantum DLT cartridges provide storage capacities from 10 to 35GB E_Port Expansion Port a port on a switch used to link multiple switches together into a Fibre Channel switch fabric ECL Emitter Coupled Logic The type of transmitter used to drive copper media such
379. y selected zone set Implementing an Open IBM SAN From the Modify Zone Set window we select Actions gt NewZone which opens the New Zone window We drag and drop the adapters of our AIX hosts to the Members in zone window as shown in Figure 3 73 New Zone AIX_Zone_1 Emulex 10 00 00 00 C9 20 DC 71 Domain 1 Emulex 10 00 00 00 09 20 E7 C7 Port 2 Emulex 10 00 00 00 C9 20 DC 71 KATE FCS0 Port 3 Emulex 10 00 00 00 C9 20 E7 C7 Emulex 10 00 00 00 C9 20 E7 F3 s Port5KATE_FCS0 Port 6 RPKA93_C1B24A1 Port RPKAS3_C1B3A1 Figure 3 73 Fabric Manager defining an AIX zone The last entry to the left of the window is another ESS but which is without a nickname After selecting Save Zone we assign this zone to our zone set Just as we did previously with the NT zone we drag and drop the AIX zone in the Modify Zone Set window from the Zone Library to the Zones in Set on the left hand side of the window as shown in Figure 3 74 Chapter 3 Implementing a SAN with McDATA 243 Modify Zone Set ITSO_Zone_Set_1 NT_Zone_1 Figure 3 74 Adding AIX zone to zone set After saving the zone set we have two zones NT_Zone_1 and AIX_Zone_1 Both of these are in our zone set ITSO_Zone_Set_1 as shown in Figure 3 75 Zone Sets C ITSO_Zone_Set_2 AITSO_Zone_Set_1 ANT_Zone_1 RPKAS3_C1B2A1 QLogic 20 00 00 E0 88 00 52 5E Emulex 10 00 00 00 09 20 CA E6 AAIX_Zone_1 Emulex 10 00 00 00 C9 20 0C0 71
380. ystems and another ESS as shown in Figure 3 71 a NT_Zone_1 es Netfinity NT Server ESS Tag te if ge ooo ooo os nn nn nm e ooo ooo 4 N Pa Pi 1 A g ri gt N 7 amp r 4 Shortwave fiber ooon ED 6064 maaana wee T L AIX_Zonet 7 nan ooo Ooo os un 88 nm Mea F r OOO OOO OOO F eeil My 1 1 I e 1 1 iS N vA s y 2 OT RS6K AIX Server ESS default zone am Figure 3 71 NT zone with three node ports and AIX zone with four node ports Chapter 3 Implementing a SAN with McDATA 241 242 The AIX hosts are already connected to the McDATA so all we need to do is to define the zone in the zone set which already includes our NT zone To add another zone to the zone set we basically follow the steps described previously We navigate to the zone set library and mark the zone set in which we want the zone to be added In our case this is the ITSO_Zone_Set_1 Then we use Modify from the Actions menu which allows us to change the content of the zone set as shown in Figure 3 72 ga QNT_Zone_1 RPKAS3_C1B2A1 GLogic 20 00 00 E0 88 00 52 5E Emulex 10 00 00 00 09 20 CA E6 ITSO_Zone_Set_2 Figure 3 72 Fabric Manager modif

Implementing an Open IBM SAN Featuring the McDATA Portfolio

Contents

Download Pdf Manuals

Related Search

Related Contents