Home

Sun ZFS Storage 7x20 Appliance Customer Service Manual

1. Chapter 2 Hardware Maintenance 109 HBA Expansion pt 1 110 fig 3 Install new HBA according to the instructions on installing PCI cards and connect the controller to the second and third chain as shown fig 4 Reconnect the two original HBAs as before to the first two chains Power on the controller and wait for it to regain control of connected storage v Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 HBA Expansion pt 1 SHELF SHELF SHELF d T T d Ee Puy es as ese c os am ci fig 5 Power down and remove all cabling from the second controller fig 6 Install new HBA according to the instructions on installing PCI cards and connect the controller to the second and third chain as shown Chapter 2 Hardware Maintenance 111 HBA Expansion pt 1 112 fig 7 Reconnect the two original HBAs as before to the first two chains Power on the controller and wait for it to regain control of connected storage fig 8 Cluster with three HBAs Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 HBA Expansion pt 2 HBA Expansion pt 2 Expanding from 3 to 4 HBAs The figures below show steps to migrate a cluster from three to four HBAs NOTE Diagrams below are not representative of proper slot location for HBAs Cabling Diagrams fig 1 Cluste
2. Figure Legend 1 Fan Board 5 Power Distribution Board 2 SAS Expander Board 6 Connector Board 3 Disk Backplane 7 Power Supply Backplane 4 Front Control Panel Light Pipe Assembly Standalone Controller Configurations The following table shows the configuration options for a 7120 controller All PCIe cards are low profile and must be fitted with low profile mounting brackets This table describes base configurations for the 7120 Mktg Part Number Description Mfg Part Number TA7120 12TB 7120 1xCPU 24GB 12TB 597 0754 01 TA7120 24TB 7120 1xCPU 24GB 24TB 597 0755 01 Chapter 2 Hardware Maintenance 31 7120 32 NIC HBA Options This table describes NIC HBA options for the 7120 Mktg Part Number Description Mfg Part Number SG XPCIESAS GEN2 Z 2 port External Sun Thebe SAS x4 HBA PCIe 594 5889 01 SG XPCIE2FC QF8 Z 2 port FC HBA 8Gb PCIe 594 5684 01 X4446A Z 4 port PCI E Quad GigE UTP 594 4024 01 X4237A N 2 port 4X IB HCA PCIe 594 5862 02 X1109A Z 2 port 10Gig SFP NIC PCle 594 6039 01 PCle Options This table describes the supported PCle configuration option summary for the 7120 Slot Type SunPartNumber Vendor Part Number Description Note 0 PCIe 540 7975 03 Sun Aura Internal Flash HBA Logzilla Base Configuration 1 PCle 375 3617 01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front end i PCIe 375 3606 01 Mellanox MHJH29
3. bet The network management connector NET MGT is an RJ 45 connector on the motherboard and provides an alternate terminal interface to the SP console iE NET MGT There are four RJ 45 Gigabit Ethernet connectors NETO NET1 NET2 NET3 located on the motherboard that operate at 10 100 1000 Mbit sec These network interfaces must be configured before use 7320 Storage Disk Shelf The 7320 single and cluster controller configurations allow a single chain of 1 to 4 Sun Disk Shelves Any combination of disk only and Logzilla capable shelves may be combined within the chain in any order The cabling configurations are unchanged Half populated shelf configurations are not supported See Also m Disk Shelf Overview Disk Shelf Details Controller Details 7420 7720 42 7420 7720 Hardware Overview Use the information on this page as a preparation reference for servicing replaceable components of 7420 and 7720 controllers Refer to the following for procedural instructions m Controller Tasks replace system controller components Disk Shelf Tasks replace disk shelf components Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7420 7720 Chassis Overview The Sun ZFS Storage 7420 Appliance consists of either a single storage controller or two storage controllers in a high availability cluster configuration and one to 24 Sun Disk shelves Refer to the http www sun com storage disk_systems
4. Introduction Alerts This is the appliance alert log recording key events of interest during appliance operation The following are example alert log entries as they would appear in the BUI Time Event ID Description Type 2009 9 16 f18bbad1 8084 4cab c950 82ef5b8228ea An I O path fromslot PCIeO Major alert 13 01 56 to chassis JBOD 1 has been removed 2009 9 16 8fb8688c 08f2 c994 a6a5 ac6e755e53bb A disk has been inserted into Minor alert 13 01 51 slot HDD 4 of chassis JBOD 1 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Logs Time Event ID Description Type 2009 9 16 446654fc b898 6da5 e87e 8d23ff12d5d0 A disk has been inserted into Minor alert 13 01 51 slot HDD 15 of chassis JBOD 1 An info icon next to the Event ID means that extended information is available Click the icon and this information will be displayed below the list of alerts The appliance can also be configured to send email raise an SNMP trap or perform other actions when particular alerts occur This is configured in the Alerts section All alerts appear in this log regardless of whether they have actions configured for them Faults The fault log records hardware and software faults This is a useful reference when troubleshooting hardware failure as timestamps are available for these hardware fault events The following are example fault log entries as they would appear in the BUI
5. 2 SSDs and 30 HDDs The expansion kit can be installed while the storage controllers are running To avoid excessive loss of cooling air during the following procedure remove only one filler panelata time then immediately insert the new component Oracle s Sun ZFS Storage appliance software automatically detects and configures each new component The LCC SSD or HDD appear in the BUI Maintenance Hardware screen when you view details for the system controller Chapter2 Hardware Maintenance 93 SAS2 SAS2 94 1 Followthe electrostatic discharge safety practices to avoid damaging the system or components 2 To install an LCC remove one of the LCC filler panels by squeezing the plastic handles and rotating the handles out to unlock the filler panel 3 Remove the filler panel and immediately insert an LCC in the slot 4 Install the second LCC is the same manner 5 Installan SSD in drive slot 30 Press the release button on the drive filler panel Remove the filler panel from the slot Press the release button on the SSD to open the latch Slide the SSD into the slot until it is fully seated 6 Install the second SSD in drive slot 31 Note There isan exception to this step if an existing drive cage in the 7700 cabinet does not have any SSDs In this case install the SSD in drive slot 30 of the 7700 drive cage that does not have SSDs 7 Install the HDDs in drive slots 0 through 29 in the same manner as for the SS
6. 7120 or 7320 Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 To install the top cover Place the top cover on the chassis so that it hangs over the rear ofthe storage controller by about an inch 2 5 cm then slide the top cover forward until it seats Close the fan cover and engage the fan cover latches The cover must be completely closed for the storage controller to power on 7420 or 7720 To install the top cover Place the top cover on the chassis 1 so that it is forward ofthe rear ofthe storage controller by about an inch 2 5 cm Slide the top cover toward the rear of the chassis 2 until it seats Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 Press down on the cover with both hands until both latches engage 12 Push the release tabs on the side of each rail and slowly push the storage controller into the rack making sure no cables obstruct the path of the controller 13 Connect the power cords to the power supplies 14 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 15 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Power button lights and rem
7. 7320 Cluster Configurations The 7320 cluster base configuration is 24GB RAM 2x2 4GHz Quad Core processors one external SAS HBA and four 10 100 1000 Ethernet ports and a Cluster card The Sun Storage 7420C Cluster Upgrade Kit XOPT 594 4680 01 contains two cluster cards with cables for converting two 7320 or two 7420 controllers to a cluster The following options are available for clustered storage controllers Note that both storage controllers in a cluster must be configured identically with regard to card configurations and all optional NIC HBA card configurations chosen for clustered storage controllers must be identical in both chassis Slot Type Part Number Vendor Part Description Note 0 PCIe 375 3617 01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front end 0 PCIe 375 3696 01 Mellanox InfiniBand HCA Optional Recommended Front end 0 PCIe 375 3606 03 MHJH29 XTC InfiniBand HCA Optional Recommended Front end 0 PCIe 375 3481 01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front end 0 PCle 371 4325 01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator Backup 1 PCIe 542 0298 01 Sun Fishworks Cluster Card 2 Cluster Base Configuration 2 PCIe 375 3609 03 Sun Thebe External SAS HBA Cluster Base Configuration 7320 Connector Pinouts The serial management connector SERIAL MGT is an RJ 45 connector and a terminal connection to the SP console Chapter 2 Hardware Maintenance 41 7420 7720
8. DIMM names in appliance logs and the Maintenance Hardware view are displayed with the full name such as SYS MB P0 D7 Fan Modules The Fan Modules and Fan Module LEDs ofthe storage controller are shown in the following figure The following LEDs are lit when a fan module fault is detected HIE t D IS 310 3 m Front and rear Service Action Required LEDs Fan Module Service Action Required TOP LED on the front of the server Fan Fault LED on or adjacent to the faulty fan module The system Overtemp LED might light if a fan fault causes an increase in system operating temperature Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7420 7720 PCle Cards and Risers The 7420 7720 PCIe expansion system is configured using two types of riser cards as follows Note that PCIe cards with x4 x8 or x16 mechanical finger pins will fit in any riser slot but will operate at the lane width ofthe slot The Sun Fishworks Cluster Controller 200 belongs in the Cluster slot C only SAS HBAs must all be ofthe same type installed in slots 1 and 8 with an optional third SAS HBA in slot2 and an optional fourth SAS HBA in slot 7 PCIe slots should be populated in the following order 9 if used 0 if used 7 2 6 3 5 4 Riser Slot Numbers Electrical Mechanical Source Riser 0 Slot 0 x8 x8 MCP55 Riser 0 Slot3 x8 x8 MCP55 Riser 1 Slot 1 internal SAS HBA x8 x8 MCP55 Riser
9. Date EventID Description Type 2009 9 5 9e46fcOb b1a4 4e69 f10f e7dbe80794fe The device HDD 6 has failed or could Major Fault 17 42 35 not be opened 2009 9 3 d37cb5cd 88a8 6408 e82d c05576c52279External sensors indicate that a fanisno Minor Fault 19 20 15 longer operating correctly 2009 8 21 c91c7b32 83ce 6da8 e51e a553964bbdbc The ZFS pool has experienced currently Major Error 16 40 48 unrecoverable I O failures These faults will generate alert log entries and so will use the alert reporting settings such as sending email if configured Faults that require administrator attention will appear in Problems System This is the operating system log available to read via the appliance interfaces This may be useful when troubleshooting complex issues but should only be checked after first examining the alert and fault logs The following are example system log entries as they would appear in the BUI Time Module Priority Description 2009 10 11 14 13 38 ntpdate error no server suitable for synchronization found Chapter 3 System Maintenance 141 Logs 142 Time Module Priority Description 2009 10 11 14 03 52 genunix notice MSunOS Release 5 11 Version ak generic 2009 10 10 1 0 64 bit 2009 10 11 14 02 04 genunix notice done 2009 10 11 14 02 01 genunix notice syncing file systems 2009 10 1113 52 16 nxge warningW ARNING nxge gt nxge rxdma databuf free DDI Audit The audit log re
10. FC FRU FTP GigE HBA HCA HDD HTTP Hybrid Storage Pool Icons iSCSI Kiosk L2ARC LDAP LED Logzilla LUN Masthead Modal Dialog NFS NIC NIS PCIe Pool Project PSU 146 a comprehensive dynamic tracing framework for troubleshooting kernel and application problems on production systems in real time Fibre Channel Field Replaceable Component File Transfer Protocol Gigabit Ethernet Host Bus Adapter Host Channel Adapter Hard Disk Drive HyperText Transfer Protocol combines disk flash and DRAM into a single coherent and seamless data store icons visible in the BUI Internet Small Computer System Interface a restricted BUI mode where a user may only view one specific screen Level 2 Adaptive Replacement Cache Lightweight Directory Access Protocol light emitting diode write IOPS accelerator Logical Unit top section of BUI screen a new screen element for a specific function Network File System Network Interface Card Network Information Service Peripheral Component Interconnect Express provide storage space that is shared across all filesystems and LUNs a collection of shares Power Supply Unit Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 ZFS QDR Readzilla Remote Replication Rollback SAS SAS 2 SATA Schema Scripting Service Share SIM Snapshot SSD SSH Statistic Storage Controller Support Bundle Title Bar Updates WebDAV ZFS quad d
11. m BUTI click the FACTORY RESET button on the Maintenance gt System screen m CLI enter the maintenance system context then issue the factoryreset command Note Factory reset of a single controller while configured into a cluster is not supported The controller must be unclustered first System Updates The system update feature provides customers developers and field personnel with the ability to update a system s software after the system is installed Software updates are delivered as opaque binary downloads that contain some or all of Management and system software Firmware for internal components such as HBAs and network devices Firmware for disks and flash devices Firmware for external storage enclosure components In general the update release notes describe what is in the update and the update process automates all of the steps of activating the delivered components Procedure The procedure for updating the system is as follows First the software update media is downloaded from an Oracle support website or retrieved from another official source The media is represented by a single compressed file named after the version number such as ak nas 2010 02 09 1 0 pkg gz The file can be renamed if needed as the true version number is recorded internally within the image The compressed media packages will vary in size but typically will be on the order of several hundred megabytes Second the so
12. 1 Slot 4 internal SAS HBA x8 x8 1055 Riser 2 Slot 2 optional 3rd internal SAS HBA x16 x16 1055 Riser 2 Slot 5 x4 x8 1055 Riser 3 Slot 6 x4 x8 1055 Riser 3 Slot 7 optional 4th internal SAS HBA x4 x8 1055 Riser 4 Slot 8 x4 x8 1055 Riser 4 Slot 9 x4 x8 1055 The serial management connector SER MGT is an RJ 45 connector and provides a terminal Ir 1 oma connection to the SP console The network management connector NET MGT is an RJ 45 connector and provides a LAN interface to the SP console GE There are four RJ 45 Gigabit Ethernet connectors NETO NET1 NET2 NET3 located on the motherboard that operate at 10 100 1000 Mbit sec These network interfaces must be configured before use Chapter 2 Hardware Maintenance 49 7420 7720 50 7420 Standalone and Cluster Controller Configurations The following tables show the configuration options for a single standalone 7420 controller or two clustered 7420 controllers All PCIe cards are low profile and must be fitted with low profile mounting brackets Standalone Base Options This table describes 7420 standalone base configurations Mktg Part Number Description Mfg Part Number TA7420 26AR00 7420 no DIMMs 2x1 86GHz 6C 597 0789 01 TA7420 28AR00 7420 no DIMMs 2x2 00GHz 8C 597 0790 01 Cluster Base Options This table describes 7420 cluster base configurations Mktg Part Number Description Mfg Part Number TA7420 26ARO0HA 742
13. 15 Usea pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Power button lights and remains lit 16 Connect data cables to the PCIe card routing them through the cable management arm 17 Go to the Maintenance gt Hardware screen of the BUI and click the details icon amp on the controller Then click Slots to verify the status ofthe new component 18 Install the disk shelf and connect the expansion storage Battery You might need to replace the battery if the storage controller fails to maintain the proper time when powered off and disconnected from the network You will need a small No 1 flat blade non metallic screwdriver or equivalent You must shut down the appliance before beginning this task Note that there will be a loss of access to the storage unless the system is in a clustered configuration Shut down the appliance using one ofthe following methods Login to the BUI and click the power icon on the left side of the masthead SSH into the storage system and issue the maintenance system poweroff command SSH or serial console into the service processor and issue the stop SYS command Usea pen or non conducting pointed object to press and release the Power button on the front panel To initiate emergency shutdown wherein all applications and files will be closed abruptly without saving press and hold
14. HDD 11 ok ST3500630NS ST3500630NS 90G1AC27 disk 012 HDD 12 ok ST3500630NS ST3500630NS 9QG1AC41 disk 013 HDD 13 ok ST3500630NS ST3500630NS 90G1ACQ5 disk 014 HDD 14 ok ST3500630NS ST3500630NS 9QG1ACKA disk 015 HDD 15 ok ST3500630NS ST3500630NS 9QG1AC5Y disk 016 HDD 16 ok ST3500630NS ST3500630NS 90G1ACQ2 disk 017 HDD 17 ok ST3500630NS ST3500630NS 90G1A76S disk 018 HDD 18 ok ST3500630NS ST3500630NS 9QG1ACDY disk 019 HDD 19 ok ST3500630NS ST3500630NS 9QG1AC3Y disk 020 HDD 20 ok ST3500630NS ST3500630NS 90G1ACG6 disk 021 HDD 21 ok ST3500630NS ST3500630NS 9QG1AC3X disk 022 HDD 22 ok ST3500630NS ST3500630NS 9QG1ACHL disk 023 HDD 23 ok ST3500630NS ST3500630NS 9QG1ABLW Chapter 1 Introduction 21 Hardware 22 Select the faulted disk and turn on the locate LED hostname maintenance chassis 001 disk gt select disk 001 hostname maintenance chassis 001 disk 001 gt set locate true locate true uncommitted hostname maintenance chassis 001 disk 001 gt commit Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 CHAPTER 2 Hardware Maintenance Maintenance Introduction This section describes concepts and procedural instructions for performing hardware and software maintenance tasks The graphic above illustrates locating a spare disk within the chassis by highlighting its name in the BUI Hardware Maintenance list The Maintenance Hardware screen of the BUI provides visual representatio
15. Maintenance 53 7700 7700 54 Disk Shelf The 7420 single and cluster controller configurations allow one to four chains of 1 to 6 Sun Disk Shelves Any combination of disk only and Logzilla capable shelves may be combined within the chain in any order The cabling configurations are unchanged Half populated shelf configurations are not supported See Disk Shelf Overview for component specifications and diagrams 7700 Cabinet Two clustered 7720 controllers are installed in a 7700 main cabinet with 12 disk cages See 7700 Hardware Overview for component specifications and diagrams 7700 Hardware Overview This page contains information and instructions to help prepare you for servicing replaceable components in the Sun ZFS Storage 7700 appliance For instructions on how to replace appliance components or for more information about the system controller refer to the following pages Controller Tasks replace controller or cabinet CRU components 7420 7720 Hardware Overview view storage controller component diagrams specifications and cluster options Cabinet Specifications The Sun ZFS Storage 7700 appliance cabinet houses all ofthe components that support a clustered storage system The cabinet includes 12 cages that host 30 hard disk drives HDDs 2 leaf controller cards LCCs and 2 optional Logzilla solid state drives SSDs To control these resources the appliance includes 2 system controllers and 2 rack c
16. Manufacturer Disk Shelf Manufacturer Model Disk Shelf Model Data Total size of all data disks within the disk shelf Cache Total size of all read optimized cache devices Readzillas within the drive shelf There are currently no supported disk shelves with read cache devices but this may on not always be the case If there are no cache devices within the shelf then is displayed Log Total size of all write optimized cache devices Logzillas within the drive shelf If there are no log devices within the shelf then is displayed Paths Total number of I O paths to the disk shelf The only supported configurations are those with multiple paths to all disks so this should read 2 under normal operating circumstances Clicking the icon will bring up a dialog with information about each path This includes which HBAs are connected to the disk shelf and the state of any paths If the disks within the disk shelf are not currently configured as part ofa storage pool complete path information will not be available though it displays two paths to the chassis isate xx Toggle the locate LED for this disk shelf If the LED is currently on then this indicator will be flashing Note that individual disk shelves in the 7700 cabinet do not have Locate LEDs Chassis Detail To view the chassis details click on the icon or one of the alternative forms described above This view includes some of the
17. PCIe riser you want to replace Label the cables for proper connection later Loosen the two captive Phillips screws on the end of the rear panel crossbar and lift the crossbar up and back to remove it Loosen the captive retaining screw holding the front end ofthe riser and the Phillips screw on the end of the riser 78 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 Lift the riser up to remove it from the storage controller filtered compressed air ifnecessary Seat the replacement PCIe card in the slot of the riser and connect the cables Align the riser together with any attached PCIe cards with the intended location on the motherboard and carefully insert it into its slot Slide the back ofthe riser into the motherboard rear panel stiffener Tighten the screw that secures the riser to the motherboard Chapter2 Hardware Maintenance 79 7x20 Replace the rear panel PCI crossbar by sliding it down over the PCIe risers ensuring the crossbar is secured with two captive Phillips screws 9 7420 or 7720 To replace the PCIe card Disengage the PCIe card slot crossbar from its locked position and rotate the crossbar into an upright position Remove the retaining screw that holds the PCIe card to the chassis Carefully remove the PCIe card from the connector and clean the slot with filtered compressed air if necessary Install the replacement PCIe card into th
18. SP controller draws power from the host s 3 3V standby supply rail which is available whenever the system is receiving AC input power even when the system is turned off Power Distribution Board The power distribution board is a FRU and distributes main 12V power from the power supplies to the rest ofthe storage controller It is directly connected to the Connector Break Out Board and to the motherboard through a bus bar and ribbon cable It also supports a top cover interlock kill switch The power supplies connect directly to the power distribution board Connector Break Out Board The Connector Break Out Board is FRU and serves as the interconnect between the power distribution board and the fan power boards storage drive backplane and I O board It also contains the top cover interlock kill switch Fan Power Boards The two fan power boards are FRUs and carry power to the system fan modules In addition they contain fan module status LEDs and transfer I2C data for the fan modules Chapter2 Hardware Maintenance 27 7120 Storage Drive Backplane The storage drive backplane is a FRU and includes the connectors for the storage drives as well as the interconnect for the I O board Power and Locator buttons and system component status LEDs The system has a 12 disk backplane Each drive has an LED indicator for Power Activity Fault and Locate 1 0 Components The I O components of the 7120 system are shown in the
19. Storage 7110 2010 02 09 1 0 Sun Storage 7110 2009 09 01 1 18 Use the and v keys to select which entry is highlighted Press enter to boot the selected OS e to edit the commands before booting or c for a command line As the system boots up using the new system software you will see some special messages on the first boot indicating that an update is completing and noting the previous and new versions ofthe system software SunOS Release 5 11 Version ak generic 2010 02 09 1 0 64 bit Copyright 1983 2010 Sun Microsystems Inc All rights reserved Use is subject to license terms System update in progress Updating from ak nas 2009 09 01 1 18 Updating to ak nas 2010 02 09 1 0 Updating system datasets done Configuring network devices done Configuring devices Sun Storage 7110 Version ak nasQ2010 02 09 1 0 Copyright 2010 Sun Microsystems Inc All rights reserved Use is subject to license terms Reading ZFS config done Mounting ZFS filesystems 27 27 monk console login Rollback The rollback procedure reverts all of the system software and all ofthe metadata settings ofthe system back to their state just prior to applying an update This feature is implemented by taking a snapshot of various aspects ofthe system before the new update is applied and rolling back this snapshot to implement the rollback The implications of rollback are as follows Any appliance configuration changes are reverted a
20. UT E 7 INTFOQUCTION eee MQ 9 VEL VI CW CERT EET TRE ENS 9 Irtroductiolt coit Re denied nitidi de aden eee 9 HardWare eea a ne D iL ed ded tee 12 Hardware Maintenance tt nd ie 23 Maintenance sense anne M 23 Introduction 255 d trae diet oen d e de di d area aed on ees 23 7A A EEEE LES 24 7120 Hardware Overview i cea dianae ea RH OO Baa t HL d EH ede ace apad tes 24 Chassis Overview Electrical Specifications ndr aei petet tete ione Perl d cll pacte aiian STTS 26 Internal Components nasale nn de it 27 Standalone Controller Configurations sens 31 Attached Storage en au anna nd eee ennemie ent 32 PR ENTER ER EEE ECTS ERP EE EEE EEE ES EEE NE EP EP D LEP 33 7320 Hardware Overview ases iiiter ce tec adore dee her i eel Pe Ue ace ada aae da 33 Chassis Overview nement deinen damian aii ep o dodo o Re dene 33 7320 Replaceable Componetits diee drei d dne ea i t anemia d 39 7320 Single and Cluster Controller Configurations ss 40 7420157205 Re tei Pe OD eterne hereto entend d its 42 Contents 7420 7720 Hardware OVERVIEW eerte eher odes aaiatescsacsvantesdsaevudes ass sd cuts UR edited end 42 Chassis OVERVIEW o4 a edward ES e ee RE E ve eed ca ERR M e vena e der des 43 Internal Boards 25er ver Ete e deter EP E Ed EPA eA EE EDO ete e aee Mere COMPONENES p 7420 Standalone and Cluster Controller Configurat
21. Verify that the green AC Present status indicator is lit 9 Close the CMA inserting the CMA into the rear left rail bracket 10 Go to the Maintenance Hardware screen of the BUI Click amp details icon for the controller and then click power supply to verify that the status icon is green for the newly installed power supply Memory To identify a specific memory module that has faulted you must open the storage controller and use the amber status LEDs on the motherboard To identify a general memory fault go to the Maintenance Hardware screen of the BUI and click on the details icon amp on the controller Then go to http fgw sfbay sun com wiki index php http fgw sfbay sun com wiki index php title2 Maintenance Hardware Details 7x20 then click DIMMs to locate the faulted component indicated by the warningicon amp Caution This procedure requires that you handle components that are sensitive to static discharge which can cause the component to fail To avoid damage wear an antistatic wrist strap and use an antistatic mat when handling components You must shut down the appliance before beginning this task Note that there will be a loss of access to the storage unless the system is in a clustered configuration Shut down the appliance using one ofthe following methods Log in to the BUI and click the power icon on the left side of the masthead SSH into the appliance and issue the maintenance system po
22. a faulted fan module Caution Operating a controller for an extended period of time with fans removed reduces the effectiveness ofthe cooling system For this reason the replacement fan should be unpacked in advance and ready to insert into the controller chassis as soon as the faulted fan is removed 7120 or 7320 The fan modules and status indicators are hidden under a fan door in the 7120 and 7320 storage controllers Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 Leaving the door open for more than 60 seconds while the storage controller is running might cause it to overheat and shut down 64 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 7420 or 7720 The following illustration shows the fan modules in the 7420 7720 storage controller 1 To locate the chassis you want to service click the associated locate icon on the Maintenance Hardware screen of the BUI or issue the set SYS LOCATE status on command at the service processor SP prompt The locate LED will flash on the controller chassis 2 Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack 3 From the front ofthe storage controller release the two slide release latches 4 While squeezing the slide release latches slowly pull the storage controller forward until the slide r
23. applied to the data stored on the system Platforms 7120 7320 7420 7720 7700 Legacy platforms are documented in the 7110 7210 7310 7410 J4400 J4500 sections of the Sun Storage 7000 Unified Storage System Service Manual available at http wikis sun com display fishworks http wikis sun com display fishworks Expansion Storage Sun Disk Shelf Overview Protocols Sun ZFS Storage appliances include support for a variety of industry standard client protocols including SMB NFS HTTP and HTTPS WebDAV iSCSI FC SRP iSER FTP SFTP Key Features Sun ZFS Storage systems also include new technologies to deliver the best storage price performance and unprecedented observability of your workloads in production including Analytics a system for dynamically observing the behavior of your system in real time and viewing data graphically The ZFS Hybrid Storage Pool composed of optional Flash memory devices for acceleration of reads and writes low power high capacity disks and DRAM memory all managed transparently as a single data hierarchy Data Services To manage the data that you export using these protocols you can configure your Sun ZFS Storage system using the built in collection of advanced data services including RAID Z RAID 5 and RAID 6 mirrored and striped disk configurations Unlimited read only and read write snapshots with snapshot schedules Data deduplication Built in data com
24. are no active problems Verify that firmware updates are not in progress Check the most recent product release notes for additional preconditions that should be observed for the software release to which you are upgrading Chapter3 System Maintenance 123 Updates 124 Deferred Updates Each update may come with new firmware or updates to external resources In general these updates are backwards compatible and applied automatically without user intervention There are exceptions however for non reversible updates These updates involve updating a resource external to the system software in a way that is incompatible with older software releases Once the update is applied rolling back to previous versions will result in undefined behavior For these updates you will always be given an explicit option of applying them automatically during upgrade or applying them after the fact They are therefore referred to as deferred updates When applying an update to a version with incompatible version changes you will be given an option to apply these version changes as part of the upgrade For each version change the benefits ofapplying the change will be presented to you The default is to not apply them requiring you to return to the updates view and apply them once the system has rebooted after the upgrade is applied This allows you to verify that the rest ofthe software is functional and a rollback is not required before applying the
25. at that point See below regarding additional firmware upgrades that may take place following the reboot While the upgrade is in progress up until the reboot and following the reboot during any firmware upgrades it is non disruptive the controller continues to provide data services to clients If the system software fails during the upgrade it will reboot and continue running the software from before the upgrade Important Do not perform a cluster takeover operation or a reboot while an upgrade is in progress Following the post upgrade reboot component firmware will be updated see firmware updates below which will take additional time that depends on the size ofthe system configuration and the amount of firmware that has changed since the previously installed version was delivered very large Sun Storage 7410 configurations may take several hours to complete all firmware upgrades once the update itself has been applied Preconditions Best practices include verifying several preconditions prior to applying an update Whenever possible administrators should ensure that these preconditions are satisfied immediately prior to applying an update on the storage controller In a clustered environment these should be verified on both storage controllers before applying the update to either one Ensure that any resilvering operations have completed This can be observed in Configuration Storage or the equivalent CLI context Ensure that there
26. cache or spare When a spare is active it will be displayed as spare Speed Processor speed in gigahertz Cores Number of CPU cores GUID Hardware global unique identifier Disks Disks support the additional options Action Description Locate X Toggle the locate indicator for the disk If the LED is currently turned on this icon will be blinking Offline o Offline the disk This option is only available for disks that are part of a configured storage pool including the system pool Offlining a disk prevents the system from reading or writing to it Faulted devices are already avoided so this option should only be required ifa disk is exhibiting performance problems that do not result in pathological failure It is not possible to offline a disk that would prevent access to data i e offlining both halves of a mirror If the device is an active hot spare this will also give the option of detaching the hot spare completely Once a hot spare is detached it cannot be activated except through another fault or hotplug event Online Online the disk Reverses the above operation Infiniband Host Controller Adapters Infiniband Host Controller Adapters HCA report additional properties for the list of available ports Action Description State When active the active port icon is displayed Other valid port states down init and arm are denoted by the inactive port ico
27. including the impact to the system affected components the system s automated response if any and the recommended action for the administrator if any In the CLI only the uuid diagnosed severity type and status fields are considered stable Other property values may change from release to release Chapter3 System Maintenance 139 Logs Logs 140 For hardware faults you may be able to select the affected hardware component to locate it on the Hardware screen Repairing problems Problems can be repaired by performing the steps described in the suggested action section This typically involves replacing the physical component for hardware faults or reconfiguring and restarting the affected service for software defects Repaired problems no longer appear on this screen While the system typically detects repairs automatically in some cases manual intervention may be required If a problem persists after the affected components have been repaired contact support You may be instructed to mark the problem repaired This should only be done under the direction of service personnel or as part of a documented Sun repair procedure Related features A persistent log of all faults and defects is available under Logs as the Fault log Faults and defects are subcategories of Alerts Filter rules can be configured to cause the appliance to email administrators or perform other actions when faults are detected
28. information on content products and services from third parties Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third party content products and services Oracle Corporation and its affiliates will not be responsible for any loss costs or damages incurred due to your access to or use of third party content products or services Copyright O 2009 2010 Oracle et ou ses affili s Tous droits r serv s Ce logiciel et la documentation qui l accompagne sont prot g s par les lois sur la propri t intellectuelle Ils sont conc d s sous licence et soumis des restrictions d utilisation et de divulgation Sauf disposition de votre contrat de licence ou de laloi vous ne pouvez pas copier reproduire traduire diffuser modifier breveter transmettre distribuer exposer ex cuter publier ou afficher le logiciel m me partiellement sous quelque forme et par quelque proc d que ce soit Par ailleurs il est interdit de proc der toute ing nierie inverse du logiciel de le d sassembler ou de le d compiler except des fins d interop rabilit avec des logiciels tiers ou tel que prescrit par la loi Les informations fournies dans ce document sont susceptibles de modification sans pr avis Par ailleurs Oracle Corporation ne garantit pas quelles soient exemptes d erreurs et vous invite le cas ch ant lui en faire part par crit Si ce logi
29. marked on the equipment and described in Important Safety Information for Sun Hardware Systems located at http dlc sun com pdf 816 7190 12 816 7190 12 pdf http dlc sun com pdf 816 7190 12 816 7190 12 pdf Electrostatic Discharge Precautions Remove all plastic vinyl and foam material from the work area Wear an antistatic wrist strap at all times when handling any CRU Before handling any CRU discharge any static electricity by touching a grounded surface Donot remove a CRU from its antistatic protective bag until you are ready to install it After removing a CRU from the chassis immediately place it in an antistatic bag or antistatic packaging Handle any card that is part of a CRU by its edges only and avoid touching the components or circuitry Donotslide a CRU over any surface Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Shelf Limit body movement which builds up static electricity during the removal and replacement of a CRU Tasks Shelf Tasks Y Replacing a Drive The shelf drives are hot swappable and may be replaced without removing power from the shelf The replacement drive must be of the same capacity and type as the drive to be replaced To avoid possible data loss when removing non faulted drives label each drive with the number ofthe slot from which it was removed and reinstall each drive into the same slot Faulted drives are indicated by an amber LED Go
30. of the other boot menu entries if present Although rollback can also be requested from the BUI or CLI rollback is offered from the boot menu because it is possible that rollback will be needed in scenarios where the new system software has completely failed i e has failed to even boot To rollback from the console access the serial console as usual and during boot before the ten second timeout use the arrow key to move the menu selection down to one of the earlier entries GNU GRUB version 0 95 613K lower 3537536K upper memory un un ct o ba o Q D m m N N H Use the and v keys to select which entry is highlighted Press enter to boot the selected OS e to edit the commands before booting or c for a command line After the rollback boot menu entry is selected the system will boot the old kernel software but the rollback must be manually confirmed on the console in order to commit the rollback which will effectively remove all changes to the system that have happened since as described above The confirmation step looks like this SunOS Release 5 11 Version ak generic 2009 09 01 1 18 64 bit Copyright 1983 2009 Sun Microsystems Inc All rights reserved Use is subject to license terms System rollback in progress Rollback to ak nas 2009 09 01 1 18 Proceed with system rollback y n Entering y proceeds with the rollback and the system will complete boot using the
31. prior snapshot Entering n cancels the rollback and immediately reboots the system allowing the administrator to select a different boot image i e the current system software or an older snapshot Chapter3 System Maintenance 127 Updates 128 Cluster Upgrade In a clustered system a rolling upgrade can be performed eliminating downtime while the upgrade is performed This section assumes familiarity with the Sun Storage clustering model if you are not familiar with the clustering concepts and terminology please read about clustering concepts in the System Administration Guide first To describe the rolling upgrade procedure this document will refer to the two clustered storage controllers as A and B where A is the controller that will be updated first and B is the controller that will be updated second A key best practice in rolling upgrades is that each controller should be upgraded at a time when it is not providing service to clients The procedure described here meets this requirement In addition all general upgrade best practices described above also apply to rolling upgrades Important Do not perform a takeover operation while an upgrade is in progress 1 Usingeither the CLI or the BUI upload the update software image to both storage controllers 2 Ifthecluster has a single storage pool the controller to which that pool is assigned will be designated B the one without a storage pool is designated A If the
32. shown in the following figure and identified in the table Figure Legend 1 Top cover 2 Left Control Panel Light Pipe Assembly 3 Drive Cage 4 Solid State Drives Chapter 2 Hardware Maintenance 35 7320 36 Figure Legend 5 blank USB Module 6 Right Control Panel Light Pipe Assembly 7320 CPU and Memory Components Following are the replaceable CPU and memory components ofthe 7320 system Part Number Description FRU CRU F371 4898 01 DIMM 4GB DDR3 2RX4 13 FRU F371 4885 01 Intel E5620 2 40G FRU The storage controller motherboard has 18 slots in two groups that hold industry standard DDR3 DIMM memory cards All sockets must be occupied by either a filler ora DDR3 DIMM D8 D7 D D5 D4 D3 D DI Do Do D1 D Ds D4 05 pe 07 08 7320 Power Distribution and Fan Module Components The Power Distribution Fan Module components of the storage controller are shown in the following figure and identified in the table Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7320 Figure Legend 1 Fan Modules 4 Power Distribution Bus Bar Assembly 2 Fan Board 5 Power Supplies 3 Paddle Board Electrical Specifications The following list shows the electrical specifications for the 7320 Note that the power dissipation numbers listed are the maximum rated power numbers for the power supply The numbers are not a rating of the actual power consumption of the applianc
33. to the Maintenance Hardware section of the BUIand double click the shelf thumbnail to view Details for HDDs or A to turn on the locator LED 1 Locate the failed disk drive at the front of the chassis 2 Press the release button in and to the right to release the ejection lever 3 Pull the ejection lever fully open to unlock and partially eject the drive from the chassis 4 Grasp the middle of the drive body and pull it toward you to remove it from the chassis Chapter 2 Hardware Maintenance 101 Shelf 102 5 6 Ensure the new drive ejection lever is in the fully extended position Align the new drive with the open slot and slide the drive into the disk chassis Push the drive into the chassis slot until the ejection lever engages the chassis connectors and beginsto swing closed Pressthe ejection lever closed until it locks in place to seat the drive and lock it into the chassis The Activity LED with be steady green to indicate a ready state Goto the Maintenance gt Hardware screen of the BUI Click forthe controller and then click HDD to verify that the iconis green for the newly installed disk Replacing a Power Supply The power supplies are hot swappable and can be replaced without removing power from the system The power supplies can produce high energy hazard and should only be replaced by instructed individuals with authorized access to the equipment Failed power supplies are indicated by an am
34. update If you elect to not apply deferred updates during an upgrade you can return to the updates view at any point to apply the update If deferred updates are available for the current software version they will appear asa list below the current set of available updates with an Apply button to apply the updates Deferred updates in a cluster take effect on both storage controllers simultaneously and can only be applied while both controllers are operational Because deferred updates are listed only for resources present on the local storage controller in a cluster it may be the case that deferred updates are available only for resources active on the peer controller In a cluster it is therefore necessary to check both storage controllers to determine the availability of deferred updates Hardware Firmware Updates Following the application ofa software upgrade any hardware for which the upgrade includes newer versions of firmware will be upgraded There are several types of devices for which firmware upgrades may be made available each has distinct characteristics Disks storage enclosures and certain internal SAS devices will be upgraded in the background When this is occurring the firmware upgrade progress will be displayed in the left panel ofthe Maintenance System BUI view or in the maintenance system updates CLI context These firmware updates are almost always hardware related though it may briefly show some number of outsta
35. which all applications and files will be closed abruptly without saving press and hold the power button for at least four seconds until the Power OK status indicator on the front panel flashes indicating that the storage controller isin standby power mode Disconnect the AC power cords from the rear panel of the storage controller Identify the faulted fan module by locating the corresponding Service Required status indicator for the fan you want to replace Lift the latch at the top ofthe fan module to unlock the fan module Pull the fan module out Unlock and insert the 7720 fan module Apply firm pressure to fully seat the fan module Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim 7 7420 To replace the fan module Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the 3 locate icon on Maintenance Hardware screen of the BUI for the fan you want to replace Chapter2 Hardware Maintenance 67 7x20 Lift the latch at the top ofthe fan module to unlock the fan module Pull the fan module out Unlock and insert the 7420 fan module Apply firm pressure to fully seat the fan module Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim 8 Verify that the Top Fan status indicator the Service Required status indicato
36. 0 no DIMMs 2x1 86GHz 6C Cluster 597 0795 01 TC7420 28AR00HA S7420 no DIMMs 2x2 00GHz 8C Cluster 597 0792 01 NIC HBA Options This table describes NIC HBA options for 7420 single and cluster configurations Mktg Part Number Description Mfg Part Number SG XPCIESAS GEN2 Z 2 port External Sun Thebe SAS x4 HBA PCIe F375 3609 03 SG XPCIE2FC QF8 Z 2 port FC HBA 8Gb PCIe 594 5684 01 X4446A Z 4 port PCIe Quad GigE UTP 594 4024 01 X4237A 2 port 4X IB HCA PCle 594 5862 02 X1109A Z 2 port 10Gig SFP NIC PCle 594 6039 01 X2129A XCVRm 850NM 1 10GPS Short Reach SFP 594 6508 01 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7420 7720 PCle Options This table describes the supported single and clustered PCIe configuration option summary for 7420 Sun Part Slot Type Number Description Note 0 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup 1 PCIe 375 3609 02 DP SAS 2 HBA Base Configuration 2 PCIe 375 3609 02 DP SAS 2 HBA Additional Optional Back end 2 PCIe 375 3481 01 QP Copper NIC Optional Recommended Front end 2 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup 2 PCIe 375 3606 01 Infiniband HCA Optional Recommended Front end 2 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 3 PCIe 375 3481 01 QP Copper NIC Optional Recommended Front end 3 PCIe 371 4325 01
37. 8Gb DP FC HBA Optional FC Target or Initiator Backup 3 PCIe 375 3606 01 Infiniband HCA Optional Recommended Front end 3 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 4 PCIe 375 3481 01 QP Copper NIC Optional Recommended Front end 4 PCIe 375 3606 01 InfiniBand HCA Optional Recommended Front end 4 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end C PCle 511 1496 04 Cluster Controller 200 Cluster Base Configuration ONLY 5 PCle 375 3481 01 QP Copper NIC Optional Recommended Front end 5 PCle 375 3606 01 InfiniBand HCA Optional Recommended Front end 5 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 6 PCle 375 3481 01 QP Copper NIC Optional Recommended Front end 6 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup 6 PCIe 375 3606 01 InfiniBand HCA Optional Recommended Front end 6 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 7 PCIe 375 3609 02 DP SAS 2 HBA Additional Optional Back end 7 PCIe 375 3481 01 QP Copper NIC Optional Recommended Front end Chapter 2 Hardware Maintenance 51 7420 7720 52 Sun Part Slot Type Number Description Note 7 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup 7 PCle 375 3606 01 Infiniband HCA Optional Recommended Front end 7 PCle 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 8 PCle 375 3609 02 DP SAS 2 HBA Base Configuration 9 PCle 371 4325 01 8Gb D
38. Back end 3 PCIe 375 3481 01 QP Copper NIC Optional Recommended Front end 3 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup 3 PCIe 375 3606 01 Infiniband HCA Optional Recommended Front end 3 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 4 PCle 375 3481 01 QP Copper NIC Optional Recommended Front end 4 PCIe 375 3606 01 Infiniband HCA Optional Recommended Front end 4 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end C PCle 542 0298 01 Cluster Controller 200 Cluster Base Configuration 5 PCIe 375 3481 01 QP Copper NIC Optional Recommended Front end 5 PCIe 375 3606 01 InfiniBand HCA Optional Recommended Front end 5 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 6 PCIe 375 3481 01 QP Copper NIC Optional Recommended Front end 6 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup 6 PCIe 375 3606 01 InfiniBand HCA Optional Recommended Front end 6 PCIe 375 3617 01 DP Optical IOGE NIC Optional Recommended Front end 7 PCIe 375 3609 02 DP SAS 2 HBA Base Configuration 8 PCIe 375 3609 02 DP SAS 2 HBA Base Configuration 9 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup Attached Storage The 7420 and 7720 do not contain primary storage within their chassis and therefore connect to external storage shelves and cages The sections below outline the differences between these two controllers and their attached storage Chapter2 Hardware
39. Boards The storage controller chassis has the following boards installed Field replaceable units FRUs should only be replaced by trained Sun service technicians Chapter 2 Hardware Maintenance 33 7320 34 PCIe Risers The storage controller contains three PCIe risers that are customer replaceable units CRUs and are attached to the rear of the motherboard Each riser supports one PCIe card Motherboard The motherboard is a FRU and includes CPU modules slots for 18 DIMMs memory control subsystems and the service processor SP subsystem The SP subsystem controls the host power and monitors host system events power and environmental The SP controller draws power from the host s 3 3V standby supply rail which is available whenever the system is receiving AC input power even when the system is turned off Power Distribution Board The power distribution board is a FRU and distributes main 12V power from the power supplies to the rest ofthe storage controller It is directly connected to the paddle board and to the motherboard through a bus bar and ribbon cable Italso supports a top cover interlock Kill switch Paddle board The paddle board is a FRU and serves as the interconnect between the power distribution board and the fan power boards hard drive backplane and I O board Fan Board This board is FRUs and carries power to the storage controller fan modules In addition they contain fan module status LEDs and t
40. Ds Note Disk slots 30 and 31 are reserved exclusively for SSDs Do not put an HDD in slot 30 or 31 SunDisk Shelf Overview The Sun Disk Shelf SAS 2 is a high availability serial attached SCSI SAS device in a 4U 24 disk chassis Refer to Disk Shelf Tasks for procedural information about replacing disk shelf components The main components are hot swappable including the SAS Interface Module SIM boards and drives and the dual load sharing power supplies and fans This provides a fault tolerant environment with no single point of failure System faults are indicated by an amber colored light on the front panel Following is the list of replaceable components of the Sun Disk Shelf SAS 2 The SAS 2 Serial Attached SCSI 2 0 storage fabric supports greater number oftargets greater bandwidth higher reliability and bigger scale The scale and reliability improvements are achieved with 2 TB SAS disks you can daisy chain to a total of 12 shelves 288 total disks In addition the new high performance SAS 2 HBA is designed for the Sun Storage 7000 series with a standard chip set to support a high density of target devices capable of attachment to 1024 targets Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 SAS2 With this new fabric you are encouraged to apply entire shelves to pools so you can get the benefits of No Single Point of Failure NSPF configurations and striping across the maximum possible numb
41. P FC HBA Optional FC Target or Initiator Backup 7720 Cluster Controller Configurations The following table shows the configuration options for the clustered 7720 controllers All PCIe cards are low profile and are fitted with low profile mounting brackets Mktg Part Number Description Mfg Part Number N A ASSY S7720 Cluster 4x8C 128GB 597 0865 01 N A ASSY S7720 Cluster 4x8C 256GB 597 0880 01 N A ASSY S7720 Cluster 4x8C 512GB 597 0881 01 NICHBA Options The following table describes NIC HBA options for the 7720 Mktg Part Number Description Mfg Part Number X4237A 2 port 4X IB HCA PCIe 594 5862 02 SG XPCIE2FC QF8 Z 2 port FC HBA 8Gb PCle 594 5684 01 X4446A Z 4 port PCIe Quad GigE UTP 594 4024 01 X1109A Z 2 port 10Gig SFP NIC PCle 594 6039 01 SDD Options The following table describes the SSD options for 7720 cluster configurations Mktg Part Number Description Mfg Part Number XTA7000 READZ512 7000 Readzilla Cache 512GB 594 6713 01 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7420 7720 PCle Options The following table describes the 7720 clustered PCIe configuration options Sun Part Slot Type Number Description Note 0 PCIe 371 4325 01 8Gb DP FC HBA Optional FC Target or Initiator Backup 1 PCIe 375 3609 02 DP SAS 2 HBA Base Configuration 2 PCIe 375 3609 02 DP SAS 2 HBA Additional Optional
42. Sun ZFS Storage 7x20 Appliance Customer Service Manual X 4 SUN So Copyright 2010 Oracle and or its affiliates All rights reserved This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws Except as expressly permitted in your license agreement or allowed by law you may not use copy reproduce translate broadcast modify license transmit distribute exhibit perform publish or display any part in any form or by any means Reverse engineering disassembly or decompilation of this software unless required by law for interoperability is prohibited The information contained herein is subject to change without notice and is not warranted to be error free If you find any errors please report them to us in writing If this is software or related software documentation that is delivered to the U S Government or anyone licensing it on behalf of the U S Government the following notice is applicable U S GOVERNMENT RIGHTS Programs software databases and related documentation and technical data delivered to U S Government customers are commercial computer software or commercial technical data pursuant to the applicable Federal Acquisition Regulation and agency specific supplemental regulations As such the use duplication disclosure modification and adaptation shall be subject to the restrictions and lice
43. TE MANUFACTURER MODEL chassis 000 08390CJ01A ok Sun Microsystems Inc Sun Storage 7410 cpu 000 CPU 0 ok AMD Quad Core AMD Op cpu 001 CPU 1 ok AMD Quad Core AMD Op cpu 002 CPU 2 ok AMD Quad Core AMD Op cpu 003 CPU 3 ok AMD Quad Core AMD Op disk 000 HDD 0 ok STEC MACH8 IOPS disk 001 HDD 1 ok STEC MACH8 IOPS disk 002 HDD 2 absent disk 003 HDD 3 absent Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Hardware disk 004 HDD 4 disk 005 HDD 5 disk 006 HDD 6 disk 007 HDD 7 fan 000 FT 0 fan 001 FT 0 FM 0 fan 002 FT 0 FM 1 fan 003 FT 0 FM 2 fan 004 FT 1 fan 005 FT 1 FM 0 fan 006 FT 1 FM 1 fan 007 FT 1 FM 2 memory 000 DIMM 0 0 DIMM 0 1 memory 001 absent absent ok ok ok HITACHI HITACHI unknown Sun Microsystems Sun Microsystems Sun Microsystems unknown Sun Microsystems Sun Microsystems Sun Microsystems HYNIX HYNIX Inc Inc Inc Inc Inc Inc HTE5450SASUN500G HTE5450SASUN500G ASY FAN BOARD H2 541 2068 541 2068 541 2068 ASY FAN BOARD H2 541 2068 541 2068 541 2068 4096MB DDR II 66 4096MB DDR II 66 A 5th column for serial number SERIAL has been truncated in the above example as has the length of this list Component Properties Ifa particular component is selected detailed information about its properties are reported The following properties are supported with the corresponding BUI property name For a description ofa particular prope
44. V 1 8 CLUSTERED V 1 CLUSTERED V 1 It is not advisable to make configuration changes to either storage controller while an upgrade is in progress Most notably while controllers are running different software versions configuration changes made to one controller will not be propagated to its peer controller For instance suppose a change is made to controller A at step 4 above That change will not be propagated to controller B until step 7 when both controllers are again running the same software version Alternatively if validation of controller A during step 6 uncovered a problem that necessitated controller A be rolled back to version V then the changes made at step 4 would be also be undone as part ofthe rollback Accordingly accessing the BUI or logging into the CLI while controllers are running different software versions will display a warning that configuration changes will not be propagated Similarly the appliance can be configured to generate alerts when a cluster is comprised of controllers running different software versions events Cluster rejoin mismatch and Cluster rejoin mismatch on peer Updating via the BUI Click the add icon next to Available Updates and specify the pathname on your desktop or local client of the update media During the upload a progress bar is displayed indicating the progress ofthe upload Chapter3 System Maintenance 129 Updates 130 I Note that on some older browsers the
45. XTC InfiniBand HCA Optional Recommended Front end 1 PCIe 375 3481 01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front end 1 PCIe 371 4325 01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator Backup 3 PCle 375 3665 01 Sun Thebe INT Internal SAS HBA Base Configuration 4 PCIe 375 3481 01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front end 4 PCIe 371 4325 01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator Backup 4 PCle 375 3609 03 Sun Thebe EXT 8P 6Gb s SAS HBA Additional Optional Back end Attached Storage The 7120 standalone configurations allow a single chain of 1 or 2 Sun Disk Shelves These shelves support up to four write optimized SSDs Any combination of HDD only and Logzilla capable shelves may be combined within the chain in any order Half populated shelf configurations are not supported Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7320 7320 7320 Hardware Overview Use the information in this section as a preparation and reference for servicing replaceable components of the 7320 system Refer to the following for procedural instructions Controller Tasks replace storage controller components Disk Shelf Tasks replace disk shelf components Chassis Overview The Sun ZFS Storage 7320 System consists of either a single storage controller or two storage controllers in a high availability cluster configuration and one to four Sun Disk Shelves The 7320 cont
46. ails latch 5 7120 or 7320 To replace the fan module Open the fan module door while unlatching the release tabs on the door Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the 3 locate icon on Maintenance gt Hardware screen of the BUI for the fan you want to replace Chapter 2 Hardware Maintenance 65 7x20 66 Using thumb and forefinger pull the fan module up and out Install the replacement fan module into the storage controller fan slot Note The fan must be replaced within one minute to avoid controller shutdown EN Apply firm pressure to fully seat the fan module Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim Close the top cover door immediately after replacing the fan to maintain airflow in the storage controller 7720 To replace the fan module Shut down the appliance using one ofthe following methods Log in to the BUI and click the power icon on the left side of the masthead SSH into the appliance and issue the maintenance system poweroff command SSH or serial console into the service processor SP and issue the stop SYS command Use a pen or nonconducting pointed object to press and release the Power button on the front panel Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 To initiate emergency shutdown during
47. ains lit 16 Connect data cables to the PCIe card routing them through the cable management arm 17 When the system has finished booting log in and set the time using the steps in the BUI Clock task included in the System Administration Guide at http wikis sun com display fishworks documentation http wikis sun com display fishworks documentation Cabinet Replacement Tasks The 7700 cabinet contains two 7720 controllers that are similar to the 7420 controller For tasks involving these controllers see Controller Tasks Chapter 2 Hardware Maintenance 85 7x20 86 7x20 Cabinet Replacement Tasks HDD or SSD The installation for an hard disk drive HDD or a solid state drive SSD is the same However SSDs are restricted to certain slots in the disk cage and HDDs cannot be added to the 7720 controller Note SSDs are restricted to slots 30 and 31 in each of the 12 drive cages Slot 30 must be populated before slot 31 To install a complete 7700 storage expansion kit see Installing a 7700 Drive LCC Expansion Kit l Identify the failed HDD or SSD by going to the Maintenance Hardware section of the BUI and clicking the drive details icon If you are physically at the system the amber Service Required indicator on the HDD or SSD should be illuminated 2 Ifyouare not physically at the system turn on the locator indicator by clicking the locator icon 3 Pushtherelease button on the HDD or SSD to
48. anel To initiate emergency shutdown wherein all applications and files will be closed abruptly without saving press and hold the power button for at least four seconds until the Power OK status indicator on the front panel flashes indicating that the storage controller is in standby power mode 1 Disconnect the AC power cords from the rear panel of the storage controller 2 Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack 3 From the front of the storage controller release the two slide release latches 4 While squeezing the slide release latches slowly pull the storage controller forward until the slide rails latch 5 7120 or 7320 To remove the top cover Unlatch the fan module door pull the two release tabs back rotate the fan door to the open position and hold it there Press the top cover release button and slide the top cover to the rear about a half inch 1 3 cm Lift up and remove the top cover 6 7420 or 7720 To remove the top cover Chapter 2 Hardware Maintenance 77 7x20 Simultaneously lift both cover latches in an upward motion Lift up and remove the top cover 7 Locate the PCIe card position in the storage controller see Single and Cluster Controller Configurations for the 7320 the 7120 Overview or 7420 7720 Overview 8 7120 or 7320 To replace the PCIe card Disconnect any data cables connected to the cards on the
49. ata rate read optimized flash SSD for the L2ARC replicating shares to another appliance reverts all of the system software and all of the metadata settings of the system back to their state just prior to applying an update Serial Attached SCSI Serial Attached SCSI 2 0 Serial ATA configurable properties for shares automating CLI tasks appliance service software ZFS filesystem shared using data protocols SAS Interface Module an image of a share Solid State Drive Secure Shell a metric visible from Analytics the head node of the appliance auto generated files containing system configuration information and core files for use by remote support in debugging system failures local navigation and function section of BUI screen software or firmware updates Web based Distributed Authoring and Versioning on disk data storage subsystem 147 148 Index Numbers and Symbols 7120 24 25 26 28 30 31 32 61 77 7320 33 34 36 37 38 39 40 41 42 7720 61 64 85 86 F FRU 33 H Hardware Locating a failed component 20 N NIC 50 52 P PCle 49 50 51 52 53 R Readzilla 44 S Shelf Replacinga Drive 101 102 Replacing a Power Supply 102 104 Replacing a SIM Board 104 106 SIM 94 95 98 104 SSD 86 93 149 150
50. ber LED on the rear panel see the Shelf Rear Panel illustration Go to the Maintenance gt Hardware screen of the BUI Double click the shelf and then click PSU to view details or to turn on the locator LED Locate the chassis and failed power supply Ensure the power supply on off switch is in the O off position Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Shelf Disconnect the power cord tie strap from the power cord and unplug the power cord from the power supply Using your thumb and forefinger unscrew both ejection are captive screws until loose and swing the ejection arms out until they are fully open Pull the power supply out of the chassis being careful not to damage the circuit board connector extending from the back of the power supply Chapter2 Hardware Maintenance 103 Shelf 6 10 11 104 With the ejection arms fully open slide the new power supply into the chassis slot until it contacts the chassis backplane and the ejection arms begin to swing closed Push the ejection arms closed fully and secure both captive screws to seat and secure the power supply in the chassis Ensure the power supply on off switch is in the O off position Plug the power cord into the new power supply and attach the power cord tie strap to the power cord Place the power supply on off switch to the I on position The Power status LED should bea steady green and the Power sta
51. bsent using the Maintenance Hardware screen of the BUI If so contact your service provider to have the RCC replaced prior to replacing the LCC Installing an LCC into a slot corresponding to a missing or faulty RCC will not improve connectivity or performance and will result in all LEDs in the affected drive set cage being illuminated until the condition is corrected 2 Identify the faulted LCC by locating the corresponding Fault status indicator or by clicking the icon on Maintenance gt Hardware screen of the BUI for the LCC you want to replace 3 Squeeze the plastic handles and rotate the handles out to unlock the LCC e eg Zi Se Ws S HE A REN M SSI J RR SM Ip AS O IRNS Eps dues HET AA SHEE ES it HE X i K p S H s REN E ax H TELL fy M TK F ACA ACC ONR 3 V4 w amum f IIH mews 7 TL s wu 2 4 Pullthe LCC out ofthe drive cage Chapter2 Hardware Maintenance 89 7x20 5 Remove the replacement LCC from the packaging and pull the two locking handles out 6 Rotate the locking handles in to lock the LCC in place 7 Verify that the LCC OK status indicator islit and that the LCC Fault status indicator on the replaced component is dim Power Supply Storage controllers are equipped with redundant hot swappable power supplies If a power supply fails and you do not have a replacement leave the failed power supply ins
52. ce 45 7420 7720 Components The components of the storage controller are shown in the following figure and identified in the table Figure Legend 1 Motherboard 8 System lithium battery 2 Low profile PCIe cards 9 CPUs and heatsinks 3 Power supplies 10 Memory Risers 4 Power supply backplane 11 Fan board 5 Filler 12 Fan Modules 7 Drive backplane 14 Boot drives and SSDs CPU and Memory The 7420 appliance supports two or four CPUs with two memory risers required by each CPU Four or eight 4GB or 8GB DDR3 DIMMs are installed on each riser accommodating up to 256GB of memory for two CPUs or up to 512GB for four CPUs Empty CPU sockets must have 46 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7420 7720 memory riser fillers installed for proper cooling Note The 7720 supports four CPU configurations only and the four CPU system requires high line 200 to 240 Volt AC sources to turn on main power M a MI M n Refer to the service label on the cover for DIMM placement information On every memory riser slots DO D2 D4 and D6 must be populated optionally slots D1 D3 D5 and D7 may be populated as a group on all installed memory risers All DIMMs in the system must be identical Chapter 2 Hardware Maintenance 47 7420 7720 48 D4 D5 lU t B D6 Jis 2 DE 4 MBO 4 CS Ds 2 ms D2 S cmm D1 a DO MB1
53. cheduled downtime The restore process takes several minutes to complete and will impact service to clients as the active networking configuration and data protocols are reconfigured Therefore a configuration restore should only be used on a development system or during a scheduled downtime Service interruption Clients accessing data on the system through a data protocol such as NFS will see service interrupted as the network is reconfigured and the NFS service restarted If the selected backup copy was taken when a service was disabled by the administrator that setting will be restored and therefore client sessions will be terminated for that protocol Session interruption If restore is initiated from a web browser that web browser session will also be disconnected during the restore process as the network is reconfigured If the restored configuration does not include the same routing and network address settings used by the current browser connection or if the browser is connected to a network address managed by DHCP the browser session will be interrupted during the restore The restore process will complete in the background but you will need to reload or point the browser ata new restored network address to continue For this reason it may be desirable to initiate a complex configuration restore from the service processor serial console using the CLI Un cluster restore and re cluster Configuration backups may be initiated f
54. ciel ou la documentation qui l accompagne est conc d sous licence au Gouvernement des Etats Unis ou toute entit qui d livre la licence de ce logiciel ou l utilise pour le compte du Gouvernement des Etats Unis la notice suivante s applique U S GOVERNMENT RIGHTS Programs software databases and related documentation and technical data delivered to U S Government customers are commercial computer software or commercial technical data pursuant to the applicable Federal Acquisition Regulation and agency specific supplemental regulations As such the use duplication disclosure modification and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract and to the extent applicable by the terms ofthe Government contract the additional rights set forth in FAR 52 227 19 Commercial Computer Software License December 2007 Oracle America Inc 500 Oracle Parkway Redwood City CA 94065 Celogiciel ou mat riel a t d velopp pour un usage g n ral dans le cadre d applications de gestion des informations Ce logiciel ou mat riel n est pas concu ni n est destin tre utilis dans des applications risque notamment dans des applications pouvant causer des dommages corporels Si vous utilisez ce logiciel ou mat riel dans le cadre d applications dangereuses il est de votre responsabilit de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesu
55. cluster has two or more storage pools and each controller is assigned at least one of them then decide at this time which controller will be designated A and which will be designated B The choice is arbitrary but A s storage pool s will be taken over first so clients using those resource will experience a standard takeover induced availability delay first 3 Login to controller B go to Configuration Cluster or the CLI equivalent and perform a takeover which will cause controller A to reboot The software will not prevent you from beginning the upgrade without taking over However if you do not perform the takeover during the upgrade you will be unable to make any changes to the appliance s configuration even though that appliance will continue to provide service and you will be performing an upgrade on a controller while it is providing service 4 Using the serial console or the CLI or BUI if you have dedicated private network interfaces assigned log in to controller A Go to Maintenance System or the CLI equivalent select the software update and apply it At the end ofthe upgrade procedure controller A will reboot again this time running the new system software 5 Log into controller A and perform a takeover as above This will cause controller B to reboot and controller A to take control of all resources and provide service to clients 6 Validate the behavior ofthe new software and ensure that firmware upgrades complete Since
56. controller A is now providing service using the new software while B remains on the previous version this provides an opportunity to ensure that all services are working correctly as seen on client systems If a serious problem is encountered roll back the software on controller A which will cause it to reboot controller B still running previous software will take over and when controller A recovers it will be running the previous version as well Important Allow all firmware upgrades to complete before proceeding to the next step Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Updates 7 Login to controller B Go to Maintenance System or the CLI equivalent select the desired update and apply it At the end of the procedure storage controller B will reboot again Controller B will boot up and be running the new system software 8 Theupgrade procedure is now complete To restore normal operation log in to storage controller A go to Configuration Cluster and execute a failback operation returning the resources to their respective assigned controllers The following table describes the state of the cluster at the end of each of the steps above during an update from version V to version V 1 Step ControllerAState Controller AVersion ControllerBState Controller B Version 1 2 CLUSTERED V CLUSTERED V 3 STRIPPED V OWNER V 4 STRIPPED V 1 OWNER V 5 6 OWNER V 1 STRIPPED V 7 OWNER V 1 STRIPPED
57. cords user activity events including login and logout to the BUI and CLI and administrative actions If session annotations are used see Users each audit entry should be noted with a reason The following are example audit log entries as they would appear in the BUI Time User Host Summary Session Annotation 2009 10 12 05 20 24 root deimos Disabled ftp service 2009 10 12 03 17 05 root deimos User logged in 2009 10 11 22 38 56 root deimos Browser session timed out 2009 10 11 21 13 35 root lt console gt Enabled ftp service Phone Home If Phone Home is used this log will show communication events with Sun support The following are example phone home entry as it would appear in the BUI Time Description Result 2009 10 12 Uploaded file cores ak 45e5ddd1 ce92 c16e b5eb 9cb2a8091f1c tar gz to Sun OK 05 24 09 support BUI Use the Maintenance gt Logs screen to navigate logs using list controls and switch between logs using the local navigation buttons CLI Logs can be viewed under the maintenance logs section of the CLI Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Logs Listing logs Use the show command to list available logs and the timestamp of the last log entry caji gt maintenance logs caji maintenance logs gt show Logs LOG ENTRIES LAST alert 2 2009 10 16 02 44 04 audit 42 2009 10 16 18 19 53 fltlog 2 2009 10 16 02 44 04 scrk 0 syste
58. ct 9a4c3d7b 50c5 6eb9 c2a6 ec9808aelcd8 loader maintenance system bundles 9a4c3d7b 50c5 6eb9 c2a6 ec9808aelcd8 list Properties filename cores ak 9a4c3d7b 50c5 6eb9 c2a6 ec9808aelcd8 tar gz status uploading step progress 14 709744730821669 These read only properties indicate that the appliance is 14 of the way through uploading the file To retry a failed upload or cancel a pending operation enter the retry and cancel commandis respectively Initial Setup Initial setup will step through the tasks performed as part ofthe initial configuration This will not change any ofthe current settings unless explicitly requested User data on the storage pool including projects and shares will not be affected To perform an initial setup m BUTI click the INITIAL SETUP button on the Maintenance gt System screen CLI enter the maintenance system context then enter the setup command Chapter3 System Maintenance 121 Updates Updates 122 Factory Reset Factory reset will reset the appliance configuration back to factory settings of the current software version and reboot the appliance All configuration changes will be lost and the appliance will need to go through initial configuration again as when it was first installed User data on the storage pool including projects and shares will not be affected however the pool will need to be imported as part of the initial setup process To perform a factory reset
59. e Connectors Two C13 connectors which work on 110 220v outlets Input Nominal frequencies 50 60Hz Nominal voltage range 100 120 200 240 VAC Maximum current AC RMS 9 0 amps Max AC operating range 90 264 VAC Output 3 3 VDC STBY 3 6A m 12 VDC 62 3A Chapter 2 Hardware Maintenance 37 7320 38 Power dissipation Max power consumption 873 W m Max heat output 2977 BTU hr Volt Ampere rating 891 VA 240 VAC 0 98P F 7320 Front Panel The following graphic illustrates the front panel LEDs The table describes the LEDs Figure Legend 1 Locate Button LED 2 Service Required LED amber 3 Power OK LED green 4 Power Button 5 Rear Power Supply 6 System Overtemperature LED 7 Top Fan The following graphic illustrates the 7320 front panel with drive locations described in the table Two mirrored hard disk drives HDDs that store the operating system reside in slots 0 and 1 Up to four solid state drives ReadZilla SSDs that store the read cache fill slots 2 through 5 in order Slots 6 and 7 are empty and must contain drive fillers Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7320 Disk Drive Locations HDDI HDD3 HDD5 HDDO HDD2 HDD4 HDD6 HDD7 7320 Replaceable Components Following is the complete list of replaceable power distribution disk and fan module components of the 7320 system N
60. e PCIe card slot Install the retaining screw to hold the PCIe card to the chassis Return the crossbar to its closed and locked position 80 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 10 7120 or 7320 Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 To install the top cover Place the top cover on the chassis so that it hangs over the rear ofthe storage controller by aboutan inch 2 5 cm then slide the top cover forward until it seats Close the fan cover and engage the fan cover latches The cover must be completely closed for the storage controller to power on 11 7420 or 7720 To install the top cover Place the top cover on the chassis 1 so that it is forward ofthe rear ofthe storage controller by about an inch 2 5 cm Slide the top cover toward the rear of the chassis 2 until it seats Press down on the cover with both hands until both latches engage 12 Push the release tabs on the side of each rail and slowly push the storage controller into the rack making sure no cables obstruct the path of the controller Chapter2 Hardware Maintenance 81 7x20 82 13 Connect the power cords to the power supplies 14 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in
61. e and partially eject the SIM from the chassis 6 Grasp the middle of the SIM board and slide it out of the slot Chapter2 Hardware Maintenance 105 Faults 7 10 11 Faults 106 With the ejector arms in the full open position align the new SIM board with the open slot and slide itinto the tray until the ejector arms contact the tray connectors and begin to swing closed Swing both ejector arms in until they are flush with the SIM board panel to seat the board Tighten both captive screws to secure the board Reconnect the SAS interface cables to their original locations Wait approximately 60 seconds for the SIM board to complete its boot process at which time the Power LED should be solid green and the SIM locate LED should be off Hardware Faults This section describes connecting to the controller Service Processor SP and configuration considerations for maximum serviceability In rare cases faults associated with uncorrectable CPU errors are not diagnosable or displayed in the controller These faults will be preserved by and observable on the ILOM The following sections describe how to connect to and manage faults for these cases Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Faults Connect to ILOM Connect to the server ILOM Service Processor on the server platform to diagnose hardware faults that do not appear in the BUI In a cluster environment an ILOM connec
62. ection outlines how various Configuration Backup tasks can be accomplished using the CLI in the maintenance system configs context Listing Configurations host maintenance system configs list CONFIG DATE SYSTEM VERSION bfa614d7 1db5 655b cba5 bd bb alefc4 2009 8 5 17 14 28 host 2009 08 04 1 0 cb2f005f cf2b 608f 90db fc7a0503db2a 2009 8 24 17 56 53 host 2009 08 18 1 0 Create a Configuration Backup The backup command saves a configuration backup You will be prompted to enter a descriptive comment for the backup and then enter done to execute the backup operation Chapter3 System Maintenance 137 ConfigurationBackup 138 host maintenance system configs gt backup Backup Configuration Enter a descriptive comment for this configuration and click Commit to backup current appliance settings host maintenance system configs conf backup stepQ gt set comment pre upgrade comment pre upgrade host maintenance system configs conf backup step0 done host maintenance system configs Restore from a Saved Configuration The restore command reverts the system to a saved configuration You will be prompted to enter the universal unique identifier for the backup see the output of List above and then enter done to execute the restore Review the Restore Impact guidance above and confirm that itis okto proceed host maintenance system configs restore Restore Select the configuration to restore host maintenance system con
63. endent from that of the 7700 cabinet but the same guidelines apply when replacing fans in a controller HEUTE a nin mim Hs Ce Canne umm NECTED RESET 58 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7700 Drive Cages The 7700 appliance cabinet hosts 12 drive cages 6 on each side Each cage hosts 30 HDDs 2 nam gnum vers Hinni hm d mmam wu mann mm SSDs and 2 LCCs Drives can be hot swapped Leaf Controller Cards The leaf controller cards LCCs are the final SAS fan out to the HDDs that are the leaves in the SAS topology Each drive cage has 2 LCCs that are load balanced In the event of a fault one LCC provides connectivity to the HDDs The LCCs can be hot swapped without shutting down the appliance If both an LCC and RCC see below are being replaced at the same time replace the RCC first Power Supplies Each 7700 cabinet comes with 6 power supplies near the bottom ofthe cabinet The power supplies can be hot swapped while the system is running The system controllers also have Chapter2 Hardware Maintenance 59 7700 power supplies See the 7x20 Overview for more information el el el el el ei a arma pL rr A ek n dirum Root Controller Cards The 7700 appliance contains two RCCs that are located between the storage controllers and the drive cages In the event of an RCC failure one RCC can provide connectivity to both system controllers and the drive cag
64. er Place the top cover on the chassis so that it hangs over the rear ofthe storage controller by about an inch 2 5 cm Slide the top cover forward until it seats Close the fan cover and engage the fan cover latches The cover must be completely closed o for the storage controller to power on 13 7420 or 7720 To replace the cover 74 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch 2 5 cm Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage Chapter 2 Hardware Maintenance 75 7x20 14 Push the release tabs on the side ofeach rail and slowly push the storage controller into the D rack The following image shows the 7420 7720 chassis 15 Connect the power cords to the power supplies 16 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 17 Usea pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Po
65. er and environmental The SP controller draws power from the host s 3 3V standby supply rail which is available whenever the system is receiving AC input power even when the system is turned off Power Distribution Board The power distribution board is a FRU and distributes main 12V power from the power supplies to the rest ofthe system It is directly connected to the Vertical PDB card and to the motherboard through a bus bar and ribbon cable It also supports a top cover interlock kill switch In the storage controller the power supplies connect to the power supply backplane which connects to the power distribution board Vertical PDB Card The vertical power distribution board or Paddle Card is a FRU and serves as the interconnect between the power distribution board and the fan power boards hard drive backplane and I O board Power Supply Backplane Card This board connects the power distribution board to power supplies 0 and 1 Fan Power Boards The two fan power boards are FRUs and carry power to the storage controller fan modules In addition they contain fan module status LEDs and transfer I2C data for the fan modules Drive Backplane The six drive backplane is a FRU and includes the connectors for the drives as well as the interconnect for the I O board Power and Locator buttons and system component status LEDs Each drive has an LED indicator for Power Activity Fault and Locate Chapter 2 Hardware Maintenan
66. er of devices Part Number Description FRU CRU F542 0194 01 SAS Interface Module SIM Assembly CRU F300 2276 01 764W AC Input Power Supply and Fan Assembly CRU F540 7980 01 Z box with Backplane J4410 4U chassis FRU F542 0274 01 2TB 7 2K SAS HDD Assembly CRU F542 0286 01 SAS 100GB SSD Logzilla CRU SAS2 Sun Disk Shelf Overview Power Supply Exterior Power supplies and fans SIMs and disks are hot pluggable on the storage shelf The following figure shows the exterior of the power supply Power supply 0 is on the left and power supply 1 is on the right Chapter2 Hardware Maintenance 95 SAS2 96 Figure Legend 1 Cooling fan status indicator 5 Power on off switch 2 AC power status indicator 6 Power cord tie wrap 3 DC power status indicator 7 Universal power input connector 4 Power supply status indicator 8 Right ejection arm and captive screw latch Drive Locations The following table shows the shelf drive locations Drive Locations SSD20 SSD21 SSD22 SSD23 HDD16 HDD17 HDD18 HDD19 HDD12 HDD13 HDD14 HDD15 HDD8 HDD9 HDD10 HDD11 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 SAS2 Drive Locations HDD4 HDD5 HDD6 HDD7 HDD0 HDDI HDD2 HDD3 The following figure shows the Sun Disk Shelf front panel Figure Legend 1 Locate button and indicator 4 Disk ready to be removed inidicator 7 Over temperatu
67. es The RCCs are the primary interface to the storage controllers and the root ofthe SAS topology The RCCs are hot swappable but they must be replaced by a Sun service technician If both an RCC and one or more LCCs are being replaced at the same kac HHH l bari iHi mmn nnan HHH tHE uu or PS wn pan vu w LE LA time replace the RCC first Solid State Drives All ofthe drive cages and both system controllers use SSDs as part of the hybrid storage pool seamlessly adding flash into the storage hierarchy for performance Slots 30 and 31 if populated are dedicated to write optimised SSDs Zero to 2 SSDs may optionally be present in each cage Populate all of the drive cages containing LCCs with one SSD in slot 30 before adding a second SSD to any ofthe cages The minimum SSD configuration is four SSDs per base cabinet Refer to 7420 7720 CPU and Memory components for other storage controller component guidelines Internal Components The following sections contain descriptions of the internal components in the Sun ZFS Storage 7700 appliance Note All internal components must be serviced by a Sun Service technician 60 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 7x20 Cabling The internal cables deliver power to the components and plumb the necessary SAS and Ethernet connections between the backplanes storage controllers and RCCs All cabling connections are show
68. es will enable new software features as described below but will prevent older versions of the software from accessing the underlying resources You should apply deferred updates once you have verified that the current software update is functioning and a rollback is not required Applying deferred updates in a cluster will also update any resources on the cluster peer 1 Support for the passthrough x aclinherit property for shares clownfish maintenance system updates gt apply Applying deferred updates will prevent rolling back to previous versions of software Are you sure Y N clownfish maintenance system updates gt apply Chapter 3 System Maintenance 133 ConfigurationBackup ConfigurationBackup 134 Configuration Backup The configuration backup function enables the administrator to Backup the appliance configuration consisting of system metadata only such as the network configuration local users and roles service settings and other appliance metadata Restore a previously saved configuration from a backup Export a saved configuration as a plain file so that it may be stored on an external server or included in a backup of a share on the appliance itself Import a saved configuration that was previously exported from this system or another system making it available for a restore operation Backup Contents A configuration backup does include Metadata associated with the system as a whole suc
69. et and Sun Storage Readzilla 512GB solid state drives SSDs may optionally fill in order slots 2 through 5 Each storage controller may have 0 2 3 or 4 Readzilla devices Figure Legend 1 Locate white 2 Service action required amber 3 OK Activity green Rear Panel The following graphic shows the 7420 7720 rear panel 43 12 11 10 nas A TS DA Figure Legend 1 Power supply unit 0 status LEDs OK green Power Supply Fail amber AC OK green 8 Network NET 10 100 1000 ports NETO NET3 44 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7420 7720 Figure Legend 2 Power supply unit 0 AC inlet 3 Power supply unit 1 status LEDs OK green Power Supply Fail amber AC OK green 10 PCIe slots 5 9 4 Power supply unit 1 AC inlet 11 Network management NET MGT port 5 System status LEDs Power green Attention amber Locate white 12 Serial management SER MGT port 6 PCIe slots 0 4 13 DB 15 video connector 7 Cluster card slot Internal Boards 7420 7720 storage controller chassis have the following boards installed Field replaceable units FRUs should only be replaced by trained Sun service technicians Motherboard The motherboard is a FRU and includes CPU modules slots for eight DIMM risers memory control subsystems and the service processor SP subsystem The SP subsystem controls the host power and monitors host system events pow
70. f the BUI and clicking the drive details icon If you are physically at the system the amber Service Required indicator on the HDD or SSD should be illuminated 2 Ifyouare not physically at the system turn on the locator indicator by clicking the locator icon 3 Pushthe release button on the HDD or SSD to open the latch 4 Grasp the latch 2 and pull the drive out of the drive slot 5 After 15 seconds navigate to the Hardware Maintenance screen and click the details icon on the system controller to verify that the software has detected that the drive is not present Chapter2 Hardware Maintenance 63 7x20 6 Slide the replacement drive into the slot until it is fully seated 7 Close the latch to lock the drive in place The Sun ZFS Storage system software automatically detects and configures the new drive The device appears in the BUI Maintenance Hardware screen when you view details for the controller drive shelf or cage Fan Module Fan modules are hot swappable unless the controller is part of a 7700 cabinet and can be removed and installed while the storage controller is running without affecting other hardware capabilities To replace storage controller fan modules in a 7720 you must first shutdown and remove power to the cabinet Each fan module contains status indicators that are visible when you open the fan tray access door An amber colored LED status indicator indicates
71. figs conf restore step0 set uuid 36756f96 b204 4911 8ed5 fefaf89cad6a uuid 36756f96 b204 4911 8ed5 fefaf89cad6a host maintenance system configs conf restore step0 done Delete a Saved Configuration Then the destroy command deletes a saved configuration host maintenance system configs gt destroy cb2f005f cf2b 608f 90db fc7a0503db2a Are you sure you want to delete the saved configuration new y host maintenance system configs Export a Saved Configuration The export command exports a saved configuration by means of executing an HTTP or FTP PUT operation against a remote HTTP or FTP server You can also use the export function to export the file to a share on the appliance itself that has the HTTP or FTP protocol enabled for writing You can enter a username and password for authentication to the remote server if one is required Import a Saved Configuration The import command imports a saved configuration by means of executing an HTTP or FTP GET operation against a remote HTTP or FTP server You can also use the import function to import a configuration stored in a share on the appliance itself that has the HTTP or FTP protocol enabled for reading You can enter a username and password for authentication to the remote server if one is required Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Problems Problems Problems To aid serviceability the appliance detects persistent hardware failure
72. following figure and described in the table Figure Legend 1Top Cover 3 Hard Disk Drives 2 Right Control Panel Light Pipe Assembly 4 Left Control Panel Light Pipe Assembly 28 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7120 Cables The storage controller s internal cables are shown in the following figure and table Note that the rear boot drives are not depicted in this illustration Cable Connection 1 Storage Drive Data Cable Connection between the HBA PCI Express Card and the storage drive backplane Chapter2 Hardware Maintenance 29 7120 Cable Connection 2 Ribbon cable Connection is between the power distribution board and the motherboard CPU and Memory The 7120 motherboard has 18 slots in two groups that hold industry standard DDR3 DIMMs The 7120 CPU and memory should only be replaced by field service professionals All sockets must be occupied by either a filler or a DDR3 DIMM All DDR3 DIMMs must be identical DIMMs are pre installed in PO slots D1 D2 D4 D5 D7 and D8 D6 07 D D5 D4 03 D2 D1 Do Do D1 D2 03 D4 D5 De D7 DB Power Distribution Fan Module and Disk Components The fan modules and LEDs are shown in the following illustration 30 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7120 The power distribution and associated components are shown in the following illustration and described in the table
73. ftware media is uploaded to the appliance This can be done via either the BUI or the CLE see below for details of this operation Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Updates After the media is uploaded it will be unpacked and verified If all verification checks pass it will appear in the list of update images as eligible for installation Any number of images can be maintained on the appliance subject to a system disk space quota without actually applying them If an update has not yet been applied i e is not running and is not a rollback target it can be deleted via either the BUTor the CLI You might want to delete images in order to free up needed space to download new images Administrators should verify that the system is in a healthy state prior to applying the update The details are described below in the preconditions section After the media is unpacked and verified the update can be applied You may be asked to set update options and confirm For more information on these questions see the section on deferred updates If the update is no longer appropriate for the system because you have skipped past its version number an error message may be provided During the update messages and a progress meter will appear to indicate that the update is proceeding The installation portion ofthe update will take about half an hour to complete however the full upgrade process may not be complete
74. ge 7x20 Appliance Customer Service Manual November 2010 Contents Introduction M E 119 System Disks T 119 Support Bundles 6 de Ete did a ok Sa itas qute ern 120 Hal Setup attt ennemie nn Factory Reset Updates p System Updates are e t ee fees da ierat eet tried eie ca o cage eR an 122 ConhgurationBackup iuocnsi Peine divo ann Ed d Hera egenis ote 134 Configuration Backup oen aU ERROR ERRARE USOS IN RAE dU RO DUANE 134 Pro DICIS parne ped de A A erste de n ats Problems Active problems display ici ettet ite on eed e Di ee eene din 139 Repairing problems 2 ease eee te pee terti rcr Revier ie ee eee 140 Related features ite RU a E REOR AXIS EU HIER REATO alere 140 Preface The Sun ZFS Storage 7x20 Appliance Customer Service Manual contains hardware overviews and maintenance procedures for Oracle s Sun ZFS Storage 7x20 series of NAS appliances This documentation is also available while using the Browser User Interface accessible via the Help button The appliance documentation may be updated using the System Upgrade procedure documented in the System Maintenance chapter of this book Who Should Use This Book These notes are for users and system administrators who service and use the Sun ZFS Storage 7x20 Appliances Related Documentation Refer to the following documentation for installation instructions hardware over
75. h 436 8 mm 17 2in Weight 29 54 kg 65 Ib Front Panel The following figure shows the front panel and the table describes the drive locations G OOC 8 9 40 1 12 13 14 15 16 au mm mm mm aia i Figure Legend 1 Locator LED button 7HDD2 13HDD8 white 2 Service Action Required 8HDD3 14HDD9 LED amber 3 Power button 9HDD4 15HDD10 4 Power OK LED green 10 HDD5 16HDD11 5 HDD 0 11HDD6 17 Drive map 6HDD1 12 HDD 7 Chapter 2 Hardware Maintenance 25 7120 26 Rear Panel The following figure shows the rear panel Note that optional Sun Dual Port 40Gb sec 4x Infiniband QDR HCAdapter PCIe cards 375 3606 01 may be located in slots 1 2 or 3 Note that 375 3606 01 HCA expansion cards are not supported in the 10Gb network configurations Figure Legend 1 Power Supply Unit 1 6 PCle 4 11 Network Management port 2 Power Supply Unit 0 7 Boot HDD 1 12 Gbit Ethernet ports NET 0 1 2 3 3 PCIe 0 8 Boot HDD 0 13 USB 2 0 ports 0 1 4 PCIe3 9 Rear Panel System Status LEDs 14 HDI5 Video port 5 PCle1 10 Serial Management port The serial management connector SER MGT is an RJ 45 port and provides a terminal Emm ig a connection to the SP console The network management connector NET MGT is an RJ 45 port and provides an alternate CF terminal interface to the SP console Hai There are four RJ 45 Gigabit Ethernet ports NETO NET1 NET2 NET3 located o
76. h as settings for NTP NIS LDAP and other services Network device datalink and interface configuration User accounts roles and privileges preferences and encrypted passwords for local users not directory users Alerts and thresholds and their associated rules A configuration backup does not include User data shares and LUNs Your user data must be backed up separately using NDMP backup software snapshots and or remote replication User passwords for directory users These remain stored solely in your separate network directory service such as LDAP or Active Directory and will not be stored in the backup or restored Metadata directly associated with user data such as snapshot schedules user quotas compression settings and other attributes of shares and LUNs Analytics and logs Events can be redirected to external SNMP trap receivers or e mail destinations using Alerts rules System software The system software is automatically backed up as part ofthe System Update capability Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 ConfigurationBackup Restore Impact The restore operation takes a selected configuration backup and modifies all ofthe corresponding system settings to reflect those in the backup including removing aspects of the configuration that were not present at the time ofthe backup Administrators should adhere to the following guidelines when planning a restore S
77. help commands Available topics are displayed by tab completing the help command or by typing help topics You can combine these two principles as follows dory help tab builtins commands general help properties script Locating a disk Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Hardware Hardware View The Maintenance gt Hardware screen also known as the hardware view provides component status of the appliance and attached disk shelves This information is available from both the BUI and the CLI BUI The BUI hardware view provides interactive illustrations that enable you to browse through the appliance and attached disk shelf components The screenshot at the top ofthis page shows a disk highlighted in a Sun Storage 7110 showing both its physical location and details The buttons in the hardware view are icon description icon description Show a X Toggle blinking of the locator LED for this component more detailed view of this component Q Leavethis g Reboot the appliance detailed view e Click for Power offthe appliance more details Hardware Qo Offline disk component is ok green Hardware ME Portactive component is not present grey vy Hardware i Portinactive component is faulted amber Chapter 1 Introduction 13 Hardware 14 System Overview The main hardware page lists the system chassis a su
78. her diagnostic information from a failed controller WARNING Failure to configure locked management interfaces on a cluster may lead to longer than necessary fault diagnosis and resolution times Observing and Clearing CPU faults from ILOM Log in to the server as root using the ILOM CLI To view server faults type the following command to list all known faults on the system show SP faultmgmt The server lists all known faults for example SP faultmgmt Targets 0 SYS MB P0 Properties Chapter2 Hardware Maintenance 107 HBA Expansion pt 1 Commands cd show To clear the CPU fault type the following command gt set SYS MB Pn clear fault action true For example to clear a fault on CPO gt set SYS MB PQ clear fault action true Are you sure you want to clear SYS MB PQ y n y See Also Cluster Configuration HBA Expansion pt 1 108 Expanding from 2 to 3 HBAs The figures below show steps to migrate a cluster from two to three HBAs NOTE Diagrams below are not representative of proper slot location for HBAs Cabling Diagrams ET SHELF He n fig 1Cluster with two HBAs and chains of disk shelves Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 HBA Expansion pt 1 qae fig 2 Power down and remove all cabling from the first controller Add and cable together the new chain of disk shelves then power on shelves
79. iguration Backup backup and restore appliance configuration Problems view current problems Logs view appliance logs Workflows manage and execute workflows 7120 Hardware Overview Use the information in this section as a preparation reference for servicing replaceable components of the 7120 system Refer to the following for procedural instructions Controller Tasks replace system controller components Disk Shelf Tasks replace disk shelf components Chassis Overview The Sun ZFS Storage 7120 is an enterprise class two socket rackmount x64 system powered by the Intel Xeon processor It packs high performance and room for growth with four PCle slots Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7120 and 18 DIMM slots into a compact 2U footprint Refer to the http www sun com storage disk systems unified storage 7120 specs xml http www sun com storage disk systems unified storage 7120 specs xmLl forthe most recent component specification The 7120 is a standalone controller that consists of a SAS 2 HBA providing disk shelf expansion optional read and write flash accelerators and 1TB and 2TB hard drives The SAS 2 storage fabric supports greater number of targets greater bandwidth higher reliability and bigger scale The 2U chassis form factor dimensions are as follows Dimension Measurement Dimension Measurement Height 87 6 mm 3 45in Depth 765 25 mm 30 13 in Widt
80. in the overview section for your model to become familiar with the replaceable parts of the system 7120 Overview Chapter 2 Hardware Maintenance 61 7x20 62 7320 Overview 7420 7720 Overview 7700 Overview Caution Read and follow the instructions in the Safety Information and Required Tools and Information sections Safety Information This section contains safety information that you must follow when servicing the storage system For your protection observe the following safety precautions when setting up your equipment Do not remove the side panels or run the storage system with the side panels removed Hazardous voltage is present that could cause injury The covers and panels must be in place for proper air flow to prevent equipment damage Follow all cautions warnings and instructions marked on the equipment and described in Important Safety Information for Sun Hardware Systems Ensure that the voltage and frequency of your power source match the voltage inscribed on the electrical rating label Follow the electrostatic discharge safety practices Electrostatic discharge ESD sensitive devices such as PCI cards HDDs SSDs and memory cards require special handling Circuit boards and HDDs contain electronic components that are extremely sensitive to static electricity Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards Do not touch
81. ions 7720 Cluster Controller Configurations ss Attached StOFage deve insanire id Doe een sentait seins est Prerequistt S rosse dd iun ducta nr meta ntm tdi Ant tht it 61 Safety Information nina tene dete a GU ERU EO Ue QR bI Ree HC bests 62 Required Tools and Information 0 o errante pe e e pite dte o ee UR ideale 62 Chassis Serial Num Det ais c e D P eh et Pe D etd Manille eeu Rd ie SERT ee 63 Controller Replacement Tasks eei ettet ttc t erit n niia i 63 Cabinet Replacement Tasks Eu C ERROR UR ER ORI UBI GIESSEN 85 Storage Expansion Upgrade soraia dte dede ge de di nn 93 pL 94 Sun Disk Shelf Overview uaa eid dvi dete de eei hee hee ate Ee eee ede 94 SL LT EE Eo D 100 Disk Shelf Maintenance Procedures inner 100 loop c 100 Satety IBfOERatlOn efte toten ted dtendui bien 100 Electrostatic Discharge Pr cautions ett tite tpe tette tini teet onsotsgses posset dep 100 Tasks RAR adm ive eher brad de kate ne dde p Dem 101 Balt 106 Hardware Faults zi dtd be eden eom n e epe TO nerd pedites 106 HBA Expansion pti din n aiiniateieteamid caia dod ced icri tet 108 Expanding from 2 10 3 HBAS usa tte ied de annees 108 HBA Expansion AR 113 Expanding from 310 4 HBAS cesserit a 113 System Maintenance pen orate iet U Rea d m e d E diis 119 Ry Cii ee tas cheat T A A E A A E T T 119 Sun ZFS Stora
82. it will be deleted If the bundle is being uploaded the upload will be cancelled and the appliance will not retry it later Download the support bundle Try again to upload the bundle to support T Cancel any pending operation and delete the support bundle Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 System Managing Support Bundles Using the CLI To generate and upload a new support bundle use the sendbundle command loader maintenance system loader maintenance system sendbundle A support bundle is being created and sent to Sun You will receive an alert when the bundle has finished uploading Please save the following filename as Sun support personnel will need it in order to access the bundle cores ak 9a4c3d7b 50c5 6eb9 c2a6 ec9808ae1cd8 tar gz As the message indicates you must provide this filename to support personnel in order for them to retrieve your bundle Manage bundles from the maintenance system bundles context in the CLI as follows loader maintenance system bundles loader maintenance system bundles list BUNDLE STATUS PROGRESS cores ak 9a4c3d7b 50c5 6eb9 c2a6 ec9808ae1cd8 tar gz Uploading 7 loader maintenance system bundles gt Bundles are identified by the filename omitting the ak prefix and the file type suffix To delete a support bundle use the destroy command To view details use the select and list commands loader maintenance system bundles sele
83. l power connector 10 SIM locator indicator Disk Shelf Configurations The following tables describe and provide part numbers for the supported expansion storage shelves Sun Disk Shelf Mktg Part Number MPSR Short Description Mfg Part Number DS2 0BASE Sun Disk Shelf 24x3 5 SAS 2 597 0764 02 DS2 HD2T Sun Disk Shelf 2TB 7 2Krpm SAS 2 3 5 20xHDD 597 0625 01 DS2X HD2T Sun Disk Shelf 2TB 7 2Krpm SAS 2 3 5 24xHDD 594 6670 01 DS2 LOGZ Sun Disk Shelf 24x3 5 SAS 2 597 0626 01 DS2 FILLER Sun Disk Shelf 24x3 5 Filler 597 0614 01 DS2X LOGZ Sun Disk Shelf 100GB Logzilla SSD 594 6629 01 Chapter2 Hardware Maintenance 99 Shelf Shelf 100 Disk Shelf Maintenance Procedures This section provides procedural details for customer replaceable units CRUs of any disk shelf in the Sun ZFS Storage 7000 family of products Refer to Disk Shelf Overview for component specifications and diagrams Prerequisites Read the information in the overview section for your controller and become familiar with the replaceable parts of the system 7120 Overview 7420 7720 Overview 7700 Overview Follow the instructions in the Electrostatic Discharge Precautions section Legacy platform overviews for 7110 7210 7310 7410 and J4400 J4500 Disk Shelf are provided in those sections of the Sun Storage 7000 Unified Storage System Service Manual Safety Information Follow all Sun cautions warnings and instructions
84. m 100 2009 10 16 03 51 01 Up to 100 recent entries for each log are visible using the CLI Viewing a log Logs may be selected for viewing with the show command caji maintenance logs select audit show Entries ENTRY TIME SUMMARY entry 000 2009 10 15 00 59 37 root console Enabled datalink ngeQ service entry 001 2009 10 15 00 59 39 root console Enabled interface ngeQ service entry 002 2009 10 15 01 00 39 root console User logged in entry 003 2009 10 15 01 41 44 root console Enabled nis service entry 004 2009 10 15 01 42 01 root console Imported storage pool pool 0 entry 005 2009 10 15 17 56 30 root console User logged in entry 006 2009 10 15 17 56 53 root deimos sf fishworks com User logged in via CLI entry 007 2009 10 15 18 00 21 root deimos sf fishworks com User logged out of CLI entry 008 2009 10 15 18 14 47 root console Browser session timed out entry 009 2009 10 15 20 46 27 root deimos sf fishworks com User logged in via CLI entry 010 2009 10 15 21 51 46 root console Rebooted appliance entry 011 2009 10 15 21 51 46 root console User logged out entry 012 2009 10 15 21 56 44 root deimos sf fishworks com User logged in via CLI Most recent entries are displayed at the bottom ofthe list Entry details Alllog entry details are available when selecting that entry and running show caji maintenance logs select audit caji maintenance logs audit select en
85. mmary ofits contents and any attached disk shelves on supported systems This provides an overview ofthe hardware present on the system as well as controls to reset or power offthe system System Chassis The primary system chassis is shown on the top half of the view At the top left click the amp to get more detail about the chassis The indicator notes if there are any faulted components within the chassis and the name ofthe chassis The chassis name is initially set to the appliance name during installation To change the chassis name use the entry field on the Configuration gt Services gt System Identity screen At the top right ofthe system chassis is the X control to light the locate LED 2 reboot the appliance and o power off the chassis Note that in configurations with attached storage and for the 7700 cabinet the controller does not control the drive shelf power The reboot and poweroff operations are identical to those provided at the left ofthe masthead A thumbnail of the controller is presented at left Clicking on the thumbnail or the Show Details link takes you to a detailed view ofthe chassis and is identical to clicking on the right pointing arrow at the top left of the view The following information is presented in a summary view Property Description Manufacturer Manufacturer ofthe system Model System model name Serial System chassis hardware serial number Processors Coun
86. n BK Mousing over the port icon will display the current port state in the tip pop up GUID The hardware assigned port GUID Chapter 1 Introduction 17 Hardware 18 Action Description Speed The current port speed enabled Single Data Rate SDR Dual Data Rate DDR or Quad Data Rate QDR Service Processor The service processor behaves differently from other component nodes Instead of providing a list of components it presents a set of network properties that can be configured from the storage appliance The following properties control the behavior ofthe service processor network management port Property Description MAC Address Hardware MAC address This is read only IP Address Either DHCP or Static Controls whether DHCP should be used on the interface Source IP Address IPv4 Address when using static IP configuration IPv6 is not supported Subnet Dotted decimal subnet when using static IP configuration Default Gateway IPv4 default gateway address Changing multiple values in conflicting ways such as changing static IP assignments while in DHCP mode has undefined behavior CLI Hardware status details are available in the CLI under the maintenance hardware section Use the show command to list the status of all components The List command will list available chassis which can be selected and then viewed using show tarpon maintenance hardware show Chassis NAME STA
87. n in the cabling label on the inside of the cabinet Failed internal cables must be replaced by a Sun Service technician Interface Boards The 7700 cabinet includes several internal interface boards There are no CRUs inside the 7700 cabinet and access to the internal interface boards is limited to Oracle s Sun Service technicians Fan Tray Backplane Provides power to the fan trays and the system indicators The fan tray backplane also provides an interface between the system software and the system indicators HDD Backplane Delivers power and data connections to the HDDs SSDs and LCCs System Indicator Boards Provides system level status indicators on the front and rear panels under the top drive cage Power Distribution Backplane Distributes power from the power supplies to the other components in the cabinet except for the system controllers and Ethernet switch RCC Backplane Interface card between the RCC and the Disk Cage backplanes The RCC backplane also delivers power to the RCCs See Also 7x20 and 7700 CRU Maintenance Procedures 7420 7720 Controller Overview 7x20 and 7700 CRU Maintenance Procedures This section provides instructions on how to replace customer replaceable components CRUs in Oracle s Sun ZFS Storage 7120 7320 7420 and 7720 controllers and the 7700 main cabinet Refer to Disk Shelf Details for replacing expansion storage shelf components Prerequisites Read the information
88. n the motherboard that operate at 10 100 1000 Mbit sec These network interfaces must be configured before use Electrical Specifications The following list shows the electrical specifications for the 7120 Note that the power dissipation numbers listed are the maximum rated power numbers for the power supply The numbers are not a rating of the actual power consumption of the appliance Connectors Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7120 Two C13 connectors which work on 110 220v outlets Input Nominal frequencies 50 60Hz Nominal voltage range 100 120 200 240 V AC Maximum current AC RMS 13 8A 100 VAC AC operating range 90 264 VAC Output 3 3 VDCSTBY 3 0A m 12 VDC 86 7A Power dissipation Max power consumption 1235 3 W a Max heat output 4212 BTU hr Volt Ampere rating 1261 VA 240 VAC 0 98P F Internal Components The chassis has the following boards installed Field replaceable units FRU should only be replaced by trained Sun service technicians PCIe Risers Each riser supports two PCIe cards that are customer replaceable There are two risers per system each attached to the rear of the motherboard Motherboard The motherboard is a FRU and includes CPU modules slots for 18 DIMMs memory control subsystems and the service processor SP subsystem The SP subsystem controls the host power and monitors host system events power and environmental The
89. nd lost For example assume you are running version V and then you update to V 1 and then you change your DNS server If you execute a rollback then your DNS server setting modification is effectively undone and removed from the system permanently Conversely any changes made to user data are not reverted if you update from V to V 1 and clients then create directories or modify shares in any way those changes still exist after the rollback as you would expect Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Updates Ifthe appliance is running version V and has previous rollback targets V 1 and V 2 and you revert all the way to version V 2 thereby skipping V 1 then you not only are removing the system software settings and system software for V but also for V 1 That is after a rollback to V 2 itis as if updates V 1 and V never happened However the software upload images for V 1 and V will still be saved on the system and you can apply them again after the rollback if you wish by re executing the update If after applying an update the system is back up and running you can use either the BUI or the CLI to initiate a rollback to one oftwo previously applied updates If the system is not able to run at all after an update then use the fail safe rollback procedure Fail safe Rollback Administrators can execute a fail safe rollback of the system software from the serial console by selecting one
90. nding updates when applying certain deferred updates to components other than hardware Applying hardware updates is always done in a completely safe manner This means that the system may be in a state where hardware updates cannot be applied This is particularly important in the context of clustered configurations During takeover and failback operations any in progress firmware upgrade will be completed pending firmware upgrades will be suspended until the takeover or failback has completed at which time the restrictions described below will be reevaluated in the context of the new cluster state and if possible firmware Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Updates upgrades will resume Important Unless absolutely necessary takeover and failback operations should not be performed while firmware upgrades are in progress The rolling upgrade procedure documented below meets all of these best practices and addresses the per device class restrictions described below It should always be followed when performing upgrades in a clustered environment In both clustered and standalone environments these criteria will also be reevaluated upon any reboot or diagnostic system software restart which may cause previously suspended or incomplete firmware upgrades to resume Components internal to the storage controller such as HBAs and network devices other than disks and certain SAS devices will generally be u
91. ns of the physical system components allowing you to visually identify and locate hardware components and verify their status Software Updates can be applied in the System section of the interface as well as viewing Logs and current Problems Hardware identify hardware components and verify their status 7120 Overview view component diagrams and specifications 23 7120 7120 24 7320 Overview view component diagrams specifications and cluster options 7420 7720 Overview view component diagrams specifications and cluster options 7700 Overview view component diagrams and specifications 7120 7320 7420 7720 Maintenance Procedures replace controller or cabinet drives fans power supplies RAM cards risers and batteries Disk Shelf Overview view component diagrams and specifications Disk Shelf Maintenance Procedures replace disk shelf components Hardware Faults Connect to ILOM to diagnose hardware faults Expanding from 2 to 3 HBAs Expanding from 3 to 4 HBAs Legacy platforms are described in associated sections as follows 7110 Overview 7210 Overview 7310 Overview 7410 Overview 7x10 Maintenance Procedures J4400 J4500 Overview also available in the Sun Storage 7000 Unified Storage Service Manual on http wikis sun com display fishworks http wikis sun com display fishworks System view system disks manage support bundles Updates manage appliance software updates Conf
92. nse terms set forth in the applicable Government contract and to the extent applicable by the terms ofthe Government contract the additional rights set forth in FAR 52 227 19 Commercial Computer Software License December 2007 Oracle USA Inc 500 Oracle Parkway Redwood City CA 94065 This software or hardware is developed for general use in a variety of information management applications It is not developed or intended for use in any inherently dangerous applications including applications which may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure the safe use Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications Oracle and Java are registered trademarks of Oracle and or its affiliates Other names may be trademarks of their respective owners AMD Opteron the AMD logo and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International Inc UNIX is a registered trademark licensed through X Open Company Ltd This software or hardware and documentation may provide access to or
93. omponent if the component has it The LED on the component will begin to flash Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Hardware CLI To turn on the locate LED using the CLI run the following commands Go to the maintenance hardware context hostname maintenance hardware List the appliance components hostname maintenance hardware list NAME STATE MODEL SERIAL chassis 000 hostname ok Sun Storage 7410 unknown chassis 001 000000000C faulted 14400 000000000C Select the chassis and list its components hostname maintenance hardware select chassis 001 hostname maintenance chassis 001 list disk fan psu slot Select the component type and show all available disks hostname maintenance chassis 001 select disk hostname maintenance chassis 001 disk show Disks LABEL STATE MANUFACTURER MODEL SERIAL disk 000 HDD 0 ok ST3500630NS ST3500630NS 9Q0G1ACNJ disk 001 HDD 1 faulted ST3500630NS ST3500630NS 90G1A77R disk 002 HDD 2 ok ST3500630NS ST3500630NS 90G1AC3Z disk 003 HDD 3 ok ST3500630NS ST3500630NS 9QG1ACKW disk 004 HDD 4 ok ST3500630NS ST3500630NS 9QG1ACKF disk 005 HDD 5 ok ST3500630NS ST3500630NS 9QG1ACPM disk 006 HDD 6 ok ST3500630NS ST3500630NS 9QG1ACRR disk 007 HDD 7 ok ST3500630NS ST3500630NS 9QG1ACGD disk 008 HDD 8 ok ST3500630NS ST3500630NS 90G1ACG4 disk 009 HDD 9 ok ST3500630NS ST3500630NS 9QG1ABDZ disk 010 HDD 10 ok ST3500630NS ST3500630NS 90G1A769 disk 011
94. onBackup 136 to those properties that did not exist at the time of the backup When restoring across software versions administrators should manually verify settings for new features following the restore Password maintenance The root password is not changed or reverted to the password at thetime ofthe backup if it was different The current root password is maintained on the system across the restore For more details about passwords refer to the summary of Security Considerations Import or re configure storage required Storage will be unconfigured after the restore has completed Administrators should import or reconfigure storage under the Configuration Storage screen after performing a configuration restore Security Considerations A configuration backup contains information that is normally only accessible to the root administrative user on the appliance Therefore any configuration backup that is exported to another system or into a filesystem share must apply security restrictions to the backup file to ensure that unauthorized users cannot read the backup file Local user passwords are stored in the backup file in encrypted hashed format not as clear text However on the system access to these password hashes is restricted as they could be used as input to dictionary attacks Therefore administrators must carefully protect configuration backups that are exported either by restricting file access to the backup o
95. ontroller cards RCCs on internal and external SAS and Ethernet networks To power and cool the components the cabinet includes 6 power supplies PSUs and 3 fan trays The lower cabinet is populated with 2 3U Sun ZFS 7720 storage controllers containing 4 socket CPU motherboards with large memory capacities 4 optional read optimized Readzilla SSDs and 10 PCIe slots with installed adapters that are clustered by default in a high availability configuration Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7700 Front and Rear Panels The following illustration shows the 7700 front panel left and rear panel right ofthe main cabinet 4 Figure Legend 1 Fan trays 5 Power supplies 2LCCs 6 RCCs 3 Disk cages 7 Storage controllers main cabinet only 4 HDDs and SSDs Refer to http www sun com storage disk systems unified storage 7700 specs xml http www sun com storage disk systems unified storage 7700 specs xml for the most recent component specification Cabinet Dimensions Description U S Metric Width 23 5in 60cm Depth without doors 43 0in 109 cm Chapter2 Hardware Maintenance 55 7700 Description U S Metric Depth with front and rear doors 46 0in 117cm Height 79 5in 202cm Maximum weight storage system 1 740 790 kg cabinet Ib Clearance front or rear ofsystem 48in 122cm for service access Clearance above system 18in 46cm E
96. open the latch 4 Grasp the latch 2 and pull the drive out of the drive slot 5 After 15 seconds navigate to the Hardware Maintenance screen and click the details icon on the system controller to verify that the software has detected that the drive is not present Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 6 Slide the replacement drive into the slot until it is fully seated 7 Close the latch to lock the drive in place The Sun ZFS Storage system software automatically detects and configures the new drive The device appears in the BUI Maintenance Hardware screen when you view details for the controller drive shelf or cage Fan Tray Fan trays are hot swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities An amber colored status indicator indicates a faulted fan module Caution Fan trays must not be removed from the cabinet for more than one minute Removal ofa fan tray for more than one minute will result in the cabinet overheating and automatically shutting down You must unpack and prepare the replacement fan tray in advance so that you can insert it into the cabinet as soon as the faulted fan tray is removed The following illustration shows the location of fan modules in the 7700 storage cabinet til ANI MALLE DELLE 1 Identify the faulted fan module by locating the corresponding Se
97. or appliances that are joined in a cluster but a configuration restore may not be used while systems are actively clustered The clustering process means that settings are being synchronized between cluster peers and each peer appliance also is maintaining private settings For this reason you must first use the Unconfiguring Clustering procedure to un cluster the two systems Then restore the configuration backup on a selected head and then re cluster the two systems at which point the other system will automatically synchronize itself with the restored configuration Root privileges required Configuration backups include all system metadata and therefore require all possible privileges and authorizations to create or apply Therefore unlike other delegated administrative options only the root user is authorized to perform a configuration backup or restore Verify setting for new features It is permitted to restore a configuration that was saved before applying a system update to a new version of the appliance software In some cases services and properties that were present at the time ofthe backup may have different effects and new services and properties may exist in the newer software that did not exist at the time of the backup Similar to the system update process the configuration restore process will make every effort to transfer applicable settings and apply reasonable defaults Chapter3 System Maintenance 135 Configurati
98. orts This table describes base configurations for the 7320 Mktg Part Number Description Mfg Part Number TA7320 24A S7320 2xCPU 24GB Single 597 1060 01 TA7320 24A HA S7320 2xCPU 24GB Cluster 597 1061 01 Following are the PCIe configuration options for a single controller All PCIe cards are low profile and must be fitted with low profile mounting brackets Slot Type Part Number Vendor Part Description Note 0 PCIe 375 3617 01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front end 0 PCIe 375 3696 01 Mellanox InfiniBand HCA Optional Recommended Front end 0 PCIe 375 3606 03 MHJH29 XTC InfiniBand HCA Optional Recommended Front end 0 PCIe 375 3481 01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front end Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7320 Slot Type Part Number Vendor Part Description Note 0 PCle 371 4325 01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator Backup 1 PCIe 375 3617 01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front end 1 PCIe 375 3696 01 Mellanox InfiniBand HCA Optional Recommended Front end 1 PCIe 375 3606 05 MHJH29 XTC InfiniBand HCA Optional Recommended Front end 1 PCIe 375 3481 01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front end 1 PCIe 371 4325 01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator Backup 2 PCIe 375 3609 03 Sun Thebe External SAS HBA Base Configuration
99. ote that power supplies disks and fan modules are hot pluggable on the storage controller Part Number Description FRU CRU F300 2233 02 RoHS 760W Power Supply CRU F541 2075 04 Buss Bar Power 1U FRU F542 0184 01 DR 3Gb SATA CRU F542 0330 01 2 5 512GB ReadZilla SSD CRU F541 276 01 ASSY FAN Module CRU F541 4274 02 Fan Board 1U FRU 7320 PCle Cards and Risers Following is the complete list of replaceable PCIe cards for the 7320 system Part Number Description FRU CRU F371 4325 01 8Gb FC HBA PCIe CRU F375 3609 02 PCA SAS 6GBS 8 Port PCIe CRU F375 3606 03 Dual Port x4 IB HCA PCIe CRU F375 3696 01 Dual Port CX2 4XQDR PCIe CRU F375 3617 01 2X10GbE SFP X8 PCIe CRU F375 3481 01 NIC Card Quad Port 1GigE Cu PCIe CRU F511 1496 04 Sun Fishworks Cluster Controller 200 PCIe FRU Chapter2 Hardware Maintenance 39 7320 40 7320 Rear Panel Following is an illustration of the 7320 storage controller rear panel The Sun 375 3609 belongs in slot 2 cannot be installed in any other slots and a second is not offered as an option Figure Legend 1 Power supplies 4 Network management port 2 SC summary status LEDs 5 Ethernet ports 3 Serial management port 6 PCIe slots 7320 Single and Cluster Controller Configurations The single controller base configuration is 24GB RAM 2x2 4GHz Quad Core processors one external SAS HBA and four 10 100 1000 Ethernet p
100. pgraded automatically during boot these upgrades are not visible and will have completed by the time the management interfaces become available Upgrading disk or flash device firmware requires that the device be taken offline during the process If there is insufficient redundancy in the containing storage pool to allow this operation the firmware upgrade will not complete and may appear stalled Disks and flash devices that are part ofa storage pool which is currently in use by the cluster peer if any will not be upgraded Finally disks and flash devices that are not part of any storage pool will not be upgraded Upgrading the firmware in a disk shelf requires that both back end storage paths be active to all disks within all enclosures and for storage to be configured on all shelves to be upgraded For clusters with at least one active pool on each controller these restrictions mean that disk shelf firmware upgrade can be performed only a controller that is in the owner state During the firmware upgrade process hardware may appear to be removed and inserted or offlined and onlined While alerts attributed to these actions are suppressed if you are viewing the Maintenance Hardware screen or the Configuration Storage screen you may see the effects of these upgrades in the UI in the form of missing or offline devices This is not a cause for concern however if a device remains offline or missing for an extended period of time seve
101. pression Remote replication of data for disaster recovery Active active clustering for high availability 7310 7320 7410 7420 and 7720 Thin provisioning of iSCSI LUNs Virus scanning and quarantine NDMP backup and restore Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Overview Availability To maximize the availability of your data in production Sun ZFS Storage appliances include a complete end to end architecture for data integrity including redundancies at every level of the stack Key features include Predictive self healing and diagnosis of all system hardware failures CPUs DRAM I O cards disks fans power supplies ZFS end to end data checksums of all data and metadata protecting data throughout the stack a RAID 6 double and triple parity and optional RAID 6 across disk shelves Active active clustering for high availability 7310 7320 7410 7420 and 7720 Link aggregations and IP multipathing for network failure protection O Multipathing between the controller and disk shelves Integrated software restart of all system software services Phone Home of telemetry for all software and hardware issues Lights out Management of each system for remote power control and console access Browser User Interface BUI The browser user interface The BUI is the graphical tool for administration of the appliance The BUI provides an intuitive environment for administra
102. progress bar may not be updated continuously during the upload if you see a watch cursor just wait a minute in the worst case the upload will proceed all the way to completion and you may not see the progress bar Unpacking and verifying media This step will happen automatically after the media is done uploading Available Updates VERSION _RELEASE DATE STATUS B unpacking unpacking FrFFFIIFIJZXF Unpacking update 2008 10 10 1 0 2008 10 10 01 45 Previous vystom software gt 2008 10 14 1 0 2008 10 14 16 10 49 Current system software Beginning an upgrade After the update is uploaded unpacked and verified it will appear as an update Available Updates VERSION RELEASE DATE STATUS 2009090130 1 18 ce 24 Ubiosded st 2000 129 15259 Ld Click the information icon to view the Release Notes for the software update To begin the upgrade click on the apply icon As the upgrade progresses you will see the most recent message in the status field of the update To cancel the update at any time and without ill effect click on the Q cancel icon Rolling back To roll back locate a previous image and click on the 9 rollback icon You will be asked to confirm that you wish to execute a rollback and then the system will reboot and execute the rollback Unlike fail safe rollback you will not be asked for further confirmation when the system reboots Sun ZFS Storage 7x20 Appliance Customer Service Man
103. prompted for confirmation Updating from ak nasQ2009 10 11 1 0 Backing up smf 5 done Loading media metadata C This will cancel the current update Are you sure Y N y Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Updates error interrupted by user dory maintenance system updates ak nasQ2009 10 14 1 0 nd Rolling back To roll back to an earlier version select the update that corresponds to that version and execute the rollback command You will be asked to confirm that you wish to execute a rollback and then the system will reboot and execute the rollback Unlike fail safe rollback you will not be asked for further confirmation when the system reboots Removing update media To remove update media use the dest roy command specifying the update to be removed dory maintenance system updates destroy ak nas 2009 10 14 1 0 nd This will destroy the update ak nasQ2009 10 14 1 0 nd Are you sure Y N y dory maintenance system updates Applying Deferred updates To see if there are any available deferred updates run the show command If deferred updates are available you can use the apply command clownfish maintenance system updates show Updates UPDATE DATE STATUS ak nas 2009 11 20 2 1 1 1 9 2009 4 1 04 18 48 AKUP PREVIOUS ak nas 2009 04 03 1 0 2009 4 3 08 45 01 AKUP_ CURRENT Deferred updates The following incompatible updates are available Applying these updat
104. r by applying an additional layer of encryption to the entire backup file or both Directory user passwords are not stored in the appliance and therefore are not stored in the configuration backup If you have deployed a directory service such as LDAP or AD for administrative user access there are no copies of directory service password hashes for directory users stored in the configuration backup Only the user name user ID preferences and authorization settings for directory users are stored in the backup and then restored Following a configuration restore the local root administrative user password is not modified to the root password at the time ofthe backup The root password is left as is unmodified by the restore process to ensure that the password used by the administrator who is executing the restore process and thus has logged in using that password is retained If the administrator s intent was to also change the root password at the time of configuration restore that step must be executed manually following the restore using the normal administrative password change procedure Managing Configuration Backups Using the BUI The following section outlines how various Configuration Backup tasks can be accomplished using the Configuration Backup area near the bottom of the Maintenance System screen in the BUI Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 ConfigurationBackup Create a Config
105. r with three HBAs and chains of disk shelves vv Chapter2 Hardware Maintenance 113 HBA Expansion pt 2 SHELF mmm met EE J J 3 SHELF ET SHELF CL SHELF SHELF cim m sem E T il s fig 2 Power down and remove all cabling from the first controller Add and cable together the new chain ofdisk shelves then power on shelves ETE Ir SHELF mm n qe es SHELF SHELF cien ost mea e fig 3 Install new HBA according to the instructions on installing PCI cards and connect the controller to the third and fourth chain as shown aly 114 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 HBA Expansion pt 2 gm amr fig 4 Reconnect the three original HBAs as before to the first three chains Power on the controller and wait for it to regain control of connected storage SEE s SHELF SHELF SHELF SHELF Sean qe Ta a qe ca me m fig 5 Power down and remove all cabling from the second controller d Chapter2 Hardware Maintenance 115 HBA Expansion pt 2 116 g SHELF E SHELF Sem pes Sep qe i nm fig 6 Install new HBA according to the instructions on installing PCI cards and connect the controller to
106. ral minutes or more even after refreshing the hardware view this may be an indication of a problem with the device Check the Maintenance Problems view for any relevant faults that may have been identified Additionally in some cases the controllers in the disk shelves may remain offline during firmware upgrade If this occurs no other controllers will be updated until this condition is fixed If an enclosure is listed as only having a single path for an extended period of time check the physical enclosure to determine whether the green link lights on the back ofthe SIM are active If not remove and re insert the SIM to re establish the connection Verify that all enclosures are reachable by two paths Reboot After an Update Following the completion of the update process the system will reboot automatically If you have the serial console open you will notice during this reboot that multiple GRUB menu entries are available ordered from the newest software at the top to the oldest software at the bottom The default menu entry will be the top the new software to which you just updated Chapter3 System Maintenance 125 Updates 126 If you do nothing this entry will boot by default completing the update The previous entries are rollback targets that can be used to initiate a rollback to previous versions of the system software Rollback is discussed below GNU GRUB version 0 95 613K lower 3537536K upper memory Sun
107. ransfer I2C data for the fan modules Disk Backplane The hard drive backplane is a FRU and includes the connectors for the hard disk drives as well as the interconnect for the I O board Power and Locator buttons and system component status LEDs The storage controller has an eight disk backplane Each drive has an LED indicator for Power Activity Fault and OK to remove not supported Following is the complete set of replaceable system boards for the 7320 storage controller Part Number Description FRU CRU F541 2883 01 X8 PCIe Riser Card 1U CRU F541 2885 01 X16 PCIe Riser Card 1U CRU F541 4081 01 RoHS Motherboard and Tray FRU F511 1489 01 DB Power Distribution Board FRU F511 1548 01 PCB 8 Disk 1U Backplane FRU F541 4275 02 PCBA Connector Board IU FRU Cables Following is the complete set of replaceable cables for the 7320 storage controller Part Number Description FRU CRU F530 4228 01 Cable Mini SAS FRU internal Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7320 Part Number Description FRU CRU F530 3927 01 FRU CBL PDB MB 1U 2U RIBBON FRU internal F530 4431 01 Cable Fan data FRU internal F530 4417 01 FRU Cable Fan paddle FRU internal F530 3880 01 Cable Assembly Ethernet Shielded CRU RJA5 RJA5 6m external F530 3883 01 FRU 2M 4X Mini SAS Cable CRU external 7320 1 0 Components The I O components of the storage controller are
108. re warning indicator 2 System fault indicator 5 Disk fault indicator 8 SIM board fault indicator 3 System power indicator 6 Disk activity indicator 9 Power supply fault indicator Sun Disk Shelf Logzilla SSD Locations Up to four Logzilla SSDs are supported per disk shelf Logzilla SSDs should be populated in order of slots 20 21 22 and 23 Drive Assembly Exterior The following figure shows the drive assembly exterior for the Sun Disk Shelf Chapter2 Hardware Maintenance 97 SAS2 Figure Legend 1 Locate blue 2 Fault indicator amber 3 Activity indicator green SIM Board Exterior The following figure shows the SIM board exterior of the Sun Disk Shelf SAS 2 and is described in the Legend SIMs are hot pluggable on the shelf SIM 0 is on the left and SIM 1 is on the right Figure Legend 1SIM board 1 3SIMboard0 5 Network management port 2 Host or SIM Link In 4SIMlinkout 6 For Sun service only The following figure shows the SIM board and Power Supply exterior indicator LEDs 98 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 SAS2 O0 99 POP G Figure Legend 1 AC power indicator 6 Power switch 2 DC power indicator 7 Port fault indicator 3 Fan fault indicator 8 Port OK indicator 4 Power supply fault indicator 9 SIM board OK indicator green lt br gt SIM board fault indicator amber 5 Universa
109. red by the GUI Support Bundles The appliance can generate support bundles containing system configuration information and core files for use by remote support in debugging system failures Support bundles are generated automatically in response to faults if the Phone Home service is enabled Administrators can manually generate and upload a support bundle from this section ofthe Maintenance System screen Once generated support bundles are automatically uploaded to Sun s Support files Service at http supportfiles sun com http supportfiles sun com To facilitate this the appliance must be connected to the Internet either directly or through the web proxy configured on the Phone Home service screen If the upload fails the system will make another attempt After a support bundle has been successfully uploaded the support bundle and core files are automatically deleted from the system Managing Support Bundles Using the BUI To generate a support bundle click the icon next to Support Bundles on the Maintenance gt System screen You are presented with the randomly generated filename for the support bundle Provide this filename to support personnel so that they can retrieve your support bundle For each support bundle currently being generated or uploaded or which has failed to upload the following options may be available Icon Description e Cancel the current operation If the bundle is being generated
110. res n cessaires son utilisation dans des conditions optimales de s curit Oracle Corporation et ses affili s d clinent toute responsabilit quant aux dommages caus s par l utilisation de ce logiciel ou mat riel pour ce type d applications Oracle et Java sont des marques d pos es d Oracle Corporation et ou de ses affili s Tout autre nom mentionn peut correspondre des marques appartenant d autres propri taires qu Oracle AMD Opteron lelogo AMD etlelogo AMD Opteron sont des marques ou des marques d pos es d Advanced Micro Devices Intel et Intel Xeon sont des marques ou des marques d pos es d Intel Corporation Toutes les marques SPARC sont utilis es sous licence et sont des marques ou des marques d pos es de SPARC International Inc UNIX est une marque d pos e conc d e sous licence par X Open Company Ltd Ce logiciel ou mat riel et la documentation qui l accompagne peuvent fournir des informations ou des liens donnant acc s des contenus des produits et des services manant de tiers Oracle Corporation et ses affili s d clinent toute responsabilit ou garantie expresse quant aux contenus produits ou services manant de tiers En aucun cas Oracle Corporation et ses affili s ne sauraient tre tenus pour responsables des pertes subies des co ts occasionn s ou des dommages caus s par l acc s des contenus produits ou services tiers ou leur utilisation 1011230025097 Contents AAE EE E NET
111. ressing the air baffle connectors outward and lifting the air baffle up and out ofthe server 6 7420 or 7720 To remove the top cover Chapter2 Hardware Maintenance 71 7x20 Simultaneously lift both cover latches in an upward motion Lift up and remove the top cover 7 To locate the DIMM you want to service press the Fault Remind Button on the storage controller The following illustration shows the Fault remind button on the 7120 72 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 The following illustration shows the Fault remind button on the 7420 or 7720 8 7420 or 7720 Identify the memory riser that hosts the faulted DIMM by the Service Required status indicator Lift the memory riser straight up to remove it from the motherboard and place it on an antistatic mat 9 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket Chapter2 Hardware Maintenance 73 7x20 10 Line up the replacement DIMM with the connector aligning the notch with the key to ensure that the component is oriented correctly 11 Push the DIMM into the connector until the ejector tabs lock the component in place 12 7120 or 7320 Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 To replace the cov
112. roller base configuration includes two CPUs built in 4 x 1Gb s front end GigE ports redundant power supplies NIC options for expanded front end support tape backup Infiniband and dual port SAS HBA for storage expansion The CPUs are Intel Xeon 5600 series 2 40GHz 80W 4 core processors Standard memory configuration is 24GB 3 x 4GB DDR3 1333 DR DIMMs and may be upgraded to 48GB using 6x4GB DDR3 1333 DR DIMMs per CPU or to 72GB using 9x4GB DDR3 DR DIMMs per CPU The clustered configuration simply uses two servers and a cluster card in each server for a heartbeat connection between them All user accessible storage is provided by one to four Sun Disk shelves external to the server s The RAID function is done by the software Solid State 18GB SAS 1 drives 7320 SAS 2 which are used for high performance write cache known as LogZilla or ZFS intent log ZIL devices are in place of one to four of the 24 drives in the Disk Shelf the remaining 20 drives are available for storage Refer to the http www sun com storage disk_systems unified_storage 7320 specs xml http www sun com storage disk systems unified storage 7320 specs xml for the most recent component specification The 7320 is a next generation SAS 2 Serial Attached SCSI 2 0 device that consists of a new HBA new disk shelf and new disks 1TB and 2TB SAS 2 The SAS 2 storage fabric supports greater number of targets greater bandwidth higher reliability and bigger scale
113. rs and the Locator status indicator Locator button are dim 9 Push the release tabs on the side of each rail and slowly slide the storage controller into the rack Power Supply Storage controllers are equipped with redundant hot swappable power supplies If a power supply fails and you do not have a replacement leave the failed power supply installed to ensure proper air flow A faulted power supply is indicated by an amber colored status LED 1 Gain access to the rear of the storage controller where the faulted power supply is located 68 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 2 Ifa cable management arm CMA is installed press and hold the CMA release tab and rotate the arm out ofthe way 3 Disconnect the power cord from the faulted power supply 4 Remove the power supply 7120 or 7320 Release the latch then remove the power supply Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 7420 or 7720 Grasp the power supply handle and press the release latch to remove the power supply 5 Align thereplacement power supply with the empty power supply chassis bay Chapter2 Hardware Maintenance 69 7x20 6 Slide the power supply into the bay until it is fully seated The following figure shows the 7420 7720 power supply 7 Connectthe power cord to the power supply 8
114. rty see the description above CLI Property BUI Property build Build cores Cores device N A faulted status indicator label Label locate writable status indicator manufacturer Manufacturer model Model offline status indicator writeable part Part present status indicator revision Revision serial Serial size Size Chapter 1 Introduction Hardware 20 CLI Property BUI Property speed Speed type combined with use use Type When viewing a disk that is active as a hot spare the detach command is also available Viewing CPU details For example the following shows details for component CPU 0 tarpon maintenance hardware select chassis 000 tarpon maintenance chassis 000 gt select cpu tarpon maintenance chassis 000 tarpon maintenance chassis 000 Properties label present faulted manufacturer model part revision cores speed Tasks BUI cpu select cpu 000 cpu 000 gt show CPU 0 true false AMD Quad Core AMD Opteron tm Processor 8356 1002 03 4 2 14G Locating a failed component Goto the Maintenance Hardware screen Clickthe icon on the Storage System or Disk Shelf which has the fault icon Locate the fault icon in the lists of hardware components and click it The image should be updated to show where that component is physically located Optionally click the icon for that c
115. rvice Required status indicator or by clicking the 3 icon on the Maintenance gt Hardware screen of the BUI for the fan you want to replace Chapter 2 Hardware Maintenance 87 7x20 2 Squeeze the plastic handle and pull the fan tray out ofthe system 3 Unpackthe new fan tray and ensure that the metal locking handle is in the out position 4 Align the fan tray with the slot and push the fan tray into the slot ensuring that the fan tray is fully seated 5 Squeeze the plastic handle and rotate the handle into the locked position 6 Verify that the Fan OK status indicator is lit and that the Fan Fault status indicator on the replaced fan module is dim 7 Verify that the Top Fan status indicator Service Required status indicators and the Locator status indicator Locator button are dim LCC Each drive cage in the ZFS Storage 7700 cabinet contains two Leaf Controller Cards LCCs that are used in a load sharing configuration In the event ofa fault one LCC provides all of the connectivity to the storage and cache devices in the cage A faulted LCC can be replaced without 88 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 shutting down the storage system The following illustration shows the location of LCCs in the 00000000001 OO 2 1 2 lt gt OR Pr us XXX 7700 drive cage 1 Determine whether any ofthe RCCs in the cabinet is faulty or a
116. s faults and software failures defects often included under faults and reports them as active problems on this screen If the phone home service is enabled active problems are automatically reported to Sun Support where a support case may be opened depending on the service contract and the nature ofthe fault Active problems display For each problem the appliance reports what happened when the problem was detected the severity and type ofthe problem and whether it has been phoned home Below are some example faults as they would be displayed in the BUI Date Description Type Phoned Home 2009 09 16 SMART health monitoring firmware reported that a disk Major Fault Never 13 56 36 failure is imminent 2009 09 05 A disk ofa different type cache log or data wasinserted Minor Never 17 42 55 into a slot The newly inserted device must be ofthe same Fault type 2009 08 21 The ZFS pool has experienced currently unrecoverable Major Never 16 40 37 I O failures Error 2009 07 16 A memory module is experiencing excessive correctable Major Fault Never 22 03 22 errors affecting large numbers of pages This information can also be viewed in the CLI gefilte maintenance problems show Problems COMPONENT DIAGNOSED TYPE DESCRIPTION problem 000 2010 7 27 00 02 49 Major Fault SMART health monitoring firmware reported that a failure is imminent on disk HDD 17 Selecting any fault shows more information about the fault
117. same controls in the upper left state name locate reset poweroff as well as listings of all the components in the chassis At the left is a set of images describing the chassis If there are multiple views then you can switch between them by clicking on the name of the view above the image Chapter 1 Introduction 15 Hardware 16 For each view faulted components will be highlighted in red In addition the currently selected component will be highlighted in the image Clicking on a component within the image will select the corresponding component in the list to the right A tab is present for each component type in the following list Each component type has a state icon which will be orange if there is a faulted component of the given type a Disk m Slot m CPU controller only m Memory controller only Fan Power supply PSU Service processor SP controller only Clicking on a component type will display a list of all physical locations within the chassis where components may be present Clicking on a component within the list will highlight it within the appropriate chassis image Clicking on the icon while over a row or double clicking a row will bring up a dialog with detailed information about the component The information displayed in the list depends on the component type but is a subset of the information available in the component detail Disks and service processors support additional opera
118. t and description of processors in the system Memory Total memory in the system System Size and number of system disks used for the system image Data Size and number of data disks in the system chassis This is only valid for standalone systems If there are no data disks present will be displayed Cache Size and number of cache disks in the system chassis This is only valid for expandable systems that support additional disk shelves If there are no cache disks present will be displayed Log Size and number oflog disks in the system chassis This is only valid for standalone on systems If there are no log devices present will be displayed Total Total size and count of all disks in the system Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Hardware Disk Shelves A list of disk shelves if supported is displayed at the bottom ofthe view The thumbnail to the left represents the front ofthe currently selected disk shelf Clicking on the right pointing arrow or double clicking on a row within the list will provide complete details about the disk shelf The state indicator will be orange if the chassis contains any faulted components The following fields are displayed in the list Property Description Name Name of the disk shelf used in faults and alerts This is initially set to the serial number ofthe disk shelf but can be changed by clicking on the name within the list
119. talled to ensure proper air flow A faulted power supply is indicated by an amber colored status LED The power supplies are at the front of the cabinet as shown in the following illustration nnn Man tenete 1 Release the latch then pull out the handle 2 Align the replacement power supply with the empty power supply chassis bay 3 Slidethe power supply into the bay 90 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 4 Close the handle to fully seat the power supply 5 Verify that the green AC Present status indicator is lit 6 Goto the Maintenance gt Hardware screen of the BUI Click details icon for the controller and then click power supply to verify that the status icon is green for the newly installed power supply System Indicator Boards The system level indicator boards are located on the front and rear panels under the top disk cage Both indicator boards can be hot swapped while the system is running Both boards contain the following system level LEDs Locator white which helps you locate the storage system within the data center Fault amber which indicates a system level fault OK green which indicates that the storage system is operating normally The front panel indicator board also contains LEDs for components located on the rear panel Chapter2 Hardware Maintenance 91 7x20 pe Front Panel LED Indicators 1 S
120. tes download uncommitted gt set url ftp foo update pkg gz url ftp foo update pkg gz dory maintenance system updates download uncommitted gt set user bmc user bmc dory maintenance system updates download uncommitted gt set password Enter password password ORR RRR KKK dory maintenance system updates download uncommitted gt commit Transferred 157M of 484M 32 3 Unpacking and verifying media After the file has been transferred it will be automatically unpacked and verified dory maintenance system updates download uncommitted gt commit Transferred 484M of 484M 100 done Unpacking done dory maintenance system updates gt List UPDATE DATE STATUS ak nas 2009 10 14 1 0 nd 2009 10 14 08 45 AKUP_WAITING Chapter 3 System Maintenance 131 Updates Beginning an upgrade To begin an upgrade select the update that constitutes the upgrade From this context you can set any properties specific to the update including applying deferred updates For more information on the set of properties available for the particular update run the help properties command User controllable properties will begin with the update prefix clownfish maintenance system updates ak nas 2009 04 03 1 0 gt help properties Properties that are valid in this context version date status Update media version Update release date Update media status update zfs upgrade gt Apply incompatible s
121. the components without using antistatic precautions especially along the connector edges Required Tools and Information The following tools are needed to service the CRUs Antistatic wrist strap Wear an antistatic wrist strap and use an antistatic mat when handling components such as HDDs LCCs or PCI cards When servicing or removing storage controller components attach an antistatic strap to your wrist and then to a metal area on the chassis Following this practice equalizes the electrical potentials between you and the storage controller Antistatic mat Place static sensitive components on an antistatic mat No 2 Phillips screwdriver Nonconducting No 1 flat blade screwdriver or equivalent Nonconducting stylus or pencil to power on the storage controller Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 Chassis Serial Number To obtain support for your storage controller or to order new parts you need your chassis serial number You can find a chassis serial number label on the storage controller front panel on the left side Another label is on the top of the storage controller Alternatively click the Sun logo in the BUI masthead to obtain the serial number or issue the following command hostname maintenance hardware show Controller Replacement Tasks 7x20 Controller Replacement Tasks HDD or SSD l Identify the failed HDD or SSD by going to the Maintenance Hardware section o
122. the power button for at least four seconds until the Power OK status indicator on the front panel flashes indicating that the storage controller is in standby power mode 1 Disconnect the AC power cords from the rear panel of the storage controller 2 Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack 3 From the front of the storage controller release the two slide release latches 4 While squeezing the slide release latches slowly pull the storage controller forward until the slide rails latch 5 7120 or 7320 To remove the top cover Unlatch the fan module door pull the two release tabs back rotate the fan door to the open position and hold it there Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 Press the top cover release button and slide the top cover to the rear about a half inch 1 3 cm Lift up and remove the top cover 6 7420 or 7720 To remove the top cover Simultaneously lift both cover latches in an upward motion 7 Lift up and remove the top cover 8 Usinga small non metallic screwdriver press the latch and remove the battery from the motherboard The 7420 7720 battery is shown here Chapter2 Hardware Maintenance 83 7x20 9 10 11 84 The following figure shows the 7120 battery Press the replacement battery into the motherboard with the positive side facing upward
123. the third and fourth chain as shown EE SHELF EE me c IF Fe fig 7 Reconnect the three original HBAs as before to the first three chains Power on the controller and wait for it to regain control of connected storage v Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 HBA Expansion pt 2 Len Len Len Len fig 8 Cluster with four HBAs Chapter 2 Hardware Maintenance 117 118 System CHAPTER 3 System Maintenance Introduction The Maintenance gt System screen provides several system level features The screen allows the administrator to View the status ofthe system disks Manage software updates and update the system software Create and restore appliance configuration backups Create and upload a support bundle Repeat the initial setup with existing settings Reset the system to the factory defaults View pending disk firmware updates System Disks The system disks section shows the status ofthe system disks and their current usage The BUI displays this with a pie chart and the CLI as a text list For example tarpon gt maintenance system disks show Properties profile mirror root 1 14G var 52 4M update 2 52M stash 14 8M dump 16 0G cores 18K unknown 39 0G free 401G 119 System 120 Disks DISK LABEL STATE disk 000 HDD 7 healthy disk 001 HDD 6 healthy Note The disk column is not requi
124. tion should be made to each controller The server ILOM provides options for i network and ii serial port connectivity Network connection is the preferred choice as the ILOM serial port does not always allow adequate means of platform data collection WARNING Failure to configure ILOM connectivity may lead to longer than necessary hardware fault diagnosis and resolution times Management Port Configuration All standalone controllers should have at least one NIC port configured as a management interface Select the Allow Admin option in the BUI to enable BUI connections on port 215 and CLI connections on ssh port 22 All cluster installations should have at least one NIC port on each controller configured as a management interface as described above In addition the NIC instance number must be unique on each controller For example nodeA uses nge0 and nodeB uses ngel so that neither may be used as a cluster data interface In addition these interfaces must be locked to the controller using the Configuration gt Cluster option in the BUI In some cases this may require installation ofan additional network interface card on each controller in a cluster configuration If access to the appliance data interfaces is impossible for any reason the management network interface will maintain BUI and CLI access During a cluster takeover interfaces are taken down on the failed controller So locked interface configuration is required to gat
125. tion tasks visualizing concepts and analyzing performance data The management software is designed to be fully featured and functionalon the following supported web browsers Firefox 3 x Internet Explorer 7 and 8 Safari 3 1 or later and WebKit 525 13 or later Chapter 1 Introduction 11 Hardware Hardware 12 Direct your browser to the system using either the IP address or host name you assigned to the NET 0 port during initial configuration as follows https ipaddress 215 or https hostname 215 The login screen appears The online help linked in the top right of the BUI is context sensitive For every top level and second level screen in the BUI the associated help page appears when you click the Help button Command Line Interface CLI The CLI is designed to mirror the capabilities of the BUI while also providing a powerful scripting environment for performing repetitive tasks The following sections describe details of the CLI When navigating through the CLI there are two principles to be aware of Tab completion is used extensively if you are not sure what to type in any given context pressing the Tab key will provide you with possible options Throughout the documentation pressing Tab is presented as the word tab in bold italics m Help is always available the help command provides context specific help Help on a particular topic is available by specifying the topic as an argument to help for example
126. tions described below Each component can report any or all ofthe following properties Property Description Label Human readable identifier for this component within the chassis This is typically but not necessarily equivalent to the label printed on the physical chassis FMRI Fault managed resource identifier FMRI for the component This is an internal identifier used to identify the component within faults and is intended for service personnel Active Problems For a faulted component links to active problems affecting the component Manufacturer Component manufacturer Model Component model Build Manufacturing build identifier This is used to identify a particular location or batch where the component was manufactured Part Component part number or core factory part number The orderable part number may differ depending on whether a component is for replacement or expansion and whether it s part ofa larger assembly Your service provider should be able to refer you to the appropriate orderable part For components without part numbers the model number should be used instead Serial Component serial number Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Hardware Property Description Revision Firmware or hardware revision of the component Size Total memory or storage in bytes Type Disk type Can be one of system data log
127. torage pool update clownfish maintenance system updates ak nas 2009 04 03 1 0 gt get update zfs upgrade version 2009 04 03 1 0 date 2009 4 3 08 45 01 status AKUP WAITING deferred clownfish maintenance system updates ak nas 2009 04 03 1 0 gt set update zfs upgrade onreboot update zfs upgrade onreboot clownfish maintenance system updates ak nas 2009 04 03 1 0 gt 132 After you set any properties execute the upgrade command You are prompted for confirmation and assuming an affirmative the upgrade begins dory maintenance system updates select ak nas 2009 10 14 1 0 nd dory maintenance system updates ak nasQ2009 10 14 1 0 nd upgrade The selected software update requires a system reboot in order to take effect The system will automatically reboot at the end of the update process The update will take several minutes At any time during this process you can cancel the update with Control C Are you sure Y N y Updating from ak nasQ2009 10 11 1 0 Backing up smf 5 done Loading media metadata done Selecting alternate product SUNW iwashi Installing Sun Storage 7110 2009 10 14 1 0 pkg sun com ak SUNW iwashi 2009 10 14 1 0 20091014T084500Z Creating system boot ak nas 2009 10 14 1 0 done Creating system root ak nas 2009 10 14 1 0 done As the upgrade proceeds the latest message will be printed You can cancel the upgrade at any time by pressing C at which point you will be
128. try 000 show Properties 2009 10 15 00 59 37 root timestamp user Chapter3 System Maintenance 143 Logs address lt console gt summary Enabled datalink nge service annotation The annotation is the session annotation which can be enabled when configuring users 144 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7110 7120 7210 7310 7320 7410 7420 7720 Active Directory Alerts Analytics ARC BUI CLI Cluster Controller CPU CRU Dashboard Dataset DIMM Disk Shelf DNS Glossary Sun Storage 7110 Unified Storage System Sun ZFS Storage 7120 Sun Storage 7210 Unified Storage System Sun Storage 7310 Unified Storage System Sun ZFS Storage 7320 Sun Storage 7410 Unified Storage System Sun ZFS Storage 7420 Sun ZFS Storage 7720 Microsoft Active Directory server Configurable log email or SNMP trap events appliance feature for graphing real time and historic performance statistics Adaptive Replacement Cache Browser User Interface Command Line Interface Multiple heads connected to shared storage See Storage Controller Central Prcessing Unit Customer Replaceable Component appliance summary display of system health and activity the in memory and on disk data for a statistic from Analytics dual in line memory module the expansion storage shelf that is connected to the head node or storage controller Domain Name Service 145 DTrace DTrace
129. tus LED and Fan LED should be off Goto the Maintenance gt Hardware screen of the BUI Click for the controller and then click PSU to verify that the icon is green for the newly installed power supply Replacing a SIM Board The SIM boards are hot swappable so you can replace them without removing power to the system The SIM boards are multi pathed so you can remove one of the SIM boards at any time regardless ofthe state of the blue SIM OK indicator A faulted SIM board is indicated by an amber LED Locate the failed SIM at the back of the disk tray Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 Shelf 2 Label and disconnect the tray interface cables 3 Use two hands to disconnect the SAS cable Grasp the metal body of the connector with one hand and firmly grasp and pull the tab gently toward the connector body with the other then pull the connector body outward to extract it from the bulkhead Do not twist or pull the tab in any direction other than parallel with the connector body or it may break If the tab breaks use a small sharp object such as a fine tipped screwdriver to lift the metal spring at the top of the connector shell to unlatch it 4 Loosen the two extraction arm captive screws using your thumb and forefinger If the captive screws are too tight to loosen by hand use a No 2 Phillips screwdriver to loosen each screw 5 Pull each ejector tab outward and push to the sides to releas
130. ual November 2010 Updates Removing update media To remove update media highlight the corresponding row and click on the trash icon Applying deferred updates Any deferred updates will be displayed below the list of available updates If no deferred updates are available no list will be displayed The deferred updates will describe what effects they will have on the system Clicking the Apply button will apply all available deferred updates Deferred updates will apply to both nodes in a cluster and the cluster peer must be up and available to apply any deferred updates Updating via the CLI Because you log into the appliance to use the CLL the upload as described above is actually a download To download the media onto the appliance via the CLI execute the download command in maintenance system updates dory maintenance system updates download dory maintenance system updates download uncommitted get url unset user unset password unset You must set the url property to bea valid URL for the download This may be either local to your network or over the internet The URL can be either HTTP beginning with http or FTP beginning with ftp If user authentication is required it may bea part of the URL e g ftp myusername mypasswd myserver export foo or you may leave the username and password out of the URL and instead set the user and password properties dory maintenance system upda
131. unified_storage 7420 specs xml http www sun com storage disk systems unified storage 7420 specs xml for the most recent component specification The Sun ZFS Storage 7720 Appliance is comprised of two storage controllers in a high availability cluster configuration installed in a Sun Storage 7700 cabinet which houses twelve drive cages Refer to the http www sun com storage disk systems unified storage 7720 specs xml http www sun com storage disk systems unified storage 7720 specs xml for the most recent component specification The 3U chassis form factor dimensions are as follows Dimension Measurement Dimension Measurement Height 13 3cm 5 25in Depth 70 6 cm 27 8 in Width 43 7cm 17 19in Weight 16 36 kg 96 lbs Front Panel Figure Legend 1 Locator LED and button white 7 Power Supply PS Service Required LED 13 Boot drive 1 required 2 Service Required LED amber 8 Over Temperature Warning LED 14 Solid state drive 2 optional 3 Power OK LED green 9 USB 2 0 Connectors 15 Solid state drive 3 optional Chapter2 Hardware Maintenance 43 7420 7720 Figure Legend 4 Power button 10 DB 15 video connector 16 Solid state drive 4 optional 5 Service Processor SP OK LED 11 SATA DVD drive optional green 6 Fan CPU Memory Service 12 Boot drive 0 17 Solid state drive 5 optional Required LED The 500GB boot drives HDDs reside in slots 0 and 1 as a mirrored s
132. uration Backup To create a backup simply click the Backup button above the list of saved configurations and follow the instructions You will be prompted to enter a descriptive comment for the backup Restore from a Saved Configuration Click the rollback icon on any saved configuration to begin the process of reverting the system to that saved configuration Review the Restore Impact guidance above and confirm that it is ok to proceed Delete a Saved Configuration To delete a Saved Configuration simply click the trash can icon to delete the configuration that is no longer required Export a Saved Configuration To export a Saved Configuration mouse over the configuration list entry you wish to export and dick the A download icon Your browser will prompt you to save the file locally The file isa compressed archive whose contents are versioned and may vary over time You should not attempt to unpack or modify the content of the archive and doing so will render it unable to be imported back to the appliance successfully Import a Saved Configuration To import a previously exported Saved Configuration click the add icon at the top of the saved configurations list and then use your web browser s file selection dialog to locate the previously exported configuration You should upload the single compressed archive file previously saved using the export function Managing Configuration Backups Using the CLI The following s
133. views service procedures and software update notes Installation Guide Analytics Guide and Administration Guide http wikis sun com display fishworks documentation Release Notes http wikis sun com display fishworks software updates Third Party Web Site References Third party URLs are referenced in this document and provide additional related information Preface Note Oracle is not responsible for the availability ofthird party Web sites mentioned in this document Oracle does not endorse and is not responsible or liable for any content advertising products or other materials that are available on or through such sites or resources Oracle will not be responsible or liable for any actual or alleged damage or loss caused by or in connection with the use of or reliance on any such content goods or services that are available on or through such sites or resources Documentation Support and Training The Sun web site provides information about the following additional resources Documentation http www sun com documentation Support http www sun com support Training http www education oracle com 8 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 CHAPTER 1 Introduction Overview Introduction The Sun ZFS Storage 7000 family of products provide efficient file and block data services to clients over a network and a rich set of data services that can be
134. wer button lights and remains lit The Maintenance Hardware screen of the BUI provides status ofthe replacement on the Details page for DIMMs 76 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 PCle Cards and Risers Go to the Maintenance gt Hardware screen of the BUI and click the details icon on the controller and then click Slots to locate the faulted component Caution This procedure requires that you handle components that are sensitive to static discharge which can cause the component to fail To avoid damage wear an antistatic wrist strap and use an antistatic mat when handling components Note that the 7120 Sun Flash Accelerator F20 card is a FRU and must be replaced by an Oracle service representative All HBAs must be of the same type Ensure that you upgrade your system software before installing a newly released HBA You must shut down the controller before beginning this task Note that there will be a loss of access to the storage unless the system is in a clustered configuration Shut down the appliance using one ofthe following methods Login to the BUI and click the power icon on the left side of the masthead SSH into the storage system and issue the maintenance system poweroff command SSH or serial console into the service processor SP and issue the stop SYS command Useapen or non conducting pointed object to press and release the Power button on the front p
135. weroff command SSH or serial console into the service processor SP and issue the stop SYS command Usea pen or nonconducting pointed object to press and release the Power button on the front panel To initiate emergency shutdown during which all applications and files will be closed abruptly without saving press and hold the power button for at least four seconds until the Power OK status indicator on the front panel flashes indicating that the storage controller is in standby power mode 70 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 1 Disconnect the AC power cords from the rear panel ofthe storage controller 2 Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack 3 From the front ofthe storage controller release the two slide release latches 4 While squeezing the slide release latches slowly pull the storage controller forward until the slide rails latch 5 7120 or 7320 Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 To remove the top cover Unlatch the fan module door pull the two release tabs back rotate the fan door to the open position and hold it there Press the top cover release button and slide the top cover to the rear about a half inch 1 3 cm Lift up and remove the top cover Also remove the air baffle by p
136. xternal Components This section includes descriptions about the main components included in the 7700 main cabinet External Cables The 7700 appliance is shipped with installed external cables located behind the cabinet doors SAS cables connect the RCCs to the storage controllers and Ethernet cables connect the internal Ethernet bus between the system controllers 56 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7700 The external cables consist of power and data cables The power cables 1 connect the power supplies and system controllers in the main cabinet to the power circuits 2 and 3 in the facility i uh W 3 T T T T es es es that connect to the power sources 4 and 5 Chapter2 Hardware Maintenance 57 7700 The following illustration shows the data cables that create the default cluster configuration between the system controllers and the RCCs Fan Trays Each 7700 cabinet comes with three fan trays that each host three fan modules Individual fan modules cannot be replaced the entire fan tray must be replaced Caution Operating a cabinet for an extended period of time with a fan tray removed reduces the effectiveness of the cooling system and may initiate an emergency thermal shutdown Unpack the replacement fan tray in advance and insert it into the cabinet as soon as the faulted fan tray is removed Cooling for the 7720 controllers is indep
137. ystem level locator 4 Rear panel fan tray fault 2 System level fault 5 Rear panel drive set fault 3 System level OK 6 Rear panel RCC fault In addition to system level indicators the rear panel indicator board also includes LEDs for components on the front panel HE ss sus HEI Ee nm AU tiu E mum m mm jam Rear Panel LED Indicators 1System levellocator 4 Front panel drive set fault 2 System level fault 5 Front panel power supply fault 3 System level OK 92 Sun ZFS Storage 7x20 Appliance Customer Service Manual November 2010 7x20 1 Place a 1 Phillips head screwdriver in the slot at each end of the indicator board 2 Rotate the screw drivers out until the plastic locks clear the locking mechanism and pull the indicator board slightly out of the cabinet to expose the interface connector 3 Disconnect the interface connector and remove the indicator board from the cabinet 4 Removethe replacement board from the packaging 5 Align the board with the slot and connect the interface connector 6 Pushthe board into the slot and ensure that the board is fully seated in the slot 7 Verify that the procedure was successful by logging in to the Sun ZFS Storage appliance software checking the system status and clicking the associated X locator icon in the Cabinets section ofthe Maintenance Hardware BUI page Storage Expansion Upgrade The 7700 drive cage expansion kit consists of 2 LCCs

Sun ZFS Storage 7x20 Appliance Customer Service Manual

Contents

Download Pdf Manuals

Related Search

Related Contents