Home

Sun Enterprise 10000 System Service Manual

Contents

1. FIGURE 1 9 Fan Power and Control Block Diagram I Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 25 Control board CBO JTAG System TDO JTAG boards TCK board 1 16 DI controller Interconnect jase Processor Clocks Sys_Reset pwr src Reset Serial interface JTAG Centerplane ASIC TMS gt JTAG Power rDo _ JTAG scan ring _ 33V TCK 7 Lpur A System DI board __AtoD 3 3 dude controller A to D resets Interconnect CR Ok Inter Out 17 jase Clocks CB_Phase 2 Sys_Reset Centerplane JTAG DC pwrSrc Reset support bd CPO Resets board 5 controller Housekeeping power 75 JTAG Centerplane ASIC I TMS JTAG Power TDO JTAG scan ring _ 33 oi pwr POI Aren 33 controller A to D Interconnect CB_CIK_ Inter Out 17 ase Clocks Phase 2 Sys_Reset Centerplane pwrsrc Reset support bd CP1 Resets 5 Housekeeping power 33 Control board CB1 Centerplane 1 26 FIGURE 1 10 Fan Power and Control Block Diagram II Sun Enterprise 10000 System Service Manual March 2002 Global address
2. Sum Om BE MOSSES FIGURE 1 4 Component Numbering Back Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 21 NARARARAA u x SIL gt SOS SBus 0 Slot 0 SBus 0 Slot 1 SBus 1 Slot 0 SBus 1 Slot 1 FIGURE 1 5 System Board Component Numbering 1 22 Sun Enterprise 10000 System Service Manual March 2002 Bank 3 Bank 1 Bank 0 Centerplane side Bank 2 FIGURE 1 6 Memory Bank Locations LC MME NS PST CMTS P29 7 MSG P28 CNE MTG P26 LE MMI2 P5_ INS 5 P24 7 C_______MM31 P23_ Le MM ART a ee Z O INS P20 CL MM30 PI9 ______ EL MM PT CTO PT Co MIN 7 PIG CMM PT ________MMO7 PiTE_ ING PTR IMG PTO Po M2 PB Centerplane side FIGURE 1 7 Memory DIMM Locations Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 23 H RPCO RPC1 RPC2 RPC3 RPC4 SBUS 0 SLOT 0 CBO CB1 REMOTE SBUS 0 SLOT 1 ON OFF SBUS 1 SLOT 0 PCI 0 0 RPCO SBUS 1 SLOT 1 SES RPC2 PCI 1 0 RPC3 RPC4 FIGU
3. ET TOUTES AUTRES CONDITIONS DECLARATIONS ET GARANTIES EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE A L APTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFA ON eo 1 CA Adobe PostScript Contents Preface xv Component Replacement Guidelines Indicators and Nomenclatures 1 1 1 1 1 2 1 3 1 4 1 5 1 6 1 7 1 8 1 9 Configuration Rules 1 3 Testing the System 1 4 Reviewing System Temperatures 1 4 Hardware Indicators 1 5 1 4 1 Fans 1 6 1 4 2 Centerplane Support Boards 1 7 1 4 3 Control Board 1 8 1 44 System Board 1 9 Inserting a Board 1 10 Standard Torque Settings 1 11 Field Replaceable Units 1 13 Component Numbering 1 14 System Block Diagrams 1 24 Power and Cooling Component Replacement Procedures 2 1 2 1 2 2 2 3 SSP Replacement 2 1 Disk Replacement 2 1 AC Input Module Replacement 2 2 Contents iii 2 3 1 Isolating a Failed AC Input Module 2 2 2 3 2 Powering Off an AC Input Module 2 2 2 3 3 Removing an AC Input Module 2 4 2 34 Installing an AC Input Module 2 4 2 3 5 Powering Onan AC Input Module 2 4 2 3 6 Verifying an AC Input Module 2 4 2 4 48 Volt Power Supply Replacement 2 5 2 4 1 Isolating a Failed Power Supply 2 5 2 4 2 Powering Off a 48 Volt Power Supply 2 5 2 4 3 Removing a 48 Volt Power Supply 2 5 2 4 4 Installing a 48 Volt Power Supply 2 5 2 4 5
4. FIGURE 8 2 Power Shelf Cable Connections 8 4 Sun Enterprise 10000 System Service Manual e March 2002 TABLE 8 1 System Interconnect Cable Chart From To Function CC J10 PS1 J8 Sys 6 Sys 7 CC J9 PS1 J7 Sys 4 Sys 5 CC J8 PS1 J6 Sys 2 Sys 3 CC J7 PS1 J5 Sys 0 Sys 1 CC J6 PS1 J4 Ctl 0 Fan 0 top CC J5 PS2 J7 Sys 15 Ctl 1 CC J4 PS2 J6 Sys 14 Fan 2 top CC J3 PS2 J5 Sys 12 Sys 13 CC J2 PS2 J4 Sys 10 Sys 11 CC J1 PS2 J3 Sys 8 Sys 9 CC J12 PS1 J11 PS1 top AC Control CC J11 PS2 J11 PS2 top AC Control CC J16 PS1 J3 Fan 1 Bottom CC J15 PS2 J8 Fan 3 Bottom CC J14 PS1 J12 PS1 Bot AC Ctl CC J13 PS2 J12 PS2 Bot AC Ctl PS1 J1 PS2 J2 PS1 PS2 Jumper Rtn PS1 J2 PS2 J1 PS1 PS2 Jumper Rtn PS1 J9 PS2 J10 PS1 PS2 Jumper 48V PS1 J10 PS2 J9 PS1 PS2 Jumper 48V Legend CC Cardcage Bulkhead PS1 Power Shelf 1 PS2 Power Shelf 2 Chapter 8 Mechanical Component and Cable Replacement Procedures 8 5 8 2 1 8 2 2 8 2 3 Replacing Remote Power Control Cables To hot swap a remote power control cable see Section 2 7 2 Powering Off a Remotely Controlled AC Sequencer on page 2 12 and Section 2 7 6 Powering On a Remotely Controlled AC Sequencer on page 2 18 Replacing an AC Power Cord To hot swap an AC power cord see Section 2 3 3 Removing an AC Input Module on page 2 4 Replacing an Internal Cabinet Cable Caution The internal cabinet cables are NOT considered hot swappable These procedures re
5. PCI 1 0 SB2 PCI 0 0 PCI 1 0 SB3 PCI 0 0 PCI 1 0 SB4 PCI 0 0 PCI 1 0 SB5 PCI 0 0 PCI 1 0 SB6 PCI 0 0 PCI 1 0 Cable Label SBO PCI0 0 0 PCI0 1 0 SB1 PCI1 0 0 PCI1 1 0 SB2 PCI2 0 0 PCI2 1 0 SB3 PCI3 0 0 PCI3 1 0 SB4 PCI4 0 0 PCI4 1 0 SB5 PCI5 0 0 PCI5 1 0 SB6 PCI6 0 0 PCI6 1 0 Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 17 TABLE 1 14 I O Numbering Continued SBus PCI Front Panel Cable Front Panel Cable Component POST Solaris ID Label Label Solaris ID Label Label System Board 7 sysbd 7 SB7 SB7 SB7 SB7 I O Port 0 scard 7 0 0 sbus 5c SBUSOSLOTO SB7 0 0 pci 5c PCI 0 0 PCI7 0 0 I O Port 1 scard 7 0 1 sbus 5c SBUS 0 SLOT 1 SB7 0 1 I O Port 2 scard 7 1 0 sbus 5d SBUS 1 SLOT O0 SB7 1 0 pci 5d PCI 1 0 PCI7 1 0 I O Port 3 scard 7 1 1 sbus 5d SBUS 1 SLOT 1 SB7 1 1 System Board 8 sysbd 8 SB8 SB8 SB8 SB8 I O Port 0 scard 8 0 0 sbus 60 SBUS 0 SLOT O0 SB8 0 0 pci 60 PCI 0 0 PCI8 0 0 I O Port 1 scard 8 0 1 sbus 60 SBUS 0 SLOT 1 SB8 0 1 I O Port 2 scard 8 1 0 sbus 61 SBUS1SLOTO SB8 1 0 pci 61 PCI 1 0 PCI8 1 0 I O Port 3 scard 8 1 1 sbus 61 SBUS1SLOT1 SB8 1 1 System Board 9 sysbd 9 SB9 SB9 SB9 SB9 I O Port 0 scard 9 0 0 sbus 64 SBUSOSLOTO SB9 0 0 pci 64 PCI 0 0 PCI9 0 0 I O Port 1 scard 9 0 1 sbus 64 SBUS 0 SLOT 1 SB9 0 1 I O Port 2 scard 9 1 0 sbus 65 SBUS 1 SLOT O0 SB9 1 0 pci 65 PCI 1 0 PCI9 1 0 I O Port 3
6. scard 6 0 0 scard 6 0 1 scard 6 1 0 scard 6 1 1 Solaris ID sbus 40 sbus 40 sbus 41 sbus 41 sbus 44 sbus 44 sbus 45 sbus 45 sbus 48 sbus 48 sbus 49 sbus 49 sbus 4c sbus 4c sbus 4d sbus 4d sbus 50 sbus 50 sbus 51 sbus 51 sbus 54 sbus 54 sbus 55 sbus 55 sbus 58 sbus 58 sbus 59 sbus 59 SBus Front Panel Label SBO SBU SBU SBU SBU SB1 SBU SBU SBU SBU SB2 SBU SBU SBU SBU SB3 SBU SBU SBU SBU SB4 SBU SBU SBU SBU SB5 SBU SBU SBU SBU SB6 SBU SBU SBU SBU S 0 SLOT 0 S 0 SLOT 1 S 1 SLOT 0 S 1 SLOT 1 S 0 SLOT 0 S 0 SLOT 1 S 1 SLOT 0 S 1 SLOT 1 S 0 SLOT 0 S 0 SLOT 1 S 1 SLOT 0 S 1 SLOT 1 S 0 SLOT 0 S 0 SLOT 1 S 1 SLOT 0 S 1 SLOT 1 S 0 SLOT 0 S 0 SLOT 1 S 1 SLOT 0 S 1 SLOT 1 S 0 SLOT 0 S 0 SLOT 1 S 1 SLOT 0 S 1 SLOT 1 S 0 SLOT 0 S 0 SLOT 1 S 1 SLOT 0 S 1 SLOT 1 Cable Label SBO SB0 0 0 SB0 0 1 SB0 1 0 SB0 1 1 SB1 SB1 0 0 SB1 0 1 SB1 1 0 SB1 1 1 SB2 SB2 0 0 SB2 0 1 SB2 1 0 SB2 1 1 SB3 SB3 0 0 SB3 0 1 SB3 1 0 SB3 1 1 SB4 SB4 0 0 SB4 0 1 SB4 1 0 SB4 1 1 SB5 SB5 0 0 SB5 0 1 SB5 1 0 SB5 1 1 SB6 SB6 0 0 SB6 0 1 SB6 1 0 SB6 1 1 Solaris ID pci 40 pci 41 pci 44 pci 45 pci 48 pci 49 pci 4c pci 4d pci 50 pci 51 pci 54 pci 55 pci 58 pci 59 PCI Front Panel Label SBO PCI 0 0 PCI 1 0 SB1 PCI 0 0
7. Power off the breakers on the AC input modules Open the access doors Attach a wrist strap and remove all of the fan trays from the front and rear of the fan centerplane that is to be replaced See Section 2 8 3 Removing a Fan Tray on page 2 19 Verify that the control cables are properly identified Disconnect the power cable and four control cables from the fan centerplane Remove and retain the ten fastener subassemblies screw washer and spacer using a 2 5 hex driver Remove the fan centerplane from the cabinet Installing a Fan Centerplane Attach a wrist strap From the front insert the fan centerplane into the cabinet 6 4 Sun Enterprise 10000 System Service Manual March 2002 Align the holes and insert the all the fastening hardware Using a 2 5 hex driver tighten to a torque of 0 6 Nm 5 3 inch pounds Connect the power cable and four control cables to the fan centerplane Install the fan trays See Section 2 8 4 Installing a Fan Tray on page 2 19 Close the access doors Using the breakers on the AC input module power on the AC input modules Power on the system by typing ssp power on all Chapter 6 Centerplane Support Board and Fan Centerplane Replacement Procedures 6 5 6 6 Sun Enterprise 10000 System Service Manual e March 2002 CHAPTER 7 Centerplane Replacement Procedures Note All commands performed through th
8. actionsysclock System clock being set T 13 Type ssp cb_prom e cb_prom Erase PROM cb_prom Erase complete Chapter 9 Software Procedures 9 11 14 15 16 Type ssp cd tftpboot ssp cb_prom p flash boot ma Ch prom Program PROM with file flash_boot ima cb_prom Program complete Type ssp cb_ reset Resetting host e10000 cb0 Resetting host e10000 cb1 Check that the var opt SUNWssp adm messages file shows the new PROM version Mar 12 14 44 51 e10000 cb0 cbe cbe NOTICE MT initiated Prom Version 3 47 9 12 17 18 19 20 21 Configure the other control board as primary See Section 9 3 Configuring a Control Board Using SSP Version 3 1 and Subsequent Compatible Versions on page 9 6 Reboot the SSP ssp init 6 Log in to the SSP as user ssp When prompted for the SUNW_HOSTNAME use either the platform name or the name of an existing domain Repeat Step 10 through Step 16 Reconfigure the original primary control board as the current primary control board See Section 9 3 Configuring a Control Board Using SSP Version 3 1 and Subsequent Compatible Versions on page 9 6 Sun Enterprise 10000 System Service Manual March 2002 9 6 Changing the Clock Multiplier Use this procedure when changing to different speed processor modules To upgrade from a 250MHz processor module to a 336MH
9. c Install the new cable d Reinstall fan trays e Skip to Step 8 Replacing a Fan Centerplane to Bulkhead Sense Cable a For the upper cables remove fan trays ft0 ft2 for the lower cables remove fan trays ft4 ft6 b Disconnect and remove the cable c Install the new cable d Reinstall fan trays e Skip to Step 8 Chapter 8 Mechanical Component and Cable Replacement Procedures 8 7 7 Replacing a Fan Centerplane to Centerplane Cable a Confirm that the cables attached to CBO SBO and SB1 are labeled with the SBus location number and remote power control connections b In the table below record the serial numbers and locations of SBO and SB1 TABLE 8 2 Component Serial Numbers Location Serial Number Location Serial Number SBO SB1 c Disconnect the cables from CBO SBO and SB1 d Remove CBO CSBO SBO and SB1 e Disconnect and remove the cable f Install the new cable g Reinstall CBO CSBO SBO and SB1 h Reconnect all cables to CBO SBO and SB1 8 Turn on all AC input breakers 9 Power on the system by typing ssp power on all 8 8 Sun Enterprise 10000 System Service Manual March 2002 CHAPTER 9 Software Procedures Note All commands performed through the Hostview GUI hostview 1M can also be performed by other SSP user commands such as the power 1M command or the fan 1M command 9 1 Restoring the Thermal Calibration Information Using SSP Ve
10. o Ze Connector B Remote power control module to control board 5 feet 1524 mm Remote power control module to control board 10 feet 3048 mm F530 2401 F530 2400 FIGURE A 11 Sequencing Cable ee EXD SES n O Connector A Description Part Number Socket 1 mi mj i O Connector B Remote power control module to AC sequencer 20 feet 6096 mm Remote power control module to AC sequencer 20 inches 508 mm F530 2403 F530 2402 Appendix A Illustrated Parts Breakdown A 15 FIGURE A 12 Domestic Power Cord EE De P2 Im E Description Part Number P1 7 9 4 d 8 SD AC power cord U S A 20 0 feet 610 cm F530 2379 FIGURE A 13 European Power Cord rl 9 posse Description Part Number AC power cord European 20 0 feet F530 2380 610 cm A 16 Sun Enterprise 10000 System Service Manual March 2002 FIGURE A 14 Card Cage Power Cable Pin 1 ds z 8 g 2 3 at Ls o 6068 Pin 1 Description Part Number Cable internal to cabinet card cage F530 2393
11. 2 See Section 3 2 3 Removing a System Board on page 3 10 to remove the system board and place it on a flat sturdy ESD protected surface with the FRU side up Chapter 5 System Board Memory and CPU Module Replacement Procedures 5 7 3 Remove the four Phillips screws from the system board cover and remove the cover 4 Loosen the five captive 3 32 inch hex screws located on the compression connector 5 To remove the processor module lift up and away from obstructions and place on a flat ESD protected surface FIGURE 5 6 Processor SD FIGURE 5 6 Replacing System Board Processor Module 5 4 2 Installing a Processor Module 1 If no processor modules exist on this board install them in the following order 5 8 Sun Enterprise 10000 System Service Manual e March 2002 1 Processor 0 2 Processor 2 3 Processor 1 4 Processor 3 For increased processor performance avoid populating processors 0 and 1 together and processors 2 and 3 together Verify that the new processor module speed is the same as all other processor modules that are installed or will be installed in the system Mixing processors speeds in a system will cause processors that do not match the system clock speed to fail Refer to sys_clock 1M Verify that the new processor module cache size is the same as all other processor modules that are installed or will be installed on the system board Mixing cache sizes on a syst
12. 4 Removing a Control Board 3 6 3 15 Installing a Control Board 3 7 3 1 6 Powering On a Control Board 3 7 3 17 Configuring a Newly Installed Control Board as the Primary Control Board 3 8 3 1 8 Verifying a Control Board 3 8 3 2 System Board Replacement 3 9 3 2 1 Isolating a Failed System Board or Mezzanine Board 3 9 3 22 Powering Off a System Board 3 9 3 2 3 Removing a System Board 3 10 3 2 4 Installing a System Board 3 10 3 2 5 Powering On a System Board 3 11 3 2 6 Configuring a System Board 3 12 3 2 7 Verifying a System Board or Mezzanine Board 3 12 3 3 System Board Component Replacement 3 13 Contents v 4 System Board I O Component Replacement Procedures 4 1 41 SBus Component Replacement 4 1 4 1 1 Removing an SBus Card 4 1 4 1 2 Installing an SBus Card 4 2 4 1 3 Removing an SBus I O Module 4 4 4 1 4 Installing an SBus I O Module 4 5 4 2 PCI Component Replacement 4 7 42 1 Accessing PCI Components 4 8 4 2 2 RemovingaPCI Card 4 9 42 3 Installing a PCI Card 4 10 4 2 4 Removing a PCII O Module 4 12 42 5 Installing a PCI I O Module 4 13 4 2 6 Removing a PCI Riser Card 4 15 4 2 7 Installing a PCI Riser Card 4 16 4 2 8 Completing a PCI Component Replacement Procedure 4 16 43 Personality Plate Replacement 4 17 4 3 1 Removing a Personality Plate 4 17 4 3 2 Installing a Personality Plate 4 20 5 System Board Memory and CPU Module Replacement Procedures 5 1 5 1 Memory Component Replacement 5 1 5 11 Isolating a Failed DIMM 5
13. Control Board Components Mezzanine module Part Number Description Call for PN Mezzanine board Call for PN SIMM module A 11 Illustrated Parts Breakdown Appendix A FIGURE A 7 System Power Components AC Input module 48 VDC power supply Description Part Number Power shelf assembly left F540 3060 Power shelf assembly right F540 3069 AC input module assembly F540 3441 Power supply 48 VDC F300 1368 Circuit breaker assembly DC distribution F150 2901 A 12 Sun Enterprise 10000 System Service Manual March 2002 FIGURE A 8 Peripheral Power Components AC sequencer Remote power control module Description Part Number AC sequencer F300 1290 AC sequencer power cord F530 2265 Peripheral filler panel Call for PN Remote power control module assembly F540 3440 with cable Appendix A Illustrated Parts Breakdown A 13 FIGURE A 9 Cooling Components Fan Centerplane AC DI gt EE gt Description Part Number Fan centerplane F501 4365 Fan tray assembly F540 3409 Fan tray filler panel F540 3075 Air filter card cage F370 2845 A 14 Sun Enterprise 10000 System Service Manual March 2002 FIGURE A 10 Remote Power Control Cable e i Connector A Description Part Number Socket 1 D D o o o
14. To delete a file type rm filename Shell Prompts Shell C shell C shell superuser Bourne shell and Korn shell Bourne shell and Korn shell superuser xvi Sun Enterprise 10000 System Service Manual March 2002 Prompt machine name machine name Related Documents Part Application Title Number Service Sun Enterprise 10000 System Read Me First 805 2913 Sun Enterprise 10000 System Unpacking Guide 805 2915 Sun Enterprise 10000 System Qverview 805 0310 Sun Enterprise 10000 System Site Planning Guide 805 2914 Sun Enterprise 10000 Hardware Installation and De Installation Guide 805 4651 Sun Enterprise 10000 System Service Guide 805 2917 Sun Enterprise 10000 System Service Reference I 805 3622 Sun Enterprise 10000 System Service Reference II 805 3623 Sun Enterprise 10000 System Service Processor Quick Reference 805 3827 Accessing Sun Documentation Online The docs sun com M web site enables you to access a select group of Sun technical documentation on the Web You can browse the docs sun com archive or search for a specific book title or subject at http docs sun com Preface xvii Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions You can email your comments to Sun at docfeedback sun com Please include the part number 805 2917 16 of your document in the subject line of your email xviii Sun Enterpr
15. arbiter GAARB Global address router GAMOX Global address arbiter Global address router Global address arbiter Global address router Global address arbiter Global address router Coherency Coherency Coherency Coherency interface interface interface interface cntrl CIC cntrl CIC cntrl CIC cntrl CIC Local address arbiter LAARB Memory Port Port Port controller controller controller controller MC PC PC PC O O O O s Ba NE E SPSS ab 005 el a a Ofc D BB E 5 5 5 5 P g lt Da Data Data Data gx buffer buffer buffer buffer o 2 XDB XDB XDB XDB 15 o Local data router LDMUX Global data Global data arbiter GDARB router GDMUX FIGURE 1 11 System Board Block Diagram Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 27 Global address router 4 System boards up to 16 Global data interconnect 16 x 16 Global data arbiter 1 2 All global devices are located on the centerplane FIGURE 1 12 Sun Enterprise 10000 System Interconnect Diagram 1 28 Sun Enterprise 10000 System Service Manual March 2002 CHAPTER 2 Power and Cooling Component Replacement Procedures Note All commands performed through the Hostview GUI hostview 1M can also be performed by other SSP
16. bit wide UPA port Multiprocessor Ultra Port Architecture UPA refers to the module interface which plugs into the interconnect The UPA module may contain a processor or it may contain an I O controller graphics device and so on Same as Unrecoverable Error An error which cannot be corrected through hardware or software action Error detected by the hardware indicating that data has been lost This type of error is fatal and results in an arbiter stop condition A SPARC V9 processor signals itself internally to take a Watchdog Reset WDR trap at physical address offset 0x40 PA 0x1ff f0000 0040 when a trap occurs and TL is at MAX_TL Data Crossbar An application of the XMUX on the centerplane Data Buffer chip Buffers cache lines that are in transit between a UPA data port or a memory bank and the local data router Arbiter Chip Has modes to implement three functional units the local address arbiter the local data arbiter and the global address arbiter Externally Initiated Reset An externally initiated reset is sent to the CPU by the XIR pin It causes a SPARC V9 XIR which has a trap type 0x3 at physical address offset 0x60 PA 0x1ff f000 0060 Multiplexer chip Has modes to implement four functional units the global address router the local data router the global data router and the 144 576 bit wide pack unpack on the memory module Sun Enterprise 10000 System Service Manual e March 2002 Index A AC in
17. card filler panel 4 3 4 11 SBus I O module 4 4 system board 3 10 removing component caution 1 2 replacement AC input module 2 2 to 2 4 AC sequencer 2 11 to 2 18 air filter 2 21 breaker DC 2 9 to 2 11 cables to 7 9 8 2 to centerplane 7 1 to 7 10 centerplane support board 6 1 to 6 3 control board 3 1 to 3 7 fan centerplane 6 4 to fan tray 2 18 to 2 20 memory 5 2 memory module 5 4 mezzanine boards 5 8 to 5 11 panels 8 1 PCII O module 4 12 power shelf 2 6 to power supply 48 volt 2 5 to 2 6 processor module 5 8 SBus card 4 1 SBus I O module 4 4 SSP 2 1 Index 3 system board 3 8 to 3 12 rules configuration 1 3 S SBus card filler panel 4 3 4 11 installing 4 2 removing 4 1 replacement 4 1 SBus I O module installing 4 5 removing 4 4 replacement 4 4 SBUS x SLOT x 1 17 SBx 1 15 SBx x x 1 15 1 17 speed processor module configuration 1 3 SSP replacement 2 1 SunVTS 1 4 SunVTS 1M 1 4 sysbdx 1 15 1 17 system powering off 7 4 powering on 7 9 system board installing 3 10 powering off 3 9 powering on 3 11 removing 3 10 replacement 3 8 to 3 12 T testing 1 4 thermal calibration 3 12 9 1 torque settings general 1 11 Index 4 Sun Enterprise 10000 System Service Manual e March 2002
18. centerplane Normally two centerplane support boards are used each connecting into opposite sides of the centerplane Coherency Interface Controller Handles coherency transactions for the three port controllers on a board Connects to one of four global address buses Snoops for one quarter of the address space Centerplane Loopback Mode Board that connects into the centerplane and provides the system s JTAG clock fan power serial interface and Ethernet interface functions Any error that can be corrected so that processing can continue with no loss of data This includes automatic correction by hardware algorithmic correction by software and correction by hardware with software intervention Correctable errors are all hardware initiated Control and Status Register Mode in which only half of the centerplane is in use 72 bits of data two address buses and one centerplane support board Glossary 1 Domain DR Dtags ECC Externally Initiated Reset XIR Fatal Error GAARB GAB GDARB GDR Host name HO module JBC JTAG LAARB LAR Glossary 2 A set of one or more system boards that act as a separate system capable of booting and running the Solaris operating environment and independently of any other domains Dynamic Reconfiguration Duplicate tags Three SRAMs attached to each coherent interface controller provide coherency information that duplicates that maintained in each UltraSPA
19. control board 0 CB0 and control board 1 CB1 to the remote power control modules located in the processor cabinet I O space The output of a remote power control module is then connected to an AC sequencer located either in the processor cabinet I O space or an I O expansion cabinet see FIGURE 2 2 Chapter 2 Power and Cooling Component Replacement Procedures 2 13 Control board 0 CBO Control board 1 CB1 RPCO RPC1 RPC2 RPC3 RPC4 NNW ON NI EN emote el control modules CBO CB1 LI e Li Remote ME ON OFF A AC sequencer ny Pater off 3 Dia e FIGURE 2 2 Remote Power Control Remote power control modules can be programmed to addresses 0 5 When the control board issues a command and address each remote power control module programmed for that address will respond You can connect a remote power control module address to a single AC power sequencer or to a string of AC power sequencers When the command power p 3 off is issued the remote power control module or modules that are programmed for address 3 will power off see FIGURE 2 3 Subsequently all AC power sequencers attached to those remote power control modules and their associated peripherals will also power off 2 14 Sun Enterprise 10000 System Service Manual e March 2002 Contr
20. far Lift the SBus card from the socket at an angle while guiding the faceplate out from the back panel opening FIGURE 4 1 4 1 6 Place the SBus card in an antistatic bag 7 If the SBus card is not immediately replaced install a filler panel part number 340 2305 in the system board faceplate opening Caution Be sure to install the filler panel in each vacant slot opening A missing filler panel can impair system cooling and FCC regulatory compliance SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1 onality plate with gasket FIGURE 4 1 Replacing System Board SBus Card 4 1 2 Installing an SBus Card If converting from PCI to SBus the personality plate must be removed and replaced prior to installing any SBus electrical components Note SBus cards require that the black handles be installed on the cards in order to be installed into the Sun Enterprise 10000 system 4 2 Sun Enterprise 10000 System Service Manual March 2002 Determine the slot for installing the SBus card For maximum I O performance avoid populating SBus 0 Slot 0 and SBus 0 Slot 1 together and SBus 1 Slot 0 and SBus 1 Slot 1 together If a filler panel covers the desired SBus slot lift the two tabs and detach the filler panel Attach a wrist strap and take the SBus card out of the protective packaging Inspect the
21. messages in var opt SUNWssp adm domain name messages Powering Off a 48 Volt Power Supply Power off the 48 volt power supply by using hostview 1M or by typing 3 ssp power off ps x Where x 0 7 Refer to power 1M for additional information Removing a 48 Volt Power Supply Caution If the yellow LEDs are lit on the power supply do not remove the component See Section 2 4 2 Powering Off a 48 Volt Power Supply on page 2 5 Open the access door Open the door to the power shelf Pull out the 48 volt power supply and place on a flat sturdy ESD protected surface Installing a 48 Volt Power Supply Insert the 48 volt power supply into the power shelf Chapter 2 Power and Cooling Component Replacement Procedures 2 5 2 4 5 2 4 6 Push firmly to engage the rear connectors Powering On a 48 Volt Power Supply Locate the AC input module for the power supply that is off see TABLE 2 2 On the AC input module power both breakers on Close the door to the power shelf Close the access door Verifying a Power Supply Use the following checklist to confirm that a component is operational m Check that the power supply fans are on m Check the power status using hostview or the power command m Check for error messages in var opt SUNWssp adm domain name messages 2 5 2 5 1 A Power Shelf Replacement Removing a Power Shelf Caution The power she
22. plate into place against the EMI gasket as shown in FIGURE 4 20 Do not place the personality plate between the EMI gasket and faceplate Personality Plate EMI gasket Ca Se Angled flange s Front stiffener with notch FIGURE 4 20 Installing a Personality Plate Top View 5 Compress the personality plate against the EMI gasket to align the screw holes Sustain this force to relieve stress on the screw threads while installing the three attachment screws as noted in FIGURE 4 21 Chapter 4 System Board I O Component Replacement Procedures 4 21 10 11 Compress personality plate and faceplate in this direction while removing attachment screws Remove install attachment screws here FIGURE 4 21 Installing a Personality Plate If using PCI components install the PCI front bracket Replace the I O module if necessary See Section 4 1 4 Installing an SBus I O Module on page 4 5 or Section 4 2 5 Installing a PCI I O Module on page 4 13 Install the I O cards if necessary See Section 4 1 2 Installing an SBus Card on page 4 2 or Section 4 2 3 Installing a PCI Card on page 4 10 If using PCI components install the PCI front cover Replace the system board cover and secure with screws tightening to a torque of 0 8 Nm 7 1 inch pounds See Section 3 2 4 Installing a System Board on page 3 10 to confirm that the event monitoring daemon is running prior
23. remove the component See Section 2 7 2 Powering Off a Remotely Controlled AC Sequencer on page 2 12 Open the access door Note the origination of all power cords connected to the AC sequencer Power off the AC circuit breaker on the AC sequencer Disconnect all cables from the AC sequencer and the remote power control modules Remove the four Phillips screws that secure the AC sequencer Remove and place the unit on a flat sturdy ESD protected surface Installing an AC Sequencer Place the AC sequencer into the cabinet and align the attachment slots to the holes on the RETMA rails 2 12 Sun Enterprise 10000 System Service Manual e March 2002 2 Use the four Phillips screws to secure the AC sequencer to the RETMA rails W Connect the power cord to the AC sequencer and to the wall receptacle Va Connect the cables from the peripherals to the AC sequencer and the remote power control modules 5 Power on the AC circuit breaker on the AC sequencer 6 Close the access door 2 19 Configuring an AC Sequencer I O cabinets can be controlled remotely from the control board using the power 1M command To do this the control board must be connected to the AC sequencer To facilitate multiple control boards this connection is done with remote power cables and a remote power control module The control board has five remote power control connections RPCO RPC4 These are connected from both
24. running host domains Issue the standard Solaris shutdown command for all domains that are running the Solaris operating environment From a main SSP window as user ssp power off all system components except the control boards ssp power off all Log in to the main SSP as root Obtain the host names and IP addresses for the two control boards As user root execute the ssp_config 1M command The following is a sample with snax cb0 as the current primary control board After running this command snax cb1 is the primary control board Chapter 9 Software Procedures 9 3 9 4 CODE EXAMPLE 9 1 The ssp_config 1M Command ssp opt SUNWssp bin ssp_config Beginning setup of this workstation to act as a MAIN or SPARE SSP Platform name snax Control Board 0 snax cb0 gt 129 153 49 181 Control Board 1 snax cb1 gt 129 153 49 182 Primary Control Board snax cb0 Is this correct y n n The platform name identifies the entire host machine to the SSP software The platform name occupies a different name space than domain names hostnames of bootable systems Please enter the name of the platform this ssp will service snax Do you have a control board 0 y n y Please enter the host name of the control board 0 snax cb0 I could not automatically determine the IP address of snax cb0 Please enter the IP address of snax cb0 129 153 49 181 You should make sure that this host IP address is
25. screws tightening to a See Section 3 2 4 Installing a System Board on page 3 10 to confirm that the event monitoring daemon is running prior to installing the system board Removing a Memory Module Attach a wrist strap See Section 3 2 3 Removing a System Board on page 3 10 to remove the system board and place it on a flat sturdy ESD protected surface with the FRU side up 3 Remove the four Phillips screws from the system board cover and remove the cover 4 Remove the eight Phillips screws from the memory module 5 Loosen the ten captive 3 32 inch hex screws located on the compression connector 6 To remove the memory module lift straight out and place on a flat ESD protected surface FIGURE 5 3 5 o EOS o E o o fa DA di A e i E S Queen QRR OHO FIGURE 5 3 Replacing the System Board Memory Module Chapter 5 System Board Memory and CPU Module Replacement Procedures 5 5 5 3 2 Installing a Memory Module 1 Prior to installing the module wipe the gold pads of the system board and the exposed contacts of the compression connector with a lint free nonabrasive cloth 2 Align the memory module compression connectors to the system board compression connectors 3 Tighten the ten captive connector screws clockwise with a 3 32 inch hex driver a T
26. the upper terminal of the circuit breakers is connected to the 48 VDC power bus This wire should be removed first followed by the remaining wires 2 6 3 Installing a Circuit Breaker 1 Use TABLE 2 3 to connect the wires to the breaker in their respective positions TABLE 2 3 Circuit Breaker Wiring Primary Power Shelf Secondary Power Shelf Slot Wire label Slot Wire label FT4 7 W1 SB8 W1 FT0 3 W2 SB9 W12 CSB0 CB0 W3 SB10 W3 SBO W5 SB11 W2 SB1 W4 SB12 W5 SB2 W7 SB13 WA SB3 W6 SB14 W7 SB4 WO SB15 WI SB5 W8 CSB1 CB1 W8 SB6 W11 FT8 11 W6 SB7 W10 FT12 15 W11 1 The source wires are all common and therefore unlabeled and can be connected to any circuit breaker 2 10 Sun Enterprise 10000 System Service Manual e March 2002 2 6 4 Caution Verify breaker alignment prior to insertion to prevent possible damage of the breaker mating slot Insert the circuit breaker into the available circuit breaker slot Install the two M3 flat head Phillips screws to attach the breaker to the panel Torque the M3 flat head Phillips screws to 0 6 Nm 5 inch pounds Bundle the wires neatly using tie wraps as needed Insert the cable bundle into the power shelf and push the circuit breaker panel back into place on the power shelf Replace the two M4 panhead Phillips screws to fasten the panel to the power shelf Torque the M4 panhead Phillips screws to 1 0 Nm 9 inch pounds Close the access
27. torque setting of 0 7 0 8 Nm 6 0 7 0 inch pounds Install SBus cards if necessary See Section 4 1 2 Installing an SBus Card on page 4 2 Replace the system board cover and secure with Phillips screws tightening to a torque of 0 8 Nm 7 1 inch pounds Sun Enterprise 10000 System Service Manual March 2002 10 See Section 3 2 4 Installing a System Board on page 3 10 to confirm that the event monitoring daemon is running prior to installing the system board Run autoconfig 1M if you m Replace an SBus I O module with an SBus I O module that has a different Sun part number m Replace a PCI I O module with an SBus I O module m Install an SBus I O module in a previously unused slot 4 2 PCI Component Replacement Before you can install PCI components onto a system board that board must belong to a domain that has Solaris 2 6 operating environment or subsequent compatible versions installed The SSP must be running version 3 1 or subsequent compatible versions For information about installing Solaris operating environment refer to documentation that shipped with the Solaris CD which contains procedures for installing Solaris 2 6 operating environment on a new domain or upgrading a domain to Solaris 2 6 operating environment The board on which you wish to install the PCI components must also be physically removed from the system If the system is up and the domain to which the board belongs is runnin
28. user commands such as the power 1M command or the fan 1M command 24 SSP Replacement Procedures for replacing the SSP are covered in the Sun Enterprise 10000 Hardware Installation and De Installation Guide part number 805 4651 22 Disk Replacement Refer to the most recent version of the Hardware Configuration Guide for a listing of supported devices Procedures for replacing supported devices are listed in the service manuals that accompany those devices 2 1 2 9 2 31 2 32 AC Input Module Replacement Isolating a Failed AC Input Module Use the following checklist to assist with fault isolation m Verify that the system has sufficient power by typing ssp power Number of Good 48V Power Supplies 8 Required Number of 48V Power Supplies 8 m Check that the breakers are on m Check that the LEDs on the AC input module are on m Verify that the cables in the back and front of the AC input module are inserted properly m Verify that the AC input module is firmly seated m Check for error messages in var opt SUNWssp adm domainname messages If all else is all right but the LEDs are not on this is a failed item Powering Off an AC Input Module Verify that the system has sufficient power even with two power supplies powered off by using hostview 1M or by typing ssp power 2 2 Sun Enterprise 10000 System Service Manual March 2002 2 Using TABLE 2 1 determin
29. var opt SUNWssp adm domain_name m On specific domains if system call dump files are available use ADB to examine var crash domain_name Powering Off a System Board Use hostview 1M to verify that the system board is not part of a running domain Caution Do not turn off power to a system board with the system board circuit breaker It is possible to arbstop the entire platform when the board is powered on again Power off a system board by using hostview 1M or by typing ssp power off sb x Where x 0 15 Refer to power 1M for more information Chapter 3 Control and System Board Replacement Procedures 3 9 3 29 3 4 3 2 4 Removing a System Board Open the access door Caution If the yellow LEDs are lit do not remove the component See Section 3 2 2 Powering Off a System Board on page 3 9 Disconnect all cables from the system board Attach a wrist strap and unlock the handles by lifting the locking levers that reside on each of the handles Use the handles to extract the system board and place it on a flat sturdy ESD protected surface with the components side up Installing a System Board These procedures are designed to prevent the weight of the system boards from resting on the plastic power connectors Follow these procedures carefully so that the plastic power connectors are not loosened or damaged Caution Do not attempt to connect a system bo
30. window 4 Log in to the domain as root 5 Notify users that the system is going down 6 Halt the system using the appropriate Solaris commands The basic command for halting the system should be shutdown 1M Refer to the man page for options and other considerations For example cd shutdown i0 g0 y 7 Wait for the system halted message and the OpenBoot PROM gt ok prompt to be displayed on the netcon console window 8 Repeat on each domain before proceeding 9 On the SSP power off all of the system boards by typing ssp domain power off all 9 10 Sun Enterprise 10000 System Service Manual e March 2002 10 On the SSP console log in as root and type ssp opt SUNWssp bin ssp_config Beginning setup of this workstation to act as a MAIN or SPARE SSP Platform name allxf4 Control Board 0 xf4 cb0 gt Control Board 1 xf4 cb1 gt Primary Control Board xf4 cb0 Are you currently configuring the MAIN SSP y n y MAIN SSP configuration completed The flash_boot ima file and the cbe ima file are copied into tftpboot 11 Type ssp exit ssp cb_ reset Resetting host e10000 cb0 Resetting host e10000 cb1 12 Wait for daemons to reconnect Monitor var opt SUNWssp adm messages for the following message before proceeding Jun 22 11 56 46 xf4 ssp SUNW_HOSTNAME allxf4 actionsysclock Fan Speed being set Jun 22 11 57 03 xf4 ssp SUNW_HOSTNAME xf4 b2
31. 1 Cable internal card cage fan centerplane to F530 2398 page A 20 bulkhead 22 0 inches 559 mm quantity 4 Cable internal card cage fan centerplane to F530 2397 page A 20 centerplane 22 0 inches 559 mm quantity 4 Appendix A Illustrated Parts Breakdown A 5 TABLE A 2 Optional Components List Marketing Number Part Number Description X2720A 595 4619 01 Control board X2731A 605 1603 01 PCI option X2730A 595 4620 01 SBus I O module X2750A X2752A SSP X2760A 595 4621 01 System board X3850A 595 4622 01 U S A power cord X3851A 595 4623 01 European power cord X3875A 595 4624 01 AC input module X7025A 595 4625 01 Memory module X9671A 595 4626 01 Fan tray X9681A 595 4627 01 Remote power control module X9685A 595 4628 01 48 VDC power supply 1 Revisions are current as of 6 11 98 A 6 Sun Enterprise 10000 System Service Manual March 2002 A 2 Illustrated Parts Breakdown FIGURE A 2 Sun Enterprise 10000 Cabinet Description Part Number End Panel Access Panel Right Access Panel Left Styling Panel Access panel left Access panel right Styling panel End panel Call for PN Call for PN Call for PN Call for PN Appendix A Illu
32. 1 5 2 Removing a System Board DIMM 5 3 5 21 Configuring Memory ona System Board 5 3 5 3 Installing a System Board DIMM 5 4 5 3 1 Removing a Memory Module 5 4 5 3 2 Installing a Memory Module 5 6 5 4 Processor Component Replacement 5 7 5 41 Removing a Processor Module 5 7 5 42 Installing a Processor Module 5 8 vi Sun Enterprise 10000 System Service Manual March 2002 6 Centerplane Support Board and Fan Centerplane Replacement Procedures 6 1 6 1 6 2 Centerplane Support Board Replacement 6 1 6 1 1 Isolating a Failed Centerplane Support Board 6 1 6 12 Powering Off a Centerplane Support Board 6 2 6 1 3 Removing a Centerplane Support Board 6 2 6 1 4 Installing a Centerplane Support Board 6 2 6 15 Powering On a Centerplane Support Board 6 3 6 1 6 Verifying a Centerplane Support Board 6 3 Fan Centerplane Replacement 6 4 6 2 1 Removing a Fan Centerplane 6 4 6 2 2 Installing a Fan Centerplane 6 4 7 Centerplane Replacement Procedures 7 1 7 1 Centerplane Replacement 7 1 7 1 1 Isolating a Failed Centerplane 7 1 7 1 2 Setting Up the System Prior to Replacing the Centerplane 7 2 7 13 Powering Off the System 7 4 7 1 4 Removing the Centerplane Assembly From the Card Cage 7 5 7 1 5 Installing the Centerplane Assembly Into the Card Cage 7 8 7 1 6 Powering on the System 7 10 7 1 7 Verifying a Centerplane 7 10 8 Mechanical Component and Cable Replacement Procedures 8 1 8 1 8 2 Mechanical Component Replacement 8 1 8 1 1 Re
33. 2 or Section 4 2 7 Installing a PCI Riser Card on page 4 16 and Section 4 2 3 Installing a PCI Card on page 4 10 5 DIMMs See Section 5 2 1 Configuring Memory on a System Board on page 5 3 and Section 5 3 2 Installing a Memory Module on page 5 6 TABLE 3 2 When to Run autoconfig 1M Sun Enterprise 10000 system Component Run autoconfig I O modules Yes Memory module Yes Processor module Yes SBus cards or PCI cards No DIMMs No It is necessary to run autoconfig 1M only when a replacement module has a different Sun part number Chapter 3 Control and System Board Replacement Procedures 3 13 3 14 Sun Enterprise 10000 System Service Manual e March 2002 CHAPTER 4 System Board I O Component Replacement Procedures Note All commands performed through the Hostview GUI hostview 1M can also be performed by other SSP user commands such as the power 1M command or the fan 1M command 4 1 4 1 1 1 2 3 4 5 SBus Component Replacement Removing an SBus Card Attach a wrist strap See Section 3 2 3 Removing a System Board on page 3 10 After removal place the system board on a flat sturdy ESD protected surface with the FRU side up Remove the four Phillips screws from the system board cover and remove the cover Disengage the SBus card by pulling up on the handle Caution The connector housing can break if the SBus card is tilted too
34. Field Replaceable Units TABLE 1 12 lists the estimated time required for replacement of the field replaceable units FRUs in the Sun Enterprise 10000 system provided the new component is on site and properly configured The estimates do not include any time required by software for system reconfiguration power cycling autoconfig or the shutdown and bring up required for the nonconcurrent service items Caution The control board and centerplane support board are different from other hot swappable items in that the others can be dynamically reconfigured out of the system without rebooting However if a control board or a centerplane support board is in use by a running domain you must halt the domain to hot swap it TABLE 1 12 Customer Availability and MTTR Objectives Field Replaceable Unit Mean time to repair Online Service Control board 10 min Yes if two configured and not in use by system Centerplane support board 5 min Yes if not in use by system Centerplane 1 hour No System board 30 min Yes UltraSPARC module 20 min Yes Dual in line memory module DIMM 10 min Yes Memory module 30 min Yes I O module 20 min Yes SBus cards 10 min Yes I O cables 15 min Yes Fan tray 5 min Yes System Service Processor SSP 30 min Yes SSP keyboard 5 min Yes SSP monitor 10 min Yes SSP peripheral 30 min Yes SSP modem 10 min Yes 48 volt power supply 5 min Yes if not in use by system Chapter 1 Component Rep
35. Memory on a System Board Follow these DIMM configuration guidelines All sockets within a bank must be fully populated DIMM sizes should be equal However if mixed sizes are used the larger DIMMs will be limited to the smallest DIMM size used For increased performance on partially populated memory boards do not use banks 0 and 2 together or banks 1 and 3 together On the silkscreen in the replacement guide and in the diagnostics MMx indicates bank number Bank 3 Bank 1 Bank 0 Centerplane side Bank 2 FIGURE 5 1 Memory Bank Locations Chapter 5 System Board Memory and CPU Module Replacement Procedures 5 3 oo o MMI P30 i _ MM34 P20 Po _MM2 7 P16 o MM25 Pg8___ L MMOS PG I MM32 P2f_ U I MMO PTO Po M23 PTS I MM03 P13 I po MMO PSO Centerplane side FIGURE 5 2 Memory DIMM Locations 5 3 5 3 1 5 4 Sun Enterprise 10000 System Service Manual March 2002 Installing a System Board DIMM Attach a wrist strap Verify key orientation of the DIMM with respect to the connector Install the DIMM into the connector by applying firm pressure and pushing the DIMM straight into connector until it clicks into place torque of 0 8 Nm 7 1 inch pounds Replace the system board cover and secure with Phillips
36. N A Appendix A Illustrated Parts Breakdown A 3 TABLE A 1 List of Replaceable Components 2 of 3 General Category Description Part Number Page SBus Boards SCSI fast wide diff DWIS S isp 1062A N A SCSI fast wide single SWIS S isp 1063A N A SCSI Ethernet diff DSBE S esp 1052A N A SCSI Ethernet single FSBE S esp 1053A N A SunSwift SBus adapter fas hme 1018A N A Ultra SCSI RAID controller 6536A N A SBus Fibre Channel Card SOCHA 1057A N A Quad Ethernet SQEC 1058A N A Sun FastEthernet 2 0 10 100 hme 1059A N A SunFDDI SAS 5 0 1025A N A SunFDDI DAS 5 0 1026A N A SunATM 2 0 155 fiber 1060A N A SunATM 2 0 155 UTP 1061A N A SunATM 622 MFiber 1064A N A SunISDN 1012A N A Token ring tr 1014A N A Serial HSI S 1019A N A Control Board Mezzanine board Call for PN page A 11 Components SIMM module Call for PN page A 11 System Power Power shelf assembly left F540 3060 page A 12 Es Power shelf assembly right F540 3069 page A 12 AC input module assembly F540 3441 page A 12 Power supply 48 VDC F300 1368 page A 12 Circuit breaker assembly DC distribution F140 2901 page A 12 Peripheral Power AC sequencer F300 1290 page A 13 POLPA AC sequencer power cord F530 2265 page A 13 Remote power control module assembly with F540 3440 page A 13 cable A 4 Sun Enterprise 10000 System Service Manual March 2002 TABLE A 1 List of Replaceable Components 3 of 3 General Category Description P
37. O SB15 SB1 SB14 SB2 SB13 SB3 SB12 SB4 SB11 SB5 SB10 SB6 SB9 SB7 SB8 New Centerplane Chapter 7 Centerplane Replacement Procedures 7 3 8 On the side of the new centerplane without the stiffener use a DVM to check that VDD_CSBO use C29 and VDD_CSBI use C118 are not less than 100 ohms E em Si E S ei Fois fees ali il din i i TI See CCI d By Ar Lu Dn a Ip E E i 5 C118 9 I Me M di Ji eee II Lala Dez E EH Hot d or FIGURE 7 2 Centerplane Test Points 9 Visually inspect guide pins and signal pins for possible damage 7 1 9 Powering Off the System 1 Systematically bring down the operating system and then halt the domains 2 Power off the system by typing ssp power off all 3 Power off the breakers on the AC input modules 7 4 Sun Enterprise 10000 System Service Manual March 2002 7134 Removing the Centerplane Assembly From the Card Cage From the back side Attach a wrist strap Disconnect the I O cables from the control board system board 0 and system board 1 Remove the control board centerplane support board system board 0 and system board 1 Disengage the remaining boards from the centerplane Caution The carrier plate assemblies fro
38. PEN LOOK and Sun Graphical User Interface was developed by Sun Microsystems Inc for its users and licensees Sun acknowledges the pioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry Sun holds a non exclusive license from Xerox to the Xerox Graphical User Interface which license also covers Gun e licensees who implement OPEN LOOK GUIs and otherwise comply with Sun s written license agreements Federal Acquisitions Commercial Software Government Users Subject to Standard License Terms and Conditions DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Copyright 2002 Sun Microsystems Inc 4150 Network Circle Santa Clara CA 95054 Etats Unis Tous droits r serv s Ce produit ou document est distribu avec des licences qui en restreignent l utilisation la copie la distribution et la d compilation Aucune partie de ce produit ou document ne peut tre reproduite sous aucune forme par quelque moyen que ce soit sans l autorisation pr alable et crite de Sun et de ses bailleurs de licence s il y en a Le logiciel d tenu par des tiers et qui comprend la technologie relative aux polices de caract res es
39. Powering On a 48 Volt Power Supply 2 6 2 4 6 Verifying a Power Supply 2 6 2 5 Power Shelf Replacement 2 6 2 5 1 Removing a Power Shelf 2 6 2 5 2 Installing a Power Shelf 2 8 2 6 DC Breaker Module Replacement 2 9 2 6 1 Isolating a Failed DC Breaker 2 9 2 6 2 Removing a Circuit Breaker 2 9 2 6 3 Installing a Circuit Breaker 2 10 2 64 Verifying a DC Breaker 2 11 2 7 Universal AC Sequencer Replacement 2 11 2 7 1 Isolating a Failed AC Sequencer 2 11 2 7 2 Powering Off a Remotely Controlled AC Sequencer 2 12 2 7 3 Removing an AC Sequencer 2 12 2 74 Installing an AC Sequencer 2 12 2 75 Configuring an AC Sequencer 2 13 2 7 6 Powering On a Remotely Controlled AC Sequencer 2 18 2 7 7 Verifying an AC Sequencer 2 18 2 8 Fan Tray Replacement 2 18 iv Sun Enterprise 10000 System Service Manual March 2002 2 8 1 Isolating a Failed Fan Tray 2 18 2 82 Powering Off a Single Fan Tray or a Group of Fan Trays 2 18 2 8 3 Removing a Fan Tray 2 19 2 8 4 Installing a Fan Tray 2 19 2 8 5 Powering Ona Fan Tray or a Group of Fan Trays Using SSP Version 3 0 2 20 2 8 6 Powering On the Fan Trays Using SSP Version 3 1 or Subsequent Compatible Version 2 20 2 8 7 Verifying a Fan Tray 2 20 29 Replacing an Air Filter 2 21 3 Control and System Board Replacement Procedures 3 1 3 1 Control Board Replacement 3 1 3 1 1 Isolating a Failed Control Board 3 1 3 1 2 Setting Up the Network for a Replacement Control Board 3 2 3 13 Powering Off a Control Board 3 5 3 1
40. RC processor module This off loads coherency snooping from the processor Error Correction Code Refer to XIR A class of unrecoverable error that necessitates that the system be rebooted may be hardware or software initiated This type of unrecoverable error results in an arbiter stop condition which requires SSP interaction Global Address Arbiter Arbitrates for a global address bus Implemented by a Sun Enterprise 10000 arbiter chip Global Address Buses Four 16 16 48 bit wide multiplexers that connect together a coherent interface controller from each system board The multiplexers broadcast one of the inputs to all the outputs Implemented by 16 XMUX ASICs Functions like a snoopy bus for coherency purposes but is really a point to point address router Global Data Arbiter Arbitrates for the global data router s 16x16 crossbar Global Data Router Sixteen 16 1 144 bit wide multiplexers that connect together the local data routers on each system board Implemented by 12 XMUX ASICs Another term for domain name Short for the environment variable SUNW_HOSTNAME which is used to instruct SSP commands which domain the command is intended for A daughter card containing two SYSIO chips Each SYSIO controls an SBus and has sockets for two SBus cards and an embedded SCSI and Ethernet interface JTAG Board Controller The IEEE 1149 1 serial scan interface named for the Joint Test Action Group that originally developed i
41. RE 1 8 SBus Slot and Remote Power Control Numbering 1 9 System Block Diagrams Use FIGURE 1 9 FIGURE 1 10 FIGURE 1 11 and FIGURE 1 12 when diagnosing failed components 1 24 Sun Enterprise 10000 System Service Manual March 2002 Cooling subsystem ER fan Se Centerplane Control tt t Fan tray 8 ottom fan centerplane CBO Fan tray 0 CIk Cnil _ _ Status 5 S ui Fan tray 9 _ CIk Cnil ga Status 5 Na Fan tray tray 10 N SS Fan tray 11 JTAG TAS 48 Volt ivan TMS power cnt A tatus tatus sub L cnt TDI system d tatus 1 Status 1 z Power shelf Power shelf Power center AC Power AC Power plane ower supply ower supply cont PSO amp ont PS4 amp PS1 PS5 AC ahd AC Li E ower su ower su Sen US ven PS3 PS7 AC In AC In Peripheral power subsystem 8 Clk cntl Peripheral power dist unit atus 5 Peripheral power dist unit E Status OL Ke atus To a8 Cik cntl Peripheral power dist unit 25 Status BP cn Peripheral power dist unit 55 Status 9 o CIKcntf Peripheral ist unit eripheral power dist uni Status located in peripheral expansion cabinets AC In Contrpl board CB1
42. W 7 S W 0 indicate the state of an 8 bit read write register located in the SPARClite s address space When the Control Board Executive is operating correctly a marching 1s pattern can be seen on S W0 S W6 S W7 indicates the network is operational TABLE 1 10 System Board LEDs LED Name Color Purpose 5VDC HK Green Indicates that 5 0 VDC housekeeping power is present 3 3VDC HK Green Indicates that 3 3 VDC housekeeping power is present iL 3 3VDC Yellow VCC on the system board is present and the system board is NOT safe to service 5VDC Yellow VDD signal on the system board is on indicating 5 volts DC is present and the system board is NOT safe to service VDD_Core Yellow VDD_Core on the system board is present and that the system board is NOT safe to service HKS W Green Displays the state of a designated bit position on the power control JTAG ring of this board S W 7 S W 0 Green Eight LEDs that are programmable through a register in the bootbus space of the PC ASIC connected to the I O module which can be read and written either by JTAG or by resident software Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 9 1 5 1 10 Inserting a Board These are general guidelines for inserting boards into the Sun Enterprise 10000 system To reduce the risk of damage to the centerplane connector take the following precautions m T
43. ables Remove all boards and place them on a flat sturdy ESD protected surface Remove the carrier plate assembly that holds the control board and centerplane support board Remove six Phillips screws three on the top and three on the bottom of the carrier plate assembly Carefully install the centerplane handles onto the stiffener Caution Centerplane handle installation and removal must be done with care to prevent possible pin damage Fully unscrew the 27 captive Phillips screws from around the perimeter of the stiffener Grasping the handles gently slide the centerplane assembly straight toward you After the centerplane is clear of the large guide pins the centerplane assembly will drop slightly and rest on plastic guides on the bottom of the assembly Continue to slide the centerplane assembly straight toward you To remove the centerplane assembly from the card cage angle the centerplane assembly to enable the left side to exit first Place the centerplane assembly on a flat sturdy ESD protected surface Carefully remove the centerplane handles Caution Centerplane handle installation and removal must be done with care to prevent possible pin damage Chapter 7 Centerplane Replacement Procedures 7 7 ELS Installing the Centerplane Assembly Into the Card Cage From the front side 1 Attach a wrist strap 2 Carefully install the centerplane handles onto the stiffener Ca
44. acement 5 2 memory module installing 5 6 removing 5 4 replacement 5 4 mezzanine boards replacement 5 8 to 5 11 MTTR of FRUs 1 13 Index 2 Sun Enterprise 10000 System Service Manual e March 2002 N numbered components 1 14 P panels replacement 8 1 parts illustrated See illustrated parts breakdown PCI components installing 4 7 PCI I O module installing 4 13 removing 4 12 replacement 4 12 power caution 1 1 power shelf installing 2 8 removing 2 6 replacement 2 6 to power supply 48 volt installing 2 5 powering off 2 5 powering on 2 6 removing 2 5 replacement 2 5 to 2 6 power 1M 1 1 1 2 powering off AC input module 2 2 AC sequencer 2 12 centerplane support board 6 2 control board 3 5 fan tray 2 18 power supply 48 volt 2 5 system 7 4 system board 3 9 powering on AC input module 2 4 AC sequencer 2 18 centerplane support board 6 3 control board 3 7 fan tray 2 20 power supply 48 volt 2 6 system 7 9 system board 3 11 processor module installing 5 9 removing 5 8 replacement 5 8 redundant control board 1 3 removing AC input module 2 4 AC sequencer 2 12 cables to 7 9 8 2 to centerplane 7 5 centerplane support board 6 2 circuit breaker 2 9 control board 3 6 fan centerplane 6 4 fan tray 2 19 memory 5 2 memory module 5 4 PCI I O module 4 12 power shelf 2 6 power supply 48 volt 2 5 processor module 5 8 SBus card 4 1 SBus
45. ailed primary control board has been designated as an alternate and replaced it is the system administrator s option to reinstate it as the primary control board To reinstate the original primary control board see Section 9 2 Configuring a Control Board Using SSP Version 3 0 on page 9 3 or Section 9 3 Configuring a Control Board Using SSP Version 3 1 and Subsequent Compatible Versions on page 9 6 Verifying a Control Board All domains must be off before testing a control board Log in to the SSP as ssp When prompted for the SUNW_HOSTNAME use the name of the domain to be tested Prepare the domains for testing by typing ssp power off all ssp power on all From the same SSP window run POST by typing ssp bringup A off 164 Answer y when prompted to configure the centerplane The bringup process can take up to 90 180 minutes depending on system configuration Refer to the bringup 1M or hpost 1M man page for more detail 3 8 Sun Enterprise 10000 System Service Manual e March 2002 3 2 3 2 1 Deel System Board Replacement Isolating a Failed System Board or Mezzanine Board Use the following checklist to assist with fault isolation m Check for any error messages during post m On the SSP check for any error messages in var opt SUNWssp adm messages m On the SSP if available use redx to examine any arbstop dump files or record stop dump files located in
46. ard to a centerplane that has a damaged plastic power connector A bad connection can result in fire Confirm that the event monitoring daemon is running by typing ssp edd_cmd The returned message should show State started monitoring If not you must restart the event monitoring daemon by typing ssp edd_cmd x start Refer to edd 1M and edd_cmd 1M for additional information Attach a wrist strap and install a system board by firmly grasping the board by the handles and positioning it onto the card cage rail Slide the system board in carefully until the guide pins at the centerplane connector begin to engage the system board 3 10 Sun Enterprise 10000 System Service Manual e March 2002 329 4 Gently press on the bottom of the system board face just below the I O panel so that the rear of the system board is tilted upwards This action prevents or minimizes force on the power module housings Caution If you feel any abnormal resistance during installation remove the system board and examine the connector for damage A bad connection can result in fire While keeping the rear of the system board tilted upwards press firmly on the face of the system board to seat it as far as possible without using the insertion handles The system board should now be approximately a quarter inch from the fully seated position Fully seat the system board using the insertion handl
47. art Number Page Cooling Components Fan centerplane F501 4365 page A 14 Fan tray assembly F540 3409 page A 14 Fan tray filler panel F540 3075 page A 14 Peripheral filler panel Call for PN page A 14 Air filter card cage F370 2845 page A 14 Cables Remote power control module to control board F530 2401 page A 15 5 feet 1524 mm Remote power control module to control board F530 2400 page A 15 10 feet 3048 mm Remote power control module to AC sequencer F530 2403 page A 15 20 feet 6096 mm Remote power control module to AC sequencer F530 2402 page A 15 20 inches 508 mm AC power cord U S A 20 0 feet 610 cm F530 2379 page A 16 AC power cord European 20 0 feet 610 cm F530 2380 page A 16 Cable internal to cabinet card cage bulkhead to F530 2393 page A 17 power shelf orange power 50 inches 1270 mm Cable internal to cabinet card cage bulkhead to F530 2392 page A 17 power shelf orange power 24 inches 610 mm Cable internal to cabinet primary to secondary F530 2391 page A 17 power shelf 12 inches 305 mm Internal cable power shelves to bulkhead F530 2395 page A 18 power control sense 52 inches 1322 mm Internal cable power shelves to bulkhead F530 2394 page A 20 power control sense 36 02 inches 915 mm Cable internal card cage power lower fan F530 2399 page A 18 centerplane to bulkhead 10 0 inches 254 mm quantity 1 Cable internal card cage fan centerplane to F530 2396 page A 19 bulkhead quantity
48. autoconfig 1M on the SSP when a replacement system board with a different part number is installed MAT Verifying a System Board or Mezzanine Board 1 Log in to the SSP as ssp When prompted for the SUNW_HOSTNAME use the name of the domain to be tested 2 From the same SSP window run POST by typing ssp bringup A off 164 Answer y when prompted to configure the centerplane The bringup process can take up to 90 180 minutes depending on system configuration Refer to the bringup 1M or hpost 1M man page for more detail 3 12 Sun Enterprise 10000 System Service Manual e March 2002 Do System Board Component Replacement Mezzanine board or personality plate replacement requires the system board to be removed and then re installed See Section 3 2 3 Removing a System Board on page 3 10 and Section 3 2 4 Installing a System Board on page 3 10 for assistance For unpopulated system boards install multiple mezzanine modules in the following sequence and see TABLE 3 2 for instructions to run autoconfig 1M 1 I O modules See Section 4 1 4 Installing an SBus I O Module on page 4 5 or Section 4 2 5 Installing a PCI I O Module on page 4 13 2 Memory module See Section 5 3 2 Installing a Memory Module on page 5 6 3 Processor module See Section 5 4 2 Installing a Processor Module on page 5 8 4 SBus cards or PCI Cards See Section 4 1 2 Installing an SBus Card on page 4
49. before performing diagnostic testing of the system Information about autoconfig 1M is located in opt share man autoconfiglm The Sun Enterprise 10000 uses hpost 1M to diagnose system problems To use hpost 1M you must be logged in the SSP as ssp Information on hpost 1M is located in opt share man hpostim Dune sunvts 1M diagnostic can be used as a verification of the system To use sunvts 1M you must be logged into the host as superuser Information on sunvts 1M is located in opt share man manim 1 3 Reviewing System Temperatures Use the hostinfo t command to examine the temperature data being reported The output should be similar to the following sample Starfire MIBs Ambient temperature readings C Sen0 Senl Sen2 Average PROC2 PROC3 3p3VDC 44 747 39 227 42 177 47 435 41 087 42 918 System Brd CICO CICI MC XDB2 0 29 203 29 72 30 306 25 905 2 25 672 24 733 25 836 23 407 13 29 092 29 461 29 448 24 463 Control Brd 5VDC 5VDCPer 5VDCFan Sen0 0 32 664 27 049 31 443 19 336 33 274 21 312 27 293 19 141 Centerplane TMPO TMP1 TMP2 TMP3 0 25 997 25 886 24 522 22 582 25 002 24 261 21 924 21 671 Support Brd 3p3VDC1 3p3VDC2 0 24 852 27 415 26 683 34 251 39 134 31 077 29 734 1 4 Sun Enterprise 10000 System Service Manual e March 2002 The following temperature specifications TABLE 1 1 must not be exceeded TABLE 1 1 Temperature Levels Warning Level Maxi
50. bulkhead to power shelf orange power 50 inches 1270 mm Cable internal to cabinet card cage F530 2392 bulkhead to power shelf orange power 24 inches 610 mm FIGURE A 15 Power Cross over Cable Pin 1 Pin 1 PI Re 1 lm 8 8 Se o Oo Description Part Number Cable internal to cabinet primary to F530 2391 secondary power shelf 12 inches 305 mm Appendix A Illustrated Parts Breakdown A 17 FIGURE A 16 Card Cage Power Control Sense Cable Pin 1 P1 Le g fl P2 38 E Be S 3 LCE GI Pin 1 Description Part Number Internal cable power shelves to bulkhead F530 2395 power control sense 52 inches 1322 mm Internal cable power shelves to bulkhead F530 2394 power control sense 36 02 inches 915 mm FIGURE A 17 Lower Fan Power Cable Pin 1 Pin 1 a oo DE J12 J11 TT Pin 1 ooo Description Part Number Cable internal card cage power lower fan F530 2399 centerplane to bulkhead 10 0 inches 254 mm quantity 1 A 18 Sun Enterprise 10000 System Service Manual March 2002 FIGURE A 18 Centerplane and Upper Fan Power Cable 100 O Pin 1 J6 P51 P52 P53 P54 P55 P56 P57 P58 _Pin1 i ES Ez J7 Pin1 Pin1 J8 J9 Pin ia J10 Back Descripti
51. card Section 4 2 6 Removing a PCI Riser Card on page 4 15 and Section 4 2 7 Installing a PCI Riser Card on page 4 16 Guide the PCI card from behind the system board faceplate through the opening and place the PCI card edge into the mating connector FIGURE 4 10 Chapter 4 System Board I O Component Replacement Procedures 4 11 4 2 4 te amp _PClretention screw PCI card edge gt CITTA FIGURE 4 10 Inserting a PCI Card Confirm alignment of the PCI card then firmly push the card into the connector until fully seated Install the PCI retention screw into the mating flange and tighten to a torque of 0 8 Nm 7 1 inch pounds Removing a PCI I O Module Note the location of each PCI card Attach a wrist strap and remove all PCI cards SeeSection 4 2 2 Removing a PCI Card on page 4 9 Remove the five Phillips screws from the UO module Loosen the six captive 3 32 inch hex screws located on the compression connectors Remove the I O module FIGURE 4 11 After removal place it on a flat sturdy ESD protected surface 4 12 Sun Enterprise 10000 System Service Manual e March 2002 4 2 5 PCI I O module FIGURE 4 11 Replacing the PCI I O Module Installing a PCI I O Module If converting from SBus to PCI the personality plate must be removed and replaced prior to installing any PCI electrical components See Se
52. cation 4 20 Installing a Personality Plate Top View 4 21 Installing a Personality Plate 4 22 Memory Bank Locations 5 3 Memory DIMM Locations 5 4 Replacing the System Board Memory Module 5 5 Tightening Pattern for the Memory Module 5 6 Cone Washer and Standoff 5 7 Replacing System Board Processor Module 5 8 Tightening Pattern for the Processor Module 5 10 Cable Labeling 7 2 Centerplane Test Points 7 4 Sun Enterprise 10000 System Service Manual e March 2002 FIGURE 7 3 Carrier Plate Alignment Pin and Centerplane Connectors 7 6 FIGURE 8 1 Internal Cabinet Cable Connections 8 3 FIGURE 8 2 Power Shelf Cable Connections 8 4 Figures xi xii Sun Enterprise 10000 System Service Manual March 2002 Tables TABLE 1 1 TABLE 1 2 TABLE 1 3 TABLE 1 4 TABLE 1 5 TABLE 1 6 TABLE 1 7 TABLE 1 8 TABLE 1 9 TABLE 1 10 TABLE 1 11 TABLE 1 12 TABLE 1 13 TABLE 1 14 TABLE 2 1 TABLE 2 2 TABLE 2 3 TABLE 3 1 TABLE 3 2 Temperature Levels 1 5 LED Categories 1 5 Fan Components 1 6 Fan TrayLEDs 1 6 Centerplane Support Board 1 7 Centerplane Support Board LEDs 1 7 Control Board 1 8 Control Board LEDs 1 8 System Boards 1 9 System Board LEDs 1 9 Torque Specifications 1 12 Customer Availability and MTTR Objectives 1 13 Processor Numbering 1 15 YO Numbering 1 17 Power Redundancy 2 3 AC Input Module Control of Power Supplies 2 3 Circuit Breaker Wiring 2 10 Power Redundancy 3 11 When t
53. ching the power shelf to the frame Remove the door assembly from the power shelf by opening the door for the power shelf and removing the four M4 panhead Phillips screws securing the door to the frame Set the door assembly aside and retain the screws and washers Remove the side panel on the cabinet a Disengag the magnets securing the side panel to the cabinet b Pull the panel out from the cabinet at the bottom c Lift the side panel up and off its support brackets Set the side panel aside Verify that the cables at the rear of the power shelf are properly identified See Section 8 2 Cable Replacement on page 8 3 for proper connection of cables Disconnect the power cables from the rear of the power shelf The 4 40 panhead Phillips screws and washers securing connectors to the power shelf are not captive to the connectors Be careful not to lose this hardware Disconnect the rear support brackets by removing the two M4 panhead Phillips screws securing the two support brackets to the cabinet at the rear of the power shelf Chapter 2 Power and Cooling Component Replacement Procedures 2 7 15 16 2 5 2 10 11 12 13 14 Slide the power shelf out of the cabinet Once free from the cabinet remove the two rear support brackets from the old power shelf and install the two rear support brackets on the new power shelf Installing a Power Shelf Slide the power shelf into the cabinet Secure th
54. ck the handle by sliding the locking lever into position until it is fully nested with the handle Powering On a Centerplane Support Board Power on the centerplane support board by using hostview 1M or by typing ssp power on csb x Where x 0 1 Refer to power 1M for more information Verifying a Centerplane Support Board All domains must be off before testing the centerplane support board Log in to the SSP as ssp When prompted for the SUNW_HOSTNAME use the name of the domain to be tested Prepare the domains for testing by typing ssp power off all ssp power on all From the same SSP window run POST by typing ssp bringup A off 164 Answer y when prompted to configure the centerplane The bring up process can take up to 90 180 minutes depending on system configuration Refer to the bringup 1M or hpost 1M man page for more detail Chapter 6 Centerplane Support Board and Fan Centerplane Replacement Procedures 6 3 6 2 6 2 1 6 2 2 Fan Centerplane Replacement Removing a Fan Centerplane Caution The fan centerplane is NOT considered hot swappable This procedure requires turning off the AC power to the system and disconnecting the AC power cords Since the system must be powered off the operating system and all of the domains must be systematically brought down and then halted Power off the system by typing ssp power off all
55. cludes disk FIGURE A 1 System Components A 2 Sun Enterprise 10000 System Service Manual March 2002 W Fan trays AC input module 48 volt power Disk trays or filler panels located on opposite side AC power sequencer Circuit breakers System boards Centerplane support board Control board Processor cabinet TABLE A 1 List of Replaceable Components 1 of 3 General Category Cabinet Board Assemblies System Board Components Miscellaneous Description Access panel left Access panel right Styling panel End panel Centerplane assembly System board assembly Control board assembly Centerplane support board assembly Control board filler panel assembly System board filler panel assembly I O module assembly for SBus support SBus filler panel Memory module assembly DIMM module 32 Mbyte DIMM module 128 Mbyte Processor modules PCI I O module 5 0 volt riser card 3 3 volt riser card PCI filler panel Customer service accessory kit Part Number Call for PN Call for PN Call for PN Call for PN F501 4348 F501 4903 F501 4345 F501 4346 F540 3064 F540 3063 F501 4478 340 1763 04 F501 4776 F501 2653 F501 2654 2530A F501 4830 F501 4777 F501 4778 240 2391 01 565 1398 Page page A 7 page A 7 page A 7 page A 7 page A 8 page A 8 page A 8 page A 8 page A 8 page A 8 page A 9 page A 9 page A 9 page A 9 page A 9 page A 9 page A 10 page A 10 page A 10 page A 10
56. control board and centerplane support board Use TABLE 7 1 to verify board position When installing a board verify that the board top and bottom rail are inserted into the card guides Push firmly to mate the board connectors with the centerplane connectors Reconnect all I O cables Use the I O cable labels to verify cable position From the back side Attach a wrist strap Reconnect the ribbon cables on the left side of the centerplane and the power cables on the top of the centerplane Use a flashlight to assist with correct placement of the connectors Fold the ribbon cables to enable insertion of boards Reinstall the carrier plate that holds the control board and centerplane support board Install the carrier plate in the correct position by carefully inserting the center guide rail alignment pin into the centerplane hole Install and tighten the six Phillips screws Reinstall all system boards the control board and centerplane support board Use TABLE 7 1 on page 2 3 to verify board position When installing any board verify that the board top and bottom rail are inserted into the card guides Reinstall the top row of fan trays FTO FT3 Reconnect all I O cables Use the I O cable labels to verify cable position Fully engage all remaining system boards Chapter 7 Centerplane Replacement Procedures 7 9 7 1 6 Powering on the System 1 Turn on all AC input breakers 2 Power on th
57. ction 4 3 Personality Plate Replacement on page 4 17 Attach a wrist strap Prior to installing the module wipe the gold pads of the system board and the exposed contacts of the compression connector with a lint free nonabrasive cloth or alcohol wipe Align the PCI I O module compression connectors to the system board compression connector locations Align the standoffs on the system board with the UO module Tighten the six captive connector screws clockwise with a 3 32 inch hex driver a Tighten the captive connector screws in the sequence shown in FIGURE 4 12 until they touch the metal plate b Tighten each captive connector screw in the sequence shown in FIGURE 4 12 an additional 1 2 turn c Tighten the captive connector screws to a final torque of 0 68 Nm 6 0 inch pounds in the pattern shown in FIGURE 4 12 Chapter 4 System Board I O Component Replacement Procedures 4 13 FIGURE 4 12 Tightening Pattern for the PCI I O Module Install discrete attachment hardware through the board and into the threaded standoff of the system board See FIGURE 4 13 for proper orientation of separate cone washer i Cone washer Pei per l FIGURE 4 13 Cone Washer and Standoff Tighten discrete attachment hardware to a torque setting of 0 7 0 8 Nm 6 0 7 0 inch pounds Install PCI cards if necessary SeeSection 4 2 3 Installing a PCI Ca
58. door Verifying a DC Breaker Use the following checklist to verify that a DC breaker s are operational m Check that the component or components powered on m Check the power status using hostview or the power command m Check for error messages in var opt SUNWssp adm domain name messages 27 2 71 Universal AC Sequencer Replacement Isolating a Failed AC Sequencer Use the following checklist to assist with fault isolation Verify that the LEDs are on Confirm that the components powered by the AC sequencer are on Check cables Check the REMOTE LOCAL switch For remotely controlled AC sequencers issue a power P command Chapter 2 Power and Cooling Component Replacement Procedures 2 11 272 2 79 2 7 4 m Ifthe AC sequencer still is not on switch to LOCAL to determine if it will power on If it powers on in LOCAL suspect the configuration the control board the cables or the remote power control module m On remotely controlled I O cabinets check that the keyswitch is in the OFF position Powering Off a Remotely Controlled AC Sequencer Type ssp power off p x Where x 0 4 This command powers off the AC sequencers that are controlled by the remote power control module indicated by x and all peripherals powered by this AC sequencer will power off Refer to power 1M for more information Removing an AC Sequencer Caution If the switched outlet green lights are lit do not
59. e Hostview GUI hostview 1M can also be performed by other SSP user commands such as the power 1M command or the fan 1M command 7 1 2141 Centerplane Replacement Caution The centerplane is NOT considered hot swappable This procedure requires turning off the AC power to the system Isolating a Failed Centerplane Use the following checklist to assist with fault isolation m Check for any error messages during post m On the SSP check for any error messages in var opt SUNWssp adm messages m On the SSP if available use redx to examine any arbstop dump files or record stop dump files located in var opt SUNWssp adm domain_na me m On specific domains if system call dump files are available use ADB to examine var crash domain_name 7 1 7 12 Setting Up the System Prior to Replacing the Centerplane 1 Locate two Phillips screw drivers No 1 and No 2 one small straight slot screwdriver one small flashlight one digital volt meter DVM and one set of centerplane handles with captive attachment hardware 2 Secure or remove all loose clothing jewelry and watches that might get caught on internal mechanical components 3 Verify that all I O cables are properly identified If needed install new labels as shown in FIGURE 7 1 Connection Between Control Board 0 Ethernet and Ethernet Hub __ CBO ENETO oN NN CBO ENET D Connection Between System Board 0 SBUS 1 SLOT LEO and Ethern
60. e if additional system boards must be powered off prior to powering off two 48 volt power supplies Use TABLE 2 1 to confirm that the amount of available power is sufficient for the number of system boards installed If additional system boards must be powered off see Section 3 2 2 Powering Off a System Board on page 3 9 TABLE 2 1 Power Redundancy Number of System Required Power Supplies for N 2 Power Supply or Required 200V 30A Boards N 1 AC Input Unit Redundancy single phase circuits 1 2 4 2 3 5 5 3 6 8 6 3 9 12 7 4 13 16 EN 4 1 If two supplies are failing no AC module may be removed unless the two failed supplies are under the same AC module control 3 Power off both power supplies controlled by the AC input module to be changed by using hostview 1M or by typing ssp power off ps x ssp power off ps y Where x and y are the pairs of power supplies 0 1 2 3 4 5 and 6 7 that are controlled by an AC input module TABLE 2 2 TABLE 2 2 AC Input Module Control of Power Supplies AC Input Module Top 48 Volt Power Supply Bottom 48 Volt Power Supply ACO controls PSO PS1 ACI controls PS2 PS3 AC2 controls PS4 PS5 AC3 controls PS6 PS7 Refer to power 1M for additional information Chapter 2 Power and Cooling Component Replacement Procedures 2 3 2949 2 3 4 29 9 2 3 6 Removing an AC Input Module Caution If the yellow LEDs are lit do not remove t
61. e rear support brackets with the two M4 panhead Phillips screws secure to the cabinet at the rear of the power shelf Connect the power cables to the power shelf Tighten the thumbscrews or the 4 40 panhead Phillips screws and washers as necessary If necessary see Section 8 2 Cable Replacement on page 8 3 for proper connection of cables Secure the power shelf to the cabinet Connect the door assembly to the power shelf using the four M4 panhead Phillips screws Install the vertical trim strip Install the AC input modules and DC power supplies Connect the AC power cords to the AC input modules Route the power cords through the vertical trim strip Using the breakers on the AC input module power on the AC input modules Power on the system by typing ssp power on all Replace the access and side doors Move the cabinet to its original position Run diagnostics to verify the operation of the system 2 8 Sun Enterprise 10000 System Service Manual March 2002 2 6 2 6 1 DC Breaker Module Replacement Isolating a Failed DC Breaker Use the following checklist to assist with fault isolation m Referring to the circuit breaker labels FIGURE 2 1 determine which component or components remained off following a power on command Ifa group of four fan trays are off suspect the associated circuit breaker a fa control board and centerplane support board are off suspect the a
62. e system by typing ssp power on all 3 Replace the access doors 4 Place the handles and old centerplane in FRU box for shipping 5 If using SSP version 3 0 restore the system boards thermal calibration data See Section 9 1 Restoring the Thermal Calibration Information Using SSP Version 3 0 on page 9 1 6 Run diagnostics to verify operation of the system 7 1 7 Verifying a Centerplane All domains must be off before testing the centerplane 1 Log in to the SSP as ssp When prompted for the SUNW_HOSTNAME use the name of the domain to be tested 2 Prepare the domains for testing by typing ssp power off all ssp power on all 3 From the same SSP window run POST by typing ssp bringup A off 164 Answer y when prompted to configure the centerplane The bring up process can take up to 90 180 minutes depending on system configuration Refer to the bringup 1M or hpost 1M man page for more detail 7 10 Sun Enterprise 10000 System Service Manual e March 2002 CHAPTER 8 Mechanical Component and Cable Replacement Procedures 8 1 Mechanical Component Replacement 8 1 1 Replacing a Styling Panel and End Panel 1 Using both hands firmly grasp the panel on each side near the top lift straight up and then out away from the cabinet 2 To replace reverse Step 1 while aligning the top two tabs and the lower lip with receptacles on the cabinet frame 8 1 2 Re
63. em board will result in the larger caches sizes being limited to the size of the smallest If possible move dissimilar processor modules to another system board Attach a wrist strap Remove the thin blue plastic strip from the processor board thermal pad on the system board if present This blue plastic strip covers a white thermal pad that provides thermal relief for the cache on the processor module When a processor module is installed it should be removed permanently Prior to installing the module wipe the gold pads of the system board and the exposed contacts of the compression connector with a lint free nonabrasive cloth Align the processor module compression connectors to the system board compression connectors Chapter 5 System Board Memory and CPU Module Replacement Procedures 5 9 8 Tighten the five captive connector screws clockwise with a 3 32 hex driver a Tighten the captive connector screws in the sequence shown in FIGURE 5 7 until they touch the metal plate b Tighten each captive connector screw in the sequence shown in FIGURE 5 7 an additional 1 2 turn c Tighten the captive connector screws to a final torque of 0 68 Nm 6 0 inch pounds in the pattern shown in FIGURE 5 7 8 o O O O FIGURE 5 7 Tightening Pattern for the Processor Module 9 Replace the system board cover and secure with Phillips screws tightening to a torque of 0 8 Nm 7 1 i
64. er and Sequencer The SSP resident component of POST The platform name is a logical name given to a Sun Enterprise 10000 system A platform name does not correspond to any host on the network Pack Unpack A mode of the XMUX ASIC used on the memory module A SPARC v9 processor takes a trap at an offset 0xa0 PA Ox1ff f000 00a0 when processor reset or trap occurs and TL is at MAX_TL 1 or system software sets PSTATE RED to 1 Software Initiated Reset A software initiated reset is initiated by a SIR instruction within any processor This pre processor reset has a trap type 4 at physical address offset 0x80 PA Ox1ff f0000 0080 Shared Memory Domain Serial Optical Channel Connects two Fibre Channels to an SBus System Service Processor A networked SPARCstation from which the system is booted and diagnosed A large circuit board containing a memory module four UltraSPARC processor modules and two I O modules Glossary 3 System clock System Controller SC UDB UPA Uncorrectable Error Unrecoverable Error Watchdog Reset WDR XBAR XDB XARB XIR XMUX Glossary 4 The interconnect clock It is centrally distributed to all UPA ports and within the interconnect The central controller in the interconnect It orchestrates the cache coherency data flow flow control and memory operations UltraSPARC Data Buffer Two chips that connect the UltraSPARC I processor and its external cache to the 144
65. es and latch them If you feel any abnormal resistance remove the system board and examine the connector carefully for damage Lock the insertion handles by sliding the locking levers into position until they are fully nested with the handles Powering On a System Board Determine the amount of system power available by typing power See TABLE 3 1 to confirm that the amount of available power is sufficient for the number of system boards to be installed TABLE 3 1 Power Redundancy Number of System Required Power Supplies for N 2 Power Supply Required 200V 30 A Boards or N 1 AC Input Unit Redundancy single phase circuits 1 2 4 2 3 5 5 3 7 8 6 3 9 12 7 4 13 16 8 4 1 If two supplies are failing no AC module may be removed unless the two failed supplies are under the same AC module control Chapter 3 Control and System Board Replacement Procedures 3 11 2 Power on a system board by using hostview 1M or by typing ssp power on sb x Where x 0 15 Refer to power 1M for more information 3 If using SSP version 3 0 restore the system board s thermal calibration data See Section 9 1 Restoring the Thermal Calibration Information Using SSP Version 3 0 on page 9 1 3 2 6 Configuring a System Board After a system board is powered on m Itis necessary to run autoconfig 1M on the SSP when a system board is installed for the first time in a previously unused slot m Itis necessary to run
66. es for the appropriate entries m etc hosts requires IP address and hostname of control boards m etc ethers requires MAC address of control boards m etc nsswitch conf must point to files for all entries 1 Log in to the SSP as root 3 2 Sun Enterprise 10000 System Service Manual March 2002 2 Manually edit the etc hosts file with the domain s and control board s IP address if this information is not already in an NIS database This procedure is dependent on whether local files or NIS are used The control board s IP address is customer supplied Correct entries should look similar to the following etc hosts sample Differences due to the spare SSP are commented Note SSP software only supports standard class C addresses for the control board subnet CODE EXAMPLE 3 1 Sample etc hosts File Entries for dom_subnet XXX XXX XX XXX domain1_hostname XXX XXX XX XXX domain2_hostname XXX XXX XX XXX domainn_hostnname n is the number of domains Entries on both ssp s NOTE On the spare SSP make sure loghost belongs to the spare XXX XXX XX XXX main_ssp_hostname loghost XXX XXX XX XXX spare_ssp_hostname The next three entries need to be on cb0_subnet XXX XXX XX XXX main_ssp_hostname 1e0 XXX XXX XX XXX spare_ssp_hostname 1e0 XXX XXX XX XXX cbO_hostname The next three entries need to be on cbl_subnet xxx xxx xxx xxx main_ssp_hostname hme1 XXX XXX XX XXX spare_ssp_
67. et Hub __ SB0 SBUS 1 SLOT 1 ENET LEO ___ ____B0 SBUS1 SLOT 1 ENET LEO _ Connection Between Control Board 0 RPC 0 and Remote Power Control 0 CBO Clonnnon NS corp gt Connection Between System Board 0 PCI 0 0 and I O cabinet 0 Tray 0 __ SB0 PCI 0 0 CABO TRAY ot _____ SB0 PCI 0 0 CADO TRAY 0 Connection Between AC controller 0 top receptacle and the power plug Clm xp Connection Between AC power sequencer in I O cabinet 1 and the power plug CT CAB 1 acseao n CAR AC po FIGURE 7 1 Cable Labeling 4 Set up an ESD protected staging area for several system boards control boards centerplane support boards and four fan trays 7 2 Sun Enterprise 10000 System Service Manual March 2002 Caution System boards centerplane support boards control boards SBus cards and the centerplane are all VERY susceptible to electrostatic discharge Therefore all possible precautions should be taken to protect these boards against static damage Transport board assemblies on an ESD protected cart whenever possible Use an ESD wrist strap when handling Open and remove all access doors Attach a wrist strap In the table below note the serial numbers and locations of the system boards and the serial number and revision of the new centerplane TABLE 7 1 Component Serial Numbers Location Serial Number Location Serial Number CBO CB1 CSBO CSB1 SB
68. file or cut and paste them to a file This data is useful in analyzing the cause of the hang condition ok gt ctrace This will give you trace before going into OpenBoot PROM Symbols will not be available if the kernel is a nondebug kernel ok gt registers This command gives you a global register dump at the time of entering OpenBoot PROM ok gt locals This command gives you a local register dump at the time of entering OpenBoot PROM ok gt sync Sync issues a callback to the kernel to get a core dump The system should dump core and reboot after issuing this OpenBoot PROM command m If the sigbcmd command did not work attempt to force the system to panic with the hostint command on the SSP a If the hostint command does not work try a sigbcmd p bootproc panic This is a more forceful version of the hostint command 3 When all else fails issue a bringup command to restore the domain to operation Chapter 9 Software Procedures 9 9 9 5 Upgrading the CBE Flash PROM on the Control Board Using SSP Version 3 1 and Subsequent Compatible Versions This procedure can only be used with SSP version 3 1 1 Install the CBE SSP patch Search the SunSolve database for the latest patch information 2 Log in to the SSP as user ssp When prompted for the SUNW_HOSTNAME use either the platform name or the name of an existing domain 3 Open a netcon session to the domain in another
69. g you must remove the board logically before you do so physically The Dynamic Reconfiguration User s Guide tells how to do so with the DR Detach feature Chapter 4 System Board I O Component Replacement Procedures 4 7 System board Personality plate PCI card PCI filler panel PCI front bracket PCI I O module PCI front cover Top PCI riser card EN Bottom PCI riser card FIGURE 4 5 PCI Components 4 2 1 Accessing PCI Components 1 Attach a wrist strap 2 See Section 3 2 3 Removing a System Board on page 3 10 After removal place the system board on a flat sturdy ESD protected surface with the FRU side up 3 Remove the four Phillips screws from the system board cover and remove the cover 4 Loosen the four captive screws on the PCI front cover and remove from the system board front cover FIGURE 4 6 4 8 Sun Enterprise 10000 System Service Manual March 2002 WS K PCI front cover FIGURE 4 6 PCI Front Cover Removal 4 2 2 Removing a PCI Card 1 Attach a wrist strap 2 Remove the PCI retention screw from the top flange of the PCI card 3 Disengage the card from the riser card and remove it from the system board assembly FIGURE 4 7 va PCI retention screw IN x R nl Ur R he FIGURE 4 7 PCI Card Removal Chapter 4 System Board I O Component Replacement Procedures 4 9 4 Place the PCI card in an antis
70. g Component Replacement Procedures 2 21 NU FIGURE 2 5 Air Filter Replacement 5 Remove the filter and discard 6 Insert a clean air filter into the air filter slot pushing toward the center of the cabinet until it stops 7 Reinstall the faceplate with the four screws 8 Close the access door 2 22 Sun Enterprise 10000 System Service Manual e March 2002 CHAPTER O Control and System Board Replacement Procedures Note All commands performed through the Hostview GUI hostview 1M can also be performed by other SSP user commands such as the power 1M command or the fan 1M command 3 1 chel Control Board Replacement Isolating a Failed Control Board Use the following checklist to assist with fault isolation Check for any error messages during post On the SSP check for any error messages in var opt SUNWssp adm messages On the SSP if available use redx to examine any arbstop dump files or record stop dump files located in var opt SUNWssp adm domain name On specific domains if system call dump files are available use ADB to examine var crash domain name 3 1 DAZ Setting Up the Network for a Replacement Control Board Modify the host SSP network files with the Ethernet address of the replacement control board To verify that the host SSP network files are correctly set up view the etc ethers etc hosts and etc nsswitch conf fil
71. ged in to the SSP as user ssp with two login sessions Both login sessions must have their environment pointed at the correct domain Use the domain_status and domain_switch commands to set up the environment Use one session as a system console for the domain with the netcon command Use the other session for all SSP commands Determining If a Domain Is Hung Verify that netcon responds to a carriage return and that you can ping the domain from the SSP If you cannot perform these functions you either have a system problem or a hung domain m Confirm a system problem by checking power status and hostview warnings m Confirm a hung domain by issuing a telnet to the domain Use UNIX commands to determine the cause of sluggish behavior m Use ps elf to look for slow processes m Use df 1k to check file system usage and to determine who are current users and what processes they are running Restoring a Hung Domain Issue the following SSP commands and save the output to a file ssp check _host v ssp hostinfo h Attempt to force the domain into OpenBoot PROM by typing ssp sigbcmd p bootproc obp Observe netcon session activity If you see the ok gt prompt then the sigbcmd command was successful 9 8 Sun Enterprise 10000 System Service Manual e March 2002 m If the sigbcmd worked issue the following sequence of commands When finished save the contents of the window buffer to a
72. he component See Section 2 3 2 Powering Off an AC Input Module on page 2 2 Open the access door Open the door to the power shelf Disconnect the power cord from the AC input module and the wall receptacle Loosen the captive one half turn screw latch until it releases Pull out the AC input module and place on a flat sturdy ESD protected surface Installing an AC Input Module Insert the AC input module into the power shelf Tighten the captive one half turn screw latch Connect the power cord to the AC input module and the AC wall receptacle Powering On an AC Input Module Power on the two breakers located on the AC input module Close the door to the power shelf Close the access door Verifying an AC Input Module Use the following checklist to confirm that a component is operational m Confirm that the fans on the adjacent power supplies are on m Use hostview or the power command to check the power status m Verify that the power supply on status was detected by var opt SUNWssp adm domain name messages 2 4 Sun Enterprise 10000 System Service Manual March 2002 2 4 2 4 1 2 4 2 2 4 3 2 4 4 48 Volt Power Supply Replacement Isolating a Failed Power Supply Use the following checklist to assist with fault isolation Check that the power supply fans are on Confirm that the power supply is properly seated Check the power status on hostview Check for error
73. he event monitoring daemon is running by typing ssp edd_cmd The returned message should show State started monitoring If not you must restart the event monitoring daemon by typing ssp edd_cmd x start Refer to edd 1M and edd_cmd 1M for additional information Reinstall the control board Caution Do not install the control board completely until Step a Step g have been performed and all cables are attached a Firmly grasp the board by the handle and position it into the appropriate control board slot b Insert the control board part way to ensure it will not fall c Reconnect all cables that were removed in Step 2 of Section 3 1 4 Removing a Control Board on page 3 6 d With the handle extended slide the board into the slot until it begins to mate with the centerplane connector e Apply firm pressure to the faceplate to engage the board with the centerplane connector f Use the insertion handle to fully seat the board g Lock the handle by pulling up the locking lever into position until it is fully nested with the handle Powering On a Control Board Control boards are powered on upon insertion When power is on the yellow LEDs are lit No power on commands are necessary for the control board Chapter 3 Control and System Board Replacement Procedures 3 7 3 1 7 3 1 8 Configuring a Newly Installed Control Board as the Primary Control Board Once a f
74. horoughly inspect visually both the centerplane connector and the daughter board connector before insertion m Look for damage to either the male or female connector plastic housing m Look for foreign material in both the male and female connector plastic housing m Look for bent or damaged pins on all mating connectors Note If any of these conditions exist do not try to repair or replace parts unless you have been trained to do so m Never set or bump a connector against another surface m Never touch or probe the centerplane connector pins m When inserting a board into a centerplane slot Firmly press the board in by hand with evenly distributed pressure across the front panel until the resistance is too high for manual insertion m Use the insertion ejection handles to evenly apply pressure until the connector is fully seated m Always use the ejection handles when removing boards from the centerplane m Never try to force the connector using the insertion ejection handles if the board becomes cocked or jammed m Never use damaged components Sun Enterprise 10000 System Service Manual March 2002 1 6 Standard Torque Settings Components requiring specific torque settings when being secured such as the processor module in FIGURE 1 2 are listed in TABLE 1 11 SI JNA Na pia Kr Compression connector FIGURE 1 2 Compression Connector Always follow the standard torquing procedures listed in the p
75. hostname hme1 XXX XXX XX XXX cb1_hostname CODE EXAMPLE 3 2 shows an example of a main SSP etc hosts file is given assuming m xf4 and xf4 b3 are host domains m xf4 ssp is the main SSP and xf4 ssp1 is the spare SSP m xf4 cb0 and x 4 cb1 are the hostnames for the two control boards Chapter 3 Control and System Board Replacement Procedures 3 3 CODE EXAMPLE 3 2 Sample Main SSP etc hosts File 129 129 127 129 129 153 40 L53 49 0 0 1 153 49 153 49 etc hosts 8 9 dom_subnet xxx yyy 49 zzz The 49 subnet 113 114 cbO_subnet xxx yyy 151 zzz The 151 subnet 129 153 151 113 xf4 ssp le0 129 153 151 114 xf4 sspl le0 129 153 151 123 xf4 cb0 cbO_subnet xxx yyy 152 zzz The 152 subnet 129 153 152 113 xf4 ssp hmel 129 153 152 114 xf4 sspl hmel 129 153 152 127 xf4 cbl x 4 xf4 b3 localhost xf4 ssp loghost xf4 sspl Note The etc hosts file is actually a link to inet hosts 3 Manually edit the etc ethers file with the domain s control board s and SSP s Ethernet address if this information is not already in the NIS database Correct entries should look similar to the following etc ethers sample 8 0 0 0 0 0 0 0 8 0 22 OK be be be 20 87 OL OL a6 87 58 00 00 50 58 a5 le 57 2f aa xf4 ssp xf4 cb0 xf4 cb1 xf4 b3 xf4 sspl Note The control board s Ether
76. i amp Sun microsystems Sun Enterprise 10000 System Service Manual Sun Microsystems Inc 4150 Network Circle Santa Clara CA 95054 U S A 650 960 1300 Part No 805 2917 16 March 2002 Revision A Send comments about this document to docfeedback sun com Copyright 2002 Sun Microsystems Inc 4150 Network Circle Santa Clara CA 95054 U S A All rights reserved This product or document is distributed under licenses restricting its use copying distribution and decompilation No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors if any Third party software including font technology is copyrighted and licensed from Sun suppliers Parts of the product may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark in the U S and other countries exclusively licensed through X Open Company Ltd Sun Sun Microsystems the Sun logo AnswerBook2 docs sun com and Solaris are trademarks registered trademarks or service marks of Sun Microsystems Inc in the U S and other countries All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International Inc in the U S and other countries Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems Inc The Energy Star logo is a registered trademark of EPA The O
77. i 75 PCI 1 0 PCI13 1 0 I O Port 3 scard 13 1 1 sbus 75 SBUS 1 SLOT 1 SB13 1 1 System Board 14 sysbd 14 SB14 SB14 SB14 SB14 I O Port 0 scard 14 0 0 sbus 78 SBUS 0 SLOT 0 SB14 0 0 pci 78 PCI 0 0 PCI14 0 0 I O Port 1 scard 14 0 1 sbus 78 SBUS 0 SLOT 1 SB14 0 1 I O Port 2 scard 14 1 0 sbus 79 SBUS 1 SLOT O0 SB14 10 pci 79 PCI 1 0 PCI14 1 0 I O Port 3 scard 14 1 1 sbus 79 SBUS 1 SLOT 1 SB14 1 1 System Board 15 sysbd 15 SB15 SB15 SB15 SB15 I O Port 0 scard 15 0 0 sbus 7c SBUS 0 SLOT O0 SB15 0 0 pci 7c PCI 0 0 PCI15 0 0 I O Port 1 scard 15 0 1 sbus 7c SBUS 0 SLOT 1 SB15 0 1 I O Port 2 scard 15 1 0 sbus 7d SBUS 1 SLOT O0 SB15 1 0 pci 7d PCI 1 0 PCI15 1 0 I O Port 3 scard 15 1 1 sbus 7d SBUS 1 SLOT 1 SB15 1 1 Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 19 e foeston TOSCO TOPCCD SCOTS PEST OCSBS Ae Been Be Bee ii H 8 FIGURE 1 3 Component Numbering Front 1 20 Sun Enterprise 10000 System Service Manual March 2002 ACO ACI AC sequencer no number RPCO RPC1 RPC2 RPC3 RPC4 FTO ET FT2 FT3 CSBO CBO SBO SB1 SB2 SB3 SB4 SB5 SB6 SB7 FT4 FT5 FT6 FT7
78. ighten the captive connector screws in the sequence shown in FIGURE 5 4 until they touch the metal plate b Tighten each captive connector screw in the sequence shown in FIGURE 5 4 an additional 1 2 turn c Tighten the captive connector screws to a final torque of 0 68 Nm 6 0 inch pounds in the pattern shown in FIGURE 5 4 6 CG 10 O O O FIGURE 5 4 Tightening Pattern for the Memory Module 4 Install discrete attachment hardware through the cone washer and into the board and standoff FIGURE 5 5 5 6 Sun Enterprise 10000 System Service Manual e March 2002 FIGURE 5 5 Cone Washer and Standoff 5 Tighten discrete attachment hardware to a torque setting of 0 8 Nm 7 1 inch pounds 6 Install memory DIMMs if necessary See Section 5 3 Installing a System Board DIMM on page 5 4 7 Replace the system board cover and secure with Phillips screws tightening to a torque of 0 8 Nm 7 1 inch pounds 8 See Section 3 2 4 Installing a System Board on page 3 10 to confirm that the event monitoring daemon is running prior to installing the system board 9 Run autoconfig 1M if you m Replace a memory module with a memory module that has a different Sun part number m Install a memory module in a previously unused slot 5 4 5 4 1 Processor Component Replacement Removing a Processor Module 1 Attach a wrist strap
79. ise 10000 System Service Manual March 2002 CHAPTER 1 Component Replacement Guidelines Indicators and Nomenclatures In the Sun Enterprise 10000 system hot swapping a component refers to physically removing a component while the remaining system components are operational However prior to hot swapping the component must be removed as a resource for the operating system The basic procedures for hot swapping a component include 1 Using dr 1M or hostview 1M on components that can be hot swapped to remove the component as a resource for the system Caution Do not turn off power to a system board with the system board circuit breaker It is possible to arbstop the entire platform when the board is powered on again 2 Removing power from the component using either the power 1M or fan 1M command or hostview 1M Caution If the possibility exists for tools or people to come in contact with power connectors remove power from the component through the AC input module breakers 3 Removing and replacing the component components also contain the hand graphic shown in FIGURE 1 1 Prior to removal extinguish the yellow LEDs by using either hostview 1M or the power 1M command A Caution Do not remove any component that has a yellow LED lit These critical IF THE YELLOW LEDS ARE LIT DO NOT REMOVE THE COMPONENT FIGURE 1 1 Caution Graphic on Critical System Components 4 Applying
80. k trays 1 3 internal I O 1 3 memory 1 3 processor module cache size 1 3 processor module speed 1 3 configuration power and cooling for less than or more than 8 system boards 1 3 control block diagram 1 26 control board installing 3 7 powering off 3 5 powering on 3 7 removing 3 6 replacement 3 1 to 3 7 control board redundant 1 3 D designators See component numbering disk trays configuration 1 3 dr 1M 1 1 1 2 drawing assembly See illustrated parts breakdown F fan centerplane installing 6 4 removing 6 4 replacement 6 4 to fan tray installing 2 19 powering off 2 18 powering on 2 20 removing 2 19 replacement 2 18 to 2 20 fan 1M 1 1 field replaceable units FRUs 1 13 filler panel SBus card 4 3 4 11 H hostview 1M 1 1 1 2 hot swap procedure 1 1 hpost 1M 1 4 I 1 0 internal configuration 1 3 illustrated parts breakdown A 1 to A 20 inserting a board 1 10 installing AC input module 2 4 AC sequencer 2 12 cables to 7 9 8 2 to centerplane 7 8 centerplane support board 6 2 circuit breaker 2 10 control board 3 7 fan centerplane 6 4 fan tray 2 19 memory 5 4 memory module 5 6 PCI components 4 7 PCI I O module 4 13 power shelf 2 8 power supply 48 volt 2 5 processor module 5 9 SBus card 4 2 SBus I O module 4 5 system board 3 10 interconnect diagram 1 28 M memory configuration 1 3 installing 5 4 removing 5 2 repl
81. key switch in the front of the I O expansion cabinet to the OFF position m To remotely control AC sequencers in the I O expansion cabinet that do not have system interface cables connecting them set all REMOTE switches to the REMOTE position daisy chain the AC sequencers and turn the key switch in the front of the I O expansion cabinet to the OFF position 2 16 Sun Enterprise 10000 System Service Manual e March 2002 Rn Located In the Processor Cabinet I For remote control only one I RPC2 RPC3 RPC4 Remote power control modules Control board 1 CB1 Control board 0 CBO FIGURE 2 4 Basic Remote Power Connection Chapter 2 Power and Cooling Component Replacement Procedures 2 17 2 7 6 Powering On a Remotely Controlled AC Sequencer Type ssp power on p x Where x 0 4 This command powers on the AC sequencers that are controlled by the remote power control module indicated by x All peripherals powered by this AC sequencer will power on Refer to power 1M for more information 2 7 7 Verifying an AC Sequencer Use the following checklist to confirm that a component is operational m Confirm that components powered by sequencer are on 2 8 Fan Tray Replacement 2 8 1 Isolating a Failed Fan Tray Use the following checklist to assist with fault isolation m Check that the LEDs are on m Check the fan status using hostview or execute a hos
82. lacement Guidelines Indicators and Nomenclatures 1 13 TABLE 1 12 Customer Availability and MTTR Objectives Continued Field Replaceable Unit Mean time to repair Online Service AC input unit 5 min Yes if not in use by system Exterior cosmetic panel 5 min Yes Power control module 5 min Yes DC breaker 15 min Yes if not in use by system AC sequencer 15 min Yes if not in use by system Power shelf 60 min No Fan centerplane 20 min No Air filter 5 min Yes I O power cord 5 min Yes RSM tray 30 min Yes 1 8 1 14 Component Numbering All addressable components are identified by a standard set of numbering as listed in TABLE 1 13 and TABLE 1 14 Locations of all the components are shown in FIGURE 1 3 and FIGURE 1 4 Sun Enterprise 10000 System Service Manual March 2002 TABLE 1 13 Processor Numbering Component System Board 0 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 System Board 1 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 System Board 2 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 System Board 3 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 System Board 4 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 System Board 5 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 System Board 6 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 System Board 7 Proc Mod 0 Proc Mod 1 Proc Mod 2 Proc Mod 3 Chapter 1 Sola
83. lines Indicators and Nomenclatures 1 5 1 4 1 Fans Fan components and LEDs are listed in TABLE 1 3 and TABLE 1 4 TABLE 1 3 Fan Components Total maximum of fan of fan trays per fan of yellow LEDs per shelves per system shelf fan tray of fans per fan tray 4 4 4 2 TABLE 1 4 Fan Tray LEDs LED Name Color Purpose PWRI1 Yellow When lit 24 VDC is present and this fan tray is NOT safe to service 1 6 Sun Enterprise 10000 System Service Manual e March 2002 1 4 2 Centerplane Support Boards Centerplane support board components and LEDs are listed in TABLE 1 5 and TABLE 1 6 TABLE 1 5 Centerplane Support Board Total maximum per of green LEDs per of yellow LEDs per system Total per side board board 2 1 4 2 TABLE 1 6 Centerplane Support Board LEDs LED Name Color Purpose 5VDC HK Green 5 0 VDC housekeeping 3 3VDC HK Green 3 3 VDC housekeeping It 3 3VDC Yellow VDD signal on the control board is on indicating 3 3 volts DC is present and the control board is NOT safe to service HK S W Green Displays the state of a designated bit position on the power control JTAG ring of this board Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 7 1 4 3 Control Board Control board components and LEDs are listed in TABLE 1 7 and TABLE 1 8 TABLE 1 7 Control Board Total maximum per of green LEDs per of ye
84. llow LEDs per system Total per side board board 2 1 17 2 TABLE 1 8 Control Board LEDs LED Name Color Purpose 5VDC HK Green 5 0 VDC housekeeping 3 3VDC HK Green 3 3 VDC housekeeping 5VDC Yellow VDC on the control board is present 5VDC Yellow and the control board is NOT safe to service 5VDC FAN Green 5 0 VDC fan control power is present 5VDC PER Yellow 5 0 VDC peripheral cabinet power control voltage is present HK S W Green Displays the state of bit 8 on the power control JTAG ring of this board S W 7 S W0 Green Programmable bits that indicate the state of an 8 bit read write register located in the SPARClite s address space When the Control Board Executive is operating correctly a marching 1s pattern can be seen on S W0 S W6 S W7 indicates the A network is operational XMIT Green Ethernet interface transmit status REC Green Ethernet interface receive status det LINK Green Ethernet interface link status be f COLL Green Ethernet interface collision status JTAG MASTER Green Indicates that this control board is the system JTAG Master 1 8 Sun Enterprise 10000 System Service Manual e March 2002 1 4 4 System Board System board components and LEDs are listed in TABLE 1 9 and TABLE 1 10 TABLE 1 9 System Boards Total maximum per of green LEDs per of yellow LEDs per system Total per side board board 16 8 11 3 HK S W was used for hardware debug and was not programmed for use by the software S
85. lves are NOT considered hot swappable This procedure requires powering off the AC power to the system and disconnecting the AC power cords Also the side panel nearest the power shelves must be removed Therefore it might be necessary to move the cabinet to provide work space in this area Since the system must be powered off the operating system and all of the domains must be systematically brought down and then halted 1 Power off the system by typing ssp power off all 2 6 Sun Enterprise 10000 System Service Manual March 2002 10 11 12 13 14 Power off the AC circuit breakers at the AC input modules in the power shelf to be removed Disconnect the AC power cords from the AC input modules and allow them to hang loose Remove the AC input modules and DC power supplies from the power shelf Remove the access door by retracting the hinge pins located at the top and bottom of the front or rear access door enabling it to be removed from the cabinet Remove the door and set aside Remove the three M4 flat head Phillips screws securing the vertical trim strip to the frame Pull the trim strip off its brackets and set it aside Remove the AC power cords from in front of the side mounting flange for the power shelf Remove the two M4 panhead Phillips screws securing the door catch bracket to the frame Remove the door catch and set aside Remove the two screws atta
86. m both sides of the centerplane must be removed If the carrier plate assembly is removed from only the front side the alignment pin on the remaining carrier plate assembly can damage the new centerplane when it is installed Remove the carrier plate assembly that holds the control board and centerplane support board Remove six Phillips screws three on the top and three on the bottom of the carrier plate assembly Remove the top row of fan trays FTO FT3 Disconnect the power cables on the top of the centerplane FIGURE 7 3 Note the position of the ribbon cables on the left side of the centerplane and then disconnect them Verify that the ribbon cables are properly identified Chapter 7 Centerplane Replacement Procedures 7 5 Rear carrier plate n e S be o GA Vd a 5 2 2 Leg S D OZ O Oo SS SS LE Front carrier plate connectors lt o Gi Za om L O 20 E a ne a Cc oO E Cc D lt FIGURE 7 3 Carrier Plate Alignment Pin and Centerplane Connectors Sun Enterprise 10000 System Service Manual March 2002 7 6 10 11 12 From the front side Attach a wrist strap Verify that a flat sturdy ESD protected surface is available nearby for the centerplane Disconnect all I O c
87. mum Level Fatal Level ASIC 80 C 85 C 90 C Processors 80 C 85 C 90 C Power Supply 80 C 85 C 90 C Ambient Temperature 30 C 35 C 38 C 1 This includes CICs MC XDBs and all centerplane entries 2 This includes all PROC entries 3 This includes all VDC entries 4 This includes all SEN entries 1 4 Hardware Indicators The purpose of the LED indicators is to provide a method of isolating errors should the SSP or the SSP s communication path be faulty The purpose of the LEDs is limited to four primary categories as listed in TABLE 1 2 TABLE 1 2 LED Categories LED Color Purpose Yellow Each hot swappable device has at least two yellow LEDs If any yellow LED is on then it is NOT safe to be removed or serviced Two LEDs are used for redundancy On each applicable component all yellow LEDs will be enclosed in a rectangle on the silkscreen In addition to the functional identification of each yellow LED a silkscreen legend will be placed near the LEDs refer to left These yellow LEDs are in many cases indicators of the state of the software controlled power supplies Green Indicates the status of housekeeping power supplies Green Provides status indications valuable to determine the state of the boards or interfaces prior to having full communication with the SSP Green Displays the state of generally programmable registers useful for debug Chapter 1 Component Replacement Guide
88. n prompt before attempting the hostview command This allows time for the SSP daemons to start ssp hostview amp Verify that the J and C symbols are shown on control board 1 This indicates that the JTAG connection and clock distribution signals are coming from control board 1 If hostview fails to respond use ping to verify that you can communicate with control board 1 or visually examine the LEDs for correct operation and take appropriate action s to correct the problem For example verify that the link integrity LED is on indicating a good Ethernet connection or try running snoop on the SSP to verify the control boards are correctly configured 7 Issue the following power command on the main SSP to power on all system components ssp power on all 8 Use bringup 1M on each domain Chapter 9 Software Procedures 9 5 To revert back to control board 0 repeat the procedure and specify control board 0 as the primary Remember to perform the appropriate steps shown above for the spare SSP as well 9 3 Configuring a Control Board Using SSP Version 3 1 and Subsequent Compatible Versions This procedure details how to switch a primary control board to an alternate control board This requires updating the cb_config file to allow the ssp_config script to execute and resetting the control board with cb_reset Since this includes changing clock sources to the system boards centerplane and centerplane support b
89. n the three attachment screws from becoming damaged and rendering the personality plate useless 4 18 Sun Enterprise 10000 System Service Manual e March 2002 Compress personality plate and faceplate while installing or removing attachment screws Remove install attachment Ba screws here FIGURE 4 17 Installing a Personality Plate 9 Lift the personality plate out as noted in top view FIGURE 4 18 Personality Plate EMI gasket Se Angled flange s Front stiffener with notch FIGURE 4 18 Installing a Personality Plate Top View Chapter 4 System Board I O Component Replacement Procedures 4 19 4 3 2 Installing a Personality Plate Personality plates are located behind the system board faceplate All PCI front covers front brackets and risers if used I O modules and I O cards must be removed for access to the personality plate 1 Confirm that the type of personality plate you are installing is correct for your application FIGURE 4 19 O E Bas DO Angled flanges ed 2 SBus PCI Personality Personality Plate Plate FIGURE 4 19 Personality Plate Identification 4 20 Sun Enterprise 10000 System Service Manual e March 2002 2 Attach a wrist strap 3 Install the personality plate by aligning the angled flange to the notch of the front stiffener 4 Swing the personality
90. name post Use TABLE 5 1 and TABLE 5 2 to determine the failed component TABLE 5 1 DIMM and MM Conversion DIMM to Bits MM to Banks DIMM 0 lo half bits 17 0 MMO Bank 0 DIMM 1 lo half bits 35 18 MMI Bank 1 DIMM 2 lo half bits 53 36 MM2 Bank 2 DIMM 3 lo half bits 71 54 MM3 Bank 3 DIMM 4 hi half bits 17 0 DIMM 5 hi half bits 35 18 DIMM 6 hi half bits 53 36 DIMM 7 hi half bits 71 54 TABLE 5 2 Bank Conversion Bank 0 Bank 1 Bank 2 Bank 3 DIMM BITS MM P BITS MM P BITS MM P BITS MM P 0 0 17 00 1 0 17 10 17 0 17 20 3 0 17 30 19 5 1 18 35 01 5 18 35 11 21 18 35 21 7 18 35 3 1 23 2 36 53 0 2 9 36 53 1 2 25 36 53 22 11 36 53 3 2 27 bi 3 54 71 03 13 54 71 1 3 29 54 71 23 15 54 71 33 29 4 0 17 04 2 0 17 14 18 0 17 24 4 0 17 34 20 5 18 35 05 6 18 35 15 22 18 35 25 8 18 35 35 24 5 6 36 53 0 6 10 36 53 1 6 26 36 53 2 6 12 36 53 3 6 28 7 54 71 07 14 54 71 17 30 54 71 27 16 54 71 37 32 5 2 Sun Enterprise 10000 System Service Manual March 2002 2 SA Removing a System Board DIMM Attach a wrist strap See Section 3 2 3 Removing a System Board on page 3 10 to remove the system board and place it on a flat sturdy ESD protected surface with the FRU side up cover Remove the four Phillips screws from the system board cover and remove the Unlatch the sides of the DIMM connector and lift the DIMM out of its holder Configuring
91. nch pounds 10 See Section 3 2 4 Installing a System Board on page 3 10 to confirm that the event monitoring daemon is running prior to installing the system board 11 Run autoconfig 1M if you m Replace a processor module with a processor module that has a different Sun part number m Install a processor module in a previously unused location m Install a processor module onto a system board that has been newly installed into a system board slot that was previously unused 5 10 Sun Enterprise 10000 System Service Manual e March 2002 CHAPTER 6 Centerplane Support Board and Fan Centerplane Replacement Procedures Note All commands performed through the Hostview GUI hostview 1M can also be performed by other SSP user commands such as the power 1M command or the fan 1M command 6 1 6 1 1 Centerplane Support Board Replacement Isolating a Failed Centerplane Support Board Use the following checklist to assist with fault isolation m Check for any error messages during POST m On the SSP check for any error messages in var opt SUNWssp adm messages m On the SSP if available use redx to examine any arbstop dump files or record stop dump files located in var opt SUNWssp adm domain_na me m On specific domains if system call dump files are available use ADB to examine var crash domain_name 6 1 6 1 2 6 1 4 Powering Off a Centerplane Support Board Powering off a cen
92. net address is located on the front of each control board 3 4 Sun Enterprise 10000 System Service Manual March 2002 4 Edit the etc nsswitch conf file on both the main and the spare SSP m If using local configuration files the files should appear as in the following example hosts files ethers files netmasks files bootparams files m If using NIS the files should appear as in the following example hosts nis NOTFOUND return files ethers nis NOTFOUND return files netmasks nis NOTFOUND return files bootparams nis files Note The name information server nis is customer network configuration dependent 3 1 3 Powering Off a Control Board 1 Use hostview 1M to confirm that the control board is not the clock or JTAG master If the control board to be changed has a J and a C in its hostview icon you must switch the primary control board to the alternate control board See either Section 9 2 Configuring a Control Board Using SSP Version 3 0 on page 9 3 or Section 9 3 Configuring a Control Board Using SSP Version 3 1 and Subsequent Compatible Versions on page 9 6 2 Power off the control board either by using hostview 1M or by typing ssp power off cb x Where x 0 1 the alternate control board Refer to power 1M for more information 1 Caution Do not turn off a primary control board or system problems will occur Cha
93. ng system boards 14 and 15 and the blacklist file is located at SSSPVAR etc starfirel Each board in this domain will have an SBus SOC disk and HME network controller Chapter 4 System Board I O Component Replacement Procedures 4 3 4 1 3 a See if the PCs have been blacklisted by typing ssp more SSPVAR etc starfire1 blacklist pe 2 2 3 2 572 6 2 7 2 10 2 11 2 12 2 13 2 14 2 15 2 b Unblacklist the PCs on system boards 14 and 15 by editing the SSPVAR etc starfirel blacklist file and remove 14 2 and 15 2 from the pc line Removing an SBus I O Module See Section 3 2 3 Removing a System Board on page 3 10 After removal place the system board on a flat sturdy ESD protected surface with the FRU side up Remove the four Phillips screws from the system board cover and remove the cover Note the locations of each SBus card and remove all SBus cards as described in Section 4 1 1 Removing an SBus Card on page 4 1 Loosen and remove the five Phillips screws from the I O module Unscrew the six 3 32 inch hex head screws located on the compression connectors Remove the SBus I O module FIGURE 4 2 After removal place the SBus I O module on a flat ESD protected surface or into an antistatic bag 4 4 Gun Enterprise 10000 System Service Manual e March 2002 4 1 4 FIGURE 4 2 Replacing the SBus I O Module Installing an SBus I O Module If converting from PCI
94. o Run autoconfig 1M 3 13 xiii TABLE 5 1 DIMM and MM Conversion 5 2 TABLE 5 2 Bank Conversion 5 2 TABLE 7 1 Component Serial Numbers 7 3 TABLE 8 1 System Interconnect Cable Chart 8 5 TABLE 8 2 Component Serial Numbers 8 8 xiv Sun Enterprise 10000 System Service Manual March 2002 Preface The Sun Enterprise 10000 System Service Manual provides detailed instructions for replacing field replaceable components on the Sun Enterprise 10000 system Using UNIX Commands This document may not contain information on basic UNIX commands and procedures such as shutting down the system booting the system and configuring devices See one or more of the following for this information m Solaris Handbook for Sun Peripherals m AnswerBook online documentation for the Solaris software environment m Other software documentation that you received with your system XV Typographic Conventions Typeface Meaning Examples AaBbCc123 AaBbCc123 AaBbCc123 The names of commands files and directories on screen computer output What you type when contrasted with on screen computer output Book titles new words or terms words to be emphasized Command line variable replace with a real name or value Edit your login file Use 1s a to list all files You have mail su Password Read Chapter 6 in the User s Guide These are called class options You must be superuser to do this
95. oards all domains must be halted and the system must be idle 1 Log in to the SSP console as root 2 Change to single user mode by typing ssp init S 3 Stop all SSP daemons from running by typing ssp opt SUNWssp bin ssp_terminate 9 6 Sun Enterprise 10000 System Service Manual March 2002 4 Change the control board configuration by typing ssp opt SUNWssp bin ssp_config cb The following output is a representative session of this command ssp opt SUNWssp bin ssp config cb Configuring control boards Platform name allxf1 Control Board 0 xf1 cb0 gt Control Board 1 xf1 cbl gt Primary Control Board xf1 cb0 Is this correct y n n Do you have a control board 0 y n y Please enter the host name of the control board 0 xf1 cb0 Do you have a control board 1 y n y Please enter the host name of the control board 1 xf1 cbl Please identify the primary control board Is Control Board 0 xf1 cb0 the primary y n y Platform name allxf1 Control Board 0 xf1 cb0 gt 129 153 49 148 Control Board 1 xf1 cb1 gt 129 153 49 149 Primary Control Board xf1 cb0 Is this correct y n 5 Reboot the SSP 6 Use hostview to verify that the J and C symbols are in the appropriate icon for the new primary control board Chapter 9 Software Procedures 9 7 9 4 9 4 1 9 4 1 1 Recovering From a Hung Domain To recover from a hung domain you must be log
96. oc 7 0 proc 7 1 proc 7 2 proc 7 3 Component Replacement Guidelines Indicators and Nomenclatures 1 15 1 16 TABLE 1 13 Processor Numbering Continued Component Solaris ID Hostview ID POST ID System Board 8 SB8 sysbd 8 Proc Mod 0 SUNW UltraSPARC 20 0 32 proc 8 0 Proc Mod 1 SUNW UltraSPARC 21 0 33 proc 8 1 Proc Mod 2 SUNW UltraSPARC 22 0 34 proc 8 2 Proc Mod 3 SUNW UltraSPARC 23 0 35 proc 8 3 System Board 9 SB9 sysbd 9 Proc Mod 0 SUNW UltraSPARC 24 0 36 proc 9 0 Proc Mod 1 SUNW UltraSPARC 25 0 37 proc 9 1 Proc Mod 2 SUNW UltraSPARC 26 0 38 proc 9 2 Proc Mod 3 SUNW UltraSPARC 27 0 39 proc 9 3 System Board 10 SB10 sysbd 10 Proc Mod 0 SUNW UltraSPARC 28 0 40 proc 10 0 Proc Mod 1 SUNW UltraSPARC 29 0 41 proc 10 1 Proc Mod 2 SUNW UltraSPARC 2a 0 42 proc 10 2 Proc Mod 3 SUNW UltraSPARC 2b 0 43 proc 10 3 System Board 11 SB11 sysbd 11 Proc Mod 0 SUNW UltraSPARC 2c 0 44 proc 11 0 Proc Mod 1 SUNW UltraSPARC 2d 0 45 proc 11 1 Proc Mod 2 SUNW UltraSsPARC 2e 0 46 proc 11 2 Proc Mod 3 SUNW UltraSPARC 2f 0 47 proc 11 3 System Board 12 SB12 sysbd 12 Proc Mod 0 SUNW UltraSPARC 30 0 48 proc 12 0 Proc Mod 1 SUNW UltraSPARC 31 0 49 proc 12 1 Proc Mod 2 SUNW UltraSPARC 32 0 50 proc 12 2 Proc Mod 3 SUNW UltraSPARC 33 0 51 proc 12 3 System Board 13 SB13 sysbd 13 Proc Mod 0 SUNW UltraSPARC 34 0 52 proc 13 0 Proc Mod 1 SUNW UltraSPARC 35 0 53 proc 13 1 Proc Mod 2 SUNW Ul
97. ol board issues a command to RPC 3 All remote power control modules programmed to address 3 respond to control board command gei Address 3 Address 0 Address 3 PD ER D e e off id si AS l log ZG g ee e Oe e KEN ni Ces 3 i Cal eee of De c ei SC of 7 el ID E e sm e a oh wein All AC sequencers attached to l oH ZS e remote power control modules E programmed to address 3 also respond to control board commands ses off io for that address al n FIGURE 2 3 Remote Power Control Addressing Chapter 2 Power and Cooling Component Replacement Procedures 2 15 Note the following rules when configuring the AC sequencers see FIGURE 2 4 m To remotely control an AC sequencer in the Sun Enterprise 10000 system cabinet set the REMOTE switch to the REMOTE position m To remotely control AC sequencers in the I O expansion cabinet that have system interface cables connecting them set all the REMOTE switches to the REMOTE position and turn the
98. on Part Number Cable internal card cage fan centerplane to F530 2396 bulkhead quantity 1 Appendix A Illustrated Parts Breakdown A 19 FIGURE A 19 Fan Sense Cable P1 po SG 0 2000000 et o o o o o o o AH Stripe Pin 1 Pin 1 ig x e D Description Part Number Cable internal card cage fan centerplane to F530 2398 bulkhead 22 0 inches 559 mm quantity 4 FIGURE A 20 Fan Signal Cable P1 P2 4 j D EEI 8 BE e i Pin 1 2 Pin 1 Li Stripe di dl Description Part Number Cable internal card cage fan centerplane to F530 2397 centerplane 22 0 inches 559 mm quantity 4 A 20 Sun Enterprise 10000 System Service Manual March 2002 Glossary arbstop ASIC autoconfig BBSRAM BDA Centerplane Centerplane support board CIC CLM Control board Correctable Error CSR Degraded mode Arbiter stop condition Application Specific Integrated Circuit Automatic configuration of the SSP s JTAG scan database Bootbus SRAM Board Descriptor Array A double sided backplane where eight system boards one centerplane support board and one control board connect perpendicular into each side Board that connects into the centerplane and supplies clocks JTAG and control functions for one half of the
99. pins in the connector to make sure they are not bent Guide the SBus card faceplate under the springfingers and against the rear face of the personality plate The I O connectors of the SBus card should be accessible through the opening in the personality plate To align the connector and socket push the card toward the personality plate against the compliant EMI gasket Hold the SBus card by the edges near the connector and firmly but gently press the card down until the connector is fully seated Caution Do not rock the card onto the socket the plastic connector housing can break Replace the system board cover and secure with four Phillips screws tightening to a torque of 0 8 Nm 7 1 inch pounds See Section 3 2 4 Installing a System Board on page 3 10 to confirm that the event monitoring daemon is running prior to installing the system board Check for blacklisted components If SBus cards have been newly added to a system board confirm that the PCs on those system boards are not blacklisted PCs are blacklisted at the factory when a system board does not have any SBus cards installed During the bringup process observe the list of blacklisted components Alternatively to retrieve the blacklist file refer to the blacklist 1M man page Blacklisted PCs will need to be unblacklisted prior to creating a domain that would include those PCs In the following example a domain will be created usi
100. placing a Styling Panel and End Panel 8 1 8 12 Replacing an Access Door 8 1 8 1 2 1 Removing an Access Door 8 1 8 1 2 2 Replacing an Access Door 8 2 Cable Replacement 8 3 8 2 1 Replacing Remote Power Control Cables 8 6 8 22 Replacing an AC Power Cord 8 6 Contents vii vili 8 2 3 Replacing an Internal Cabinet Cable 8 6 8 2 4 Replacing an Internal Card Cage Cable 8 7 9 Software Procedures 9 1 9 1 Restoring the Thermal Calibration Information Using SSP Version 3 0 9 1 9 2 Configuring a Control Board Using SSP Version 3 0 9 3 9 3 Configuring a Control Board Using SSP Version 3 1 and Subsequent Compatible Versions 9 6 9 4 Recovering From a Hung Domain 9 8 9 41 Determining Ifa Domain Is Hung 9 8 9 4 1 1 Restoring a Hung Domain 9 8 9 5 Upgrading the CBE Flash PROM on the Control Board Using SSP Version 3 1 and Subsequent Compatible Versions 9 10 9 6 Changing the Clock Multiplier 9 13 Glossary Glossary 1 Index Index 1 Sun Enterprise 10000 System Service Manual March 2002 FIGURE 1 1 FIGURE 1 2 FIGURE 1 3 FIGURE 1 4 FIGURE 1 5 FIGURE 1 6 FIGURE 1 7 FIGURE 1 8 FIGURE 1 9 FIGURE 1 10 FIGURE 1 11 FIGURE 1 12 FIGURE 2 1 FIGURE 2 2 FIGURE 2 3 FIGURE 2 4 FIGURE 2 5 FIGURE 4 1 FIGURE 4 2 Figures Caution Graphic on Critical System Components 1 2 Compression Connector 1 11 Component Numbering Front 1 20 Component Numbering Back 1 21 System Board Component Numbering 1 22 Memo
101. placing an Access Door 8 1 2 1 Removing an Access Door 1 Open the access door 2 On the upper hinge grasp the hinge pin and pull down to release the upper part of the door 3 Holding the door in a perpendicular position with respect to the cabinet angle the top of the access door away from cabinet while lifting the lower hinge pin up and away from the lower hinge 8 1 8 1 2 2 Replacing an Access Door 4 To replace place the lower pin on the lower hinge 5 While pulling down on the upper hinge pin align the upper pin with the upper hinge Release the hinge pin to engage 8 2 Sun Enterprise 10000 System Service Manual March 2002 8 2 Cable Replacement For cable identification see Appendix A FIGURE 8 1 and FIGURE 8 2 identify the silkscreen numbers on the cabinet that corresponds to the cable connections See TABLE 8 1 d EN pam nay FIGURE 8 1 Internal Cabinet Cable Connections Back Power Shelf J1 J2 J3 J4 J5 J11 J12 J6 J7 J8 J9 J10 J13 J14 J15 J16 Chapter 8 Mechanical Component and Cable Replacement Procedures 8 3 A DD CH O e O e e Rear View of Back Power Shelf Rear View of Front Power Shelf
102. power to the component or to the cabinet in cases where power does not automatically resume 5 Using dr 1M or hostview 1M to re introduce the hot swapped component as a resource for the system Allocating components as resources is covered in the following documents Sun Enterprise 10000 Dynamic Reconfiguration User Guide Sun Enterprise 10000 Dynamic Reconfiguration Reference Manual Sun Enterprise 10000 DR Configuration Guide Sun Enterprise Server Alternate Pathing 2 3 1 User Guide Sun Enterprise Server Alternate Pathing 2 3 1 Reference Manual Sun Enterprise Server Alternate Pathing 2 3 1 Installation Guide and Release Notes 1 2 Sun Enterprise 10000 System Service Manual e March 2002 1 1 Configuration Rules The following rules apply when configuring components on the Sun Enterprise 10000 system When installing peripherals into the Sun Enterprise 10000 cabinet m RSM trays are the only peripherals used in the Sun Enterprise 10000 cabinet m Only three RSM trays can be used in the Sun Enterprise 10000 cabinet All supported peripherals are listed in the Computer Systems price list and International Configuration Guide A second control board is optional Two centerplane support boards are required to utilize a 144 bit data bus and four address buses The system is shipped with two centerplane support boards Should one fail the system will function with only a 72 bit data bus and two address buses Systems ordered wi
103. pter 3 Control and System Board Replacement Procedures 3 5 3 1 4 3 Note A warning message queries the user to continue to power off or not This warning message ensures that the user is physically present to power on or off the control board A remote power on command does not exist Removing a Control Board Caution If the yellow LEDs are lit do not remove the component See Section 3 1 3 Powering Off a Control Board on page 3 5 Open the Sun Enterprise 10000 system cabinet access door that is enclosing the control board to be replaced Note The control board to be removed will have its yellow LEDs off If the yellow power LEDs are on do not remove the board Check the other control board to see if its yellow LEDs are off If they are off then that is the control board that has been powered off for replacement Note the location of all cables connected to the control board to be replaced Attach a wrist strap Disconnect the cables from the control board Unlock the control board handle by placing one hand on the handle to hold it in place while using the other hand to pull down on the locking lever that rests on the handle Pull down on the handle carefully and remove the board Place the removed control board on a flat sturdy ESD protected surface 3 6 Sun Enterprise 10000 System Service Manual March 2002 31 5 3 1 6 Installing a Control Board 1 Confirm that t
104. put module installing 2 4 powering off 2 2 powering on 2 4 removing 2 4 replacement 2 2 to 2 4 AC sequencer installing 2 12 powering off 2 12 powering on 2 18 removing 2 12 replacement 2 11 to 2 18 air filter replacement 2 21 assembly drawing See illustrated parts breakdown autoconfig 1 3 1 4 1 13 3 12 3 13 4 7 4 16 5 8 5 11 B board insertion 1 10 breaker DC replacement 2 9 to 2 11 C cable connections 8 2 power shelf 8 3 cables internal to cabinet card cage power A 17 card cage power control sense A 18 power cross over A 17 internal to card cage centerplane and upper power A 19 fan sense A 20 fan signal A 20 lower fan power A 18 power cord domestic A 16 power cords European A 16 remote power control cables A 15 replacement to 7 9 8 2 to internal to cabinet 8 5 internal to card cage 8 6 power cords 8 5 remote power control cables 8 5 sequencing A 15 cache size processor module configuration 1 3 caution power 1 1 removing components 1 2 yellow LED 1 2 centerplane installing 7 8 removing 7 5 replacement 7 1 to 7 10 centerplane support board configuration 1 3 installing 6 2 powering off 6 2 powering on 6 3 removing 6 2 replacement 6 1 to 6 3 circuit breaker installing 2 10 Index 1 removing 2 9 component number back 1 21 system board 1 22 component numbering 1 14 front 1 20 configuration 1 3 centerplane support board 1 3 dis
105. quire turning off the AC power to the system Systematically bring down the operating systems and then halt the domains Power off the system by typing ssp power off all Power off the breakers on the AC input modules Remove the side panel nearest to the power shelves See Section 8 1 1 Replacing a Styling Panel and End Panel on page 8 1 Disconnect and remove the cable Install the new cable Reinstall the side panel See Section 8 1 1 Replacing a Styling Panel and End Panel on page 8 1 Power on all AC input breakers Power on the system by typing ssp power on all 8 6 Sun Enterprise 10000 System Service Manual March 2002 8 2 4 Replacing an Internal Card Cage Cable Caution The internal card cage cables are NOT considered hot swappable These procedures require turning off the AC power to the system Systematically bring down the operating systems and then halt the domains Power off the system by typing ssp power off all Power off the breakers on the AC input modules Replacing a Lower Fan Centerplane to Bulkhead Power Cable a Remove fan trays ft4 ft6 b Disconnect and remove the cable c Install the new cable d Reinstall fan trays e Skip to Step 8 Replacing the Fan Centerplane to Bulkhead Power Cable Harness a Remove fan trays ft0 ft3 and ft8 ft11 b Disconnect and remove the cable
106. rackets if used PCI risers if used I O modules I O cards Removing a Personality Plate Attach a wrist strap See Section 3 2 3 Removing a System Board on page 3 10 After removal place the system board on a flat sturdy ESD protected surface with the FRU side up Remove the four Phillips screws from the system board cover and remove the cover Remove the PCI front cover if necessary as shown in FIGURE 4 15 K OY Li Do Ya ACE AGI A i FIGURE 4 15 PCI Front Cover Removal a PCI front cover 5 Remove the I O cards if necessary See Section 4 1 1 Removing an SBus Card on page 4 1 or Section 4 2 2 Removing a PCI Card on page 4 9 Chapter 4 System Board I O Component Replacement Procedures 4 17 6 Remove the I O module if necessary See Section 4 1 3 Removing an SBus I O Module on page 4 4 or Section 4 2 4 Removing a PCI I O Module on page 4 12 7 Remove the PCI front brackets if necessary by removing the four screws shown in FIGURE 4 16 FIGURE 4 16 PCI Front Bracket Removal 8 Compress the personality plate to the backside of the system board faceplate to relieve the stress on the screws Sustain this force while removing the three screws securing the personality plate FIGURE 4 17 This force needs to be relieved while removing each screw to prevent the threads h Caution The compliant EMI gasket puts force o
107. rd on page 4 10 Sun Enterprise 10000 System Service Manual March 2002 4 2 6 Removing a PCI Riser Card The PCI I O module must be removed to remove or install a riser card See Section 4 2 4 Removing a PCI I O Module on page 2 11 1 Attach a wrist strap 2 Remove any PCI cards according to Section 4 2 2 Removing a PCI Card on page 4 9 Top PCI riser card Bottom PCI riser card LA is Countersink screw Fastening hardware bottom riser card only Cone washer Fastening hardware for bottom riser only FIGURE 4 14 Removing a PCI Riser Card 3 To remove the bottom PCI riser card remove the fastening hardware shown in FIGURE 4 14 Chapter 4 System Board I O Component Replacement Procedures 4 15 4 2 7 4 2 8 Pull the riser card straight out from the PCI I O module mating connector Place the riser card in an antistatic bag Installing a PCI Riser Card If converting from SBus to PCI the personality plate and I O module must be removed and replaced prior to installing any PCI electrical components See Section 4 3 Personality Plate Replacement on page 4 17 and Section 4 1 3 Removing an SBus I O Module on page 4 4 Confirm that the riser card is the correct voltage for the PCI card to be installed PCI cards and risers cards are available in multiple voltages Inspect the keyed connector on the PCI card to confirm that it will properly mate with
108. ris ID SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU SU NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U NW U ltraSPARC 0 0 ltraSPARC 1 0 ltraSPARC 2 0 ltraSPARC 3 0 ltraSPARC 4 0 ltraSPARC 5 0 ltraSPARC 6 0 ltraSPARC 7 0 ltraSPARC 8 0 ltraSPARC 9 0 ltraSPARC a 0 ltraSPARC b 0 ltraSPARC c 0 ltraSPARC d 0 ltraSPARC e 0 ItraSPARC f 0 ItraSPARC 10 0 ItraSPARC 11 0 ItraSPARC 12 0 ItraSPARC 13 0 ItraSPARC 14 0 ItraSPARC 15 0 ItraSPARC 16 0 ItraSPARC 17 0 ItraSPARC 18 0 ItraSPARC 19 0 ItraSPARC 1a 0 ItraSPARC 1b 0 ltraSPARC 1c 0 ltraSPARC 1d 0 ltraSPARC 1e 0 ItraSPARC 1f 0 Hostview ID SBO 00 01 02 03 SB1 04 05 06 07 SB2 08 09 10 11 SB3 12 13 14 15 SB4 16 17 18 19 SB5 20 21 22 23 SB6 24 25 26 27 SB7 28 29 30 31 POST ID sysbd 0 proc 0 0 proc 0 1 proc 0 2 proc 0 3 sysbd 1 proc 1 0 proc 1 1 proc 1 2 proc 1 3 sysbd 2 proc 2 0 proc 2 1 proc 2 2 proc 2 3 sysbd 3 proc 3 0 proc 3 1 proc 3 2 proc 3 3 sysbd 4 proc 4 0 proc 4 1 proc 4 2 proc 4 3 sysbd 5 proc 5 0 proc 5 1 proc 5 2 proc 5 3 sysbd 6 proc 6 0 proc 6 1 proc 6 2 proc 6 3 sysbd 7 pr
109. rocessor I O and memory mezzanine replacement procedures When retorquing a part remember to loosen or back out the screw before retightening it This will assure the proper torque is applied and will also reduce the chances of breaking a screw Note A torque wrench has been included with the system in the document pouch Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 11 TABLE 1 11 Torque Specifications Torque Specification for Manufacturing Use of 6 0 in Ibs Permitted In the Field Tolerance range Relative to spec 0 06 Nm N A Unless range stated 0 5 in Ibs N A Non specified component screws M3 7 0 in Ibs 0 8 Nm Yes M5 33 3 in lbs 3 76 Nm Yes Specific Components Captive compression connections 4 40 hex Low torque approx 3 0 in Ibs 0 34 Nm No tighten less than 6 0 in Ibs Final torque 6 0 in Ibs 0 68 Nm Yes YO processor and memory module 4 40 hex Captive low torque approx 3 0 in Ibs 0 34 Nm No tighten less than 6 0 in Ibs Captive final torque 6 0 in Ibs 0 68 Nm Yes Circuit breaker M3 screw 5 in lbs 0 6 Nm Yes System board cover M3 screw 7 0 8 8 in Ibs 0 798 0 998 Nm Yes YO memory module M3 screw 7 0 in Ibs 0 8 Nm Yes Fan centerplane M3 screw 5 3 in lbs 0 6 Nm Yes Centerplane M5 screw 33 3 in Ibs 3 76 Nm No hand tighten 1 Newton meters 1 12 Sun Enterprise 10000 System Service Manual March 2002 1 7
110. rsion 3 0 This procedure is performed automatically by SSP version 3 1 and subsequent compatible versions The system boards and centerplane contain ASICs which require thermal calibration data in order for the SSP software to correctly report temperature data The initial thermal calibration of the system boards and centerplane is done during the manufacturing process using the thermcal 1M command The resulting thermcal calibration data is then written to EEPROMs resident on the boards Once done the thermcal 1M procedure need not be repeated The SSP software requires the correct thermal calibration data for each system board and centerplane resident in the system A data file containing this information is created by the thermcal_config 1M command In order for this data file to be correct thermcal_config 1M must be executed during SSP software installation or when system boards or centerplanes are replaced added or moved to new slots Failure to execute this procedure in these cases will prevent the SSP software from correctly monitoring the system s temperature which could result in the system overheating and failure 9 1 9 2 1 Type ssp edd cmd x stop This stops the edd daemon monitoring scripts Type ssp thermcal_config The thermcal_config 1M command requires approximately 10 minutes to complete on a system containing 16 system boards The thermcal_config 1M command reads thermal data on e
111. ry Bank Locations 1 23 Memory DIMM Locations 1 23 SBus Slot and Remote Power Control Numbering 1 24 Fan Power and Control Block Diagram 1 25 Fan Power and Control Block Diagram Il 1 26 System Board Block Diagram 1 27 Sun Enterprise 10000 System Interconnect Diagram 1 28 Circuit Breaker Labels 2 9 Remote Power Control 2 14 Remote Power Control Addressing 2 15 Basic Remote Power Connection 2 17 Air Filter Replacement 2 22 Replacing System Board SBus Card 4 2 Replacing the SBus I O Module 4 5 FIGURE 4 3 FIGURE 4 4 FIGURE 4 5 FIGURE 4 6 FIGURE 4 7 FIGURE 4 8 FIGURE 4 9 FIGURE 4 10 FIGURE 4 11 FIGURE 4 12 FIGURE 4 13 FIGURE 4 14 FIGURE 4 15 FIGURE 4 16 FIGURE 4 17 FIGURE 4 18 FIGURE 4 19 FIGURE 4 20 FIGURE 4 21 FIGURE 5 1 FIGURE 5 2 FIGURE 5 3 FIGURE 5 4 FIGURE 5 5 FIGURE 5 6 FIGURE 5 7 FIGURE 7 1 FIGURE 7 2 Tightening Pattern for the SBus I O Module 4 6 Cone Washer and Standoff 4 6 PCI Components 4 8 PCI Front Cover Removal 4 9 PCI Card Removal 4 9 Installing a PCI Filler Panel 4 10 PCI Slot Numbering 4 11 Inserting a PCI Card 4 12 Replacing the PCI I O Module 4 13 Tightening Pattern for the PCI I O Module 4 14 Cone Washer and Standoff 4 14 Removing a PCI Riser Card 4 15 PCI Front Cover Removal 4 17 PCI Front Bracket Removal 4 18 Installing a Personality Plate 4 19 Installing a Personality Plate Top View 4 19 Personality Plate Identifi
112. scard 9 1 1 sbus 65 SBUS 1 SLOT 1 SB9 1 1 System Board 10 sysbd 10 SB10 SB10 SB10 SB10 I O Port 0 scard 10 0 0 sbus 68 SBUSOSLOTO SB10 0 0 pci 68 PCI 0 0 PCI10 0 0 I O Port 1 scard 10 0 1 sbus 68 SBUS 0 SLOT 1 SB10 0 1 I O Port 2 scard 10 1 0 sbus 69 SBUS 1 SLOT O0 SB10 1 0 pci 69 PCI 1 0 PCI10 1 0 I O Port 3 scard 10 1 1 sbus 69 SBUS 1 SLOT 1 SB10 1 1 System Board 11 sysbd 11 SB11 SB11 SB11 SB11 I O Port 0 scard 11 0 0 sbus 6c SBUSOSLOTO SB11 0 0 pci 6c PCI 0 0 PCI11 0 0 I O Port 1 scard 11 0 1 sbus 6c SBUS 0 SLOT 1 SB11 0 1 I O Port 2 scard 11 1 0 sbus 6d SBUS 1 SLOT O0 SB11 1 0 pci 6d PCI 1 0 PCI11 1 0 I O Port 3 scard 11 1 1 sbus 6d SBUS 1 SLOT 1 SB11 1 1 System Board 12 sysbd 12 SB12 SB12 SB12 SB12 I O Port 0 scard 12 0 0 sbus 70 SBUS 0 SLOT 0 SB12 0 0 pci 70 PCI 0 0 PCI12 0 0 I O Port 1 scard 12 0 1 sbus 70 SBUS 0 SLOT 1 SB12 0 1 I O Port 2 scard 12 1 0 sbus 71 SBUS 1 SLOT O0 SB12 1 0 pci 71 PCI 1 0 PCI12 1 0 I O Port 3 scard 12 1 1 sbus 71 SBUS 1 SLOT 1 SB12 1 1 1 18 Sun Enterprise 10000 System Service Manual March 2002 TABLE 1 14 I O Numbering Continued SBus PCI Front Panel Cable Front Panel Cable Component POST Solaris ID Label Label Solaris ID Label Label System Board 13 sysbd 13 SB13 SB13 SB13 SB13 I O Port 0 scard 13 0 0 sbus 74 SBUSOSLOTO SB13 0 0 pci 74 PCI 0 0 PCI13 0 0 I O Port 1 scard 13 0 1 sbus 74 SBUS 0 SLOT 1 SB13 0 1 I O Port 2 scard 13 1 0 sbus 75 SBUS 1 SLOT O0 SB13 1 0 pc
113. set up properly in the etc inet hosts file or in your local name service system Do you have a control board 1 y n y Please enter the host name of the control board 1 snax cb0 I could not automatically determine the IP address of snax cbl Please enter the IP address of snax cbl 129 153 49 182 You should make sure that this host IP address is set up properly in the etc inet hosts file or in your local name service system Please identify the primary control board Is Control Board 0 snax cb0 the primary y n n Is Control Board 1 snax cb1 the primary y n y Platform name snax Control Board 0 snax cb0 gt 129 153 49 181 Control Board 1 snax cb1 gt 129 153 49 182 Primary Control Board snax cbl Is this correct y n y Are you currently configuring the MAIN SSP y n y MAIN SSP configuration completed Sun Enterprise 10000 System Service Manual March 2002 6 If you have a spare SSP perform the following a Repeat Step 4 and Step 5 on the spare SSP Remember to answer n to the following question during ssp_config Are you currently configuring the MAIN SSP y n n b From the root window on the main SSP reboot the SSP ssp init 6 c From the root window on the spare SSP reboot the SSP ssp init 6 d After the main SSP reboots log in as user ssp and invoke hostview 1M Note Wait at least a minute after the SSP displays the console logi
114. ssociated circuit breaker m If a single system board is off suspect the associated circuit breaker SB8 SB10 SB11 SB12 SB13 SB14 SB15 CSB1 FT ET CB1 8 11 12 15 FT CSBO SBO SBI SB2 SB3 SB4 SBS SB6 SB7 4 7 0 3 CBO 2 6 2 A FIGURE 2 1 Circuit Breaker Labels Removing a Circuit Breaker 1 Open the access door 2 Remove the two M4 panhead Phillips screws securing the circuit breaker panel to the power shelf Retain the screws Caution When the system is powered on there is 48VDC available at the circuit breakers This does not create an electric shock hazard however there is considerable energy in these circuits Use caution to prevent any bare circuit breaker terminals or exposed wire terminals from coming in contact with the frame Chapter 2 Power and Cooling Component Replacement Procedures 2 9 3 Remove the circuit breaker panel by gently working it toward you Once loose pull it out with the cable assemblies attached 4 Power off the circuit breaker s to be removed 5 Remove the two M3 flat head Phillips screws that attach the circuit breaker to the panel Retain the screws 6 Loosen and remove the circuit breaker from the panel by gently pushing it back and through the panel Cut and remove the tie wraps as needed 7 Remove the circuit breaker s The wire attached to
115. strated Parts Breakdown A 7 FIGURE A 3 Board Assemblies MN AVA AS Centerplane L SM j All x le RSA g j jl fi System Board Sp Centerplane Support Board Control Board Description Part Number Centerplane assembly F501 4348 System board assembly F501 4903 Control board assembly F501 4345 Centerplane support board assembly F501 4346 Control board filler panel assembly F540 3064 System board filler panel assembly F540 3063 A 8 Sun Enterprise 10000 System Service Manual March 2002 FIGURE A 4 System Board and SBus Components System Board I O Module SBus Module Memory Module DIMMs Processor Module Description Part Number I O module assembly for SBus support F501 4478 Memory module assembly F501 4776 DIMM module 32 Mbyte F501 2653 DIMM module 128 Mbyte F501 2654 Processor modules 2530A SBus filler panel 340 1763 04 Appendix A Illustrated Parts Breakdown A 9 FIGURE A 5 PCI Components System board Personality plate PCI filler panel PCI front bracket PCI card PCI I O module i TT pas AI ax PCI front cover Top PCI riser card Bottom PCI riser card d Description Part Number PCI I O module F501 4830 5 0 volt riser card F501 4777 3 3 volt riser card F501 4778 PCI filler panel 240 2391 01 A 10 Sun Enterprise 10000 System Service Manual March 2002 FIGURE A 6
116. stricted air flow and possible equipment failure perform this procedure when the filters contain trapped particles or every three months Note Do not try to clean the air filters They deteriorate over time and are easily damaged Replace dirty air filters with new ones Note The air filters can be changed without powering off the Sun Enterprise 10000 system However the integrity of the I O cable connections is put at risk when the I O cables are moved to change the air filters This must be considered if the Sun Enterprise 10000 system is not powered off to change the air filters Open the front and rear cabinet doors to get access to the filters shown in FIGURE 2 5 Look at the underside of the filters with an inspection mirror and flashlight to determine if they are dirty Look at the surrounding area for evidence of excessive amounts of dirt and dust Large amounts of dirt and dust might indicate that the filters are loading up quickly and require more frequent inspections and changes Caution Large amounts of dirt and dust might indicate that the Sun Enterprise 10000 system must be powered off to change the filters Dust and dirt can be drawn into the Sun Enterprise 10000 system cabinet when the filters are removed and the cooling fans are running Remove the faceplate by removing four screws With one hand reach under the cabinet and slide the filter toward you Chapter 2 Power and Coolin
117. t Local Address Arbiter Arbitrates for the local address router Local Address Router Four bidirectional 3 1 multiplexors that connect the three local address buses to four coherency interface controllers Implemented inside the four coherency interface controllers on each board Sun Enterprise 10000 System Service Manual e March 2002 LBIST LDARB LDMUX LDR MC Memory bank Memory module NPB POST PC PCS Platform PUP RED_state Trap REDMODE SIR SMD SOC SSP System board Logic Built in Self test Local Data Arbiter Arbitrates for the local data router Local Data MUX One mode of the XMUX Local Data Router Two unidirectional 144 bit wide 4 1 multiplexers that connect the four UPA databuses on a system board with the global data router Implemented by four XMUX ASICs per system board Memory Controller chip Accepts memory addresses from the four coherency interface controllers and data from the data buffer XDB and performs reading and writing of 64 byte blocks of data into one to four banks of memory 512 data bits plus 64 ECC bits made up of eight DIMMs A daughter card containing 32 DIMMs Non Processor Board Power on self test Port Controller ASIC Interfaces UPA modules to the Sun Enterprise 10000 system The PC controls address flow between the UPA port and the four coherency interface controllers and controls data flow between the UPA port and the data buffer XDB POST Controll
118. t prot g par un copyright et licenci par des fournisseurs de Sun Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie UNIX est une marque d pos e aux Etats Unis et dans d autres pays et licenci e exclusivement par X Open Company Ltd Sun Sun Microsystems le logo Sun AnswerBook2 docs sun com et Solaris sont des marques de fabrique ou des marques d pos es ou marques de service de Sun Microsystems Inc aux Etats Unis et dans d autres pays Toutes les marques SPARC sont utilis es sous licence et sont des marques de fabrique ou des marques d pos es de SPARC International Inc aux Etats Unis et dans d autres pays Les produits portant les marques SPARC sont bas s sur une architecture d velopp e par Sun Microsystems Inc L interface d utilisation graphique OPEN LOOK et Sun a t d velopp e par Sun Microsystems Inc pour ses utilisateurs et licenci s Sun reconnait les efforts de pionniers de Xerox pour la recherche et le d veloppement du concept des interfaces d utilisation visuelle ou graphique pour l industrie de l informatique Sun d tient une licence non exclusive de Xerox sur l interface d utilisation graphique Xerox cette licence couvrant galement les licenci s de Sun qui mettent en place l interface d utilisation graphique OPEN LOOK et qui en outre se conforment aux licences crites de Sun LA DOCUMENTATION EST FOURNIE EN L ETAT
119. tatic bag 5 If the PCI card is not immediately replaced install a filler panel part number 240 2391 01 onto the PCI front bracket using the PCI retention screw FIGURE 4 8 PCI front bracket PCI retention screw PCI filler panel FIGURE 4 8 Installing a PCI Filler Panel 4 2 3 Installing a PCI Card If converting from SBus to PCI the personality plate and I O module must be removed and replaced prior to installing any PCI electrical components See Section 4 3 Personality Plate Replacement on page 4 17 and Section 4 1 3 Removing an SBus I O Module on page 4 4 1 Determine the slot for installing the PCI card FIGURE 4 9 4 10 Sun Enterprise 10000 System Service Manual e March 2002 PCI 0 0 PCI 1 0 FIGURE 4 9 PCI Slot Numbering If a filler panel covers the PCI slot remove the PCI retention screw on the top flange to remove the filler panel FIGURE 4 8 Retain the screw to attach the PCI card Attach a wrist strap and take the PCI card out of the protective packaging Inspect the connector to make sure it is not damaged Confirm that the installed riser card is the correct voltage for the PCI card to be installed PCI cards and risers cards are available in multiple voltages Inspect the keyed connector on the PCI card to confirm that it will properly mate with the riser connector If not obtain and install the correct riser
120. terplane support board also powers off one half of the centerplane Therefore be sure to either blacklist one half of the centerplane or have all of the domains down Power off a centerplane support board by using hostview 1M or by typing ssp power off csb x Where x 0 1 Refer to power 1M for more information Removing a Centerplane Support Board Open the access door Caution If the yellow LEDs are lit do not remove the component See Section 6 1 2 Powering Off a Centerplane Support Board on page 6 2 Attach a wrist strap and unlock the handle by pulling up on the locking lever that resides on the handle Use the handle to extract the centerplane support board and place on a flat sturdy ESD protected surface Installing a Centerplane Support Board Confirm that the event monitoring daemon is running by typing ssp edd_cmd x start Refer to edd 1M and edd_cmd 1M for additional information Attach a wrist strap and firmly grasp the centerplane support board by the handle and position it onto the control board carrier With the handle extended slide the board into the slot until it begins to mate with the centerplane connector 6 2 Sun Enterprise 10000 System Service Manual March 2002 6 1 5 6 1 6 Apply firm pressure to the faceplate to engage the board with the centerplane connector Push the insertion handle to fully seat the board Lo
121. th eight or less system boards are configured with fans power supplies AC input modules and with all boards on the same side back plus a centerplane support board AC input module power supply and two fans on the front The following rules apply when configuring components on the system board All processor modules in the system must be the same speed All processor modules on a system board must have the same cache size For increased processor performance avoid populating processors 0 and 1 together and processors 2 and 3 together For increased I O performance avoid populating SBus 00 and 01 together and SBus 10 and 11 together When configuring memory on a system board a All sockets within a bank must be fully populated a All DIMM sizes must be equal a For increased performance on partially populated memory boards do not use banks 0 and 2 together or banks 1 and 3 together It is necessary to run autoconfig 1M on the SSP when any system board or system board module processor memory I O is installed for the first time It is necessary to run autoconfig 1M on the SSP when any replacement system board or system board module processor memory I O with a different part number than the original is installed Chapter 1 Component Replacement Guidelines Indicators and Nomenclatures 1 3 1 2 Testing the System It might be necessary to run autoconfig 1M after the Sun Enterprise 10000 system is powered on and
122. the fan tray slot 4 Close the access door Chapter 2 Power and Cooling Component Replacement Procedures 2 19 2 8 5 2 8 6 2 8 7 Powering On a Fan Tray or a Group of Fan Trays Using SSP Version 3 0 Note SSP version 3 0 does not properly detect power when an SSP command restores power Therefore remove and reinsert the fan with power on Power on a fan tray by using hostview 1M or by typing a Fora single fan tray where x 0 15 ssp fan t x p on a Fora group of trays where x front ft8 15 rear ft0 7 ssp fan 1 x p on In future releases of the software power will be reinstated to a fan tray upon insertion Refer to fan 1M for more information Powering On the Fan Trays Using SSP Version 3 1 or Subsequent Compatible Version Power on all of the fan trays by using hostview 1M or by typing ssp fan p on Power will be reinstated to a fan tray upon insertion Refer to fan 1M for more information Verifying a Fan Tray Use the following checklist to confirm that a component is operational m Check that the LEDs are on m Check the fan status using hostview or execute a hostinfo F command 2 20 Sun Enterprise 10000 System Service Manual e March 2002 29 Replacing an Air Filter The Sun Enterprise 10000 system has four front and four rear air filters which provide approximately 150 CFMs per system board These air filters require periodic replacing To prevent re
123. the riser connector If not obtain the correct riser card Attach a wrist strap and insert the riser card into the mating connector on the PCI I O module Press firmly to seat completely into the connector If installing the bottom riser use the fastening hardware as shown in FIGURE 4 14 torque to a setting of 0 6 Nm 5 3 inch pounds Install any PCI cards according to Section 4 2 3 Installing a PCI Card on page 4 10 Completing a PCI Component Replacement Procedure Install the PCI front cover onto the front of the system board tightening to a torque setting of 0 8 Nm 7 1 inch pounds Replace the system board cover and secure with screws tightening to a torque setting of 0 8 Nm 7 1 inch pounds See Section 3 2 4 Installing a System Board on page 3 10 to confirm that the event monitoring daemon is running prior to installing the system board Run autoconfig 1M if you m Replace a PCI I O module with a PCI I O module that has a different Sun part number m Replace an SBus I O module with a PCI I O module m Install a PCI I O module in a previously unused slot 4 16 Sun Enterprise 10000 System Service Manual e March 2002 4 3 4 3 1 1 Personality Plate Replacement Personality plates are located behind the system board faceplate Therefore all of the following components must be removed for access to the personality plate PCI front covers if used PCI front b
124. tinfo F command m Check the var opt SUNWssp adm domain name messages file for fan error messages 2 8 2 Powering Off a Single Fan Tray or a Group of Fan Trays Note SSP version 3 0 does not properly detect power when an SSP command restores power Therefore remove and reinsert the fan with power on 2 18 Sun Enterprise 10000 System Service Manual e March 2002 Power off a fan tray by using hostview 1M or by typing Fora single fan tray where x 0 15 ssp fan t x p off a Fora group of trays where x front ft8 15 rear ft0 7 ssp fan 1 x p off Refer to fan 1M for more information Caution To maintain adequate system cooling limit the amount of time a fan is off to less than 10 minutes 2 8 3 Removing a Fan Tray AN Caution If the yellow LEDs are lit do not remove the component See e Section 2 8 2 Powering Off a Single Fan Tray or a Group of Fan Trays on page 2 18 1 Open the access door 2 Grasp the handle and pull the fan tray straight out Initially you will encounter higher resistance due to the retention mechanism this is normal 3 Set the fan tray aside 2 8 4 Installing a Fan Tray 1 Place the bottom surface of the fan tray onto the top of the support of the fan shelf angle bracket 2 Slide the fan tray in until initial engagement begins with the mating connector 3 Using firm steady pressure fully insert the fan tray into
125. to SBus the personality plate must be removed and replaced prior to installing any SBus electrical components See Section 4 3 Personality Plate Replacement on page 4 17 Attach a wrist strap Prior to installing the module wipe the gold pads of the system board and the exposed contacts of the compression connector with a lint free nonabrasive cloth or alcohol wipe Align the SBus I O module compression connectors to the system board compression connector locations Tighten the six captive connector screws clockwise with a 3 32 inch hex driver a Tighten the captive connector screws in the sequence shown in FIGURE 4 3 until they touch the metal plate b Tighten each captive connector screw in the sequence shown in FIGURE 4 3 an additional 1 2 turn c Tighten the captive connector screws to a final torque of 0 68 Nm 6 0 inch pounds in the pattern shown in FIGURE 4 3 Chapter 4 System Board I O Component Replacement Procedures 4 5 FIGURE 4 3 Tightening Pattern for the SBus I O Module Install discrete attachment hardware through the board and into the threaded standoff of the system board Later versions of the system board include discrete hardware with a captive washer If a separate washer is used see FIGURE 4 4 for proper orientation of cone washer FIGURE 4 4 Cone Washer and Standoff Tighten discrete attachment hardware to a
126. to installing the system board 4 22 Sun Enterprise 10000 System Service Manual e March 2002 CHAPTER D System Board Memory and CPU Module Replacement Procedures Note All commands performed through the Hostview GUI hostview 1M can also be performed by other SSP user commands such as the power 1M command or the fan 1M command 5 1 91 Memory Component Replacement Isolating a Failed DIMM Note An occasional correctable memory error that the Solaris operating environment calls Persistent or Intermittent on a DIMM is normal A DIMM only needs to be replaced if the number of these type of correctable errors experienced on the same DIMM is three or more in a 24 hour period and the SSP Recordstop corresponding to the Solaris operating environment error message indicates the DIMM is the source of the errors not another component Systems that experience uncorrectable errors or correctable errors called Sticky require immediate service but once again the SSP Arbstop Recordstop or POST log needs to be examined to ensure the DIMM is the source of the errors not another component 5 1 Use the following checklist to assist with fault isolation m In the suspect domain check var adm messages for DIMM error messages m Check the domain s console window for error messages m Review the POST messages either by running POST or if available access the POST log files in var opt SUNWssp adm domain_
127. traSPARC 36 0 54 proc 13 2 Proc Mod 3 SUNW UltraSPARC 37 0 55 proc 13 3 System Board 14 SB14 sysbd 14 Proc Mod 0 SUNW UltraSPARC 38 0 56 proc 14 0 Proc Mod 1 SUNW UltraSPARC 39 0 57 proc 14 1 Proc Mod 2 SUNW UltraSPARC 3a 0 58 proc 14 2 Proc Mod 3 SUNW UltraSPARC 3b 0 59 proc 14 3 System Board 15 SB15 sysbd 15 Proc Mod 0 SUNW UltraSPARC 3c 0 60 proc 15 0 Proc Mod 1 SUNW UltraSPARC 3d 0 61 proc 15 1 Proc Mod 2 SUNW UltraSPARC 3e 0 62 proc 15 2 Proc Mod 3 SUNW UltraSPARC 3f 0 63 proc 15 3 Sun Enterprise 10000 System Service Manual March 2002 TABLE 1 14 I O Numbering Component System Board 0 I O Port 0 I O Port 1 I O Port 2 I O Port 3 System Board 1 I O Port 0 I O Port 1 I O Port 2 I O Port 3 System Board 2 I O Port 0 I O Port 1 I O Port 2 I O Port 3 System Board 3 I O Port 0 I O Port 1 I O Port 2 I O Port 3 System Board 4 I O Port 0 I O Port 1 I O Port 2 I O Port 3 System Board 5 I O Port 0 I O Port 1 I O Port 2 I O Port 3 System Board 6 I O Port 0 I O Port 1 I O Port 2 I O Port 3 POST sysbd 0 scard 0 0 0 scard 0 0 1 scard 0 1 0 scard 0 1 1 sysbd 1 scard 1 0 0 scard 1 0 1 scard 1 1 0 scard 1 1 1 sysbd 2 scard 2 0 0 scard 2 0 1 scard 2 1 0 scard 2 1 1 sysbd 3 scard 3 0 0 scard 3 0 1 scard 3 1 0 scard 3 1 1 sysbd 4 scard 4 0 0 scard 4 0 1 scard 4 1 0 scard 4 1 1 sysbd 5 scard 5 0 0 scard 5 0 1 scard 5 1 0 scard 5 1 1 sysbd 6
128. ution Exercise caution to prevent the screwdriver from slipping and coming in contact with the centerplane 3 Holding the centerplane assembly by the handles angle the centerplane assembly to enable entry of the right side into the card cage 4 With the plastic guides resting on the bottom rails gently slide the centerplane assembly toward the center of the cabinet 5 As the centerplane assembly nears the center of the cabinet tilt the top of the centerplane assembly slightly away from you and firmly push forward causing the centerplane assembly to rise up on the plastic ramps and engage with the alignment pins Confirm that no cables are trapped between the centerplane and the cabinet 6 Partly install the 27 captive Phillips screws then fully secure the centerplane to the cabinet Alternate sides from top to bottom left to right as you tighten Torque to 3 76 Nm 33 3 inch pounds 7 Carefully remove the centerplane handles i Caution Failure to remove the centerplane handles may result in system board damage 8 Reinstall the carrier plate that holds the control board and centerplane support board Install the carrier plate in the correct position by carefully inserting the center guide rail alignment pin into the centerplane hole Install and tighten the six Phillips screws 7 8 Sun Enterprise 10000 System Service Manual March 2002 10 Reinstall all systems boards and if previously installed the
129. very system board as well as the centerplane configured in the system and creates a file thermcaldata tcl It is important to note any errors that the thermcal_config 1M command encounters when performing this operation The SSPVAR adm messages contains additional messages related to problems the thermcal_config 1M command encounters Use the following command in a separate window to monitor the messages file ssp tail f SSPVAR adm messages If the thermcal_config 1M command encounters problems while attempting to read thermal data you must repeat Step 2 until no errors occur Note If errors of this type persist especially for the same board it is likely that the board is not thermally calibrated In this case contact your service representative Type ssp edd cmd x start This restarts edd event monitoring Sun Enterprise 10000 System Service Manual March 2002 952 SE Configuring a Control Board Using SSP Version 3 0 The following outlines the current procedure for switching from a primary usually control board 0 to a secondary control board Use this procedure for the SSP 3 0 release of software Caution Failure to follow these steps can result in crashed domains arbitration stops arbstops Caution Do not edit the var opt SUNWssp ssp_private cb_config file manually Instead use the ssp_config 1M command described below Shut down all
130. z processor module the clock multiplier must change from 3 2 to 2 1 To do this all domains must be down and the new processors installed onto the system board 1 Change the multiplier value by typing ssp sys_clock p two to one s This updates the ssp_resource file Caution Do not run the sys_clock command with any of its command line options on a running system 2 Check the multiplier value by typing ssp sys_clock Chapter 9 Software Procedures 9 13 9 14 Sun Enterprise 10000 System Service Manual e March 2002 APPENDIX A Illustrated Parts Breakdown The illustrations and tables in this appendix supplement the removal and replacement procedures described in previous chapters Part numbers in this section might differ from those found in your system Before ordering replacement parts find the label on the part to be replaced and place your order using that number Be sure you select the right part number for the entire assembly instead of the individual components Note For information about additional capacity drives and other replacement options contact your sales representative A 1 A List of Components a D 3 cdd A WS d HR Ha S Kl ri 7 J in

Download Pdf Manuals

Related Search

Related Contents

Samsung Galaxy S Duos 2 Εγχειρίδιο χρήσης  Front Suspension - Bike  IMCM G2 Brochure - International Mailing Equipment    C-TRAC3 - Engineered Air  Eizo FlexScan HD2442W User's Manual  Sony A3802LENSBDL How to Use    ICC IC1078L6GY wire connector  Optimierung des Fortpflanzungsverhaltens: Wichtige Einflußgrößen  

Copyright © All rights reserved. Failed to retrieve file