Home

Sun Blade X6240 Server Module Service Manual

1. de de dede e eee eee eee ee PPP PSS PPS ehe e ehe e ehe ehe ehe ehe e hohe eee e eee e e ee e e e e e e e e e n n n n n n G Sun Blade X6240 Server Module Service Manual January 2010 2 3 7 4 BIOS Boot Menu Hard Disk Drives Screen EEE de eee rr Hard Disk Drives Specifies the boot deo dede eoe eee e eoe eee eee eee eee eee e eee e e e e n d e n d B Bn B 9 B B 9 B4 9 B n n 9 B 04 B8 R sequence from the available devices 2nd Drive SCSI 0500 IDO1 LU Select Screen Select Item Change Option F1 General Help F10 Save and Exit ESC Exit CRW ekk kk kk kk kk kk kk kk kk kk kk eed e dede oe de n n dn n n n n n G 2 3 8 BIOS Security Settings Menu Main Ad d PCIPr jaot Securit de de de de ehe he e ehe hee eoe e ehe e ehe e e hehe e e eoe e ehe oe e he e e hee e he e e he e e hehe e e hohe ee he e e he e eh e e e e e d n n n n n Bn n A Security Settings Install or Change the de odeode ehe e eee e eee eee ee eoe e e hee e ehe oe e hee e e e e e e e e Ok password S isor Not ass t Change User Password Boot Sector Virus Protection Disabled 4 a Select Screen is vu Select Item Enter Change a Lg General Help E a Save and Exit ESC Exit S e e e e e eee hehehe heh
2. Diagnostic Partition on page 3 17 Show Results Summary Section 3 6 6 Show Results Summary on page 3 17 Print Results Report Section 3 6 7 Print Results Report on page 3 18 About PC CHECK Section 3 6 8 About Pc Check on page 3 19 Exit Section 3 6 9 Exit on page 3 19 Use the arrow keys on the keyboard to navigate through the diagnostics software the Enter key to select a menu item and the ESC key to exit a menu Navigation instructions appear at the bottom of each screen To test a specific hardware component select Advanced Diagnostics Test See Section 3 6 2 Advanced Diagnostics on page 3 11 for details Chapter 3 Diagnostics Tools 3 9 To run a test script select Immediate Burn In Testing Sun provides three scripts that include a full test of all possible devices full tst a quick test of devices quick tst and a test that requires no user interaction noinput tst See Section 3 6 4 1 Performing Immediate Burn In Testing on page 3 15 for details To create your own test script select Deferred Burn In Testing See Section 3 6 4 2 Performing Deferred Burn In Testing on page 3 16 for details 3 6 3 6 1 3 10 Pc Check Menus The following sections in this chapter describe the menu items and tests in detail System Information Menu Clicking System Information in the Diagnostics main menu causes the System Information menu to appear Select items in this menu to see detailed infor
3. Selects Smart Monitoring Analysis Reporting Test SMART HPA Protection Selects Host Protected Area HPA protection Media Test Settings Selects the test time duration the percentage of the hard disk to test and the sectors to be tested on the hard disk Device Test Settings Selects the test time durations of the devices and the test level Select a test to begin execution The Read Test Read Verify Test the Non Destructive Write Test and the Destructive Write Test test the actual media on the physical disk drive The Mechanics Stress Test and the Internal Cache Test test non media related parts of the hard drive hardware Caution Running the Destructive Write Test destroys any data on the disk 3 6 4 Burn In Testing Burn In testing enables you to run test scripts and to create new scripts The Diagnostics main menu provides two burn in selections Immediate Burn In Testing and Deferred Burn In Testing Immediate Burn In enables you to run an existing script and to select configuration options Deferred Burn In enables you to create a new script 3 14 Sun Blade X6240 Server Module Service Manual January 2010 3 6 4 1 Sun provides three ready made scripts designed to test the general health of the devices on your system These scripts include m quick tst This script performs a series of tests that require you to interact with the test software When the tests require a user interaction the tests
4. TABLE C 4 SAS Power LED Connector Pins Pin Number Signal Name DISK1 FAULT LED L DISK1 RDY2RM L DISK1 PRSNT L 12V GND DISK0 FAULT LED L DISKO RDY2RM L DISKO PRSNT L GND 5V o 00 d Oh D FF WO Ne nA ce C 6 Sun Blade X6240 Server Module Service Manual January 2010 C 5 Compact Flash The Compact Flash connector pins and their corresponding descriptions are shown in the figure and table in this section 25 20 15 10 5 D 50 45 40 35 30 26 FIGURE CS Compact Flash Connector TABLEC 5 Compact Flash Connector Pins Signal Name Pin Pin GND 1 26 D03 2 27 D04 3 28 D05 4 29 D06 5 30 D07 6 31 CS1_L 7 32 GND 8 33 ATA_SEL 9 34 GND 10 35 GND 11 36 GND 12 37 3 3V 13 38 GND 14 39 GND 15 40 GND 16 41 GND 17 42 Signal Name PRSNT_N D11 D12 D13 D14 D15 CS3 L No Connect IOR L IOW L WE INT L 3 3V IDE_CSEL No Connect IDE_RESET_L IDE_RDY Appendix C Connector Pinouts C 7 TABLE C 5 Compact Flash Connector Pins Continued Signal Name Pin Pin Signal Name ADDR2 18 43 DROL ADDR1 19 44 DACK L ADDRO 20 45 No Connect D00 21 46 No Connect D01 22 47 D08 D02 23 48 D09 No Connect 24 47 D10 IDE CD2 15 50 GND C 8 Sun Blade X6240 Server Module Service Manual e January 2010 Index A accessory kit contents 1 6 Advanced Configurable Power Interface ACPI testing 3 13 Advanced Menu BIOS screen 2 8 ATA diagnosing 3 12 ATAPI devices diagnosing 3 12 di
5. le logo Sun Java Solaris Sun Blade docs sun com Sun Fire et le logo Solaris sont des marques de fabrique ou des marques d pos es de Sun Microsystems Inc aux Etats Unis et dans d autres pays Microsoft sont est marques de fabrique ou des marques d pos es de Microsoft Corporation ou de sa filiale aux Etats Unis et dans d autres pays Windows est une marque de fabrique ou une margues d pos e de Microsoft Corporation ou de sa filiale aux Etats Unis et dans d autres pays Le logo Adobe est une marque d pos e de Adobe Systems Incorporated L utilisation de pieces detachees ou d unites centrales de remplacement est limitee aux reparations ou a l echange standard d unites centrales pour les produits exportes conformement a la legislation americaine en matiere d exportation Sauf autorisation par les autorites des Etats Unis l utilisation d unites centrales pour proceder a des mises a jour de produits est rigoureusement interdite LA DOCUMENTATION EST FOURNIE EN L ETAT ET TOUTES AUTRES CONDITIONS DECLARATIONS ET GARANTIES EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE ALA QUALITE MARCHANDE A L APTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFACON SC BA Adobe PostScript Contents Preface ix Introduction to the Sun Blade X6240 Server Module 1 1 1 1 Features of the Server Module 1 1 12 Gun Blade X6240 Server Mo
6. 2 27 J16 2 28 J19 2 29 J21 2 30 Password Clear 2 29 Recover SP 2 30 Sun Blade X6240 Server Module Service Manual January 2010 K keyboard testing 3 12 L LEDs CPU fault 3 5 DIMM fault 3 5 external 3 2 front panel definitions 3 3 Hard Disk Drive Status 3 3 internal 3 4 Locate 3 3 Power OK 3 3 Service Action Required 3 3 limitations of Option ROM size 2 8 Locate LED and button 3 3 M main cover removal 4 4 Main Menu BIOS screen 2 8 memory diagnosing 3 12 tests against 3 18 memory See DIMMs menu tree BIOS setup screens 2 9 motherboard components testing 3 8 diagnosing 3 12 replacement 4 31 4 32 tests against 3 18 mouse testing 3 12 tests against 3 18 N network testing 3 12 noinput tst script 3 15 O Option ROM size 2 8 options available 1 6 P passwords resetting 2 29 Pc Check utility 3 8 viewing information on 3 19 PCI ExpressModule slot BIOS priority 2 6 PCIPnP Menu BIOS screen 2 8 physical specifications A 1 pinouts See connector pinouts POST code checkpoints B 1 redirecting console output 3 6 Power OK LED 3 3 powering off the server 2 4 powering on the server 2 2 processor diagnosing 3 12 tests against 3 17 product updates ix Q quick tst script 3 15 R RAID Expansion Module REM battery replacement 4 21 board replacement 4 17 Recover SP jumper 2 30 redirecting console output 2 5 3 6 related documentation x replaceable
7. 2 3 5 9 BIOS Advanced Menu MPS Configuration Screen ee o ede eee hehe e dee ehe hee hee he e hee he e e ehe e he e he e ee ehe e he e e e e e he e e ee ehe e e e e e e e he he e e e e e e e e e e e e n e e fn KKK MPS Configuration Select MPS a odd d d e d de ee de e de d d e d e d d d RAR RRA KEE Devision Select Screen E Select Item E Change Option SERGE General Help Z F10 Save and Exit ESC Exit He de e e e e ee HH he kk kk hehe e e e e ee e e hee e e he e ehe he e e he he e e e hee e e ee ee ee e he e e e e e e e e e e e he e e e he e e e e e n n Chapter 2 Powering On and Configuring BIOS Settings 2 15 2 3 5 10 BIOS Advanced Menu PCI Express Configuration Screen E Dese Kk kk Ak kk KK kk hee ehe he eee he kk kk eoe ee e e he e ehe eoe e he kk hee ee e e e e e e e e e kk e e n n e kk PCI Express Configuration Enable Disable do hehe e e e e e e e he e e he e e e e e e e e d e e d d d RHR EE PCI Express Los and L1 link power states Select Screen we Select Item Change Option F1 General Help F10 Save and Exit ESC Exit e e e e e e ee e e KK ee e hee e e e hee e he hee e e he e e e he e e e e e e e e ee e he ee ee ee e e hee e e he e e e e e e he e e e e fe f e e e EEE 2 2 11 BIOS Advanced Menu Remote Access Configuration Screen
8. 2 9 5 13 BIOS Advanced Menu USB Configuration Screen E e e de dede eee KKK kk kk kk kk kk kk kk kk kk kk kk ee he e he e he he he he he he e e he e e hh e hee e e he de he e de e e e e e e e e n e n Bn B AG USB Configuration Enables support for F1 General Help F10 Save and Exit ESC Exit JUG e kk kk kk eoe e ee e ehe ee e e hoe e hoe e e e e e e e e e e n n n Bn Bn n n Bn BG G E ME legacy USB AUIC Module Version 2 24 3 13 4 option disables legacy support if no USB USB Devices Enabled devices are connected 1 ey ard 1 Mouse 1 Hub USB 2 0 Controller Mode HiSpeed io BIOS EHCI Hand Off Enabled il Tic Select Screen igi l Select Item o Change Option e e e e e e e e ee e eee ee e eee eoe e e e e e e e e e e e e e e e e e e e e e e e e e IK he he he he e he e e e e he e e e he e e e he e e e e e e n A Chapter 2 Powering On and Configuring BIOS Settings 2 17 2 3 6 BIOS PCIPnP Menu Screen Clear NVRAM 2 18 Sun Blade X6240 Server Module Service Manual e January 2010 2 3 7 BIOS Boot Menu Screens 2 3 7 1 BIOS Boot Menu Main Screen Boot Settings Configuration Chapter 2 Powering On and Configuring BIOS Settings 2 19 2 3 7 2 2 3 7 3 2 20 BIOS Boot Menu Boot Settings Configuration Screen ee a ee Kk kk Ak kk de eee hee e he he KR KK eoe e eee he eoe ee eoe he e e he hoe e e e e e e e
9. 6048 Modular Systems The Sun Blade X6240 server module supports two AMD Opteron quad core Rev F processors and embedded I O that provides PCI Express SAS and Gigabit Ethernet interfaces to the Sun Blade 6000 6048 chassis midplane and up to four SAS or SATA drive interfaces at the front of the server module A RAID expansion module REM provides up to four additional SAS or SATA drive interfaces via the chassis midplane for external hard disk drives HDDs Server monitoring is performed by an onboard AST2000 service processor SP module TABLE 1 1 summarizes the features of the server module TABLE 1 1 Sun Blade X6240 Features Feature or Component Specifications CPU Up to two AMD Opteron 2000 Series quad core processors 1 Mbyte L2 cache per core Processor frequencies 2 1 GHz and faster Memory Up to eight registered ECC DDR2 DIMMs per CPU up to 64 Gbyte capacity using 4 Gbyte Hard disk drives HDDs Service processor RAID options Midplane I O Front panel I O Compact Flash IP Security DIMMs Up to eight four internal and four external with RAID Expansion Module Serial Attached SCSI SAS or SATA HDDs 2 5 inch or 63 5 mm Aspeed AST2000 processor providing Baseboard Management Controller BMC functions One 10 100 Mbit management Ethernet port to midplane Remote keyboard video mouse KVMS over IP Integrated Light Out Manager ILOM management interface Four channel SAS RAID disk contro
10. A An A X Memory Configuration Enable Bank Memory x A E ME Interleaving Channel Interleaving XCR of Address bit Enable Clock to All DIMMs Disabled MemClk Tristate C3 ATIVID Disabled Memory Hole Remapping Enabled n CS Sparing Enable Disabled DCT Unganged Mode Disabled Power Down Enable Enabled 2 Power Down Mode Channel a ra Select Screen ede Select Item z 4 Change Option F1 General Help x T EID Save and Exit z a ESC Exit e e e de e e e hehe e ehe e eee e eoe e eoe e ehe e ehe e e hee e ehe ehe ee eoe e eoe e ehe e e hee e he e e he e e e ee e e e e e e e e d n n n n Bn n Chapter 2 Powering On and Configuring BIOS Settings 2 23 2 3 9 4 BIOS Chipset Menu NorthBridge ECC Configuration Screen Basic 2 24 Sun Blade X6240 Server Module Service Manual e January 2010 2 3 9 5 BIOS Chipset Menu NorthBridge DRAM Timing Configuration Screen a E E de dede dede eee eee eee he eoe eee eee eee e eee eee eee ee eee ee eee eee eoe ee e e e e d d n d n n B n n B n B B8 Bn GM 9B8 amp DRAM Timing Configuration E deo ode eoe eee e ee e eee eee ee e e hee eoe e oe e e e e e e e d e n d n n n n n n n G E ME Auto DRAM Timing Mode Auto Limit i Manual ed Select Screen ok Select Item i Change Option ze General Help E e E FI S
11. BIOS Settings This section describes how to view and modify the BIOS settings The Basic Input Output System BIOS has a Setup utility stored in the BIOS flash memory The setup utility reports system information and can be used to configure the BIOS settings The configured data is provided with context sensitive help and is stored in the system s battery backed CMOS RAM If the configuration stored in the CMOS RAM is invalid the BIOS settings default to optimal values specified in the BIOS The BIOS Setup Utility contains seven menu screens which are displayed in this order Main Advanced PCI PnP Boot Security Chipset and Exit Use the left and right arrow keys to move sequentially back and forth through the seven screens Fields that can be reconfigured are displayed in color All other fields are nonconfigurable Use the up and down arrows on the keyboard to scroll through a screen s menu Use the Tab key to move back and forth across columns Changing the Configuration of a BIOS Menu Item You can change the BIOS configuration using several different interfaces m Use a USB keyboard and mouse and a VGA monitor connected directly to the server dongle m Use the remote video console of the ILOM service processor and redirect the server s console output Refer to the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1188 for more information m Use a terminal or terminal emulator connected to a computer through the
12. Enabled SATA Controller 1 Enabled v be Select Screen z SE Select Item Enter Go to Sub Screen EL General Help a F10 Save and Exit e ESC Exit e e e e e e e eee e HH e ehe oe e hee eoe e ehe e hee e e hee e hee e ehe e e hehe e he eee e e ehe oe e he e e he e e he e e e e EEN 2 12 Sun Blade X6240 Server Module Service Manual e January 2010 2 3 5 4 BIOS Advanced Menu ACPI Configuration Screen LUE A nnd kk kA kk ee eoe he hee ehe he eee he e eoe e e eoe e oe oe e ee e he ee e he he eoe e heo e e e e e e he d e e e e e e e e e e e n e KKK ACPI Settings YES NC de hee e e e e e e e e e e he REHEARSE ACPI support for Operating System Advanced ACEI Configuration YES If OS supports ACPI NO If CS does not support ACPI Select Screen we Select Item Change Option F1 General Help F10 Save and Exit ESC Exit e e e e e e ehe e e HK e e he ee e e e hee e he he e e e he e ee he e e e e e e e e ee e he e ehe he ee e e hee e he e e e e e e e he e e e e f e EEEE E 2 3 5 5 BIOS Advanced Menu Event Logging Details Screen SS o Wee de he de de de hehe e eoe te he ehe e ehe hee e ehe ee ehe e e hehe e eee e e he e e e he hee e he he ehe e ehe he e ee he e e he e e e he e e he e e e e e d n n n Event Logging details View all unread events Th E ORCI ORIGO ROIG ROIG I KG eR Re e on the Event Lo
13. FEM board See Section 4 3 7 Adding or Replacing a Fabric Expansion Module on page 4 23 Note The server module enclosure the motherboard and hard drive backplanes are all part of the motherboard FRU Installation is the reverse of this procedure 4 4 4 32 Servicetool FRU Update Procedure Caution The SunService account is for the use of Sun service representatives only Do not use the SunService account unless you are instructed to do so in a procedure developed by Sun Microsystems Follow these steps to update the Servicetool FRU 1 Use the ssh command to log in to the SunService account The default password is changeme ssh SP IP address 1 sunservice 4 SP IP Address password changeme Sun Blade X6240 Server Module Service Manual January 2010 2 At the prompt enter the servicetool command with options The options are defined in the following table servicetool fru update serviceprocessor lt OtherOptions gt lt value gt Other Options Value fru product part number Write a new part number to the FRU fru product serial number Write a new serial number to the FRU fru asset tag Write a new asset tag to the FRU 3 Watch the output from the command and respond to the confirmation prompts for continuing the update and rebooting the server Servicetool is going to collect system information for the service processor for future part swaps The following precondit
14. If the REM board uses a backup battery connect the jumper cable between the REM board and chassis motherboard Note For information about the implementation and configuration of RAID on this server see the Sun StorageTek RAID Manager Software User s Guide 820 1177 and the Uniform Command Line Interface User s Guide 820 2145 4 18 Sun Blade X6240 Server Module Service Manual January 2010 FIGURE 4 12 Inserting the REM Note If you are replacing an existing REM you are done If you are adding a REM to a system without a REM continue Caution The following steps will remove all data from the system Back up your data to an external site before proceeding 7 Remove the hard drives See Section 4 3 1 Replacing a Hard Disk Drive on page 4 7 Chapter 4 Maintaining the Sun Blade X6240 Servers 4 19 8 To change the disk controller type from SATA to SAS move the disk drive control cables on the motherboard The server has two HDD backplanes positioned behind HDD 0 and 1 and behind HDD 2 and 3 respectively Each backplane connector has two cables that connect to the motherboard The connectors on the HDD backplane are labeled HDD 1 3 and HDD 0 2 Move the cables on the motherboard as follows HDD Backplane HDD Bay Connectors Motherboard Connectors HDD 0 and 1 HDD 0 2 Move from SATAO to SASO HDD 1 3 Move from SATA1 to SAS1 HDD 2 and 3 HDD 0 2 Move from SATA2 to SAS2 HDD 1 3 Move from SATA3
15. LEE WEE e de eee eee hee eee hehe eoe hee PPS PS PPS PP eee PSPS SPS PSE PS PPS PS EPPS hee PPS PSS he e e he e PT n x An G Configure Remote Access type and parameters Select Serial Port id KKK eoe he ee hee eoe hee eee hee hoe eoe hee e he oe d n n d n d n n n n KKK Ok type Remote Access Enabled z x Serial Port Mode 9600 8 n 1 Flow Control None Redirection After BIOS POST Always Terminal Type ANSI VI UIE8 Combo Kay Support Enabled Sredir Memory Display Delay No Delay 2e Select Screen e e se Select Item Change Option F1 General Help F10 Save and Exit x ESC Exit kk eode dee eoe eee eee eee krk 2 16 Sun Blade X6240 Server Module Service Manual e January 2010 2 9 5 12 BIOS Advanced Menu Trusted Computing Screen E o eee e he e de e e e hehe e ehe KK e eoe e eee e hee e hee e hee hee eee eee eoe e ehe e eh e e he e e e e e e doe e d e n n f n n n n n E Trusted Ccmputing Enable Disable x KRR RAKKAR IR RIT RR RR RK Hk kk a aR E a RR RK RRR TPM TCG TPM 1 1 1 2 support in BIOS Execute TPM Ccmmand Don t change Clearing the TPM Press Enter E T E le D le Status Enabled S a MN Select Screen S Select Item z Change Option RER General Help 2 F10 Save and Exit fe ESC Exit KEE EE
16. Menu Screen 2 18 BIOS Boot Menu Screens 2 19 2 37 1 2 3 7 2 2 3 7 3 2 3 7 4 BIOS Boot Menu Main Screen 2 19 BIOS Boot Menu Boot Settings Configuration Screen 2 20 BIOS Boot Menu Boot Device Priority Screen 2 20 BIOS Boot Menu Hard Disk Drives Screen 2 21 BIOS Security Settings Menu 2 21 BIOS Chipset Menu Screens 2 22 2 3 9 1 2 3 92 BIOS Chipset Menu Main Screen 2 22 BIOS Chipset Menu NorthBridge Configuration Screen 2 23 iv Sun Blade X6240 Server Module Service Manual January 2010 2 4 2 5 2 6 2 3 9 8 BIOS Chipset Menu NorthBridge Memory Configuration Screen 2 23 2 3 9 4 BIOS Chipset Menu NorthBridge ECC Configuration Screen 2 24 2 3 9 5 BIOS Chipset Menu NorthBridge DRAM Timing Configuration Screen 2 25 2 3 9 6 BIOS Chipset Menu SouthBridge Configuration Screen 2 25 2 3 10 BIOS Exit Option Menu Screen 2 26 Modifying Settings Using Jumpers 2 27 2 4 1 Using the Clear CMOS Jumper J16 2 28 2 4 2 Resetting SP Password Using Jumper J19 2 29 2 4 3 Recovering the SP Using Jumper J21 2 30 Updating the BIOS 2 31 Power On Self Test POST 2 32 Diagnostics Tools 3 1 3 1 3 2 3 3 3 4 3 5 Service Processor ILOM 3 1 System Status LEDs 3 2 3 2 1 External Status Indicator LEDs 3 2 3 2 2 Internal Status Indicator LEDs 3 4 BIOS POST 3 5 3 3 1 How BIOS POST Memory Testing Works 3 5 3 3 2 Redirecting Console Output 3 6 Hardware Debug Tool HDT 3 7 3 4 1 HDT Functionality 3 7 3 4 2 Acce
17. and disconnect the dongle from the server FIGURE4 1 Removing a Server Module 3 Remove the server module from the chassis See FIGURE 4 1 a Press together and hold the green ejector buttons b Open the ejector levers by rotating them out from the server module c Pull the server module out from the chassis by the ejector levers until you are able to grasp the module with both hands to pull it out of the chassis 4 Set the server module on an antistatic surface Chapter 4 Maintaining the Sun Blade X6240 Servers 4 3 5 Install a filler panel into the server module slot if the server module will be out of the chassis for more than one minute Caution Before handling internal components of the server module attach an electrostatic discharge ESD wrist strap to the grounding post that is built into the rear of the chassis The system s printed circuit boards and hard disk drives contain components that are extremely sensitive to static electricity 4 2 2 Removing the Main Cover 1 Press down on the cover release button and using the indent for leverage slide the main cover toward the rear of the chassis approximately 0 5 inch 12 mm See FIGURE 4 2 2 Grasp the cover by its rear edge and lift it straight up from the chassis FIGURE 4 2 Removing the Main Cover 4 4 Sun Blade X6240 Server Module Service Manual January 2010 FIGURE 4 3 Sun Blade X6240 Server Module Replaceable Component Locations Midplan
18. components list 1 6 replacement procedures battery 4 10 CPU 4 25 DIMMs Fabric Expansion Module FEM board replacement 4 23 hard disk drive 4 7 heatsink 4 25 motherboard 4 31 4 32 RAID Expansion Module REM battery replacement 4 21 RAID Expansion Module REM board replacement 4 17 resetting passwords 2 29 Index 3 S tests 3 18 safety guidelines ix SAS connector pinouts C 3 SAS diskplane connector pinouts C 5 SAS power and LED connector pinouts C 6 scripts for testing components 3 15 Security Menu BIOS screen 2 8 server features list 1 1 Service Action Required LED 3 3 service processor SP ILOM 3 1 password reset 2 29 shutting down the server 2 4 special considerations BIOS 2 6 specifications system A 1 summary of features 1 1 system hang using CMOS jumper to clear 2 28 system specifications A 1 T testing ATAPI devices 3 18 burn in 3 10 cache 3 14 hard drive 3 18 memory 3 18 motherboard 3 18 motherboard components 3 8 mouse 3 18 processor 3 17 USB 3 18 video 3 18 thermal grease application 4 30 tools required 4 1 typographic conventions xii U USB devices diagnosing 3 12 tests against 3 18 V video devices testing 3 13 memory tests 3 18 Index 4 Sun Blade X6240 Server Module Service Manual January 2010
19. data to an external site before adding a REM to a server that does not already have a REM installed Adding or Removing and Replacing a REM Note This component is a CRU and can be replaced by anyone Use the following procedure to add or remove and replace the REM Chapter 4 Maintaining the Sun Blade X6240 Servers 4 17 1 Power off the server and remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Caution Do not operate the system with empty slots Always insert a filler panel into an empty slot to reduce the possibility of system shutdown 2 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 3 If the REM board uses a backup battery see also Section 4 3 6 Changing the REM Battery on page 4 21 disconnect the jumper cable between the REM board and chassis motherboard The Sun Blade X6240 can be populated either with REM board model 4620A which uses a backup battery to store the system configuration or REM board model 4607A which does not use a backup battery 4 Remove the existing REM board or the cap s from the REM connector s if either is present The cap s should only be present if you are adding a REM board to a server module without one 5 Slide the REM board at an angle into the support bracket then press it carefully into the connector See FIGURE 4 12 6
20. empty slot to reduce the possibility of system shut down The Sun Blade X6240 server module HDDs are hot swappable so you can remove an HDD either when the server module is installed in the chassis or when it is out of the chassis See FIGURE 4 5 and FIGURE 4 6 FIGURE 4 5 Removing the Hard Disk Drive After Removing the Server Module 4 8 Sun Blade X6240 Server Module Service Manual January 2010 FIGURE 4 6 Removing the Hard Disk Drive Without Removing the Server Module Note When you return the HDDs in their bays you must return each HDD to the same bay from which it was removed Use an adhesive note or another method to temporarily label the HDDs when you remove them 3 Press the button on the face of the HDD to release the spring loaded securing latch See FIGURE 4 5 and FIGURE 4 6 4 Grasp the securing latch and remove the HDD from the drive bay Installation is the reverse of this procedure Note If the HDDs were previously configured as a mirrored RAID 1 array an automatic resynchronization is invoked and the contents are automatically rebuilt from the rest of the array with no need to reconfigure the RAID parameters If the bad HDD was configured as a hotspare the new HDD is automatically configured as a new hotspare Chapter 4 Maintaining the Sun Blade X6240 Servers 4 9 4 3 2 4 10 When you install an HDD open its
21. he d e e e e KKK e n f e e n n e n KKK Boot Settings Configuration Allows BIOS to skip de oe e ee e ee e e he he he e eee e e e e e e he e e e e e e e e e d d d d OK certain tests while booting This will Quiet Boot Disabled decrease the time Language English needed to boot the Bootup Num Lock 0n system Wait For F1 If Error Enabled Interrupt 19 Capture Enabled Select Screen R 2 ww Select Item ke Change Option gh General Help F10 Save and Exit ESC Exit he eee ee eee ee hehehe he he e e e e ee e e e hehe he he he ee e e e e ee e EE BIOS Boot Menu Boot Device Priority Screen E IN IENISUUSEUN e de e e e e eee eee eee e eee e hee ehe ee hee e hee e hee e hee e he e hehe e ehe e ehe e eee eee e e ee e eoe KR KKK Boot Device Priority Specifies the boot dede ode eee hee eee e eoe eoe e ehe e ehe e ehe e ehe e he e e e d n n n n n n n n n 8 8 98 980 Ok sequence from the available devices 2nd Boot Device Network IBA GE Slo 3rd Boot Device Network IBA GE Slo A device enclosed in 4th Boot Device Network IBA GE Slo parenthesis has been Sth Boot Device Network IBA GE Slo disabled in the corresponding type menu Select Screen Select Item Change Option F1 General Help F10 Save and Exit ESC Exit LSW
22. message such as memory errors or hard disk errors on your srver you will run one of the following selections from the Pc Check Diagnostics main menu Sun Blade X6240 Server Module Service Manual January 2010 3 5 1 Use Immediate Burn In Test to run a test script Sun provides three diagnostic scripts designed to test a full range of system resources Use Advanced Diagnostics Test to test a specific hardware component for example a CPU or a hard disk Other selections on the Diagnostics main menu display information about the system create disk partitions and display test results Accessing Pc Check Diagnostics 1 Shut down the server For instructions see Section 2 2 Powering Off the Server on page 2 4 Start the ILOM and access the web GUI See the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1158 for details Select Remote Control gt Diagnostics gt Run Diagnostics on Boot From the drop down menu select Boot to Manual Power cycle the platform The system boots to the Pc Check main menu which offers the following selections System Information Menu Section 3 6 1 System Information Menu on page 3 10 Advanced Diagnostics Tests Section 3 6 2 Advanced Diagnostics on page 3 11 Immediate Burn In Testing Section 3 6 4 Burn In Testing on page 3 14 Deferred Burn In Testing Section 3 6 4 Burn In Testing on page 3 14 Create Diagnostic Partition Section 3 6 5
23. password Refer to the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1188 Change the default password to a password of your choice Repeat Steps 1 through 7 to remove the J19 jumper Remove the jumper in Step 4 rather than inserting it Note If you do not remove this jumper the ILOM SP password will be reset every time you power cycle the server 2 4 3 Recovering the SP Using Jumper J21 You may need to recover the service processor SP if it hangs due to an incomplete flash Use this jumper to hold the SP in reset The procedures in this section require you to use The Sun Blade X6240 Server Module Tools amp Drivers DVD which is available in the Sun Blade X6240 Server Module Accessory Kit See Section 1 3 Accessory Kits on page 1 6 A bootable USB flash drive A dongle cable with USB connectors Load the Tools amp Drivers DVD into a DVD ROM drive Navigate to the SPrecovery directory and copy the following files to a bootable USB flash drive a Socflash exe a spnnnnn bin where nnnnn represents the firmware version m dos4gw exe Shut down the server to standby power mode Use a stylus or other pointed object to press and release the recessed Power button on the server module front panel See Section 2 2 Powering Off the Server on page 2 4 post that is built into the rear of the chassis The system s printed circuit boards and D Caution Before handling componen
24. pins See FIGURE 2 5 for the header pin location Wait 10 seconds and then remove the shorting jumper This jumper removes battery power from the SouthBridge chipset where the CMOS settings are stored thereby removing the CMOS settings Reinstall the main cover to the server Reinstall the server module into the server See Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 The server powers up to standby power mode indicated when the blue Read to Remove LED on the server module front panel is illuminated Return the server to main power mode Use a stylus or other pointed object to press and release the recessed Power button on the server module front panel Sun Blade X6240 Server Module Service Manual January 2010 244 7 Resetting SP Password Using Jumper J19 This procedure describes how to reset the Administrator password the root password for the ILOM service processor SP back to the default after it has been set once during initial setup 1 Shut down the server to standby power mode Use a stylus or other pointed object to press and release the recessed Power button on the server module front panel See Section 2 2 Powering Off the Server on page 2 4 Caution Before handling components attach an ESD wrist strap to the grounding post that is built into the rear of the chassis The system s printed circuit boards and hard disk drives contain components that are
25. serial port on the server dongle 1 To change the system parameters enter the BIOS Setup Utility by pressing the F2 key while the system is performing the power on self test POST POST testing is indicated when the Power LED on the server module front panel goes into slow blink mode 2 Highlight the field to be modified using the arrow and Tab keys 3 Press Enter to select the field A dialog box appears The box presents you with the options available for the setup field that you have chosen 4 Modify the setup field and close the screen Chapter 2 Powering On and Configuring BIOS Settings 2 5 259 2 2 3 2 1 2 3 2 2 2 6 5 If you need to modify other setup parameters use the arrow and Tab keys to navigate to the desired screen and menu item and then repeat Steps 1 through 3 Otherwise go to Step 6 6 Press and release the right arrow key until the Exit menu screen is displayed 7 Follow the instructions on the Exit menu screen to save your changes and exit the Setup Utility BIOS Considerations This section contains information and considerations regarding the system BIOS PCI Card Slot Booting Priority The Sun Blade X6240 server module has up to two PCI ExpressModules PCI EMs per server module installed in the chassis The slots for the PCI Express Modules are detected by the BIOS during startup in this order PCI EM BLx 1 and PCI EM BLx 0 For example if the server module is in slot 3 the BIOS b
26. the Uniform Command Line Interface User s Guide 820 2145 Show Results Summary Selecting Show Results Summary on the Diagnostics main menu displays the tests that have been run and lists the results which can be Pass Fail or N A The following list describes all the tests that are available with the Tools and Drivers DVD If your system does not have the corresponding option the results will show as N A in the Show Results Summary list m Processor This section shows the following tests conducted against the processor Core Processor Tests AMD 64 Bit Core Tests Math Co Processor Tests Pentium Class FDIV and Pentium Class FIST MMX Operation 3DNow Operation SSE Instruction Set SSE2 Instruction Set and MP Symmetry m Motherboard Chapter 3 Diagnostics Tools 3 17 3 6 7 3 18 This section shows the following tests conducted against the motherboard DMA Controller Tests System Timer Tests Interrupt Test Keyboard Controller Tests PCI Bus Tests and CMOS RAM Clock Tests Memory Cache Memory and Video Memory This section shows the following tests conducted against the various types of memory Inversion Test Tree Progressive Inv Test Chaotic Addressing Test and Block Rotation Test Input Device This section shows the following tests conducted against the input device Verify Device Keyboard Repeat and Keyboard LEDs Mouse This section shows the following tests conducted against the mouse Butto
27. 2 3 2 4 BIOS Option ROM Size Limitation The BIOS Option ROM is 128 kbytes Of these 128 kbytes approximately 80 kbytes are used by the VGA controller the LSI controller and the network interface card Approximately 48 kbytes remain for the Option ROM Z9 BIOS Setup Screens TABLE 2 1 contains summary descriptions of the seven top level BIOS setup screens and indicates the section that contains examples of the BIOS screens TABLE2 1 BIOS Setup Screens Summary Screen Description Section Main General system information Section 2 3 4 BIOS Main Menu Screen on page 2 10 Advanced Configuration interface for the CPUs IDE SuperIO Section 2 3 5 BIOS Advanced ACPI Event Log HyperTransport IPMI MPS PCI Menu Screens on page 2 11 Express PowerNow Remote Access and USB PCIPnP Plug and Play PnP devices can be configured by the Section 2 3 6 BIOS PCIPnP Menu BIOS default or by the operating system if Screen on page 2 18 applicable Boot Configure the boot device priority CD DVD Section 2 3 7 BIOS Boot Menu Removables Hard Disks Networks Screens on page 2 19 Security Install or change the user and supervisor passwords Section 2 3 8 BIOS Security Settings Menu on page 2 21 Chipset Configuration options for the NorthBridge and Section 2 3 9 BIOS Chipset Menu SouthBridge devices Screens on page 2 22 Note that the Memory Chipkill option is enabled by default Enabling Chipkill improves system reliabi
28. Battery on page 4 10 CRU m Section 4 3 3 Replacing the Compact Flash Module on page 4 11 CRU m Section 4 3 4 Replacing Memory Modules DIMMs on page 4 12 CRU m Section 43 5 Adding or Replacing a RAID Expansion Module on page 4 17 CRU m Section 4 3 6 Changing the REM Battery on page 4 21 CRU m Section 43 7 Adding or Replacing a Fabric Expansion Module on page 4 23 CRU m Section 4 3 9 Replacing the Motherboard on page 4 31 FRU Caution Before handling components attach an ESD wrist strap to the grounding post that is built into the rear of the chassis The system s printed circuit boards and hard disk drives contain components that are extremely sensitive to static electricity Sun Blade X6240 Server Module Service Manual January 2010 4 3 1 Replacing a Hard Disk Drive Follow these steps to remove and replace a hard disk drive HDD Note This component is a hot swappable CRU and can be replaced by anyone The internal system software designation of the HDDs is shown in FIGURE 4 4 FIGURE 4 4 Designation of Hard Disk Drives NOU dmu GA UU D o D D o ko D 0 mp A single HDD failure does not cause a data failure if the HDDs are configured as a mirrored RAID 1 volume optional The HDD can be removed and when a new HDD is inserted the contents are automatically rebuilt from the rest of the array with no need to reconfigure the RAID parameters If t
29. POST Memory Testing Works The BIOS POST memory testing is performed as follows 1 The first megabyte of DRAM is tested by the BIOS before the BIOS code is shadowed that is copied from ROM to DRAM 2 Once executing out of DRAM the BIOS performs a simple memory test a write read of every location with the pattern 55aa55aa Chapter 3 Diagnostics Tools 3 5 2 The BIOS polls the memory controllers for both correctable and uncorrectable memory errors and logs those errors into the service processor 3 02 Redirecting Console Output Use these instructions to access the service processor and redirect the console output so that the BIOS POST codes can be read 1 10 11 12 13 14 Connect a dongle cable to the server module universal connector port UCP See FIGURE 1 2 Connect a monitor to the dongle cable video port and a keyboard to a USB port Power cycle or power on the server Initialize the BIOS Setup Utility by pressing the F2 key while the system is performing the power on self test POST When the BIOS Main Menu screen is displayed select Advanced When the Advanced Settings screen is displayed select IPMI 2 0 Configuration When the IPMI 2 0 Configuration screen is displayed select the LAN Configuration menu item Select the IP Address menu item The service processor s IP address is displayed in the following format Current IP address in BMC XXX XXX XXX XXX Copy th
30. SS 4v SUN microsystems Sun Blade X6240 Server Module Service Manual Sun Microsystems Inc www sun com Part No 820 3971 11 Rev A January 2010 Submit comments about this document by clicking the Feedback link at http docs sun com Copyright O 2008 Sun Microsystems Inc 4150 Network Circle Santa Clara California 95054 U S A All rights reserved Sun Microsystems Inc has intellectual property rights relating to technology embodied in the product that is described in this document In partic ar and without limitation these intellectual property rights may include one or more of the U S patents listed at ttp www sun com patents and one or more additional patents or pending patent applications in the U S and in other countries Parts of the produet may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark in the U S and in other countries exclusively licensed through X Open Company Ltd Sun Sun Microsystems the Sun logo Java Solaris Sun Blade docs sun com Sun Fire and the Solaris logo are trademarks or registered trademarks of Sun Microsystems Inc in the U S and other countries Microsoft is a trademark or registered trademark of Microsoft Corporation or its subsidiaries in the United States and Other countries Windows is a trademark or registered trademark of Microsoft Corporation or its subsidiaries in the United States and Other countries The Adob
31. T link will cause this a BIOS POST failure before video comes up Note HDT diagnostics will stop or reset and power cycle the system Do not use HDT while the operating system is running Accessing HDT You can access HDT through the server module service processor SP as follows Chapter 3 Diagnostics Tools 3 7 3 4 3 Login to server module SP with the following login Username sunservice Password changeme HDT Commands m To query HDT execute hdtl q This command does the following Dumps the current system status and configuration a Power cycles the system and executes the HyperTransport Link test Dumps the system status and configuration after another clean start Note On a nonresponsive system run this command before the system is reset or power cycled m To log output to the default location coredump debug 10g execute hdt 1 q m To log output to a specified log file execute hdt 1logfile name qa Where logfile name is the path and file location 3 5 3 8 Pc Check Diagnostics Overview Pc Check diagnostics can test and detect problems on all motherboard components drives ports and slots This program can be accessed and executed only from Integrated Lights Out Manager ILOM If you are having a problem with your system use the diagnostics to troubleshoot and solve the problem Normally if you encounter any hardware related error
32. Testing to create scripts 1 From the Diagnostics main menu select Deferred Burn In Testing The screen displays a list of settings shown in TABLE 3 5 and a Burn In menu 2 Use the Burn In menu to configure the following selections m Change Options Opens the Burn In Options menu which enables you to modify the options listed in TABLE 3 5 for the currently loaded test script Sun Blade X6240 Server Module Service Manual January 2010 3 6 5 3 6 6 m Select Tests Opens a listing of the tests available for your workstation configuration and the currently loaded test script 3 When you are done select Save Burn In Script and type the name for the new script Enter d Mestname tst Where testname is the name of the script that you have created 4 To run the newly created script go to Immediate Burn In Testing in Section 3 6 4 1 Performing Immediate Burn In Testing on page 3 15 and run the script testname tst Diagnostic Partition A diagnostic partition is required for the test scripts to write their log files Without a diagnostic partition the only output is the display on the diagnostic screens The diagnostic partition is preinstalled on the You do not need to reinstall the diagnostic partition unless you have removed it To change partitions see the instructions for your operating system If you have RAID you can use the instructions in the Sun StorageTek RAID Manager Software User s Guide 820 1177 and
33. adjustable torque driver alternately tighten the two heatsink mounting screws 180 degrees at a time until each spring is completely compressed Tighten the screws to 7 in lbs 0 8 Nm Replacing the Motherboard Note This component is a FRU and should be replaced only by qualified service technicians Contact your Sun Service representative for assistance Follow these steps to remove and replace the motherboard 1 Remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Chapter 4 Maintaining the Sun Blade X6240 Servers 4 31 Caution Do not operate the system with empty slots Always insert a filler panel into an empty slot to reduce the possibility of system shut down 2 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 3 Remove the following components from the motherboard and place them on an antistatic surface m DIMMs See Section 4 3 4 Replacing Memory Modules DIMMs on page 4 12 m Hard drives See Section 4 3 1 Replacing a Hard Disk Drive on page 4 7 You must return each HDD to the bay from which it was removed Use an adhesive note or another method to temporarily label the HDDs after you remove them m REM board See Section 4 3 5 Adding or Replacing a RAID Expansion Module on page 4 17 m REM battery See Section 4 3 6 Changing the REM Battery on page 4 21 m
34. ave and Exit n E ESC Exit si e e e e he e de hehe e hehe ehe hee eee e eoe e ehe e e hee e hee e hehe ehe ehe e e eee eoe e ehe e e he e e he e e he e ee e e ee e e e de e e e n n n A 2 3 9 6 BIOS Chipset Menu SouthBridge Configuration Screen A o de de e dee e e hee e eee eee e eoe e ehe e ehe e e hee e ehe e he e hee ee ee eoe e ehe EH SouthBridge MCP55 Chipset Configuration Select CPU LDT Spread de de dece e de hehe e eoe oe ehe e e eoe oe eoe oe e hee e eoe e oe e ehe e ee e de dee de de e e dn f Bn Bn n Gn GB 0 Spectrum type SATA Spread Spectrum Enabled PCIE Spread Spectrum Enabled Primary Graphics Adapter PCI Express gt PCI Restore on AC Power Loss Power Off Select Screen Doe Select Item Change Option F1 General Help x10 Save and Exit E k ESC Exit de de e de he e e hee e hee e hee oe he eoe e ee e ehe ee he e e hehe e hehe e e he e eee e eoe e ehe e ehe e e he he e he e e he e e ee e e e e e e e e e e e n n n Chapter 2 Powering On and Configuring BIOS Settings 2 25 2 3 10 BIOS Exit Option Menu Screen Save Changes and Exit 2 26 Sun Blade X6240 Server Module Service Manual e January 2010 24 Modifying Settings Using Jumpers The following sections show how to modify system settings using jumpers on the server motherboard m Section 24 1 Using the Clear CMOS Jumpe
35. cessory Kit Item Part Number Sun Blade X6240 Server Module Tools and Drivers DVD 708 0346 Sun Blade X6240 Server Module Sun Installation Assistant CD 707 0096 Sun Blade X6240 Server Module Installation Guide printed 820 3968 documentation Sun Blade X6240 Server Module Getting Started Guide printed 820 3975 documentation Additional safety and license documentation 1 4 Additional Options and Replaceable Components Supported components and their part numbers are subject to change over time For the most up to date list of replaceable components for servers see the following URL http sunsolve sun com handbook pub Systems 1 Click the name and model of your server 2 On the product page that opens for the server click Full Components List for the list of components Note These servers are fully compliant with the Reduction of Hazardous Substances RoHS Directive 1 6 Sun Blade X6240 Server Module Service Manual e January 2010 CHAPTER 2 Powering On and Configuring BIOS Settings You can power on the Sun Blade X6240 server module directly from the front panel You can power off the server module using one of four different methods In addition you can configure or change serveral BIOS settings The following topics are contained in this chapter Section 2 1 Powering On the Server on page 2 2 Section 2 2 Powering Off the Server on page 2 4 Section 2 3 Configuring BIOS Settings on pag
36. ction to remove and replace the server s dual inline memory modules DIMMs 4 3 4 1 DIMM Population Rules The DIMM population rules for the Sun Blade X6240 server modules are listed here m Each CPU can support a maximum of eight DDR2 DIMMs 4 12 Sun Blade X6240 Server Module Service Manual January 2010 4 3 4 2 m Each pair of DIMMs must be identical same manufacturer size and speed The DIMM slots are paired and the DIMMs must be installed in pairs The memory sockets are colored black or white to indicate which slots are paired by matching colors m Populate the DIMMs in the slots farthest from the CPU first The first pair to be populated should be D0 D1 then D2 D3 and so on Replacing a DIMM Note This component is a CRU and can be replaced by anyone Use the following procedure to replace a DIMM 1 Power off the server and remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Caution Do not operate the system with empty slots Always insert a filler panel into an empty slot to reduce the possibility of system shut down 2 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 3 Press the fault indicator button on the motherboard to illuminate the LED for the DIMMs that have failed Chapter 4 Maintaining the Sun Blade X6240 Servers 4 13 FIGURE 4 9 Fault Indicator Button Loca
37. d to illuminate the LED for the CPU that has failed Chapter 4 Maintaining the Sun Blade X6240 Servers 4 25 FIGURE 4 16 Fault Indicator Button Location Fault indicator CPU fault LEDs button 4 Identify which CPU and heatsink you are replacing The internal designation of the two CPUs in the server is shown in FIGURE 4 16 There is a fault LED on the motherboard for each CPU m LED is off CPU is OK m LED is lit amber CPU has encountered a voltage or heat error condition 4 26 Sun Blade X6240 Server Module Service Manual e January 2010 FIGURE 4 17 CPU Locations 5 Remove the CPU and heatsink from the motherboard a Hold down on the top of the heatsink to prevent it from tipping unevenly while you alternately loosen the four spring loaded mounting screws that secure the heatsink to the motherboard Turn the screws 180 degrees at a time and then remove the screws when they are detached See FIGURE 4 18 Chapter 4 Maintaining the Sun Blade X6240 Servers 4 27 FIGURE 4 18 Removing the Heatsink and CPU b Twist the heatsink slightly to lift it off the board Turn the heatsink upside down and allow the spring in each of the four mounting holes to fall out into your hand Note Set the heatsink upside down on a clean flat surface to prevent the thermal grease from contaminating other components 6 Pull the CPU socket lever slightly away from the socket a Pivot the lever up into the fully open posit
38. dule Orientation 1 2 1 3 Accessory Kits 1 6 14 Additional Options and Replaceable Components 1 6 Powering On and Configuring BIOS Settings 2 1 21 Powering On the Server 2 2 2 2 Powering Off the Server 2 4 2 3 Configuring BIOS Settings 2 5 2 3 1 Changing the Configuration of a BIOS Menu Item 2 5 2 3 2 BIOS Considerations 2 6 2 3 2 1 PCI Card Slot Booting Priority 2 6 2 3 22 Ethernet Port Device and Driver Naming 2 6 2 3 2 3 Ethernet Port Booting Priority 2 7 2 3 2 4 BIOS Option ROM Size Limitation 2 8 2 3 3 BIOS Setup Screens 2 8 2 3 4 BIOS Main Menu Screen 2 10 2 3 6 2 3 7 2 3 8 2 3 9 BIOS Advanced Menu Screens 2 11 2 3 5 1 2 3 52 2 3 5 3 2 3 5 4 2 3 5 5 2 3 5 6 2 3 5 7 2 3 5 8 2 3 5 9 2 3 5 10 2 3 5 11 2 3 5 12 2 3 5 13 BIOS Advanced Menu Main Screen 2 11 BIOS Advanced Menu CPU Configuration Screen 2 12 BIOS Advanced Menu IDE Configuration Screen 2 12 BIOS Advanced Menu ACPI Configuration Screen 2 13 BIOS Advanced Menu Event Logging Details Screen 2 13 BIOS Advanced Menu IPMI Configuration Screen 2 14 BIOS Advanced Menu IPMI LAN Configuration Screen 2 14 BIOS Advanced Menu IPMI PEF Configuration Screen 2 15 BIOS Advanced Menu MPS Configuration Screen 2 15 BIOS Advanced Menu PCI Express Configuration Screen 2 16 BIOS Advanced Menu Remote Access Configuration Screen 2 16 BIOS Advanced Menu Trusted Computing Screen 2 17 BIOS Advanced Menu USB Configuration Screen 2 17 BIOS PCIPnP
39. e logo is a registered trademark of Adobe Systems Incorporated Use of any spare or replacement CPUs is limited to repair or one for one replacement of CPUs in products exported in compliance with U S export laws Use of CPUs as product upgrades unless authorized by the U S Government is strictly prohibited DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Copyright 2008 Sun Microsystems Inc 4150 Network Circle Santa Clara California 95054 Etats Unis Tous droits r serv s Sun Microsystems Inc d tient les droits de propri t intellectuels relatifs la technologie incorpor e dans le produit qui est d crit dans ce document En particulier et ce sans limitation ces droits de propri t intellectuelle peuvent inclure un ou plus des brevets am ricains list s l adresse http www sun com patents et un ou les brevets suppl mentaires ou les applications de brevet en attente aux Etats Unis et dans les autres pays Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie UNIX est une marque d pos e aux Etats Unis et dans d autres pays et licenci e exclusivement par X Open Company Ltd Sun Sun Microsystems
40. e 2 5 Section 2 4 Modifying Settings Using Jumpers on page 2 27 Section 2 5 Updating the BIOS on page 2 31 Section 2 6 Power On Self Test POST on page 2 32 2 1 2 1 2 2 Powering On the Server Note Before powering on your server for the first time follow the installation instructions provided in the Sun Blade X6240 Server Module Installation Guide 820 3968 1 Verify that power cords have been connected to the chassis power supplies and that standby power is on In standby power mode the blue Ready to Remove LED on the server module front panel is illuminated indicating that the service processor is working and that the server module is ready to be fully powered on to main power mode See FIGURE 2 1 for the LED location 2 Use a stylus or other pointed object to press and release the recessed Power button on the front panel of the server See FIGURE 2 1 for the Power button location When main power is applied to all components in the server the Power LED next to the Power button lights and remains lit FIGURE 2 1 shows the location of the Power button Sun Blade X6240 Server Module Service Manual January 2010 FIGURE 2 1 Power Button and Power LED Location Power LED Power button Chapter 2 Powering On and Configuring BIOS Settings 2 3 2 2 Powering Off the Server 1 Choose a method for shutting down the server from main power mode to standby power mode Graceful shutdow
41. e System Battery Installation is the reverse of this procedure Note Install the new system battery in the holder with the same orientation polarity as the battery that you removed The positive polarity marked with a symbol should be facing upward 4 3 3 Replacing the Compact Flash Module Note This component is a CRU and can be replaced by anyone Use the following procedure to replace the compact flash module 1 If necessary back up any data that is contained on the Compact Flash module 2 Power off the server and remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Chapter 4 Maintaining the Sun Blade X6240 Servers 4 11 Caution Do not operate the system with empty slots Always insert a filler panel into an empty slot to reduce the possibility of system shut down 3 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 4 Locate the Compact Flash module underneath the REM board See FIGURE 4 8 FIGURE 4 8 Replacing the Compact Flash Module 5 Push the compact flash ejector button to release the module from its holder This action causes the spring loaded card to eject 6 Grasp the compact flash module and pull it out from under the REM board Installation is the reverse of this procedure 4 3 4 Replacing Memory Modules DIMMs Use the procedures in this se
42. e connector CPUS and heatsinks 2 REM Board Compact Flash below FEM Board REM Battery System Battery Hard drives 4 DIMMs up to 8 for each CPU Chapter 4 Maintaining the Sun Blade X6240 Servers 4 5 4 3 4 6 Replaceable Component Procedures Note Some of the procedures in this section are for customer replaceable units CRUs and some are for field replaceable units FRUs as noted in the procedures and in the list below FRU components must be replaced only by trained Sun service technicians Contact your Sun Service representative for assistance with FRU replacements Supported components and their part numbers are subject to change over time For the most up to date list of replaceable components for the Sun Blade X6240 server module see the following URL http sunsolve sun com handbook pub Systems 1 Click the name and model of your server 2 On the product page that opens for the server click the Full Components List for the list of components Some Sun Blade X6440 server module components are hot swappable which means that you can remove and replace those components without powering off the server module For other component replacements you must power off and remove the server module from the chassis This section contains procedures for replacing the following components m Section 4 3 1 Replacing a Hard Disk Drive on page 4 7 CRU m Section 4 3 2 Replacing the System
43. e hehehe KK he e e e e he e e e e e he he e he he he e hee e ee e e e e e e e e eoe he he he he hehe hee hee he e e e e e e e e e e e e e e e e de Chapter 2 Powering On and Configuring BIOS Settings 2 21 2 9 9 BIOS Chipset Menu Screens 2 3 9 1 BIOS Chipset Menu Main Screen NorthEridge Configuration 2 22 Sun Blade X6240 Server Module Service Manual e January 2010 2 3 9 2 BIOS Chipset Menu NorthBridge Configuration Screen a Sol ete e te te te te de te te He He KK HHH HHH TKI hee hee hee eoe hehehe hehe he ehe e he eee hee he ee e he e he e he e n n f n ECC Configuration DRAM Timing Configuration Alternate VID Memory Timing Parameters NorthBridge Chipset Configuration e e de ehe ee he ee hee eee eee eee eee eee eee eee eee e he e he e n n n n n n 98 kk kk kk kk krk Auto CPU Node 0 eode dee dede eee kk kk kk eoe eee eee e e e e e e e d e n n n B n B AB 9n 98 e de e ee e eoe eee e ehe e ehe e e hee e ee eee oe eee e hee e ee e hee eee hee eee e eee eoe e eoe e oe e eoe e e e e dn d n n A n n A G Gare Select Screen n M Select Item Enter Go to Sub Screen EL General Help s F10 Save and Exit ESC Exit 2 3 9 3 BIOS Chipset Menu NorthBridge Memory Configuration Screen Oe e de HH KK KKK KKK KKK KR ERR ERR EERE REE RE eee hee KERR KKK KKK KKK
44. e service processor IP address You will need to insert it into a web browser in the next step Start a web browser and type the service processor s IP address in the browser s URL field When you are prompted type a user name and password as follows User name root Password changeme When the ILOM service processor web GUI screen is displayed click the Remote Control tab Click the Redirection tab Set the color depth for the redirection console to either 8 or 16 bits Click the Start Redirection button The Remote Console window appears and prompts you for your user name and password again 3 6 Sun Blade X6240 Server Module Service Manual January 2010 15 When you are prompted type a user name and password as follows User name root Password changeme The current POST screen is displayed 3 4 3 4 1 3 4 2 Hardware Debug Tool HDT The hardware debug tool HDT is a diagnostic tool that allows access to all memory spaces and CPU registers of the system HDT Functionality Available functionality includes m Access to CPU registers and memory spaces m Automated diagnostics m Checking of all HT links for errors at different speeds and widths m Testing of BIOS flash access and BIOS progress m Testing of access to other board components HDT can be used to m Check the status and configuration of system m Diagnose the system with the following symptoms a No video System hang any bad H
45. er LED Connector on page C 6 Section C 5 Compact Flash on page C 7 C 1 CA C 2 Front 1 O Dongle The front I O dongle connector pins and their corresponding descriptions are shown in the figure and table in this section FIGURE C 1 Front I O Dongle Connector Em WW e e ELEU Y 10 30 36 20 TABLE C 1 Front I O Dongle Pins Signal Name Pin Pin Signal Name No Connect 1 21 28 30 15 USBO_FRONT_VCC 31 33 34 DNGL_VGA_RED 2 16 USB1_FRONT_VCC DNGL_VGA_GRN 3 17 USB1_FRONT_VCC DNGL_VGA_BLU 4 18 USB1_FRONT_CM_N GND 5 19 USB1_FRONT_CM_P DNGL_VGA_MONID2 6 20 GND GND 7 11 20 29 22 DNGL_RES_SER_RXD 32 36 DNGL_VGA_MONID1 8 23 RES_DNGL_SER_RTS_N DNGL_VGA_HSYNC_BUF 9 24 RES_DNGL_SER_TXD DNGL_VGA_VSYNC_BUF 10 25 DNGL_RES_SER_CTS_N GND 11 26 RES_DNGL_SER_DTR_N USBO_FRONT_CM_N 12 27 DNGL_RES_SER_DCD_N USBO_FRONT_CM_P 13 35 DONGLE_PRSNT_L USBO_FRONT_VCC 14 Sun Blade X6240 Server Module Service Manual January 2010 C2 SAS SATA Connectors The Serial Attached SCSI SAS Serial Advanced Technology Attachment SATA connector pins and their corresponding descriptions are shown in the figure and table in this section FIGURE C 2 SAS SATA Connector S8 I 1 S7 P1 P15 o 14 TABLE C 2 SAS SATA Connector Pins Segment Pin Number Pin Name Description Signal S1 Gnd Second mate ground SERIEN 92 TX Positive side of transmit to hard drive S3 TX Negative
46. extremely sensitive to static electricity 2 Remove the server module from the chassis See Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 3 Remove the main cover from the server See Section 4 2 2 Removing the Main Cover on page 4 4 4 Install the shorting jumper across the J19 header pins See FIGURE 2 5 for the header pin location This jumper s function is to clear the ILOM SP password 5 Reinstall the main cover to the server 6 Reinstall the server module into the chassis See Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 The server powers up to standby power mode indicated when the blue Read to Remove LED on the server module front panel is illuminated 7 Return the server to main power mode Use a stylus or other pointed object to press and release the recessed Power button on the server module front panel Note You must allow the entire server not just the SP to reboot to main power mode to complete the password reset This is because the state of this jumper cannot be determined without the host CPU running Wait until the end of POST when you see the CMOS password cleared by jumper message after which the SP password is reset m The ILOM SP password is reset to the default changeme Chapter 2 Powering On and Configuring BIOS Settings 2 29 8 9 10 Log in to the ILOM web GUI using root as the user name and changeme as the
47. g Mark all events as read Clear Event Log Machine Check Error Reporting Enabled e Select Screen xi BN Select Item Enter Go to Sub Screen E General Help i F10 Save and Exit ESC Exit e e e e e e e kk kk ee hee e e eoe e e e e e he kk kk x Chapter 2 Powering On and Configuring BIOS Settings 2 13 2 3 5 6 2 3 5 7 2 14 BIOS Advanced Menu IPMI Configuration Screen SS o TUENDUM NMSN SUUM e de de ee de eee ede oe ee eee e eoe e e ehe hee hehe e eee e e he e ee he e e he e e ehe e e he e e hehe e e he he e eh e e he e e he e e e e n n n n 9 IPMI 2 0 Configuration deo ode eee eoe eoe eee eee eoe ee ee ee eee e e e e e e d e n d n n B B B B 9 B8 9 B 4 9 B8 B B8 Status Of BMC i rkinc It will take a max of 15 seconds to read all Clear BMC System Event Log BMC SEL records LAN Con iguration PEF Configuration BMC Watch Dog Timer Action Disabled a Select Screen eae tls Select Item Enter Go to Sub Screen le SERE General Help Ere Save and Exit ESC Exit e e de e hee te te eee e ehe e e hee e e hee e ee e hehe e e ehe e ehe he e hee e ehe e e ehe e e hee ehe e e he e e e he e e e e e e e e n n n B Bn Bn 9 View all events in the BMC Event Log BIOS Advanced Menu IPMI LAN Configuration Sc
48. ger ILOM Viewing replaceable component information Viewing sensors and LED indicators Viewing indicators LEDs and controlling the Locate LED Managing alerts Viewing and clearing the system event log See the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1188 for more information 3 1 92 System Status LEDs The Sun Blade X6240 server module has external and internal system status LEDs 3 2 1 External Status Indicator LEDs FIGURE 3 1 shows the locations of the external status indicator LEDs FIGURE 3 1 External LED Locations Locate button with LED Ready to Remove LED Service Action Required LED Power LED Hard Drive Power LED Hard Drive Service Action Required LED Hard Drive Ready to Remove LED 3 2 Sun Blade X6240 Server Module Service Manual e January 2010 Refer to TABLE 3 1 for descriptions of the LED behavior TABLE3 1 Front Panel LED Functions LED Name Description Locate button LED This LED helps you to identify which system in the rack you are working on in a rack full of servers Push and release this button to make the Locate LED blink for 30 minutes Hold down the button for 5 seconds to initiate a push to test mode that illuminates all other LEDs both inside and outside the chassis for 15 seconds Ready to Remove LED The server module is ready to be removed from the chassis This LED is switched on by the service processor when the server module main powe
49. hange the REM battery 1 Power off the server and remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Caution Do not operate the system with empty slots Always insert a filler into an empty slot to reduce the possibility of module shutdown 2 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 3 Disconnect the battery cable from the chassis motherboard See FIGURE 4 14 4 Remove the four screws that secure the REM battery to the motherboard 5 Lift the battery away from the motherboard 6 To install the new battery reverse Step 1 through Step 5 Chapter 4 Maintaining the Sun Blade X6240 Servers 4 21 FIGURE 4 14 Replacing the REM Battery 4 22 Sun Blade X6240 Server Module Service Manual e January 2010 4 3 7 4 3 7 1 Adding or Replacing a Fabric Expansion Module Follow these steps to remove and replace a Fabric Expansion Module FEM in a Sun Blade X6240 server module Adding or Removing and Replacing a FEM Note This component is a CRU and can be replaced by anyone Use the following procedure to add or remove and replace the FEM 1 Power off the server and remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Caution Do not operate the system with empty slots Always insert a filler
50. he CPU in three lines in the pattern shown in FIGURE 4 20 FIGURE 4 20 Required Pattern for Thermal Grease Application CPU surface Lines of thermal grease b If you are reinstalling an existing heatsink use an alcohol pad to clean all the old thermal grease from the component surface Also clean the dust from the heatsink fins 4 30 Sun Blade X6240 Server Module Service Manual January 2010 4 3 9 Note System cooling might be affected by dust and contaminant build up Therefore you should open and check systems approximately every six months or more often in dirty operating environments Check system heatsinks fans and air openings lf necessary clean systems by carefully brushing blowing or vacuuming contaminants from the system c Turn the heatsink upright and reinsert the four springs and mounting screws Caution Avoid moving the heatsink after it has contacted the top of the CPU Too much movement could disturb the layer of thermal grease leading to component damage d Carefully position and align the heatsink over the CPU Note The heatsink is not symmetrical and it must be aligned before you place it on the CPU Note that the half of the Sun Microsystems logo imprinted on the top of the heatsink creates a complete logo when correctly aligned with the adjacent heatsink e Lower the heatsink onto the CPU aligning the mounting screws with their holes on the motherboard f Using an
51. he I O port assignment for the hardware devices on the system Memory Browser Enables you to view the mapped memory for the entire system Sector Browser Reads sector information from the hard disks sector by sector CPU Frequency Monitor Tests the processor speed CMOS RAM Utilities Shows the CMOS settings of the system Text File Editor Opens a file editor Start Up Options Enables you to set up startup options for diagnostics testing Advanced Diagnostics Advanced diagnostics are used to test an individual device on the system Most of the selections on this menu display information about the corresponding devices and then offer a menu of testing options For example to test CPU 0 you can select Advanced Diagnostics gt Processor gt CPUO Note If you do not know which device to test see Section 3 6 4 Burn In Testing on page 3 14 TABLE 3 4 gives the name and a brief description of the selections in the Advanced Diagnostics Tests menu Chapter 3 Diagnostics Tools 3 11 Note Some of the tests in TABLE 3 4 might be irrelevant for certain systems Ignore any that are not relevant to your hardware configuration TABLE 3 4 Advanced Diagnostics Test Menu Options Option Description Processor Displays information about the processors and includes a Processor Tests menu Memory Displays information about the memory and includes tests for the different types of system memory Motherboard D
52. he bad HDD was configured as a hotspare the new HDD is automatically configured as a new hotspare Chapter 4 Maintaining the Sun Blade X6240 Servers 4 7 Caution Possible data loss If you insert an HDD that has been configured with a RAID volume into a server that did not previously have its HDDs configured with RAID volumes the existing HDDs in the server will be converted to RAID volumes during automatic synchronization and any existing data on the existing HDDs in the server are erased Before permanently removing an HDD that is part of an active RAID volume use the MegaRAID Storage Manager Integrated RAID MSM IR to delete the RAID volume from the HDD to avoid causing this problem For information about the implementation of RAID on this server and instructions on how to use the MSM IR MegaRAID Storage Manager Integrated RAID utility to create RAID arrays and then manage and monitor the RAID arrays refer to the X64 Servers Utilities Reference Manual 820 1120 Use the following procedure to replace a hard disk drive 1 Observe the LEDs on the faces of the HDDs and identify the defective HDD m Middle LED on amber The drive is faulty and should be replaced m Left LED on green The drive is operating properly 2 Execute the software commands appropriate to the software that you are using to prepare the hard drive for removal Caution Do not operate the system with empty slots Always insert a filler panel into an
53. ion b Open the hinged plate that covers the CPU until it is in the fully open position 4 28 Sun Blade X6240 Server Module Service Manual January 2010 c Lift the CPU out of the socket leaving the lever and plate in the open position 7 Install the new CPU or reinstall the existing CPU FIGURE 4 19 shows how to install the CPU and heatsink FIGURE 4 19 Installing the Heatsink and CPU Note Mixing CPU speeds is not supported Use two identical CPUs in your server a If you are reinstalling the existing CPU use an alcohol pad to clean all the old thermal grease from the component surface You will need to apply new thermal grease when you reinstall the heatsink in Step 8 Chapter 4 Maintaining the Sun Blade X6240 Servers 4 29 b Ensure that the CPU socket release lever and retainer plate are in the fully open position c Align the CPU in the socket Note Use the alignment keys in the CPU socket to match the alignment notches on the sides of the CPU d Gently set the CPU onto the pins in the socket e When the CPU is fully seated in the socket pivot the hinged retainer plate down onto the top of the CPU f Pivot the release lever down and into the locked position at the side of the socket The release lever must lock down the retainer plate as you close the lever 8 Install the heat sink a Using one syringe of thermal grease 0 2 ml 0 5 g carefully apply grease to the top of t
54. ions must be true for this to work The new service processor must be installed Do you want to continue v n y Service processor FRU information ready to be collected You MUST reboot the service processor for to complete this process Allow the service processor to fully boot DO NOT UNPLUG THE SYSTEM WHILE THE SERVICE PROCESSOR IS BOOTING would you like to reboot the service processor now y n y The system is going down NOW Sending SIGTERM to all processes Chapter 4 Maintaining the Sun Blade X6240 Servers 4 33 4 34 Sun Blade X6240 Server Module Service Manual January 2010 APPENDIX A System Specifications This appendix contains physical specifications for the Sun Blade X6240 server module Refer to the chassis documentation for additional server module specifications TABLE A 1 Sun Blade X6240 Server Module Physical Specifications Specification Value Width 12 87 inches 327 mm Height 1 7 inches 44 mm Depth 20 16 inches 512 mm Weight 17 pounds 8 kg A 1 A 2 Sun Blade X6240 Server Module Service Manual January 2010 APPENDIX B BIOS POST Codes This appendix lists the BIOS POST code checkpoints for the Sun Blade X6240 server module B 1 POST Code Checkpoints The POST code checkpoints are the largest set of checkpoints during the BIOS preboot process TABLE B 1 describes the checkpoints that might occur during the POST portion of the BIOS These two digit checkpoin
55. isplays information about the motherboard and includes a Motherboard Tests menu Floppy Disks Not relevant Hard Disks Displays information about the hard disk and includes a Hard Disk Tests menu Refer to Section 3 6 3 Hard Disk Testing on page 3 13 for detailed information about scripts and about testing hard disks CD ROM DVD Displays a CD ROM DVD menu to test DVD devices ATAPI Devices ATA USB Network System Stress Test Keyboard Mouse on the system Displays information about devices attached to the IDE controllers on the system other than a DVD or hard disks for example zip drives Includes an ATA test menu Select the parallel ATA driver to test Displays information about the USB devices on the system and includes a USB Tests menu Performs network register controller tests Exercises and checks the CPU memory and hard drive Includes a Keyboard Test menu with options for performing different tests on the keyboard Displays information about the mouse and includes a menu to test the mouse on the system Sun Blade X6240 Server Module Service Manual January 2010 TABLE3 4 Advanced Diagnostics Test Menu Options Continued Option Description Audio Displays information about the audio devices on the system and includes an Audio Tests menu to test audio device information A PCI audio card is required to run this test Video Displays information about the video card Initially the mo
56. lacing a CPU and Heatsink 4 25 4 3 9 Replacing the Motherboard 4 31 4 4 Servicetool FRU Update Procedure 4 32 System Specifications A 1 BIOS POST Codes B 1 B 1 POST Code Checkpoints B 1 Connector Pinouts C 1 C 1 FrontI O Dongle C 2 C 2 SAS SATA Connectors C 3 C 3 SASDiskplane C 5 CA SAS Power LED Connector C 6 Ch Compact Flash C 7 Index Index 1 Contents vii viii Sun Blade X6240 Server Module Service Manual January 2010 Preface The Sun Blade X6240 Server Module Service Manual contains information and procedures for maintaining and upgrading the Sun Blade X6240 Server Module Before You Read This Document It is important that you review the safety guidelines in the Sun Blade X6240 Server Module Safety and Compliance Guide 820 4411 and in the Important Information for Sun Hardware Systems 816 7190 Product Updates For product updates that you can download for the Sun Blade X6240 server modules please visit the following web site http www sun com servers blades X6240 This site contains updates for firmware and drivers as well as CD ROM iso images Related Documentation The documents listed in the following table are available online at http docs sin com At that site search for the Sun Blade X6240 server module Note The last two digits of the documentation part number identify the latest version of the product documentation that is available for dow
57. lity but degrades system performance under specific applications Exit Save or discard changes Section 2 3 10 BIOS Exit Option Menu Screen on page 2 26 FIGURE 2 4 summarizes the BIOS Configuration Utility menu tree See the following sections for examples of each of these screens 2 8 Sun Blade X6240 Server Module Service Manual e January 2010 FIGURE 2 4 Sun Blade X6240 Server Module BIOS Configuration Utility Menu Tree A Advanced PCIPnP Security Chipset Main menu Menu menu Boot menu men men Exit menu CPU Boot Settings NorthBridge Configuration Configuration Configuration IDE Boot Device SouthBridge Configuration Priority Configuration ACPI Hard Disk Configuration Drives Event Memory Logging Configuration IPMI BMC Configuration Event Log ECC Configuration MPS LAN DRAM Configuration Configuration Configuration PCI Express PEF Configuration Configuration RemoteAccess Configuration Trusted Computing USB Configuration The following figures show sample BIOS setup menu screens and show optional default settings Note The screens shown are examples The version numbers and the screen items and selections shown are subject to change over the life of the product Chapter 2 Powering On and Configuring BIOS Settings 2 9 2 3 4 BIOS Mai
58. ller RAID levels 0 1 5 and 6 supported via RAID Expansion Module REM Four eight lane PCI Express one per Network Express Module NEM and one per PCI ExpressModule PCI EM Two 10 100 1000 Mbit Ethernet one per NEM 10 100 Mbit Ethernet management port to the chassis management module CMM Optional two eight lane PCI Express Gigabit Ethernet and AUIX Ethernet interfaces via the fabric expansion module FEM Dongle connector that interfaces to VGA graphics Serial console to SP Dual USB ports keyboard mouse IDE Compact Flash module interface Optional crypto key storage and system authentication T2 1 2 Sun Blade X6240 Server Module Orientation This section contains illustrations that you can use to become familiar with the components of the Sun Blade X6240 server module Sun Blade X6240 Server Module Service Manual January 2010 FIGURE 1 1 shows the features of the front panel FIGURE 1 1 Sun Blade X6240 Server Module Front Panel Locate button with LED Ready to Remove LED Service Action Required LED Power LED Power button NMI Dump button for Service only UCP for dongle connection Hard Drive Power OK LED Hard Drive Service Action Required LED Hard Drive Ready to Remove LED Caution Do not use the NMI button unless you are instructed to do so by authorized Sun Service personnel The non maskable interrupt NMI switch sends an NMI order to the CPUs
59. mage preparation for different BIOS modules Fill the free area in F000h segment with OFFh Initializes the Microsoft IRQ Routing Table Prepares the runtime language module Disables the system configuration display if needed A4 Initialize runtime language module Display boot option popup menu A7 Displays the system configuration screen if enabled Initializes the CPUs before boot which includes the programming of the MTRRs A9 Wait for user input at config display if needed AA Uninstall POST INT1Ch vector and INTO9h vector AB Prepare BBS for Int 19 boot Initialize MP tables AC End of POST initialization of chipset registers De initializes the ADM module B1 Save system context for ACPI Prepare CPU for OS boot including final MTRR values 00 Prepares CPU for booting to OS by copying all of the context of the BSP to all application processors present NOTE APs are left in the CLIHLT state 61h 70h OEM POST error This range is reserved for chipset vendors and system manufacturers The error associated with this value may be different from one platform to the next Appendix B BIOS POST Codes B 3 B 4 Sun Blade X6240 Server Module Service Manual January 2010 APPENDIX C Connector Pinouts This appendix contains information about the following connector pinouts Section C 1 Front I O Dongle on page C 2 Section C 2 SAS SATA Connectors on page C 3 Section C 3 SAS Diskplane on page C 5 Section C 4 SAS Pow
60. mation TABLE 3 3 describes the selections in the System Information menu TABLE3 3 System Information Menu Options Option Description System Information Menu Includes basic information about your system motherboard BIOS processor memory cache drives video modem network buses and ports Hardware ID Image Menu Enables you to create an XML or txt document showing your system s hardware ID System Management Info Provides information about the BIOS type system motherboard enclosure processors memory modules cache slots system event log memory array memory devices memory device mapped addresses and system boot PCI Bus Info Includes details about specific devices from pci config space within the system similar to the System Management Information section IDE Bus Info Displays information about the IDE bus Interrupt Vectors Displays a list of interrupt vectors IRQ Information Shows hardware interrupt assignments Device Drivers Shows device drivers loaded under OpenDOS Sun Blade X6240 Server Module Service Manual January 2010 2 6 2 TABLE3 3 System Information Menu Options Continued Option Description APM Information Enables you to test and configure the Advanced Power Management APM capabilities of the system You can choose to change the power state view the power status indicate CPU usage get a power management event or change the interface mode I O Port Browser Shows t
61. me 3B Test for total memory installed in the system Also check for DEL or ESC keys to limit memory test Display total memory in the system 3C Mid POST initialization of chipset registers 40 Detect different devices parallel ports serial ports and coprocessor in CPU etc successfully installed in the system and update the BDA EBDA etc B 2 Sun Blade X6240 Server Module Service Manual January 2010 TABLE B 1 POST Code Checkpoints Continued Post Code Description 52 Updates CMOS memory size from memory found in memory test Allocates memory for Extended BIOS Data Area from base memory Programming the memory hole or any kind of implementation that needs an adjustment in system RAM size if needed 60 Initializes NUM LOCK status and programs the KBD typematic rate 75 Initialize Int 13 and prepare for IPL detection 78 Initializes IPL devices controlled by BIOS and option ROMs 7C Generate and write contents of ESCD in NVRam 84 Log errors encountered during POST 85 Display errors to the user and gets the user s response to the error 87 Execute BIOS setup if needed requested Check boot password if installed 8C Late POST initialization of chipset registers 8D Build ACPI tables if ACPI is supported 8E Program the peripheral parameters Enable Disable NMI as selected 90 Initialization of system management interrupt by invoking all handlers Al Clean up work needed before booting to OS A2 Takes care of runtime i
62. menu options 3 10 DIMMs ECC errors 4 17 error correction 4 17 fault indicator button 4 14 fault LEDs 3 5 parity 4 17 population rules 4 12 4 15 replacement 4 12 supported configurations 4 12 4 15 documentation related x dongle cable attaching to the front panel 1 4 connector pinouts C 2 connectors 1 4 driver updates ix E ECC errors DIMM errors 4 17 Ethernet driver naming 2 6 Ethernet port booting priority 2 7 naming 2 6 Exit Menu BIOS screen 2 8 external LEDs 3 2 F Fabric Expansion Module FEM board replacement 4 23 fault indicator button CPU 4 26 DIMMs 4 14 feature summary 1 1 firmware updates ix firmware testing 3 13 Index 2 front panel attaching the dongle cable 1 4 figure 1 3 LED definitions 3 3 front panel LEDs and buttons 1 3 full tst script 3 15 H hard disk drive 4 7 status LEDs 3 3 hard disk drive replacement 4 7 hard drive diagnosing 3 12 testing 3 13 tests against 3 18 hardware debug tool HDT access 3 7 commands 3 7 functionality 3 7 heatsink replacement 4 25 input device testing 3 18 Integrated Lights Out Manager ILOM component information 3 1 documentation 3 1 power off server 2 4 redirecting console output 2 5 3 6 internal LEDs 3 4 J J1302 jumper 2 27 J1303 jumper 2 27 J1330 jumper 2 27 J16 jumper 2 28 J19 jumper 2 29 J21 jumper 2 30 jumpers Clear CMOS 2 28 header pins location
63. move the server module from the chassis If you are only removing hard disk drives you can skip this section and go to Section 4 3 1 Replacing a Hard Disk Drive on page 4 7 1 Choose a method for shutting down the server from main power mode to standby power mode See FIGURE 1 1 for the location of the power button m Graceful shutdown Use a stylus or other pointed object to press and release the recessed Power button on the front panel This causes Advanced Configuration and Power Interface ACPI enabled operating systems to perform an orderly shutdown of the operating system Servers not running ACPI enabled operating systems shut down to standby power mode immediately m ILOM shutdown Use the ILOM CLI or Web GUI to power off the system At the ILOM command prompt type stop SYS See the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1188 for more information When the main power is off the blue Ready to Remove LED on the server module front panel illuminates indicating that the server is in standby power mode 4 2 Sun Blade X6240 Server Module Service Manual January 2010 Note When you use the Power button to enter standby power mode power is still directed to the SP board and power supply fans indicated when the blue Ready to Remove LED is illuminated To completely power off the server you must remove the server module from the midplane 2 Turn off any peripheral devices connected to the dongle
64. n Use a stylus or other pointed object to press and release the Power button on the front panel This causes Advanced Configuration and Power Interface ACPI enabled operating systems to perform an orderly shutdown of the operating system Servers not running ACPI enabled operating systems will shut down to standby power mode immediately Emergency shutdown Press and hold the Power button for four seconds to force the main power off and enter standby power mode ILOM CLI shutdown Log in to the SP ILOM CLI and type stop SYS ILOM web GUI shutdown Log in to the ILOM web GUI and do the following a Select Remote Control gt Remote Power Control The Server Power Control page appears b Select an action from the drop down list a Immediate Power Off Select to power off the server Graceful Shutdown and Power Off Select to gracefully shut down the system operating system before the system is powered off Refer to the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1188 for more information When the main power is off the blue Ready to Remove LED on the server module front panel illuminates indicating that the server is in standby power mode To completely power off the server remove the server module from the chassis See Section 4 2 Removing the Server Module From the Chassis and Removing the Cover on page 4 2 2 4 Sun Blade X6240 Server Module Service Manual January 2010 2 2 9 Configuring
65. n Menu Screen System Time 2 10 Sun Blade X6240 Server Module Service Manual e January 2010 2 3 5 BIOS Advanced Menu Screens 2 3 5 1 BIOS Advanced Menu Main Screen CPU Ccnfiguration Chapter 2 Powering On and Configuring BIOS Settings 2 11 2 3 5 2 BIOS Advanced Menu CPU Configuration Screen eS See eee ete e te de te de de te de He te KH HK HH KH TK TTT TRI RIE ERR EERE REE RRR CPU Configuration This option should e Version 13 33 remain disabled for the normal operation The driver developer may enable it for testing purpose Select Screen S Select Item Change Option F1 General Help F10 Save and Exit ESC Exit Microcode Update Enabled Secure Virtual Machine Mode Enabled PowerNow Enabled LSW e de e dee e dee eee e eee HR hehe e ehe e ehe e ehe e e hee e ee e eee eoe e hee hee eee e KKK KKK eoe e eoe e e e e e f n n n n n n G 2 3 5 3 BIOS Advanced Menu IDE Configuration Screen WS Geet rr IDE Configuration While entering setup ode e de d e d e d e e d e e e e e e AE BIOS auto detects the presence of IDE d devices This displays the status of auto E Hard Disk Write Protect Disabled detection of IDE IDE Detect Time Out Sec 35 devices ATA PI 80Pin Cable Detection Device SATA Controller 0
66. nitor might flicker but then it brings up a Video Test Options menu that enables you to perform various video tests Firmware ACPI Displays information about Advanced Configurable Power Interface ACPI and includes an ACPI Tests menu 3 6 3 Hard Disk Testing Use these tests to select and test a hard drive Before starting the test you can set the parameters using the Test Settings option 3 6 3 1 To Select and Test a Hard Drive 1 From the main menu choose Advanced Diagnostics Tests 2 From the Advanced Diagnostics Tests menu choose Hard Disks 3 From the Select Drive menu choose the hard disk that you need to test The Hard Disk Diagnostics dialog opens It displays information about the selected hard drive and the Hard Disk Tests menu which includes the following options m Select Drive m Test Settings m Read Test m Read Verify Test m Non Destructive Write Test m Destructive Write Test m Mechanics Stress Test m Internal Cache Test m SMART Immediate Test m View Error Log Chapter 3 Diagnostics Tools 3 13 6 Utilities Menu Exit Click Select Drive to select a hard drive to test Click Test Settings if desired to select options for that test This enables you to change the following parameters Number of Retries Selects the number of times to retry testing a device before terminating the test Maximum Errors Selects the number of errors allowed before terminating the test Check SMART First
67. nload or viewing online For example 820 xxxx XX Title Content Part Number Format Sun Blade X6240 Server Late breaking information 820 3972 PDF Module Product Notes about the server module HTML Sun Blade X6240 Server Basic installation information 820 3975 PDF Module Getting Started Guide for setting up the server Print module Sun Blade X6240 Server Detailed installation 820 3968 PDF Module Installation Guide information for setting up the HTML server module Print option Sun Blade X6240 Server Installation instructions for 820 3969 PDF Module Operating System the Solaris and Linux HTML Installation Guide operating systems Sun Blade X6240 Server Installation instructions for 820 3970 PDF Module Windows Operating the Windows Server HTML System Installation Guide operating system Sun Blade X6240 Server Information and procedures 820 3971 PDF Module Service Manual for maintaining and HTML upgrading the server module x64 Servers Utilities Reference Information for using 820 1120 PDF Manual applications and utilities HTML common to x64 servers and server modules Sun Integrated Lights Out ILOM features and tasks that 820 1188 PDF Manager 2 0 User s Guide are common to servers and HTML server modules that support ILOM Sun Blade X6240 Server Module Service Manual January 2010 Title Content Part Number Format Sun Integrated Lights Out ILOM information that is 820 3974 PDF Manager Suppleme
68. ns Ballistics Text Mode Positioning Text Mode Area Redefine Graphics Mode Positions Graphics Area Redefine and Graphics Cursor Redefine Video This section shows the following tests conducted against the video Color Purity Test True Color Test Alignment Test LCD Test and Test Cord Test ATAPI Devices This section shows the following tests conducted against ATAPI devices Linear Read Test Non Destructive Write and Random Read Write Test Hard Disk This section shows the following tests conducted against the hard disk Read Test Read Verify Test Non Destructive Write Test Destructive Write Test Mechanics Stress Test and Internal Cache Test USB This section shows the following tests conducted against the USB Controller Tests and Functional Tests Hardware ID The compare test is used to determine the machine ID for the system This test is not available for the Sun Print Results Report The Print Results Report option enables you to print results of the diagnosis of your system Ensure that your server is connected to a printer and then enter the required information to print the results Sun Blade X6240 Server Module Service Manual January 2010 3 6 8 About Pc Check The About Pc Check window includes general information about the Pc Check software including resident and nonresident components such as mouse devices 3 6 9 Exit The Exit option exits the Pc Check software and reboots the serve
69. nt for Sun specific to the server module HTML Blade X6240 Server Module Sun Blade X6240 Server Hardware safety and 820 4411 PDF Module Safety and Compliance compliance information for Manual the server module Important Safety Information Multilingual hardware safety 816 7190 Print for Sun Hardware Systems and compliance information for all Sun hardware systems Using UNIX Commands This document might not contain information about basic UNIX commands and procedures such as shutting down the system booting the system and configuring devices Refer to the following for that information m Software documentation that you received with your system m Solaris Operating System documentation which is at http docs sun com Preface xi Typographic ConventionsThird Party Typeface Meaning Examples AaBbCc123 The names of commands files Edit your Login file and directories on screen Use 1s a to list all files computer output You have mail AaBbCc123 What you type when contrasted su with on screen computer output password AaBbCc123 Book titles new words or terms Read Chapter 6 in the User s Guide words to be emphasized These are called class options Replace command line variables You must be superuser to do this with real names or values To delete a file type rm filename The settings on your browser might differ from these settings Web Sites Sun is not responsible f
70. nual e January 2010 4 3 4 3 4 3 5 4 3 5 1 Error Correction and Parity The AMD processor on the Sun Blade X6240 server module provides parity protection on its internal cache memories and error correcting code ECC protection of the data The system can detect and log to the system event log SEL the following types of errors m Correctable and uncorrectable memory ECC errors m Correctable and uncorrectable CPU internal errors m Faults in the chassis shared infrastructure including fan and power supply faults Advanced ECC corrects up to 4 bits in error on nibble boundaries as long as they are all in the same DRAM If a DRAM fails the DIMM continues to function Refer to the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1188 for more information on accessing the error log Adding or Replacing a RAID Expansion Module The REM RAID expansion module enables the RAID functionality The supports RAID 0 1 5 and 6 If you are adding a REM to a system you must have a set of SAS HDDs to replace the existing SATA HDDs This will effectively remove the operating system and any data from your system When a RAID expansion module is installed SAS drives can be installed in disk slots 0 through 3 These disks can be configured as RAID 0 1 5 or 6 as described in the Sun StorageTek RAID Manager Software User s Guide 820 1177 and the Uniform Command Line Interface User s Guide 820 2145 Caution Backup all
71. oot priority is 3 0 3 1 See the chassis documentation for further information on PCI EMs Ethernet Port Device and Driver Naming The Sun Blade X6240 server modules have up to two 10 100 1000BASE T Gigabit Ethernet ports provided by the network express modules NEMs installed in the chassis The lower NEM port is NET 0 and the upper NEM port is NET 1 as shown in FIGURE 2 2 If you have the Infiniband NEM installed only one Ethernet port per server module will be available Sun Blade X6240 Server Module Service Manual e January 2010 FIGURE 2 2 Ethernet Port Chassis Labeling Designations NET 0 See the chassis documentation for further information on NEMs The device naming for the Ethernet interfaces is reported differently by different interfaces and operating systems Refer to FIGURE 2 3 for a diagram that explains how various operating systems and interfaces name the two Ethernet ports shown in FIGURE 2 2 Note If you have an Infiniband NEM the Net 0 interfaces only are used FIGURE2 3 Sun Blade X6240 Server Module Ethernet Port Naming Net 1 Net 0 202 BIOS Solaris 10 Red Hat Linux SUSE Linux Windows 2003 2008 er Ethernet Port Booting Priority The order in which the BIOS detects the Ethernet ports during bootup and the corresponding drivers that control those ports are listed below 1 NET 0 INTEL NIC 0 2 NET 1 INTEL NIC 1 Chapter 2 Powering On and Configuring BIOS Settings 2 7
72. or button See TABLE 3 2 for internal LED behavior 3 4 Sun Blade X6240 Server Module Service Manual January 2010 TABLE 3 2 Internal LED Functions LED Name Description DIMM Fault LED This LED has two states The ejector levers on the Off DIMM is operating properly DIMM slots are the LEDs Lit amber The system has detected a fault with the DIMM CPU Fault LED This LED has two states on motherboard Off CPU is operating properly Lit amber The system has detected a fault with the CPU 3 9 949 4 BIOS POST The system BIOS provides a rudimentary power on self test POST The basic devices required for the server to operate are checked memory is tested the attached disks are probed and enumerated and the two dual gigabit Ethernet controllers are initialized The progress of the self test is indicated by a series of POST codes Refer to Appendix B for information on BIOS POST codes These codes are displayed at the bottom right corner of the system s VGA screen once the self test has progressed far enough to initialize the video monitor However the codes are displayed as the self test runs and they scroll off the screen too quickly to be read An alternate method of displaying the POST codes is to redirect the output of the console to a serial port see Section 3 3 2 Redirecting Console Output on page 3 6 The message BMC Responding is displayed at the end of the POST How BIOS
73. or the availability of third party web sites mentioned in this document Sun does not endorse and is not responsible or liable for any content advertising products or other materials that are available on or through such sites or resources Sun will not be responsible or liable for any actual or alleged damage or loss caused by or in connection with the use of or reliance on any such content goods or services that are available on or through such sites or resources Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions You can submit your comments by going to http www sun com hwdocs feedback Please include the title and part number of your document with your feedback Sun Blade X6240 Server Module Service Manual part number 820 3971 11 xii Sun Blade X6240 Server Module Service Manual January 2010 CHAPTER 1 Introduction to the Sun Blade X6240 Server Module This chapter contains an overview of the Sun Blade X6240 server module and contains the following topics m Section 1 1 Features of the Server Module on page 1 1 m Section 1 2 Sun Blade X6240 Server Module Orientation on page 1 2 m Section 1 3 Accessory Kits on page 1 6 m Section 14 Additional Options and Replaceable Components on page 1 6 1 1 Features of the Server Module The Sun Blade X6240 server module is a 1U server designed to fit into the Sun Blade 6000 and Sun Blade
74. panel into an empty slot to reduce the possibility of system shutdown 2 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 3 Remove the existing FEM board or the cap from the FEM connector if either is present The cap should only be present if you are adding a FEM board to a server module without one 4 Slide the FEM board at an angle into the support bracket then press it carefully into the connector See FIGURE 4 15 Installation is the reverse of this procedure Chapter 4 Maintaining the Sun Blade X6240 Servers 4 23 FIGURE 4 15 Inserting the FEM Board Sun Blade X6240 Server Module Service Manual January 2010 4 24 4 3 8 Replacing a CPU and Heatsink Note This component is a FRU and should be replaced only by qualified service technicians Contact your Sun service representative for assistance Follow these steps to remove and replace a CPU and its heatsink in a Sun Blade X6240 server module 1 Power off the server and remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Caution Do not operate the system with empty slots Always insert a filler panel into an empty slot to reduce the possibility of system shut down 2 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 3 Press the fault indicator button on the motherboar
75. r J16 on page 2 28 m Section 2 42 Resetting SP Password Using Jumper J19 on page 2 29 m Section 2 4 3 Recovering the SP Using Jumper J21 on page 2 30 FIGURE 2 5 shows the header pin locations on the Sun Blade X6240 server module that are referenced in the following procedures FIGURE 2 5 Header Pin Locations Chapter 2 Powering On and Configuring BIOS Settings 2 27 2 4 1 2 28 Using the Clear CMOS Jumper J16 You can use this jumper to clear the server s CMOS settings in the case of a system hang For example if the server hangs because of incorrect settings and does not boot use this jumper to invalidate the settings and reboot with defaults 1 Shut down the server to standby power mode Use a stylus or other pointed object to press and release the recessed Power button on the server module front panel See Section 2 2 Powering Off the Server on page 2 4 Caution Before handling components attach an ESD wrist strap to the grounding post that is built into the rear of the chassis The system s printed circuit boards and hard disk drives contain components that are extremely sensitive to static electricity Remove the server module from the chassis See Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Remove the main cover from the server See Section 4 2 2 Removing the Main Cover on page 4 4 Install the shorting jumper across the J16 header
76. r is off Service Action Required LED This LED has three states Off Normal operation Slow Blinking A new unacknowledged event requiring a service action has been detected On The event has been acknowledged but the problem still requires attention Power LED This LED has three states Off Server main power and standby power are off Standby Blinking Standby power is on but main power is off Slow Blinking POST or diagnostics are running On Server is in main power mode with power supplied to all components Hard Disk Drive Status LEDs The hard disk drives have three LEDs The order listed below is when the server module is installed in the chassis Power Fast blink means normal disk activity slow blink means RAID activity and off means power is off or no disk activity Service Action Required System has detected a hard disk fault This LED is controlled by the service processor Ready to Remove On indicates that the disk is ready to be removed hot swapped Off indicates that the disk is operating normally Chapter 3 Diagnostics Tools 3 3 3 2 2 Internal Status Indicator LEDs These servers have internal status indicator LEDs for the DIMM slots and the CPUs When the board is removed from the chassis you can press a fault indicator button to view the location of the DIMM or CPU that has failed FIGURE 3 2 Fault Indicator Button DIMM fault LEDs CPU fault LEDs Fault indicat
77. r module Chapter 3 Diagnostics Tools 3 19 3 20 Sun Blade X6240 Server Module Service Manual January 2010 CHAPTER 4 Maintaining the Sun Blade X6240 Servers This chapter contains information and procedures for servicing the Sun Blade X6240 server module hardware including component removal and replacement procedures The following topics are covered in this chapter 4 1 Section 4 1 Tools and Supplies Needed on page 4 1 Section 4 2 Removing the Server Module From the Chassis and Removing the Cover on page 4 2 Section 4 3 Replaceable Component Procedures on page 4 6 Section 4 4 Servicetool FRU Update Procedure on page 4 32 Tools and Supplies Needed You can service the server with the following items No 2 Phillips screwdriver Adjustable setting torque driver 5 20 in lbs Antistatic wrist strap Stylus or other pointed object to press the recessed Power button 4 1 4 2 Removing the Server Module From the Chassis and Removing the Cover Use the preparatory procedures in this section when you are referred to them from the removal and replacement procedures Caution Do not operate the system with empty slots Always insert a filler into an empty slot to reduce the possibility of system shut down 4 2 1 Removing the Server Module From the Chassis To replace components for the Sun Blade X6240 server module with the exception of the hard disk drives you need to re
78. reen e de e e e e eee ee eoe e ehe oe e hoe e ehe e e he e e hohe e eee e ehe eee ee hohe e EN LAN Configuration dee dede ee eee e eee ee eee ee he e e e e eoe e eh e e e e e d e n n n n n n n n n GG 8 ede e eee eee e ehe ee hehe e he e eee e ehe e ehe ehe ee hee e hehe ehe e e ee e ehe ee he e he e e he e e he e e e e e e n f B n An G Enter channel number for SET LAN Config Command Proper valve below 16 Select Screen 2x Select Item Enter Update F1 General Help F10 Save and Exit ESC Exit Sun Blade X6240 Server Module Service Manual January 2010 2 3 5 8 BIOS Advanced Menu IPMI PEF Configuration Screen yy e he e e e e e eee ehe ee hee e eee eee e hee ehe hee hehe ehe ee ee eoe eee ee he e eh e e he e he e e e e oe e d e e n f n n f n n n n G Set PEF Configuration Parameters Command Enable or Disable PEF deo dede de dede ee eoe ee eee ee e e e e e e e e e e e ee e e e e e e e e e e e e fe B B A n n E Es Support EN Select Screen S Select Item z E Change Option ct EI General Help 2 e F10 Save and Exit ESC Exit j deed ode ode oe eee oe oe eee oe ee e eoe e ee e e e e e e e he e he he he he e he e e e e he he e hh e he he e e e he hh e e e e e e e RRR RHEE
79. securing latch before you push the drive into the bay Push the HDD into the bay until it stops and then close the securing latch to fully engage the connector on the HDD backplane Replacing the System Battery Note This component is a CRU and can be replaced by anyone Use the following procedure to replace the server module system battery 1 Power off the server and remove the server module from the chassis as described in Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Caution Do not operate the system with empty slots Always insert a filler panel into an empty slot to reduce the possibility of system shut down 2 Remove the main cover as described in Section 4 2 2 Removing the Main Cover on page 4 4 3 If a RAID expansion module REM card is installed in the server module it must be removed before extracting the system battery For instructions see Section 4 3 5 Adding or Replacing a RAID Expansion Module on page 4 17 Note Before removing the system battery from its holder note the orientation polarity of the battery before it is removed The positive polarity marked with a Hua symbol should be facing upward Sun Blade X6240 Server Module Service Manual January 2010 4 Remove the system battery by gently pulling the clip away from the side of the battery and sliding the battery out of the battery holder See FIGURE 4 7 FIGURE 4 7 Removing th
80. side of transmit to hard drive S4 Gnd Second mate ground S5 RX Negative side of receive from hard drive S6 RX Positive side of receive from hard drive S7 Gnd Second mate ground Backside S8 Gnd Second mate ground duum S9 Not used S10 Not used S11 Gnd Second mate ground S12 Not used S13 Not used S14 Gnd Second mate ground Appendix C Connector Pinouts C 3 CA TABLE C 2 SAS SATA Connector Pins Continued Segment Pin Number Pin Name Description Power P1 3 3 V Not used GEES P2 33V Not used P3 33V Not used P4 Gnd First mate ground P5 Gnd Second mate ground P6 Gnd Second mate ground P7 5 0 V Pre charge second mate P8 5 0 V P9 5 0 V P10 Gnd Second mate ground P11 Reserved Should be grounded P12 Gnd First mate ground P13 12 0 V Pre charge second mate P14 12 0 V P15 12 0 V Sun Blade X6240 Server Module Service Manual January 2010 C 3 SAS Diskplane The SAS diskplane connector pins and their corresponding descriptions are shown in the figure and table in this section FIGURE C 3 SAS Diskplane Signal Connector Pin 7 TABLEC 3 SAS Disk Backplane Signal Connector Pins Pin Number Signal Name 1 4 7 GND 2 3 TX TX 5 6 RX RX Appendix C Connector Pinouts C 5 C 4 SAS Power LED Connector The SAS power LED connector pins and their corresponding descriptions are shown in the figure and table in this section FIGURE CA SAS Power LED Connector 10 6 o o oO o o o o BH 5 1
81. splay information about 3 12 tests against 3 18 audio devices testing 3 13 available options 1 6 B battery replacement 4 10 BIOS changing menu settings 2 5 configuring 2 5 Ethernet port booting priority 2 7 menu tree 2 9 Option ROM size 2 8 overview 2 5 PCI ExpressModule slot priority 2 6 POST code checkpoints B 1 redirecting console output for POST 3 6 setup screens summary 2 8 special considerations 2 6 updating 2 31 Boot Menu BIOS screen 2 8 burn in testing 3 10 C cache testing 3 14 CD ROM DVD 3 12 Chipset Menu BIOS screen 2 8 Clear CMOS jumper 2 28 comments and suggestions xii Compact Flash connector pinouts C 7 component information through ILOM 3 1 replacement procedures 4 6 configuring BIOS 2 5 connector pinouts Compact Flash C 7 front dongle C 2 SAS connectors C 3 SAS diskplane C 5 SAS LED C 6 SAS power C 6 console output redirecting 3 6 CPU fault indicator button 4 26 fault LED 3 5 replacement 4 25 D data loss 3 14 Destructive Write Test running 3 14 diagnostic tools BIOS POST 3 5 external LEDs 3 2 Index 1 hardware debug tool HDT 3 7 internal LEDs 3 4 service processor SP ILOM 3 1 diagnostics advanced diagnostics option 3 11 hard drive testing 3 13 main menu options 3 8 Pc Check information viewing 3 19 print results reports option 3 18 show results summary option 3 17 shut down option 3 19 system information
82. ssing HDT 3 7 3 4 3 HDT Commands 3 8 Pc Check Diagnostics Overview 3 8 3 5 1 Accessing Pc Check Diagnostics 3 9 Contents v 3 6 Pc Check Menus 3 10 3 6 1 System Information Menu 3 10 3 6 2 Advanced Diagnostics 3 11 3 6 3 Hard Disk Testing 3 13 3 6 3 1 To Select and Test a Hard Drive 3 13 3 6 4 Burn In Testing 3 14 3 6 4 1 Performing Immediate Burn In Testing 3 15 3 6 4 2 Performing Deferred Burn In Testing 3 16 3 65 Diagnostic Partition 3 17 3 6 6 Show Results Summary 3 17 3 6 7 Print Results Report 3 18 3 6 8 About Pc Check 3 19 3 6 9 Exit 3 19 4 Maintaining the Sun Blade X6240 Servers 4 1 4 1 Tools and Supplies Needed 4 1 42 Removing the Server Module From the Chassis and Removing the Cover 4 2 42 1 Removing the Server Module From the Chassis 4 2 4 2 2 Removing the Main Cover 4 4 43 Replaceable Component Procedures 4 6 43 1 Replacing a Hard Disk Drive 4 7 4 3 2 Replacing the System Battery 4 10 43 3 Replacing the Compact Flash Module 4 11 4 3 4 Replacing Memory Modules DIMMs 4 12 4 3 4 1 DIMM Population Rules 4 12 4 3 4 2 Replacing a DIMM 4 13 4 3 4 3 Error Correction and Parity 4 17 4 3 5 Adding or Replacing a RAID Expansion Module 4 17 vi Sun Blade X6240 Server Module Service Manual January 2010 4 3 5 1 Adding or Removing and Replacing a REM 4 17 4 3 6 Changing the REM Battery 4 21 4 3 7 Adding or Replacing a Fabric Expansion Module 4 23 4 3 7 1 Adding or Removing and Replacing a FEM 4 23 4 3 8 Rep
83. stname tst where testname is the name of the script that you have created 4 To change any of the options at the bottom of the screen select Change Options This opens the Burn In Options menu which enables you to modify the options listed in TABLE 3 5 for the currently loaded test script 5 Select Perform Burn In Tests The diagnostics software executes the test script as configured Chapter 3 Diagnostics Tools 3 15 3 6 4 2 3 16 TABLE 3 5 Continuous Burn In Testing Options Option Default General Default Using quick tst noinput tst Or full tst Script All Possible Choices Pass Control Duration Script File Report File Journal File Journal Options Pause on Error Screen Display POST Card Beep Codes Maximum Fails Overall Time 01 00 N A None None Failed Tests N Control Panel N N Disabled Overall Passes quick tst noinput tst or full tst None D noinput jrl D Nquick jrl or D full jrl All Tests Absent Devices and Test Summary N Control Panel N N Disabled Individual Passes Overall Passes or Overall Time Enter any number to choose the time duration of the test quick tst noiniput tst or full tst User defined User defined Failed Tests All Tests Absent Devices and Test Summary YorN Control Panel or Running Tests YorN YorN 1 9999 Performing Deferred Burn In Testing Use Deferred Burn In
84. stop and do not time out These tests are faster than the full tst but they are less thorough For example they do not run all the tests associated with a DIMM m noinput tst This script performs a non detailed test of most hardware components excluding those components that require user input keyboard mouse sound and video This test does not require user input It is normally the first test performed for hardware related problems m full tst This script performs a detailed and comprehensive test on all hardware components including those that require user input It includes external port tests and requires loopback connectors on COM ports parallel ports and USB ports You must interact with the test utility to progress through these interactive tests Tip Each of these scripts tests the operating status of your entire system To test specific disk drives independently of the rest of the system use the procedures in Section 3 6 3 Hard Disk Testing on page 3 13 Performing Immediate Burn In Testing Use Immediate Burn In Testing to run test scripts 1 From the Diagnostics main menu select Immediate Burn In Testing The screen displays a list of settings shown in TABLE 3 5 and a Burn In menu 2 From the Burn In menu select Load Burn In Script A text box appears 3 Type the name of the script you want to run m quick tst noinput tst or full tst m If you have created and saved your own script type d Me
85. tem will finish booting from the USB flash drive Open a terminal window and type the following command to reflash the server module SP socflash exe f spnmnnnn bin The server module SP firmware is reflashed Repeat Steps 3 through 8 to remove the J21 header pins jumper Remove the jumper in Step 6 rather than inserting it Updating the BIOS The BIOS is updated whenever you update the ILOM service processor firmware For instructions on updating the firmware refer to the Sun Integrated Lights Out Manager 2 0 User s Guide 820 1188 Chapter 2 Powering On and Configuring BIOS Settings 2 31 2 6 Power On Self Test POST For information about BIOS POST POST codes POST code checkpoints and console redirection see Appendix B 2 32 Sun Blade X6240 Server Module Service Manual January 2010 CHAPTER 3 Diagnostics Tools This chapter contains information about diagnostic tools that you can use to determine the status of the Sun Blade X6240 server module and components This chapter contains the following topics ad Section 3 1 Service Processor ILOM on page 3 1 Section 3 2 System Status LEDs on page 3 2 Section 3 3 BIOS POST on page 3 5 Section 3 4 Hardware Debug Tool HDT on page 3 7 Section 3 5 Pc Check Diagnostics Overview on page 3 8 Service Processor ILOM The following component information is available through the service processor SP Integrated Lights Out Mana
86. tion DIMM fault LEDs CPU fault LEDs Fault indicator button 4 Locate the DIMM slot on the motherboard into which you plan to install or replace a DIMM The DIMM ejector levers contain LEDs that can indicate a faulty DIMM a DIMM ejector LED is off DIMM is operating properly a DIMM ejector LED is on amber DIMM is faulty and should be replaced 4 14 Sun Blade X6240 Server Module Service Manual e January 2010 FIGURE 4 10 Sun Blade X6240 Server Module DIMM Slot Numbering and Pairing He REES E 72 o3 D3 be 5 Before continuing with the next step review the guidelines in Section 4 3 4 1 DIMM Population Rules on page 4 12 6 To remove a DIMM a Rotate both DIMM slot ejectors outward as far as they will go The DIMM is partially ejected from the socket See FIGURE 4 11 b Carefully lift the DIMM straight up to remove it from the socket Chapter 4 Maintaining the Sun Blade X6240 Servers 4 15 FIGURE 4 11 Removing a DIMM a 4 7 To install a DIMM a Ensure that the DIMM slot ejectors at each end of the memory socket are fully open rotated outward to accept the new DIMM b Align the notch in the bottom edge of the DIMM with the key in the DIMM socket See FIGURE 4 11 c Press down evenly on both top corners of the DIMM until the ejectors snap over the cutouts in the left and right edges of the DIMM 4 16 Sun Blade X6240 Server Module Service Ma
87. to SAS3 FIGURE 4 13 shows the HDD backplane to motherboard cables FIGURE 4 13 HDD Backplane Connectors HDD 1 3 DU p HDD 0 2 O HDD backplane Motherboard HDD 0 1 SAS 0 HDD 0 1 SATA 0 HDD 2 3 SAS 2 HDD 2 3 SATA 2 HDD 0 1 SAS 1 HDD 0 1 SATA 1 HDD 2 3 SAS 3 HDD 2 3 SATA 3 4 20 Sun Blade X6240 Server Module Service Manual January 2010 4 3 6 9 Place the new SAS drives in the disk drive bays See Section 4 3 1 Replacing a Hard Disk Drive on page 4 7 Unless you have preloaded software on the SAS drives your server will not have an operating system or any data You will need to restore your data from backups and install the operating system m To install the Solaris Operating System or Linux Operating System see the Sun Blade X6240 Server Module Operating System Installation Guide 820 3969 m To install the Windows Operating System see the Sun Blade X6240 Server Module Windows Operating System Installation Guide 820 3970 Changing the REM Battery The REM battery used with board model 4620A should be replaced when indicated in the Sun StorageTek RAID Manager Software User s Guide 820 1177 Caution Follow the instructions in this section to ensure that the REM battery is properly installed Proper installation is required to ensure adequate cooling of the battery Note This component is a CRU and can be replaced by anyone Use the following procedure to c
88. ts attach an ESD wrist strap to the grounding hard disk drives contain components that are extremely sensitive to static electricity 2 30 Sun Blade X6240 Server Module Service Manual January 2010 10 11 12 13 14 15 20 Remove the server module from the chassis See Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 Remove the main cover from the server See Section 4 2 2 Removing the Main Cover on page 4 4 Install the shorting jumper across the J21 header pins See FIGURE 2 5 for the header pin location Reinstall the main cover to the server Reinstall the server module into the server See Section 4 2 1 Removing the Server Module From the Chassis on page 4 2 The server powers up to standby power mode indicated when the blue Read to Remove LED on the server module front panel is illuminated Attach a dongle cable to the server module universal connection port UCP See FIGURE 1 2 for information on the dongle cable connection Insert the bootable USB flash drive into a dongle cable USB connector Return the server to main power mode Use a stylus or other pointed object to press and release the recessed Power button on the server module front panel During system boot you will receive a BMC not responding message When you receive this message press F8 Select the USB flash drive as the boot device and click Enter to continue The sys
89. ts are the output from primary I O port 80 TABLE B 1 POST Code Checkpoints Post Code Description 03 Disable NMI Parity video for EGA and DMA controllers Initialize BIOS POST Runtime data area Also initialize BIOS modules on POST entry and GPNV area Initialize CMOS as mentioned in the Kernel Variable wCMOSFlags 04 Check the CMOS diagnostic byte to determine if battery power is OK and the CMOS checksum is OK Verify that CMOS checksum manually by reading storage area If the CMOS checksum is bad update CMOS with power on default values and clear passwords Initialize status register A Initializes data variables that are based on CMOS setup questions Initializes both the 8259 compatible PICs in the system 05 Initializes the interrupt controlling hardware generally PIC and interrupt vector table 06 Do R W test to CH 2 count reg Initialize CH 0 as system timer Install the POSTINTICh handler Enable IRQ 0 in PIC for system timer interrupt Traps INT1Ch vector to POSTINT1ChHandlerBlock 07 Fixes CPU POST interface calling pointer 08 Initializes the CPU The BAT test is being done on KBC Program the keyboard controller command byte is being doen after Auto detection of KB MS using AMI KB 5 TABLE B 1 POST Code Checkpoints Continued Post Code Description CU Early CPU Init Start Disable Cache Init Local APIC C1 Set up boot strap processor information C2 Set up boot strap processor for POST C5 En
90. umerate and set up application processors C6 Re enables cache for boot strap processor C7 Early CPU Init Exit 0A Initializes the 8042 compatible Keyboard Controller OB Detects the presence of PS 2 mouse 0C Detects the presence of Keyboard in KBC port OE Testing and initialization of different input devices Also update the kernel variables Traps the INTO9h vector so that the POST INTO9h handler gets control for IRQ1 Decompress all available language BIOS logo and Silent logo modules 13 Early POST initialization of chipset registers 20 Relocate System Management Interrupt vector for all CPUs in the system 24 Decompresses and initializes any platform specific BIOS modules GNPV is initialized at this checkpoint 2A Initializes different devices through DIM 2C Initializes different devices Detects and initializes the video adapter installed in the system that have optional ROMs 2E Initializes all the output devices 31 Allocates memory for ADM module and decompresses it Gives control to ADM module for initialization Initializes language and font modules for ADM Activates ADM module 33 Initializes the silent boot module Sets the window for displaying text information 37 Displays sign on message CPU information setup key message and any OEM specific information 38 Initializes different devices through DIM USB controllers are initialized at this point 39 Initializes DMAC 1 and DMAC 2 3A Initializes RTC date ti
91. which is used by Sun Field Service for debugging activities at the request of Sun Service personnel Chapter 1 Introduction to the Sun Blade X6240 Server Module 1 3 FIGURE 1 2 shows how to attach a dongle cable to the Sun Blade X6240 server module universal connection port UCP The dongle cable provides the following I O connections for the server VGA graphics serial console to the server module service processor and dual USB connectors for keyboard mouse connections FIGURE 1 2 Attaching a Dongle Cable to the Server VGA connector RJ 45 serial connector USB connectors Caution The dongle cable should be used only for configuration and service purposes It should be disconnected from the server module when the configuration or servicing operation is completed If you have a dongle cable connected to a server module it must be removed before closing the door of a rack cabinet The dongle cable may be damaged if it is not removed before the cabinet door is closed Sun Blade X6240 Server Module Service Manual January 2010 Midplane connector Es REM Board FEM Board Compact Flash below CPUs and heatsinks 2 REM Battery System Battery Hard drives 4 DIMMs up to 8 for each CPU Chapter 1 Introduction to the Sun Blade X6240 Server Module 1 5 1 3 Accessory Kits TABLE 1 2 lists the contents of the accessory kit an option that you can order with the server module TABLE 1 2 Ac

Sun Blade X6240 Server Module Service Manual

Contents

Download Pdf Manuals

Related Search

Related Contents