Home

Supermicro 6026TT-HDIBQRF

1. Dedicated IPMI LAN Port Dedicated IPMI LAN Port LAN Ports PCI Express x16 Slot Power Supply LAN Ports PCI Express x16 Slot m SJL m a EI LES fi EE dn EAT E mum amp i SOLU ES ex LIE 1 JR ICLZNDE UA UA TO a ii m o f e je mm 9 dom mi L REO 7 i BICI EIL D E3 Sime o uw us o Vv USB Ports COM Port VGA Port InfiniBand Port USB Ports COM Port VGA Port InfiniBand Port The InfiniBand ports are included on the 6026TT B6IBXRF and 6026TT B6IBQRF only 6 2 Control Panel Each control panel on the front of the chassis must be connected to the JF1 connector on its associated serverboard to provide you with system control buttons and status indicators These wires have been bundled together in a ribbon cable to simplify the connection Pull all excess cabling out of the airflow path The LEDs inform you of system status for the serverboard it is connected to See Chapter 3 for details on the LEDs and the control panel buttons 6 3 System Fans The system has four hot swappable 8 cm PWM fans to provide the cooling for all four nodes The fans connect directly to the backplane but receive their power fro
2. js d B b P wt so ob db d Bae co d JSPK El p Poega h InfinBand o i P Connector IPMI LAN j q p PHY q InfiniBand Winbond 23 5 a CTRL WPCM450 m sm HE p randum ag v sco S e Oo JPCB0 m g EEG glee o di Ei a S CLEAR h CMOS 5 Intel ICH10R x South Bridge BIOS E Intel 5520 IOH 36D Battery o Lol JBATI SUPER hal ballad adel o o v v v v v v NIIRI RIRIS gll o eleje EEE EAE SEIRE SSS SSS CPU2 gt OI gt wi gt o o O ro re re ro LoJLotLojLotLotLot 85 Cb zl z oo Eit o o o 2 Sole oog o e CUN 3 z z s 2 2 CPU1 sg sis s s s zzlgzj s sz s HHHH glll S S 5 gt gt o gt oi o O O Lo ILo lo JLo Lo JLo LE1 LE3 Note Jumpers not indicated are for test purposes only Not all connectors jumpers and other components are present in all serverboard versions 5 12 Chapter 5 Advanced Serverboard Setup X8DTT HEF HIBXF HIBQF Quick Reference Jumper JBT1 JPG1 JPL1 JPL2 JWD1 Connector FAN 1 InfiniBand IPMB JF2 JNMI1 JRST1 JSPK1 LAN1 2 LAN IPMI dedicated Slot 1 swi USB 0 1 USB 2 3 JUSB2 VGA LED LET LE2 LES LE4 LEB1 Description Default Setting CMOS Clear See Section 5 8 VGA Enable Disable Pins 1 2 Enabled LAN1 2 Enable Disable Pins 1 2 Enabled Watch Dog Enable Disable Reset Pins 1 2 Reset Description
3. Select Enable to enable the hot plug function for the SATA devices The options are Enabled and Disabled SATA 2 Configuration Selecting Enhanced will set SATA 2 to native SATA mode The options are Disabled and Enhanced Primary IDE Master Slave Secondary IDE Master Slave Third IDE Master and Fourth IDE Master These settings allow the user to set the parameters of Primary IDE Master Slave Secondary IDE Master Slave Third and Fourth IDE Master slots Hit lt Enter gt to activate the following submenu screen for detailed options of these items Set the correct configurations accordingly The items included in the submenu are Type Select the type of device connected to the system The options are Not Installed Auto CD DVD and ARMD LBA Large Mode LBA Logical Block Addressing is a method of addressing data on a disk drive In the LBA mode the maximum drive capacity is 137 GB For drive capacities over 137 GB your system must be equipped with a 48 bit LBA mode addressing If not contact your manufacturer or install an ATA 133 IDE controller card that supports 48 bit LBA mode The options are Disabled and Auto Block Multi Sector Transfer Block Mode boosts the IDE drive performance by increasing the amount of data transferred Only 512 bytes of data can be transferred per interrupt if Block Mode is not used Block Mode allows transfers of up to 64 KB per interrupt Select Disabled to allow data to be transferred from an
4. Cooling Fan Header InfiniBand Connector X8DTT HIBXF HIBQF only IPMB Header for an IPMI Card SMC Proprietary Slot for Power FP Control amp I SATA Connections NMI Non Maskable Interrupt Header System Reset Header Internal Speaker Buzzer Header Gigabit Ethernet RJ45 Ports LAN RJ45 Port for IPMI 2 0 PCI E 2 0 x16 slot Unit Identifier Switch Universal Serial Bus USB Ports 0 1 Front Accessible USB connections Video Port Description Onboard Standby PWR warning LED Indicator BMC Heartbeat LED Indicator HDD SATA LED Indicator Rear Unit Identifier UID LED Indicator InfiniBand Link LED X8DTT HIBXF HIBQF only Note Jumpers not indicated are for test purposes only 5 13 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 8 Connector Definitions Front Panel Accessible Add on Card Header JF2 The JF2 add on card header provides front access to the power supply Serial ATA and Front Panel Control connections for the X8DTT H Series motherboard Plug an Add On card into this header to use the functions indicated above This header is designed specifically for a hot plug 2U daughter card NMI Header NMI Button Pin Definitions The non maskable interrupt header is located at JNMI1 Refer to the table on the Pim Definition right for pin definitions 1 Control 2 Ground Internal Buzzer Internal Buzzer The Internal Buzzer located at JSPK1 can Pin Definitions
5. JBT1 is used to clear CMOS which will also clear any passwords Instead of pins this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS To Clear CMOS 1 First power down the system and unplug the power cord s 2 With the power disconnected short the CMOS pads with a metal object such as a small screwdriver 3 Remove the screwdriver or shorting device 4 Reconnect the power cord s and power on the system Note Do not use the PW ON connector to clear CMOS Watch Dog Enable Disable Watch Dog JWD1 enables the Watch Dog function a Jumper Settings system monitor that takes action when a Jumper Setting Definition software application freezes the system posia Reset Jumping pins 1 2 will have Watch Dog reboot Pus Nui the system if a program freezes Jumping Open Disabled pins 2 3 will generate a non maskable N te When WatchDog ie enabied va interrupt for the program that has frozen must write your own application software s F to disable the Watch Dog Timer See the table on the right for jumper settings Watch Dog must also be enabled in BIOS 5 18 Chapter 5 Advanced Serverboard Setup LAN1 LAN2 Enable Disable Change the setting of jumper JPL1 JPL2 to enable or disable the LAN1 and LAN2 ports respectively See the table on the right for jumper settings The default setting is enabled VGA Enable Disable JPG1 allows you to enable or disable
6. SUPER SuperServer 6026TT H6RF 6026TT H6IBXRF 6026TT H6IBQRF On Firs DEE felle USER S MANUAL Revision 1 0 The information in this User s Manual has been carefully reviewed and is believed to be accurate The vendor assumes no responsibility for any inaccuracies that may be contained in this document makes no commitment to update or to keep current the information in this manual or to notify any person or organization of the updates Please Note For the most up to date version of this manual please see our web site at www supermicro com Super Micro Computer Inc Supermicro reserves the right to make changes to the product described in this manual at any time and without notice This product including software and documentation is the property of Supermicro and or its licensors and is supplied only under a license Any use or reproduction of this product is not allowed except as expressly permitted by the terms of said license IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT INDIRECT SPECIAL INCIDENTAL SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES IN PARTICULAR SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY HARDWARE SOFTWARE OR DATA STORED OR USED WITH THE PRODUCT INCLUDING THE COSTS OF REPAIRING REPLACING INTEGRATING
7. Weight Gross Weight 85 Ibs 38 6 kg System Cooling Four 8 cm PWM Pulse Width Modulated fans System Input Requirements AC Input Voltage 100 240V AC auto range Rated Input Current 10 5 14 7 1200W 9 5 7 2A max 1400W Rated Input Frequency 50 to 60 Hz Power Supply Rated Output Power 1400W Part PWS 1K41P 1R 80 Plus Gold Certified Rated Output Voltages 12V 100A 9 100 140V 117A 180 240V 5Vsb 6A Note The SuperServer 6026TT H6RF 6026TT H6IBXRF and 6026TT H6IBQRF servers all come with a redundant power supply Operating Environment Operating Temperature 10 to 35 C 50 to 95 F Non operating Temperature 40 to 70 C 40 to 158 F Operating Relative Humidity 896 to 9096 non condensing Non operating Relative Humidity 5 to 95 non condensing C 2 Appendix C System Specifications Regulatory Compliance Electromagnetic Emissions FCC Class A EN 55022 Class A EN 61000 3 2 3 3 CISPR 22 Class A Electromagnetic Immunity EN 55024 CISPR 24 EN 61000 4 2 EN 61000 4 3 EN 61000 4 4 EN 61000 4 5 EN 61000 4 6 EN 61000 4 8 EN 61000 4 11 Safety CSA EN IEC UL 60950 1 Compliant UL or CSA Listed USA and Canada CE Marking Europe California Best Management Practices Regulations for Perchlorate Materials This Perchlorate warning applies only to products containing CR Manganese Dioxide Lithium coin cells Perchlorate Material special handling may apply See www dtsc ca go
8. INSTALLING OR RECOVERING SUCH HARDWARE SOFTWARE OR DATA Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California USA The State of California County of Santa Clara shall be the exclusive venue for the resolution of any such disputes Super Micro s total liability for all claims will not exceed the price paid for the hardware product Statement This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the manufacturer s instruction manual may cause harmful interference with radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be required to correct the interference at your own expense California Best Management Practices Regulations for Perchlorate Materials This Perchlorate warning applies only to products containing CR Manganese Dioxide Lithium coin cells Perchlorate Material special handling may apply See www dtsc ca gov hazardouswaste perchlorate WARNING Handling of lead solder materials used in this product may expose you to lead
9. In the 2U Twin server the serverboards nodes are capable of being hot swapped from the chassis allowing one to be powered down for servicing while the others continue operating Important Removing a node from the server affects the airflow serviced and replaced as quickly as possible Also note that powering throughout the system For this reason nodes should be removed down a node will power down all the hard drives that are logically associated with it Removing a Node 1 Depress the power button on the control panel to power down the node There are two latches located below the handles at the rear of the node tray Push both of these inward While pushing the latches inward grasp both handles and pull the node from the chassis Perform any service needed to the node in a timely manner Reinstall the node by pushing it into its bay until firmly seated 6 7 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Figure 6 7 Removing a System Node 6 8 Chapter 6 Advanced Chassis Setup 6 6 Installing the Air Shrouds Air Shrouds Air shrouds concentrate airflow to maximize fan efficiency The SC827 chassis air shroud does not require screws to set up Four identical air shrouds are required one in each serverboard drawer Installing an Air Shroud 1 Confirm that all four fans are in place and working properly 2 Place the first air shroud into the serverboard drawer The air shroud s
10. Memory Each X8DTT HEF HIBXF HIBQF has twelve DIMM sockets that can support up to 192 GB of registered ECC DDR3 1333 1066 800 SDRAM or 48 GB of Unbuffered ECC Non ECC 1333 1066 800 MHz Memory with max 4 GB of Registered ECC and 2 GB of Unbuffered memory per DIMM slot for a maximum of 192 GB for the system See Chapter 5 Section 6 for more details on installing memory into the system Serial ATA The South Bridge ICH10R of the chipset includes a Serial ATA controller for six Gb s SATA drives The hot swappable SATA drives are connected to a backplane that provides power bus termination and configuration settings RAID 0 1 10 and 5 are supported Refer to the support area of our web site for procedures on setting up RAID on your system PCI Expansion Slots Each X8DTT HEF HIBXF HIBQF board has one PCI Express 2 0 x16 slot so four PCI Express 2 0 x16 slots for low profile expansion cards are provided in the server In the SYS 6026TT H6RF H6IBXRF H6IBQRF server configuration riser cards have been pre installed to support low profile add on cards Chapter 1 Introduction Ethernet Ports An Intel network controller is integrated into each of the serverboards to support two Gigabit LAN ports 100 1000Base T 1000BaseTX RJ45 output Onboard Controllers Ports Onboard I O backpanel ports on each serverboard include one COM port a VGA port two USB ports a dedicated IPMI LAN port and two Gigabit LAN NIC ports An Inf
11. environment compatible with the manufacturer s maximum rated ambient tempera ture Tmra Reduced Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading Circuit Overloading Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring Appropriate consideration of equipment nameplate ratings should be used when addressing this concern Reliable Ground A reliable ground must be maintained at all times To ensure this the rack itself should be grounded Particular attention should be given to power supply connec tions other than the direct connections to the branch circuit i e the use of power strips etc 2 3 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Removing the Protective Film Before operating the 6026TT server for the first time it is important to remove the protective film covering the top of the chassis in order to allow for proper ventila tion and cooling Removing the Protective Film 1 Peel off the protective film covering the top cover and the top of the chassis 2 Check that all ventilation openings on the top cover and the to
12. DR QR Note 1 1333 1066 QR RDIMMs MHz will run at 800 MHz BIOS automatic downgrading Note 2 1333 SR DR RDIMMs MHz will run at 800 MHz BIOS automatic downgrading Note 3 1333 SR DR QR RDIMMs MHz will run at 800 MHz BIOS automatic downgrading Note 4 Mixing of 1 35V and 1 5V DIMMs is not recommended 1 35V UDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Unb Speeds in MHz Ranks per DIMM Slots per Populated Unbuffered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank 2 1 Unb DDR3 ECC 800 1066 1333 SR or DR 2 2 Unb DDR3 ECC 800 1066 Mixing SR DR Note 1 1333 MHz for two DIMMs per channel is supported when Unbuf ECC DIMMs are used Note 2 Mixing of 1 35V and 1 5V DIMMs is not recommended 5 10 Chapter 5 Advanced Serverboard Setup Due to the memory allocation to system devices the amount of memory that remains available for operational use will be reduced when 4 GB of RAM is used The reduction in memory availability is disproportional Refer to the table below Possible System Memory Allocation amp Availability System Device Size Physical Memory Remaining Physical Memory Remaining Available Available 3 GB Total System Memory 4 GB Total System Memory Firmware Hub 1 MB 3 00 3 99 flash memory System BIOS Local APIC 4KB 3 00 3 99 Area Reserved 2MB 3 00 3 99 for the chipset l O APIC 4 4KB 3 0
13. be used to provide audible alarms for various beep codes See the table on the right for Pin Pos Beep In pin definitions Pin 2 Neg Alarm Speaker Pin Definitions SP1 DEEP IN ril peers 2 ALARM SPI NEG IPMB I2C SMB SMB Header A System Management Bus header for the FInBeInIHopS IPMI slot is located at IPMB Connect the Ping Definition appropriate cable here to use the IPMB 12C 1 Data connection on your system See the table on 2 the right for pin definitions 3 Clock 4 No Connection Ground Video Connector A Video VGA connector is located next to the COM Port on the IO backplane This connector is used to provide video and CRT display 5 14 Chapter 5 Advanced Serverboard Setup Fan Header Fan Header The X8DTT H series motherboard has Pin Definitions one fan header on the motherboard This Pine _ Delinition 1 Ground 4 pin header is backward compatible with traditional 3 pin fans however fan speed e control is only available for 4 pin fans 3 Tachometer The fan speeds are controlled by Thermal 4 PWR Modulation Management via Hardware Monitoring in the Advanced Setting in the BIOS The default setting is disabled See the table on the right for pin definitions 412V Universal Serial Bus USB Back Panel USBO 1 Two Universal Serial Bus ports USBO 1 are TAG GREAT located on the I O back panel In addit
14. faster than that of the traditional Parallel ATA SAS Connections SAS is supported on the 6026TT H series of servers only with the addition of the installed internal BPN ADP SAS2 H6IR backpane These backpanes include an LSI 2108 SAS controller for SAS support 5 21 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 12 Installing Additional Drivers After you ve installed the Windows Operating System a screen as shown below will appear You are ready to install software programs and drivers that have not yet been installed To install these software programs and drivers click the icons to the right of these items S SUPERMICRO X8DTT IBX Motherboard Drivers amp Tools WinXP x Intel Tylersburg Chipset INF files SUPERMICR Drivers amp Tools Matrox G200e Graphics Driver Intel 5520 Chipset X8DTT IBX Intel Matrix Storage Manager Adaptec Storage Manager Intel PRO Network Connections Drivers Mellanox InfiniBand Driver SUPERMICRO Supero Doctor III SUPERMICRO Computer Inc Build driver diskettes and manuals Browse CD J Auto Start Up Next Time For more information please visit SUPERMICRO s web site Driver Tool Installation Display Screen Note Click the icons showing a hand writing on the paper to view the readme files for each item Click a computer icon to the right of an item to install an item from top to the bottom one at a time After installing each item you must
15. nimi rrr rero eH Ere PERCHE EHEEH ERE 2 5 Checking the Serverboard Setup sseeeeeeeeneenenn 2 6 Preparing to POWE ON eicere iret rrt e edi eet teli o Chapter 3 System Interface 3 1 Overview 39 27 Gontrol Panel BUttOns nne ni m eere eene eter ceat i 3 1 a ge 3 1 E p EN 3 1 3 9 Control Panel MEDS sos cece cs torre rre RE RR SEX PER rti pd dee 3 2 Overtieat Fan Fall etri N E EER 3 2 jo 3 2 3 4 SATA Drive Carri n LDEDS ore e ette e a ees 3 2 Chapter 4 System Safety 4 1 Electrical Safety Precautions eessseeeeeeenneneene 4 1 4 2 General Safety Preca tions eerie eee ens 4 2 4 3 ESD Precautions ysis osse rar ox sie ege sepe SERI OR agis 4 3 44 Operalirig Pr cautioris rot iere e der rhe e EO ades 4 4 Chapter 5 Advanced Serverboard Setup 5 1 Handling the Serverboard cesceseeceeseeeseeesceeseeeaeeeaeeeeeeseesaeeeaetsaeeeaeeeeaes 5 1 Precautions Unpacking EE 5 2 Serverboard Installation 2 eei ce eee a see W O POMS e CREI P 5 4 Processor and Heatsink Installation Installing ECIA 1366 PrOCOSSOTS ettet nter ntn Installing CPU Heatsink oett tt eee Removing theXeatsimniea serre rote ete ri ein epe teet eter tainen 5 5 Installing Memory orm mn trt terrere tern 5 6 Adding POL Cards eee iere eben ee
16. pel 5 pe LOPLN EN amp EN amp m 1 L3 __ PROCESSOR 0 N V PROCESSOR e TE e E E RE 8 re B8 re my B EN B Intel LN MT25408 82574 Ve QSFP Connect X IB PCI E Gen2 DDR or QDR For 36D Only 1OH 5520 5500 Intel LN 36 D 24 D 82574 miz PCFE yr x16 Slot NT LHN AT25 spiv DF321 ICH10R SEI IE SATA PCI ipo Hotswap Connector z AN BMC VGA LPCIO W83527 B Nu RMU VGA CONN RTL8201N PHY Dedicated LAN Figure 1 1 Intel 5520 Chipset System Block Diagram Note1 This is a general block diagram Please see Chapter 5 for details Note2 The Intel 5500 IOH 24D chipset is available for OEM only 1 4 Chapter 1 Introduction 1 3 Server Chassis Features The following is a general outline of the main features of the SC827HQ R1400B 2U chassis Details on the chassis can be found in Chapter 6 System Power When configured as a SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF the SC827HQ R1400B includes a single 1400W power supply which provides power to all four serverboards nodes An additional 1400W power supply module not included may be installed to provide redundant power for the SYS 6026TT H6RF H6IBXRF H6IBQRF models SATA Subsystem The SC827HQ R1400B chassis was designed to support twelve SATA hard drives which are hot swappable units There are three hard drives per node in the system Control Panel The SC827HQ R1400B features four independant control panels as
17. power off and restart the system for the change to take effect Please refer to Intel s web site for detailed information Execute Disable Bit Capability Available when supported by the OS and the CPU Set to Enabled to enable the Execute Disable Bit which will allow the processor to designate areas in the system memory where an application code can execute and where it cannot thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor or damage the system during an attack The default is Enabled Refer to Intel and Microsoft Web Sites for more information Simultaneous Multi Threading Available when supported by the CPU Set to Enabled to use the Simultaneous Multi Threading Technology which will result in increased CPU performance The options are Disabled and Enabled Active Processor Cores Set to Enabled to use a processor s Second Core and beyond Please refer to Intel s web site for more information The options are All 1 and 2 Intel EIST Technology EIST Enhanced Intel SpeedStep Technology allows the system to automatically adjust processor voltage and core frequency in an effort to reduce power consump 7 6 Chapter 7 BIOS tion and heat dissipation Please refer to Intel s web site for detailed information The options are Disable Disable GV3 and Enable Enable GV3 Intel TurboMode Technology Select Enabled to use the Turbo Mode to boost system performance The options a
18. the VGA port The default position is on pins 1 and 2 to enable VGA See the table on the right for jumper settings 5 10 Onboard Indicators LAN1 LAN2 LEDs The Ethernet ports located beside the COM port have two LEDs On each Gb LAN port one LED indicates activity when blinking while the other LED may be green amber or off to indicate the speed of the connection See the table on the right for the functions associated with the connection speed LED InfiniBand LED Indicators LEB1 LEB2 Two InfiniBand LEDs LEB1 LEB2 are included on the motherboard The green LED LEB1 is the InfiniBand Link LED The yellow LED LEB2 indicates activity Refer to the tables on the right for details 5 19 LAN1 2 Enable Disable Jumper Settings Jumper Setting Definition Pins 1 2 Enabled Pins 2 3 Disabled VGA Enable Disable Jumper Settings Jumper Setting Definition Pins 1 2 Enabled Pins 2 3 Disabled LAN1 LAN2 LEDs Connection Speed Indicator LED Color Definition Off No connection or 10 Mb s Green 100 Mb s Amber 1 Gb s InfiniBand Link LED LEB1 Color Status Definition Green Solid InfiniBand Connected Off Off No connection InfiniBand Activity LED LEB2 Color Status Definition Yellow Solid InfiniBand Active Yellow Dim InfiniBand Connected Activity Idle Off Off No connection Onboard Power
19. 0 3 99 Kbytes PCI Enumeration 256 MB 3 00 3 76 Area 1 PCI Express 256 256 MB 3 00 3 51 MB PCI Enumeration 512 MB 3 00 3 01 Area 2 if needed Aligned on 256 MB boundary VGA Memory 16 MB 2 85 2 85 TSEG 1MB 2 84 2 84 Memory available 2 84 2 84 to OS amp other applications 5 6 Adding PCI Cards PCI Express Slot The SYS 6026TT H6RF H6IBXRF H6IBQREF includes four preinstalled riser cards designed specifically for use in the SC827HQ R1400B 2U rackmount chassis one card for each node These riser cards support four low profile PCI Express x16 cards to fit inside the chassis PCI Card Installation A riser card has already been preinstalled into each serverboard Perform the following steps to add a PCI add on card 1 Remove the PCI slot shield on the chassis by releasing the locking tab 2 Insert the add on card into the riser card 3 Secure the add on card with the locking tab 5 11 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 7 Serverboard Details Figure 5 3 X8DTT HEF HIBXF HIBQF Series Motherboard Layout VGA d E7773 USBO 1 COMI L TE LAN2 LAN
20. 1 5 P MVAESIUery Tp 1 5 Control Panel Rear VO Panel mter rb RE Re TERRENAE EE RR E aaia 1 5 Cooling SyStem iin cette cre tere ere n rea ee EE Fete e nies 1 5 14 gt 2U Twin System Notes aite eran sr setae teo deren ia Eee 1 6 Dp iis e eia 1 6 System POW Glee oerte E A e ce Ai ders 1 6 SATA Backplane DriV6s 5 ais o roten ter ASt 1 6 1 5 Contacting SUpetmicto nein eani reete eerie ex teen a 1 7 Chapter 2 Server Installation 2 1 OVEIVICW EE 2 2 Unpacking the System 2 3 Preparing for Set p oioietesin e retenir repre En peo ERES Choosing Set p LOCaltlon 2 cn ettet e rere ama eir seats 2 2 Rack Precautlolis oro n ee te eere etr a he x Ea es rea rns Server Precautions Rack Mounting Corisiderations ec eret rt ereptus 2 3 Ambient Operating Temperature eene 2 3 Reduced AIIflOW ne ect retreat 2 3 Mechanical OAC Gscices cexsicascshissscssers conc sasaces ean ea Epa e aeaaee EER 2 3 Circ it Overloading rr Erato e Hera HER 2 3 Reliable Ground vices occi beo ti ate rr feceris Fen pepe e 2 3 vi Table of Contents Removing the Protective Film ennt ins 2 4 2 4 Rack Mounting InstructiOrs a eic D erre e oec tcs 2 5 Separating the Sections of the Rack Rails eese 2 5 Installing the Inner Rail Extensions Outer Rack halls 6
21. BIOS Image file is accessible for the host system Start the terminal program on the host system and create a new connection Use the following communication parameters for the new connection Bits per second 115200 bits sec Data Bits 8 Parity None Stop Bit 1 Flow Control None 7 28 Chapter 7 BIOS 4 Power on your system and click the lt Connect gt button in the Hyper Terminal AMI_FLSH HyperTerminal File Edit view Call BAGGA Help Receive File Capture Text Send Text File Press lt Spa f yke remote BIOS flash Begin remo Capture to Printer TA y Starting remote flash Upload new BIOS file using Mmodem protocol S5555 The terminal screen will display the following messages 5 Following the instructions given on the screen to update the BIOS These instructions are also shown below E Send File Folder C Documents and Settings Desktop Filename C Documents and Settings Desktop 3C02 ROM Protocol Rode N a At the prompt press the lt SpaceBar gt to update the BIOS Starting FLASH Recovery NVRAM data will be destroyed CMOS data will be preserved Ending FLASH Recovery FLASH Update completed successfully Rebooting b When asked to confirm BIOS updating press lt y gt to confirm BIOS updates c Press lt y gt again to begin flashing BIOS remotely Note Be sure to complete Steps a c above quickly because you ha
22. DIMM Pitch This is the physical space between each DIMM module Each step is in 1 1000 of an inch The default is 400 Press or on your keyboard to change this value 7 9 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual gt North Bridge Configuration This feature allows the user to configure the settings for the Intel IOH chip Crystal Beach DMA Direct Memory Access This feature works with the Intel I O AT Acceleration Technology to accelerate the performance of TOE devices Note ATOE device is a specialized dedicated processor that is installed on an add on card or a network card to handle some or all packet processing of this add on card When this feature is set to Enabled it will enhance overall system performance by providing direct memory access for data transferring The options are Enabled and Disabled Intel VT d Select Enabled to enable Intel s Virtualization Technology support for Direct I O VT d by reporting the I O device assignments to VMM through the DMAR ACPI Tables This feature offers fully protected I O resource sharing across the Intel platforms providing the user with greater reliability security and availability in networking and data sharing The settings are Enabled and Disabled IOH PCIE Max Payload Size Some add on cards perform faster with the coalesce feature which limits the payload size to 128 MB while others with a payload size of 256 MB which in hibits the coalesc
23. Failure Redundant Power Two Modules The SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF has two 1400 watt power supply modules to provide redundant power for the system If either of the two power supply modules fail the other module will take the full load and allow the system to continue operation without interruption The LED on the control panel will flash slowly about 4 seconds on and 4 off and remain flashing until the failed unit has been replaced Replacement units can be ordered directly from Supermicro see contact information in the Preface The power supply units have a hot swap capability meaning you can replace the failed unit without powering down the system Removing Replacing the Power Supply Figure 6 8 1 Disconnect the AC power cord from the failed module 2 Push the colored release tab to the side and pull the power module out with the handle provided 3 Replace the failed power supply module with the exact same model from Supermicro 4 Carefully insert the new module into position in the chassis and push it in until fully seated You should see the LED on the rear of the module turn amber showing that power from the backup module is present 5 Reconnect the AC power cord to the new module 6 10 Chapter 6 Advanced Chassis Setup Figure 6 8 Removing the Power Supply Release Tab SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Notes 6 12 Chapter 7 BIOS 7 1 Chap
24. IOS will restore the setting to the previous state The default setting depends on the type of CPU installed on the motherboard The default setting for the CPU installed in your motherboard is 16 Press or on your keyboard to change this value 7 5 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual C1E Support Select Enabled to use the feature of Enhanced Halt State C1E significantly reduces the CPU s power consumption by reducing the CPU s clock cycle and voltage during a Halt State The options are Disabled and Enabled Hardware Prefetcher Available when supported by the CPU If set to Enabled the hardware pre fetcher will pre fetch streams of data and instruc tions from the main memory to the L2 cache in the forward or backward manner to improve CPU performance The options are Disabled and Enabled Adjacent Cache Line Prefetch Available when supported by the CPU The CPU fetches the cache line for 64 bytes if this option is set to Disabled The CPU fetches both cache lines for 128 bytes as comprised if Enabled Intel Virtualization Technology Available when supported by the CPU Select Enabled to use the feature of Virtualization Technology to allow one platform to run multiple operating systems and applications in independent partitions creat ing multiple virtual systems in one physical computer The options are Enabled and Disabled Note If there is any change to this setting you will need to
25. LED An Onboard Power LED is located at LE1 on the motherboard When this LED is on the system power is on Be sure to turn off the system and unplug the power cord before removing or installing components See the table at right for more information BMC Activity LED LE2 A BMC Heartbeat LED is located at LE2 on the motherboard When LE2 is on BMC Baseboard Management Controller is active See the table at right for more information HDD SATA LED LE3 An HDD SATA LED is located at LE3 on the motherboard This LED indicates the status of hard drive activitiy or SATA activity supported by the South Bridge Rear UID LED LE4 The Rear UID LED is located at LE4 on the motherboard Refer to Section 5 7 for details 5 20 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Onboard PWR LED LED Color Definition Off System Off PWR cable not connected Green System On Green ACPI S1 State Flashing Quickly BMC Heartbeat LED On BMC is normal HDD SATA LED LE3 Status Definition On HDD SATA Connected Off No connection Chapter 5 Advanced Serverboard Setup 5 11 SATA and SAS Ports SATA Connections A Front Panel Add On Card header is located at JF2 on the motherboard This header provide onboard SATA support Plug an add on card in JF2 to use SATA connections These connections provide serial link signal transmission which is
26. R EX We Ramones Tos eb EH Graceful power control Supero Doctor II allows a user to aiform the OS to reboot oc shut down witten a specdied time the defauk is 30 second Before the eystem reboots or shits down it s alowed to cancel the acmon Requirements Keep Supero SD3Sernce Daemon running at all times on this system Frovide TCP IP ccanectinty Power control 4 Note SD III Software Revision 1 0 can be downloaded from our Web site at ftp ftp supermicro com utility Supero Doctor IIl You can also download SDIII User s Guide at http www supermicro com manuals other SDIIl User Guide pdf For Linux we will still recommend that you use Supero Doctor II 5 24 Chapter 6 Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform maintenance on the SC827HQ R1400B chassis For component installation follow the steps in the order given to eliminate the most common problems encountered If some steps are unnecessary skip ahead to the step that follows The only tool you will need to install components and perform maintenance is a Philips screwdriver 6 1 Static Sensitive Devices Electrostatic Discharge ESD can damage electronic components To prevent damage to any printed circuit boards PCBs it is important to handle them very carefully The following measures are generally sufficient to protect your equipment from ESD discharge Precau
27. S code block a main BIOS image The boot sector block contains critical BIOS code including memory detection and recovery code to be used to flash a new BIOS image if the original BIOS Image is corrupted When the system is powered on the boot sector code executes first Once it is completed the main BIOS code will continue with system initialization and complete the bootup process Note BIOS Recovery described below is used when the main BIOS block crashes However when the BIOS Boot sector crashes you will need to send the mother board back to Supermicro for RMA repairs Boot Sector Recovery from a USB Device This feature allows the user to recover a BIOS image using a USB device without additional utilities needed A user can download the BIOS image into a USB flash device and name the file SUPER ROM for the recovery process to load the file A USB flash device such as a USB Flash Drive a USB CDROM or a USB CDRW device can be used for this purpose 1 Insert the USB device that contains the new BIOS image the ROM files saved in a root directory into your USB drive 2 While turning the power on press and hold Ctrl and Home at the same time until the USB Access LED Indicator comes on This might take a few seconds 3 Once the USB drive LED is on release the Ctrl and Home keys AMIBIOS will issue beep codes to indicate that the BIOS ROM file is being updated 4 When BIOS flashing is completed the comput
28. SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Installing the Inner Rail Extensions The SC827 chassis includes a set of inner rails in two sections inner rails and inner rail extensions The inner rails are pre attached to the chassis and do not interfere with normal use of the chassis if you decide not to use a server rack The inner rail extension is attached to the inner rail to mount the chassis in the rack Installing the Inner Rails 1 Place the inner rail extensions on the side of the chassis aligning the hooks of the chassis with the rail extension holes Make sure the extension faces outward just like the pre attached inner rail 2 Slide the extension toward the front of the chassis 3 Secure the chassis with 2 screws as illustrated Repeat steps for the other inner rail extension Figure 2 3 Installing the Inner Rail Extensions 2 6 Chapter 2 Server Installation Figure 2 4 Assembling the Outer Rails Outer Rack Rails Outer rails attach to the rack and hold the chassis in place The outer rails for the SC827 chassis extend between 30 inches and 33 inches Installing the Outer Rails to the Rack 1 Secure the back end of the outer rail to the rack using the screws provided 2 Press the button where the two outer rails are joined to retract the smaller outer rail 3 Hang the hooks of the rails onto the rack holes and if desired use screws to secure the front of the outer r
29. The settings are 1st boot device 2nd boot device 3rd boot device 4th boot device 5th boot device and Disabled 1st Boot Device USB XXXXXXXXX 2nd Boot Device CD DVD XXXXXXXXX 7 24 Chapter 7 BIOS gt Hard Disk Drives This feature allows the user to specify the boot sequence from all available hard disk drives The settings are Disabled and a list of all hard disk drives that have been detected i e 1st Drive 2nd Drive 3rd Drive etc 1st Drive SATA XXXXXXXXX P Removable Drives This feature allows the user to specify the boot sequence from available Removable Drives The settings are 1st boot device 2nd boot device and Disabled BIOS SETUP UTILITY Save Changes and Exit 1st Drive USB XXXXXXXXX 2nd Drive P CD DVD Drives This feature allows the user to specify the boot sequence from available CD DVD Drives i e 1st Drive 2nd Drive etc 7 25 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 7 6 Exit Options Select the Exit tab from the AMI BIOS Setup Utility screen to enter the Exit BIOS Setup screen Save Changes and Exit When you have completed the system configuration changes select this option to leave the BIOS Setup Utility and reboot the computer so the new system con figuration parameters can take effect Select Save Changes and Exit from the Exit menu and press lt Enter gt Discard Changes and Exit Select this option to quit th
30. Type Timestamp Generator ID Event Message Format User Event Sensor Type Event Sensor Number Set LAN Configuration Set this feature to configure the IPMI LAN adapter with a network address as shown in the following graphics Channel Number Enter the channel number for the SET LAN Config command This is initially set to 1 Press or on your keyboard to change the Channel Number Channel Number Status This feature returns the channel status for the Channel Number selected above Channel Number is OK or Wrong Channel Number gt IP Address Configuration Enter the IP address for this machine This should be in decimal and in dotted quad form i e 192 168 10 253 The value of each three digit number separated by dots should not exceed 255 as shown in the screen below Parameter Selector Use this feature to select the parameter of your IP Address configuration 7 20 Chapter 7 BIOS IP Address Source Select the source of this machine s IP address If Static is selected you will need to know and enter manually the IP address of this machine below If DHCP is selected the BIOS will search for a DHCP Dynamic Host Configuration Protocol Server in the network it is attached to and request the next available IP address The options are DHCP and Static The following items are assigned IP addresses automatically if DHCP is selected under IP Address Source above IP Address The BIOS
31. a chemical known to the State of California to cause birth defects and other reproductive harm Manual Revision 1 0 Release Date June 6 2011 Unless you request and receive written permission from Super Micro Computer Inc you may not copy any part of this document Information in this document is subject to change without notice Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders Copyright 2011 by Super Micro Computer Inc All rights reserved Printed in the United States of America Preface Preface About This Manual This manual is written for professional system integrators and PC technicians It provides information for the installation and use of the SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF Installation and maintenance should be performed by experienced technicians only The SuperServer SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF is a 2U Twin four serverboards nodes in a 2U chassis rackmount server based on the SC827HQ R1400B server chassis and four Super X8DTT HEF HIBXF HIBQF serverboards An optional redundant power supply may be added to the system indicated by the R in the product name The H in the product name indicates that the system is cableless The main differences between the various serverboards and the servers they are in is shown in the table below Model Variations Differences between X8DTT H
32. ady installed in each of the two serverboards Each processor needs its own heatsink See Chapter 5 for instructions on processor and heatsink installation Your server system may have come with system memory already installed Make sure all DIMMs are fully seated in their slots For details on adding system memory refer to Chapter 5 You can install four add on cards to the system See Chapter 5 for details on installing PCI add on cards Make sure all power and data cables are properly connected and not blocking the chassis airflow See Chapter 5 for details on cable connections 2 9 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 2 6 Preparing to Power On Next you should check to make sure the SATA drives and SATA backplane have been properly installed and all connections have been made Checking the SATA drives 1 The SATA disk drives are accessable from the front of the server and can be installed and removed from the front of the chassis without removing the top chassis cover Depending upon your system s configuration your system may have one or more drives already installed If you need to install SATA drives please refer to Chapter 6 Checking the Airflow 1 Airflow is provided by four 8 cm PWM fans and for each serverboard one air shroud The system component layout was carefully designed to direct sufficient cooling airflow to the components that generate the most heat Note that all pow
33. ail onto the rack 4 Repeat steps 1 3 for the remaining outer rail 2 7 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Figure 2 5 Installing Into the Rack PS CEU a AR A PA PA Installing the Chassis into a Rack T Extend the outer rails as illustrated above Align the inner rails of the chassis with the outer rails on the rack Slide the inner rails into the outer rails keeping the pressure even on both sides When the chassis has been pushed completely into the rack it should click into the locked position Optional screws may be used to secure the to hold the front of the chassis to the rack 2 8 Chapter 2 Server Installation 2 5 Checking the Serverboard Setup After you install the system in the rack you will need to access the inside of the nodes to make sure the serverboard is properly installed Accessing the Inside of a Node Figure 2 6 1 Before removing a node unplug all the cables that connect to that node To remove a node first push the two latches located near the handles inward Grasp the handles and pull the node out from the rear of the chassis To remove the system from the rack completely depress the locking tabs in the chassis rails push the right side tab down and the left side tab up to continue to pull the system out past the locked position Checking the Components and Setup 1 You may have one or two processors alre
34. allow the BIOS to use Single Word DMA mode 2 It has a data transfer rate of 8 3 MB s Select MWDMAO to allow the BIOS to use Multi Word DMA mode 0 It has a data transfer rate of 4 2 MB s Select MWDMAt1 to allow the BIOS to use Multi Word DMA mode 1 It has a data transfer rate of 13 3 MB s Select MWDMA to allow the BIOS to use Multi Word DMA mode 2 It has a data transfer rate of 16 6 MB s Select UDMAO to allow the BIOS to use Ultra DMA mode 0 It has a data transfer rate of 16 6 MBs It has the same transfer rate as PIO mode 4 and Multi Word DMA mode 2 Select UDMA to allow the BIOS to use Ultra DMA mode 1 It has a data transfer rate of 25 MB s Select UDMA to allow the BIOS to use Ultra DMA mode 2 It has a data transfer rate of 33 3 MB s Select UDMAS3 to allow the BIOS to use Ultra DMA mode 3 It has a data transfer rate of 66 6 MB s Select UDMAA to allow the BIOS to use Ultra DMA mode 4 It has a data transfer rate of 100 MB s 7 13 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Select UDMAS to allow the BIOS to use Ultra DMA mode 5 It has a data transfer rate of 133 MB s Select UDMAG to allow the BIOS to use Ultra DMA mode 6 It has a data transfer rate of 133 MB s The options are Auto SWDMAn MWDMAn and UDMAn S M A R T For Hard disk drives Self Monitoring Analysis and Reporting Technology SMART can help predict impending drive failures Select Auto to allow the AMI BIOS to automatic
35. ally appear on the screen Fatal errors will not allow the system to continue the boot up procedure If a fatal error occurs you should consult with your system manufacturer for possible repairs A 1 BIOS Error Beep Codes BIOS Error Beep Codes Beep Code Error Message Description 1 beep Refresh Circuits have been reset Ready to power up 5 short beeps 1 long beep Memory error No memory detected in the system 8 beeps Display memory read Video adapter missing or with faulty write error memory 1 continuous beep with the System Overheat 1 continuous beep with the front panel front panel OH LED on OH LED on SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Notes Appendix B Installing Windows Appendix B Installing Windows After all hardware components have been installed you must first configure Intel South Bridge RAID Settings before you install the Windows OS and other software drivers To configure RAID settings please refer to RAID Configuration User Guides posted on our web site at www supermicro com support manuals B 1 1 Installing Windows for a RAID System Insert Microsoft s Windows XP 2003 Setup CD in the CD drive and the system will start booting up from CD Press the F6 key when the message Press F6 if you need to install a third party SCSI or RAID driver displays When the Windows XP 2003 Setup screen appears press S to specify additional device s In
36. ally de tect hard disk drive support Select Disabled to prevent the AMI BIOS from using the S M A R T Select Enabled to allow the AMI BIOS to use the S M A R T to support hard drive disk The options are Disabled Enabled and Auto 32Bit Data Transfer Select Enable to enable the function of 32 bit IDE data transfer The options are Enabled and Disabled IDE Detect Timeout sec Use this feature to set the time out value for the BIOS to detect the ATA ATAPI devices installed in the system The options are 0 sec 5 10 15 20 25 30 and 35 P PCI PnP Configuration Clear NVRAM This feature clears the NVRAM during system boot The options are No and Yes Plug amp Play OS Selecting Yes allows the OS to configure Plug amp Play devices This is not required for system boot if your system has an OS that supports Plug amp Play Select No to allow the AMI BIOS to configure all devices in the system PCI Latency Timer This feature sets the latency Timer of each PCI device installed on a PCI bus Select 64 to set the PCI latency to 64 PCI clock cycles The options are 32 64 96 128 160 192 224 and 248 PCI IDE BusMaster When enabled the BIOS uses PCI bus mastering for reading writing to IDE drives The options are Disabled and Enabled 7 14 Chapter 7 BIOS Load Onboard LAN1 Option ROM Load Onboard LAN2 Option ROM Select Enabled to enable the onboard LAN1 or LAN2 Option ROM This is to boot computer usi
37. ar both ends of the module This should release it from the slot Figure 5 2 DIMM Installation Notch Release Tab Front View Note Notch should align with the receptive key point on the slot Release Tab RDIMM Population with 5500 Processors Installed DIMM DIMMs DIMM Type Reg Speeds in MHz Ranks per DIMM Slots per Populated Registered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank 2 i Reg DDR3 ECC 800 1066 1333 SR or DR 2 1 Reg DDR3 ECC 800 1066 Note 1 QR 2 2 Reg DDR3 ECC 800 1066 Note 1 Mixing SR DR 2 2 Reg DDR3 ECC 800 Note 2 Mixing SR DR QR Note 1 1333 RDIMMs will run at 1066 MHz BIOS automatic downgrading Note 2 1333 1066 RDIMMs will run at 800 MHz BIOS automatic downgrading UDIMM Population with 5500 Processors Installed DIMM DIMMs DIMM Type Unb Speeds in MHz Ranks per DIMM Slots per Populated Unbuffered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank D 1 Unb DDR3 ECC Non ECC 800 1066 1333 SR or DR 2 2 Unb DDR3 ECC Non ECC 800 1066 Note Mixing SR DR Note 1333 UDIMMs will run at 800 MHz BIOS automatic downgrading 5 9 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 1 5V RDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Reg Speeds in MHz Ranks pe
38. as a single 1400W power supply is used to provide the power for all four serverboards Each serverboard however can be shut down independently of the other with the power button on its own control panel The server also has an additional 1400W power supply module two total for power redundancy If a power supply module fails the other backup module will keep the system running until it can be replaced SATA Backplane Drives As a system the SYS 6026TT H6RF H6IBXRF H6IBQRF supports the use of twelve SATA drives A single SATA backplane works to apply system based control for power and fan speed functions yet at the same time logically connects a set of three SATA drives to each serverboard Consequently RAID setup is limited to a three drive scheme RAID cannot be spread across all twelve drives See the Drive Bay Installation Removal section in Chapter 6 for the logical hard drive and node configuration 1 6 Chapter 1 Introduction 1 5 Contacting Supermicro Headquarters Address Tel Fax Email Web Site Europe Address Tel Fax Email Asia Pacific Address Tel Fax Web Site Technical Support Email Tel Super Micro Computer Inc 980 Rock Ave San Jose CA 95131 U S A 1 408 503 8000 1 408 503 8008 marketing supermicro com General Information support supermicro com Technical Support www supermicro com Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenb
39. ble in the system Size This item displays the memory size detected by the BIOS SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 7 8 Advanced Setup Configurations Use the arrow keys to select Boot Setup and hit lt Enter gt to access the submenu items BIOS SETUP UTILITY gt Boot Features gt BOOT Features Quick Boot If Enabled this option will skip certain tests during POST to reduce the time needed for system boot The options are Enabled and Disabled Quiet Boot This option allows the bootup screen options to be modified between POST mes sages or the OEM logo Select Disabled to display the POST messages Select Enabled to display the OEM logo instead of the normal POST messages The op tions are Enabled and Disabled AddOn ROM Display Mode This sets the display mode for Option ROM The options are Force BIOS and Keep Current Bootup Num Lock This feature selects the Power on state for Numlock key The options are Off and On Wait For F1 If Error This forces the system to wait until the F1 key is pressed if an error occurs The options are Disabled and Enabled Chapter 7 BIOS Hit Del Message Display This feature displays Press DEL to run Setup during POST The options are Enabled and Disabled Interrupt 19 Capture Interrupt 19 is the software interrupt that handles the boot disk function When this item is set to Enabled the ROM BIOS of the host adaptors will capture I
40. carriers have pre installed dummy drive trays This dummy tray needs to be removed before installing an actual hard drive see Figure 6 3 1 Remove the screws 2 holding connecting the drive tray the carrier 2 Remove the tray from the carrier Mounting a Hard Drive in a Carrier 1 Install the drive into the carrier with the printed circuit board side facing down so that the mounting holes align with those in the carrier 2 Secure the drive to the carrier with six screws as shown in Figure 6 4 3 Use the open handle to replace the drive tray into the chassis Make sure to fully close the drive carrier handle 6 4 Chapter 6 Advanced Chassis Setup Figure 6 3 Removing a Dummy Drive Tray Figure 6 4 Mounting a Hard Drive in a Carrier Hard Drive Drive Tray Installing Removing Hot swap Drives 1 To remove a carrier push the release button located beside the drive LEDs 2 Swing the handle fully out and use it to pull the unit straight out see Figure 6 5 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Figure 6 5 Removing a Hard Drive Figure 6 6 Drives and Nodes Logical Configuration Note see Figure 6 1 for the locations of the control panels that are associated with each node 6 6 Chapter 6 Advanced Chassis Setup 6 5 Node Installation Removal As with any server system power must be removed from the serverboard when upgrading or installing memory or processors
41. ched to the rack n multiple rack installations the racks should be coupled together Always make sure the rack is stable before extending a component from it You should extend only one component at a time extending two or more si multaneously may cause the rack to become unstable Server Precautions Review the electrical and general safety precautions in Chapter 4 Determine the placement of each component in the rack before you install the rails Install the heaviest server components on the bottom of the rack first and then work up Use a regulating uninterruptible power supply UPS to protect the server from power surges voltage spikes and to keep your system operating in case of a power failure 2 2 Chapter 2 Server Installation Allow the hot plug SATA drives and power supply modules to cool before touch ing them Always keep the rack s front door and all panels and components on the servers closed when not servicing to maintain proper cooling Make sure all power and data cables are properly connected and not blocking the chassis airflow See Chapter 5 for details on cable connections Rack Mounting Considerations Ambient Operating Temperature If installed in a closed or multi unit rack assembly the ambient operating tempera ture of the rack environment may be greater than the ambient temperature of the room Therefore consideration should be given to installing the equipment in an
42. cted to Depressing this button removes the main power but keeps standby power supplied to the serverboard This button has an LED built into it which will illuminate when its node is powered on Q UID Depressing the UID unit identifier button illuminates an LED on both the front and rear of the chassis for easy system location in large stack configurations The LED will remain on until the button is pushed a second time Another UID button on the rear of the chassis serves the same function This button has an LED built into it which will illuminate when either the front or rear UID button is pushed 3 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 3 3 Control Panel LEDs In addition to the LEDs built into the power and UID buttons each of the four control panels located on the front of the SC827H R 1400B chassis has two LEDs that provide you with critical information related their own node This section explains what each LED indicates when illuminated and any corrective action you may need to take n Overheat Fan Fail When this LED is solid on it indicates an overheat condition When it flashes quickly once every second it indicates a fan failure When it flashes slowly once every four seconds it indicates a power supply failure An overheat condi tion may be caused by cables obstructing the airflow in the system or the ambient room temperature being too warm Check the routing of the cables a
43. d to the device one sector at a time Select Auto to allow data transfer from and to the device occur multiple sectors at a time if the device supports it The options are Auto and Disabled PIO Mode The IDE PIO Programmable l O Mode programs timing cycles between the IDE drive and the programmable IDE controller As the PIO mode increases the cycle time decreases The options are Auto 0 1 2 3 and 4 Select Auto to allow the AMI BIOS to automatically detect the PIO mode Use this value if the IDE disk drive support cannot be determined 7 12 Chapter 7 BIOS Select 0 to allow the AMI BIOS to use PIO mode 0 It has a data transfer rate of 3 3 MB s Select 1 to allow the AMI BIOS to use PIO mode 1 It has a data transfer rate of 5 2 MB s Select 2 to allow the AMI BIOS to use PIO mode 2 It has a data transfer rate of 8 3 MB s Select 3 to allow the AMI BIOS to use PIO mode 3 It has a data transfer rate of 11 1 MB s Select 4 to allow the AMI BIOS to use PIO mode 4 It has a data transfer band width of 32 Bits Select Enabled to enable 32 Bit data transfer DMA Mode Select Auto to allow the BIOS to automatically detect IDE DMA mode when the IDE disk drive support cannot be determined Select SWDMAO to allow the BIOS to use Single Word DMA mode 0 It has a data transfer rate of 2 1 MB s Select SWDMA 1 to allow the BIOS to use Single Word DMA mode 1 It has a data transfer rate of 4 2 MB s Select SWDMA to
44. e Fan1 Fan 4 Reading This feature displays the fan speed readings from fan interfaces Fani through Fan5 CPU1 Vcore CPU2 Vcore 5Vin 12Vcc V VP1 DIMM VP2 DIMM 3 3Vcc V and Battery Voltage gt ACPI Configuration Use this feature to configure Advanced Configuration and Power Interface ACPI power management settings for your system ACPI Version Features The options are ACPI v1 0 ACPI v2 0 and ACPI v3 0 Please refer to ACPI s website for further explanation http www acpi info ACPI APIC Support Select Enabled to include the ACPI APIC Table Pointer in the RSDT Root System Description Table pointer list The options are Enabled and Disabled 7 18 Chapter 7 BIOS APIC ACPI SCI IRQ When this item is set to Enabled APIC ACPI SCI IRQ is supported by the system The options are Enabled and Disabled Headless Mode This feature is used to enable system to function without a keyboard monitor or mouse attached The options are Enabled and Disabled High Performance Event Timer Select Enabled to activate the High Performance Event Timer HPET that produces periodic interrupts at a much higher frequency than a Real time Clock RTC does in synchronizing multimedia streams providing smooth playback and reducing the de pendency on other timestamp calculation devices such as an x86 RDTSC Instruc tion embedded in the CPU The High Performance Event Timer is used to replace the 8254 Programmable Interva
45. e BIOS Setup without making any permanent changes to the system configuration and reboot the computer Select Discard Changes and Exit from the Exit menu and press lt Enter gt Discard Changes Select this option and press lt Enter gt to discard all the changes and return to the AMI BIOS Utility Program Load Optimal Defaults To set this feature select Load Optimal Defaults from the Exit menu and press lt Enter gt Then select OK to allow the AMI BIOS to automatically load Optimal De faults to the BIOS Settings The Optimal settings are designed for maximum system performance but may not work best for all computer applications Load Fail Safe Defaults To set this feature select Load Fail Safe Defaults from the Exit menu and press lt Enter gt The Fail Safe settings are designed for maximum system stability but not for maximum performance 7 7 BIOS Recovery Warning Do not upgrade the BIOS unless your system has a BIOS related issue Flashing the wrong BIOS can cause irreparable damage to the system In no event shall Supermicro be liable for direct indirect special incidental or consequential damages arising from a BIOS update If you need to update the BIOS do not shut down or reset the system while the BIOS is updating This is to avoid possible boot failure 7 26 Chapter 7 BIOS How to Recover the AMIBIOS Image the Main BIOS Block An AMIBIOS flash chip consists of a boot sector block and a main BIO
46. e feature Please refer to your add on card user guide for the desired setting The options are 256 MB and 128MB PCI E Port 1 Link Select This feature allows the user to configure the IOH link settings for the PCI E Port 1 The options are X4X4X4X4 X4X4X8 X8X4X4 X8X8 and X16 gt SouthBridge Configuration This feature allows the user to configure the settings for the Intel ICH South Bridge chipset USB Functions This feature allows the user to decide the number of onboard USB ports to be enabled The Options are Disabled 2 USB ports 4 USB ports 6 USB ports 8 Ports 10 Ports and 12 USB ports Legacy USB Support Select Enabled to use Legacy USB devices If this item is set to Auto Legacy USB support will be automatically enabled if a legacy USB device is installed on the motherboard and vise versa The settings are Disabled and Enabled 7 10 Chapter 7 BIOS USB 2 0 Controller Select Enabled to activate the onboard USB 2 0 controller The options are Enabled and Disabled USB 2 0 Controller Mode This setting allows you to select the USB 2 0 Controller mode The options are Hi Speed 480 Mbps and Full Speed 12 Mbps BIOS EHCI Hand Off Select Enabled to enable BIOS Enhanced Host Controller Interface support to provide a workaround solution for an operating system that does not have EHCI Hand Off support When enabled the EHCI Interface will be changed from the BIOS controlled to the OS controlled The o
47. e main screen will display Appendix C System Specifications Appendix C System Specifications Note unless noted specifications apply to a complete system four server boards Processors Eight Intel 5500 5600 Series processors in LGA1366 sockets Note Please refer to our website for details on supported processors Chipset Intel 5520 ICH10R BIOS 32 Mb AMI SPI Flash ROM each serverboard Memory Capacity each Serverboard Twelve 240 pin DIMM sockets that can support up to 192 GB of registered ECC DDR3 1333 1066 800 SDRAM or 48 GB of Unbuffered ECC Non ECC 1333 1066 800 MHz Memory with max 4 GB of Registered ECC and 2 GB of Unbuffered memory per DIMM slot Note interleaved memory requires DIMMs to be installed in pairs refer to Section 5 6 for details Serial ATA Controller Intel ICH10R on chip controller to support six 3 Gb s Serial ATA RAID 0 1 SATA Drive Bays Twelve hot swap drive bays to house standard SATA drives three per node PCI Expansion Four low profile PCI Express 2 0 x16 slots with pre installed riser cards one per node C 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Serverboard 6026TT H6RF X8DTT HEF 6026TT H6IBXRF X8DTT HIBXF 6026TT H6IBOQRF X8DTT HIBQF Dimensions all 16 64 L x 6 80 W 422 66 mm x 172 72 mm X8DTT HEF HIBXF HIBQF Chassis SC827HQ R1400B 2U Rackmount Dimensions WxHxD 17 2 x 3 5 x 28 5 in 437 x 89 x 724 mm
48. e vertically into a slot following the charts below Pay attention to the notch along the bottom of the module to prevent inserting it incorrectly 2 Gently press down on the DIMM module until it snaps into place in the slot see Figure 5 2 3 Repeat for all DIMMs See tables below and on following pages Populating Memory for Optimal Performance Single CPU Configuration O BranchO Branch 1 Branch 2 3 DIMMs P1 DIMM1A P1 DIMM2A P1 DIMM3A 6 DIMMs P1 DIMM1A P1 DIMM1B P1 DIMM2A P1 DIMM2B P1 DIMM3A P1 DIMM3B Populating Memory for Optimal Performance Dual CPU Configuration CPU1 CPU2 Branch 0 Branch 1 Branch 3 Branch 0 Branch 1 Branch 3 6 DIMMs 1A 2A 3A 1A 2A 3A 12 1A 1B 2A 2B 3A 3B 1A 1B 2A 2B 3A 3B DIMMs 5 8 Chapter 5 Advanced Serverboard Setup DIMM Population Table DIMM DIMMs DIMM Type Reg Speeds in MHz Ranks per DIMM Slots per Populated Registered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank 2 1 Reg DDR3 ECC 800 1066 1333 SR DR 2 1 Reg DDR3 ECC 800 1066 QR 2 2 Reg DDR3 ECC 800 1066 1333 SR DR 2 2 Reg DDR3 ECC 800 1066 SR DR QR To Install Insert module vertically and press down until it snaps into place Pay attention to the alignment notch at the bottom To Remove Use your thumbs to gently push the release tabs ne
49. eatsink If you buy a CPU separately make sure that you use an Intel certified multi directional heatsink only Make sure to install the serverboard into the chassis before you install the CPU heatsinks When receiving a serverboard without a processor pre installed make sure that the plastic CPU socket cap is in place and none of the socket pins are bent otherwise contact your retailer immediately Refer to the Supermicro web site for updates on CPU support Installing LGA1366 Processors Starting with CPU1 press the Socket clip to release the load plate which covers the CPU Socket from its locked position Gently lift the socket clip to open Socket Clip Load Plate the load plate Hold the plastic cap at its north and south center edges to remove it from the CPU socket Holding the north amp south edges 5 4 Chapter 5 Advanced Serverboard Setup 1 After removing the plastic cap use CPU your thumb and the index finger to hold the CPU at the north and south center edges 2 Align the CPU key the semi circle cutout with the socket key the notch below the gold color dot on the side of the socket 3 Once the CPU and the socket are aligned carefully lower the CPU straight down into the socket Do not rub the CPU against the surface of the socket or its pins to avoid damaging the CPU or the socket 4 With the CPU in the socket inspect the four corners of the CPU to make sure that it sits l
50. er and data cables have been routed in such a way that they do not block the airflow generated by the fans Providing Power 1 Plug the power cords from the power supplies unit into a high quality power strip that offers protection from electrical noise and power surges It is recommended that you use an uninterruptible power supply UPS Finally depress the power on button on the front of the chassis 2 10 Chapter 2 Server Installation Figure 2 6 Removing a Node from the System 2 11 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Notes 2 12 Chapter 3 System Interface Chapter 3 System Interface 3 1 Overview There are LEDs on the control panels and on the SATA drive carriers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components There are also two buttons on each control panel This chapter explains the meanings of all LED indicators and the appropriate re sponse you may need to take Note that the server has four control panels one for each serverboard node installed in the system This allows each severboard to be controlled independently of the other 3 2 Control Panel Buttons There are two push buttons located on each control panel a power on off button and a UID button Power This is the main power button which is used to apply or turn off the main system power only to the node it is conne
51. er will reboot Do not interrupt the flashing process until it is completed Boot Sector Recovery from an IDE CD ROM This process is almost identical to the process of Boot Sector Recovery from a USB device except that the BIOS image file is loaded from a CD ROM Use a CD R or CD RW drive to burn a CD with the BIOS image file in it and name the file SUPER ROM for the recovery process to load the file 7 27 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Boot Sector Recovery from a Serial Port Serial Flash This process also known as Serial Flash allows the user to use a serial port to load a BIOS image for Boot Sector recovery This feature is usually used for embed ded systems that rely on a serial port for remote access and debugging Requirements In order to use Serial Flash for Boot Sector Recovery you will need to meet the following requirements The Target system the system that needs BIOS updates must have a serial port and Serial Flash support embedded in the BIOS image file The Host system should also have a serial port and a terminal program that supports XModem Transfer protocol Hyper Terminal for the Windows operating systems and minicom for Linux FreeSBD etc A Null_modem serial cable How to use Serial Flash for Boot Sector Recovery 1 Connect a Null modem serial cable between the target system and the host System that runs the terminal program Make sure that the new
52. erating systems that have been certified for use with the 6026TT www supermicro com In addition to the serverboard and chassis various hardware components may have been included with the system as listed below Eight passive CPU heatsinks SNK P0037P Four 8 cm cooling fans FAN 0111L4 Four air shrouds MCP 310 82710 0B SATA Accessories Twelve SATA hard drive carriers three per node MCP 220 00024 0B One internal HDD backplane BPN SAS 827HQ Four internal SAS2 backplanes BPN ADP SAS2 H6IR Four PCI Express riser cards RSC R1U E16R Rackmount rails kit MCP 290 00053 0N One CD containing drivers and utilities SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Note The SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF system is cableless and does not need or come with SATA cables 1 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 1 2 Serverboard Features At the heart of the SuperServer 6026TT are four X8DTT HEF HIBXF HIBQF dual processor serverboards which are based on Intel s 5520 North Bridge ICH10R South Bridge chipset Below are the main features of the serverboards Note that the features on each board are quadrupled for the server which includes four nodes Processors Each X8DTT HEF HIBXF HIBQF supports two Intel 5500 5600 Series processors in LGA1366 sockets up to 95w Please refer to our web site for a complete listing of supported processors www supermicro com
53. ers and jumpers Refer to this chapter when adding or removing processors or main memory and when reconfiguring the serverboard Chapter 6 Advanced Chassis Setup Refer to Chapter 6 for detailed information on the SC827HQ R1400B 2U rackmount server chassis You should follow the procedures given in this chapter when installing removing or reconfiguring SATA or peripheral drives and when replacing system power supply units and cooling fans Chapter 7 BIOS The BIOS chapter includes an introduction to BIOS and provides detailed information on running the CMOS Setup Utility Appendix A BIOS Error Beep Codes Appendix B Installing Windows Appendix C System Specifications Preface Notes SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Table of Contents Chapter 1 Introduction 1 1 OIL E B 1 2 Serverboard Features PrOCOSSOTS noa P H Setia ATA tero em OO RUD ROT URN DD ET EMO OE HETES PGI Expansion Slots Gr ntt tbc o es er EE Ethernet ufo Onboard Controllers Ports sesssseeeeeenen emen 1 3 Graphics Controller inet rrr rere iieri torte p Hind 1 3 Other F6atures cente p n e RR ERE Gace tcl epe 1 3 InfiniBand 1 3 1 8 Server Chassis Features sesessseseeeeeeeeeneen rennen 1 5 System POWOF act startet E F EYE E
54. evel j Ex and is properly installed 5 Once the CPU is securely seated in the socket lower the CPU load plate to the socket 6 Use your thumb to gently push the socket clip down to the clip lock 7 Repeat for the CPU2 socket for a dual processor configuration Important Please save the plastic cap The motherboard must be shipped with the plastic cap properly installed to protect the CPU socket pins Shipment without the plastic cap properly installed may cause damage to the socket pins 5 5 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Installing a CPU Heatsink 1 Remove power from the system and unplug the AC power cord from the power supply 2 Do not apply any thermal grease to the heatsink or the CPU die the required amount has already been applied 3 Place the heatsink on top of the CPU so that the four mounting holes are aligned with those on the preinstalled heatsink retention mechanism crew Install Screw 1 4 Screw in two diagonal screws i e the 1 and the 2 screws until just snug Do not fully tighten the Screws or you may damage the CPU 5 Add the two remaining screws then finish the installation by fully tightening all four screws 5 6 Chapter 5 Advanced Serverboard Setup Removing the Heatsink However if you do need to uninstall the heatsink please follow the instruc Warning We do not recommend that the CPU or the heatsink be
55. has not been used Change Supervisor Password Select this feature and press Enter to access the submenu and then type in a new Supervisor Password User Access Level Available when Supervisor Password is set as above Available options are Full Access grants full User read and write access to the Setup Utility View Only allows access to the Setup Utility but the fields cannot be changed Limited allows only limited fields to be changed such as Date and Time No Access prevents User access to the Setup Utility Change User Password Select this feature and press Enter to access the submenu and then type in a new User Password Clear User Password Available only when User Password has been set This item allows you to clear a user password after it has been entered 7 23 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Password Check This item allows you to check a password after it has been entered The options are Setup and Always BIOS SETUP UTILITY gt Boot Device Priority Boot Sector Virus Protection When Enabled the AMI BOIS displays a warning when any program or virus is sues a Disk Format command or attempts to write to the boot sector of the hard disk drive The options are Enabled and Disabled 7 5 Boot Configuration Use this feature to configure boot settings gt Boot Device Priority This feature allows the user to specify the sequence of priority for the Boot Device
56. iguration Enter the gateway address for this machine This should be in decimal and in dotted quad form i e 192 168 10 253 The value of each three digit number separated by dots should not exceed 255 as shown in the screen below Parameter Selector Use this feature to select the parameter of your Gateway Address settings Gateway Address The BIOS will automatically enter the Gateway address of this machine however it may be over ridden Gateway addresses are 6 two digit hexadecimal numbers separated by dots BIOS SETUP UTILITY Change Supervisor Passuord Current Gateway Address in BMC This item displays the current Gateway address used for your IPMI connec tion 7 22 Chapter 7 BIOS gt DMI Event Log View Event Log Use this option to view the System Event Log Mark all events as read This option marks all events as read The options are OK and Cancel Clear event log This option clears the Event Log memory of all messages The options are OK and Cancel 7 4 Security Settings The AMI BIOS provides a Supervisor and a User password If you use both pass words the Supervisor password must be set first Supervisor Password This item indicates if a Supervisor password has been entered for the system Not Installed means a Supervisor password has not been used User Password This item indicates if a user password has been entered for the system Not In stalled means that a user password
57. ime System Overview The following BIOS information will be displayed System Time System Date Use this option to change the system time and date Highlight System Time or Sys tem Date using the arrow keys Enter new values through the keyboard Press the lt Tab gt key or the arrow keys to move between fields The date must be entered in 7 2 Chapter 7 BIOS Day MM DD YY format The time is entered in HH MM SS format Note The time is in the 24 hour format For example 5 30 P M appears as 17 30 00 Supermicro X8DTT F IBX IBXF IBQ IBQF BIOS Build Version This item displays the BIOS revision used in your system BIOS Build Date This item displays the date when this BIOS was completed AMI BIOS Core Version This item displays the revision number of the AMI BIOS Core upon which your BIOS was built Processor The AMI BIOS will automatically display the status of the processor used in your system CPU Type This item displays the type of CPU used in the motherboard Speed This item displays the speed of the CPU detected by the BIOS Physical Count This item displays the number of processors installed in your system as detected by the BIOS Logical Count This item displays the number of CPU Cores installed in your system as detected by the BIOS Micro_code Revision This item displays the revision number of the BIOS Micro_code used in your system System Memory This displays the size of memory availa
58. ing CPU Fan speed triggering the Overheat Alarm etc Since CPUs can have different Temperature Tolerances the installed CPU can now send informa tion to the motherboard what its Temperature Tolerance is and not the other way around This results in better CPU thermal management Supermicro has leveraged this feature by assigning a temperature status to certain thermal conditions in the processor Low Medium and High This makes it easier for the user to understand the CPU s temperature status rather than by just simply seeing a temperature reading i e 259C The CPU Temperature feature will display the CPU temperature status as detected by the BIOS Low This level is considered as the normal operating state The CPU temperature is well below the CPU Temperature Tolerance The motherboard fans and CPU will run normally as configured in the BIOS Fan Speed Control User intervention No action required Medium The processor is running warmer This is a precautionary level and generally means that there may be factors contributing to this condition but the CPU is still within its normal operating state and below the CPU Temperature Tolerance The motherboard fans and CPU will run normally as configured in the BIOS The fans may adjust to a faster speed depending on the Fan Speed Control settings User intervention No action is required However consider checking the CPU fans and the chassis ventilation fo
59. iniBand port is also included on the X8DTT H6IBXF H6IBQF serverboards the 6026TT H6IBXRF and 6026TT H6IBQRF servers only Up to four USB 2 0 Universal Serial Bus connections 2 Rear USB Ports and 1 Type A Header w 2 USB connections supported are on each of the servers There are four sets of l O ports included in the server one set for each serverboard Graphics Controller The X8DTT HEF HIBXF HIBQF features an integrated Matrox G200eW graphics chip which includes 8 MB of DDR2 memory Other Features Other onboard features that promote system health include voltage monitors auto switching voltage regulators chassis and CPU overheat sensors virus protection and BIOS rescue InfiniBand Both the 6026TT H6IBXRF and 6026TT H6IBQRF servers include an InfiniBand port at DDR dual data rate and QDR quad data rate speeds respectively InfiniBand is a scalable serial communications link intended for connecting processors with high speed peripherals InfiniBand requires a QSFP connector 1 3 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 1 2 2 1 1 2 2 1 1 2 2 1 A A iD Dr MAN M NE DIIRE 8
60. ion Pin Definition Pin Definition another two USB connections USB2 3 are oy 2 Bow located at JUSB2 to provide front chassis s USB PNi 6 USB PNO access Connect USB cables to these USB UsmppW p USE Fr 4 Ground 8 Ground ports headers to use USB connections USB cables are not included See the tables on the right for pin definitions Front Panel USB2 3 Pin Definitions USB2 USB 3 Pin Definition Pins Definition 1 45V 6 45V 2 USB PN2 V USB PN3 3 USB PP2 8 USB PP3 4 Ground 9 Ground 5 No 10 Key Connection Serial Ports Serial Port Pin Definitions Pin Definitions One serial port is included on the serverboard The COM port is located beside the VGA Pin Definition Pin Definition port See the table on the right for pin 1 DCD 6 DSR definitions 2 RXD 7 RTS 3 TXD 8 cts 4 DTR 9 RI 5 Ground 10 NC NC No Connection 5 15 Ethernet Ports Two Ethernet ports are located next to USBO 1 on the IO Backplane In addition an IPMI Dedicated LAN is located above USBO 1 These ports accept RJ45 type cables See the table on the right for pin definitions Note 1 Please refer to the LED Indicator Section for LAN LED information InfiniBand Connection X8DTT HIBXF HIBQF Only The onboard InfiniBand connector is located on the backplane on the motherboard This switch is primarily used for High performance computing See the table on the right for pin defin
61. ion after Power On Self Test POST Select Always to keep Console Redirection active all the time after POST Note This setting may not be supported by some operating systems Select Boot Loader to keep Console Redirection active during POST and Boot Loader The options are Disabled Boot Loader and Always 7 15 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Terminal Type This feature allows the user to select the target terminal type for Console Redirec tion The options are ANSI VT100 and VT UTF8 VT UTF8 Combo Key Support Aterminal keyboard definition that provides a way to send commands from a remote console The options are Enabled and Disabled Sredir Memory Display Delay This feature defines the length of time in seconds to display memory information The options are No Delay Delay 1 Sec Delay 2 Sec and Delay 4 Sec Hardware Health Monitor This feature allows the user to monitor system health and review the status of each item as displayed CPU Overheat Alarm This option allows the user to select the CPU Overheat Alarm setting which de termines when the CPU OH alarm will be activated to provide warning of possible CPU overheat Warning 1 Any temperature that exceeds the CPU threshold tempera ture predefined by the CPU manufacturer may result in CPU overheat or system instability When the CPU temperature reaches this predefined threshold the CPU and system cooling fans will run at ful
62. ispose of used batteries according to the manufacturer s instructions DVD ROM Laser CAUTION this server may have come equipped with a DVD ROM drive To prevent direct exposure to the laser beam and hazardous radiation exposure do not open the enclosure or use the unit in any uncon ventional way Mainboard replaceable soldered in fuses Self resetting PTC Positive Tempera ture Coefficient fuses on the mainboard must be replaced by trained service technicians only The new fuse must be the same or equivalent as the one replaced Contact technical support for details and support General Safety Precautions A Follow these rules to ensure general safety Keep the area around the SYS 6026TT H6RF H6IBXRF H6IBQRF clean and free of clutter The SYS 6026TT H6RF H6IBXRF H6IBQRF weighs approximately 85 Ibs 38 6 kg when fully loaded When lifting the system two people at either end should lift slowly with their feet spread out to distribute the weight Always keep your back straight and lift with your legs Place the chassis top cover and any system components that have been re moved away from the system or on a table so that they won t accidentally be stepped on While working on the system do not wear loose clothing such as neckties and unbuttoned shirt sleeves which can come into contact with electrical circuits or be pulled into a cooling fan 4 2 Chapter 4 System Safety Remove any jewelry or metal objects from you
63. itions System Reset If System Reset JRST1 is connected to a switch then the system reset feature is enabled See the table on the right for pin definitions 5 16 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual LAN Ports Pin Definitions Pin Definition Pin Definition 1 P2V5SB 10 SGND 2 TDO 11 Act LED 3 TDO 12 P3V3SB 4 TD1 13 Link 100 LED Yellow 3V3SB 5 TD1 14 Link 1000 LED Yellow 3V3SB 6 TD2 15 Ground i TD2 16 Ground 8 TD3 17 Ground 9 TD3 88 Ground NC No Connection InfiniBand Pin Definitions Pin Definition Pin Definition S1 npu S9 Outpu Pair0 Pos Pair3 Pos S2 npu S10 Outpu Pair0 Neg Pair3 Neg S3 npu S11 Outpu Pair1 Pos Pair2 Pos S4 npu 12 Outpu Pair1 Neg Pair2 Neg S5 npu S13 Outpu Pair2 Pos Pair1 Pos S6 npu S14 Outpu Pair2 Neg Pair1 Neg S7 npu 15 Outpu Pair3 Pos Pair0 Pos S8 npu S16 Outpu Pair3 Neg Pair0 Neg InfiniBand Ground Pins G1 G9 Pin Definitions Pins Definitions G1 G9 Ground Alarm Reset Pin Definitions Pin Definition Pin 1 3 3V Pin2 Ground Chapter 5 Advanced Serverboard Setup Unit Identifier Switches UID Switch Two Unit Identifier UID switches and LED Pin Betinitions indicators are located on the motherboard bin Definition 1 Ground The Front Panel UID Switch is located at pin 16 on JF2 The Rear UID Switch is located at 2 SW1 next to the Infi
64. its behind the system fans and goes over the top of the serverboard and its components 3 Repeat the procedure for the remaining three serverboard drawers 6 7 Power Supply The SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF has a single 1400 watt power supply you may add an additional power supply module for redundancy The power supply module has an auto switching capability which enables it to automatically sense and operate at a 100V 240V input voltage Power Supply Failure Single Power Supply Module If the power supply module fails the system will shut down and you will need to replace the module Replacements can be ordered directly from Supermicro see contact information in the Preface As there is only one power supply module in the system power must be completely removed from the server before removing and replacing the power supply for whatever reason Removing Replacing the Power Supply Figure 6 8 1 First unplug the AC power cord from the system 2 Push the release tab on the back of the power supply 3 Pull the power supply out using the handle provided 4 Replace the failed power module with the same model see Appendix C for part number 6 9 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 Push the new power supply module into the power bay until you hear a click 6 Reconnect the AC power cord and depress the power button on the control panel to restart the system Power Supply
65. l Timer The options are Enabled and Disabled gt General WHEA Configuration WHEA Support Select Enabled to enable Windows Hardware Error Architecture WHEA sup port which will provide a common infrastructure for handling hardware errors on Windows platforms in order to reduce system crashes due to hardware errors and improvesystem recovery and health monitoring The default setting is Enabled gt IPMI Configuration X8DTT HF HIBXF HIBQF Only Intelligent Platform Management Interface IPMI is a set of common interfaces that IT administrators can use to monitor system health and to manage the system as a whole For more information on the IPMI specifications please visit Intel s website at www intel com Status of BMC Baseboard Management Controller BMC manages the interface between system management software and platform hardware This is an informational feature which returns the status code of the BMC micro controller IPMI Firmware Revision This item indicates the revision number of the current IPMI Firmware 7 19 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual gt View BMC System Event Log This feature displays the BMC System Event Log SEL It shows the total num ber of entries of BMC System Events To view an event select an Entry Number and pressing lt Enter gt to display the information as shown in the screen Total Number of Entries SEL Entry Number SEL Record ID SEL Record
66. l contact to the serverboard ground to provide a continuous ground for the system 5 2 Chapter 5 Advanced Serverboard Setup Warning To avoid damaging the motherboard and its components do not apply any force greater than 8 lbs per square inch when installing a screw into a mounting hole 5 3 I O Ports The I O ports are color coded in conformance with the PC 99 specification See Figure 5 1 below for the colors and locations of the various I O ports Figure 5 1 I O Ports 9 o ool fl til e o O By tu o 1 Dedicated IPMI LAN 6 COMI Port Black 2 USB Port 1 7 VGA Port 3 USB Port 0 8 InfiniBand Port 4 LAN1 9 UID Switch 5 LAN2 Note The InfiniBand ports are included on the 6016TT IBXF and 6016TT IBQF only 5 3 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 4 Processor and Heatsink Installation the label area of the fan When handling the processor package avoid placing direct pressure on Notes Note The photos on this page and succeeding pages are for illustration purposes only They do not necessarily reflect the exact product s described in this manual Always connect the power cord last and always remove it before adding re moving or changing any hardware components Make sure that you install the processor into the CPU socket before you install the CPU h
67. l speed 2 To avoid possible system overheating please be sure to provide adequate airflow to your system The options are The Early Alarm Select this setting if you want the CPU overheat alarm includ ing the LED and the buzzer to be triggered as soon as the CPU temperature reaches the CPU overheat threshold as predefined by the CPU manufacturer The Default Alarm Select this setting if you want the CPU overheat alarm including the LED and the buzzer to be triggered when the CPU temperature reaches about 59C above the threshold temperature as predefined by the CPU manufacturer to give the CPU and system fans additional time needed for CPU and system cooling In both the alarms above please take immediate action as shown below 7 16 Chapter 7 BIOS CPU Temperature System Temperature This feature displays current temperature readings for the CPU and the System The following items will be displayed for your reference only CPU Temperature The CPU thermal technology that reports absolute temperatures Celsius Fahr enheit has been upgraded to a more advanced feature by Intel in its newer processors The basic concept is each CPU is embedded by unique temperature information that the motherboard can read This Temperature Threshold or Tem perature Tolerance has been assigned at the factory and is the baseline on which the motherboard takes action during different CPU temperature conditions i e by increas
68. m the serverboard they are connected to logically Fan speed may be controlled by a setting in BIOS see Chapter 7 6 2 Chapter 6 Advanced Chassis Setup Fan Configuration In the 2U Twin each node serverboard controls the two fans that reside on its side of the chassis This means that two nodes will share control for two fans If the fan speed settings in BIOS are different for these two nodes the BIOS setting with the higher fan speed will apply In the event that one of the serverboard drawers is removed then the remaining node serverboard will operate both fans Note Due to this configuration both nodes on the same side of the chassis as the failed fan must be powered down before replacing the fan System Fan Failure If a fan fails the remaining fans will ramp up to full speed and the overheat fan fail LED on the control panel will blink on and off about once per second Replace any failed fan at your earliest convenience with the same type and model See note above about powering down the nodes associated with the failed fan befire replacing Changing a System Fan 1 If necessary open the chassis while the power is running to determine which fan has failed Never run the server for an extended period of time with the chassis cover open 2 Remove the failed fan s wiring from the backplane 3 Lift the fan housing up and out of the chassis 4 Push the fan up from the bottom and out of the top of the housi
69. models X8DTT HEF HIBXF HIBQF IPMI 2 0 w KVM Over LAN DDR IB QDR IB e e Manual Organization Chapter 1 Introduction The first chapter provides a checklist of the main components included with the server system and describes the main features of the Super SYS 6026TT H6RF H6IBXRF H6IBQRF serverboard and the SC827HQ R1400B chassis Chapter 2 Server Installation This chapter describes the steps necessary to install the SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF into a rack and check out the server configuration prior to powering up the system If your server was ordered without the processor and memory components this chapter will refer you to the appropriate sections of the manual for their installation SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Chapter 3 System Interface Refer to this chapter for details on the system interface which includes the functions and information provided by the control panel on the chassis as well as other LEDs located throughout the system Chapter 4 System Safety You should thoroughly familiarize yourself with this chapter for a general overview of safety precautions that should be followed when installing and servicing the SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF Chapter 5 Advanced Serverboard Setup Chapter 5 provides detailed information on the SYS 6026TT H6RF H6IBXRF H6IBQRF serverboard including the locations and functions of connectors head
70. nd make sure all fans are present and operating normally You should also check to make sure that the chassis cover is properly installed Finally verify that the heatsinks are installed properly see Chapter 5 This LED will remain flashing or on as long as the indicated condition exists NIC Indicates network activity on any of the LAN ports when flashing 3 4 SATA Drive Carrier LEDs Each SATA drive carrier has two LEDs Green When illuminated the green LED on the front of the SATA drive carrier indicates drive activity A connection to the SATA backplane enables this LED to blink on and off when that particular drive is being accessed Red There is no function associated with the red LED 3 2 Chapter 4 System Safety 4 1 Chapter 4 System Safety Electrical Safety Precautions A Basic electrical safety precautions should be followed to protect yourself from harm and the SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF from damage Be aware of the locations of the power on off switch on the chassis as well as the room s emergency power off switch disconnection switch or electrical outlet If an electrical accident occurs you can then quickly remove power from the system Do not work alone when working with high voltage components Power should always be disconnected from the system when removing or in stalling main system components such as the serverboard memory modules and floppy drive When disco
71. ndling the Serverboard Electrostatic Discharge ESD can damage electronic components To prevent damage to any printed circuit boards PCBs it is important to handle them very carefully see previous chapter To prevent the X8DTT HEF HIBXF HIBQF serverboard from bending keep one hand under the center of the board to support it when handling The following measures are generally sufficient to protect your equipment from electric static discharge Precautions Use a grounded wrist strap designed to prevent Electrostatic Discharge ESD Touch a grounded metal object before removing any board from its antistatic bag Handle a board by its edges only do not touch its components peripheral chips memory modules or gold contacts When handling chips or modules avoid touching their pins Put the serverboard add on cards and peripherals back into their antistatic bags when not in use For grounding purposes make sure your computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard 5 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Unpacking The serverboard is shipped in antistatic packaging to avoid electrostatic discharge When unpacking the board make sure the person handling it is static protected 5 2 Serverboard Installation This section explains the first step of physically mounting the X8DTT HEF HIBXF HIBQF in
72. ng 5 Place the replacement fan into the vacant space in the housing while making sure the arrows on the top of the fan indicating air direction point in the same direction as the arrows on the other fans 6 Confirm that the fan is working properly before replacing the chassis cover 6 3 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 6 4 Hard Drive Installation Removal Overview The hard drives are mounted in drive carriers to simplify their installation and removal from the chassis These carriers also help promote proper airflow for the system For this reason even empty carriers without drives installed must remain in the chassis Because of their hot swap capability you do not need to access the inside of the chassis or power down the system to install or replace hard drives Note The operating system you use must have RAID support to enable the hot swap capability of the hard drives Use caution when working around the hard drive backplane Do not touch the backplane with any metal objects and make sure no AN cables touch the backplane Also regardless of how many drives are installed all twelve drive carriers must remain in the chassis to maintain proper airflow IN Be aware that powering down a node will power down all the hard drives that are logically associated with it as shown in Figure 6 6 Installing and Removing Hard Drives Installing a Hard Drive into the Drive Carrier Empty drive
73. ng a network interface The options are Enabled and Disabled gt Super IO Device Configuration Serial Port1 Address Serial Port2 Address This option specifies the base I O port address and the Interrupt Request address of Serial Port 1 and Serial Port 2 Select Disabled to prevent the serial port from accessing any system resources When this option is set to Disabled the serial port physically becomes unavailable Select 3F8 IRQ4 to allow the serial port to use 3F8 as its I O port address and IRQ 4 for the interrupt address The options for Serial Porti are Disabled 3F8 IRQ4 3E8 IRQ4 2E8 IRQ3 The options for Serial Port2 are Disabled 2F8 IRQ3 3E8 IRQ4 and 2E8 IRQ3 gt Remote Access Configuration Remote Access This allows the user to enable the Remote Access feature The options are Disabled and Enabled If Remote Access is set to Enabled the following items will display Serial Port Number This feature allows the user decide which serial port to be used for Console Redi rection The options are COM 1 and COM 2 Serial Port Mode This feature allows the user to set the serial port mode for Console Redirection The options are 115200 8 n 1 57600 8 n 1 38400 8 n 1 19200 8 n 1 and 9600 8 n 1 Flow Control This feature allows the user to set the flow control for Console Redirection The options are None Hardware and Software Redirection After BIOS POST Select Disabled to turn off Console Redirect
74. niBand Connector The 3 Button In Front Panel UID LED is located at pin 17 4 Ground of JF2 and the Rear UID LED is located at Ground LE4 When you press the UID switch on the UID Switches amp LEDs front panel or on the back panel both Rear Description Location UID LED and Front Panel UID LED indicators Sch PU ow aA will be turned on Press the UID switch Rear Switch swi again to turn off both LED Indicators These ja PIS Pin 17 on JF2 e UID Indicators provide easy identification aa i Rear UID LED LE4 of a system unit that may be in need of service See the table on the right for pin definitions Note UID LED is supported by the physical switch or the BMC When it is controlled by the physical switch it will stay solid When it is controlled by the BMC it will blink 5 17 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 9 Jumper Settings Connector To modify the operation of the serverboard Pins jumpers can be used to choose between optional settings Jumpers create shorts between two pins to change the function of the connector Pin 1 is identified with a square solder pad on the printed circuit board See the serverboard layout pages Setting for jumper locations gt ENS Jumper Note On a two pin jumper Closed means the jumper is on both pins and Open means the jumper is either on only one pin or completely removed CMOS Clear
75. nnecting power you should first power down the operating system first and then unplug the power cords The unit has more than one power supply cord Disconnect two power supply cords before servicing to avoid electrical shock When working around exposed electrical circuits another person who is familiar with the power off controls should be nearby to switch off the power if neces sary Use only one hand when working with powered on electrical equipment This is to avoid making a complete circuit which will cause electrical shock Use extreme caution when using metal tools which can easily damage any electrical components or circuit boards they come into contact with Do not use mats designed to decrease static electrical discharge as protection from electrical shock Instead use rubber mats that have been specifically designed as electrical insulators The power supply power cords must include a grounding plug and must be plugged into grounded electrical outlets 4 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 4 2 This product may be connected to an IT power system In all cases make sure that the unit is also reliably connected to Earth ground Serverboard Battery CAUTION There is a danger of explosion if the onboard battery is installed upside down which will reverse its polarites see Figure 4 1 This battery must be replaced only with the same or an equivalent type recommended by the manufacturer D
76. nterrupt 19 at boot and allow the drives that are attached to these host adaptors to function as bootable disks If this item is set to Disabled the ROM BIOS of the host adap tors will not capture Interrupt 19 and the drives attached to these adaptors will not function as bootable devices The options are Enabled and Disabled gt Power Configuration Power Button Function If set to Instant_Off the system will power off immediately as soon as the user hits the power button If set to 4 Second Override the system will power off when the user presses the power button for 4 seconds or longer The options are Instant Off and 4 Second Override Restore on AC Power Loss Use this feature to set the power state after a power outage Select Power Off for the system power to remain off after a power loss Select Power On for the System power to be turned on after a power loss Select Last State to allow the System to resume its last state before a power loss The options are Power On Power Off and Last State Watch Dog Timer If enabled the Watch Dog Timer will allow the system to reboot when it is inactive for more than 5 minutes The options are Enabled and Disabled P Processor and Clock Options This submenu allows the user to configure the Processor and Clock settings Ratio CMOS Setting This option allows the user to set the ratio between the CPU Core Clock and the FSB Frequency Note if an invalid ratio is entered the AMI B
77. osch The Netherlands 31 0 73 6400390 31 0 73 6416525 sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support Super Micro Computer Inc 4F No 232 1 Liancheng Rd Chung Ho 235 Taipei County Taiwan R O C 886 2 8226 3990 886 2 8226 3991 www supermicro com tw support supermicro com tw 886 2 8226 5990 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Notes 1 8 Chapter 2 Server Installation 2 1 Chapter 2 Server Installation Overview This chapter provides a quick setup checklist to get the SYS 6026TT H6RF H6IBXRF H6IBQRF up and running Following these steps in the order given should enable you to have the system operational within a minimum amount of time This quick setup assumes that your system has come to you with the processors and memory preinstalled If your system is not already fully integrated with a serverboard processors system memory etc please turn to the chapter or section noted in each step for details on installing specific components 2 2 Unpacking the System You should inspect the box the system was shipped in and note if it was damaged in any way If the server itself shows damage you should file a damage claim with the carrier who delivered it Decide on a suitable location for the rack unit that will hold the server It should be situated in a clean dust free area that is well ventila
78. p of the chassis are clear and unobstructed Figure 2 1 Removing the Protective Film Check Ventilation Openings Warning Except for short periods of time do NOT operate the server AN without the cover in place The chassis cover must be in place to allow proper airflow and prevent overheating 2 4 Chapter 2 Server Installation 2 4 Rack Mounting Instructions This section provides information on installing the SC827 chassis into a rack unit with the quick release rails provided There are a variety of rack units on the market which may mean the assembly procedure will differ slightly You should also refer to the installation instructions that came with the rack unit you are using Note This rail will fit a rack between 26 and 33 5 deep Separating the Sections of the Rack Rails The chassis package includes two rail assemblies in the rack mounting kit Each assembly consists of two sections an inner fixed chassis rail that secures directly to the server chassis and an outer fixed rack rail that secures directly to the rack itself Figure 2 2 Separating the Rack Rails e Rail Assembly Separating the Inner and Outer Rails 1 Locate the rail assembly in the chassis packaging Extend the rail assembly by pulling it outward 3 Press the quick release tab Quick Release Tab 4 Separate the inner rail extension from the outer rail assembly Separating the Inner Rail EM 2 5
79. ptions are Disabled and Enabled gt IDE SATA Configuration When this submenu is selected the AMI BIOS automatically detects the presence of the IDE devices and displays the following items SATA 1 Configuration If Compatible is selected it sets SATA 1 to legacy compatibility mode while se lecting Enhanced sets SATA 1 to native SATA mode The options are Disabled Compatible and Enhanced Configure SATA 1 as This feature allows the user to select the drive type for SATA 1 The options are IDE RAID and AHCI When the option RAID is selected the item ICH RAID Code Base will appear When the option AHCI is selected the item SATA AHCI will be available ICH RAID Code Base This feature is available when the option RAID is selected Select Intel to enable Intel s SATA RAID firmware to configure Intel s SATA RAID settings Select Adaptec to enable Adaptec s SATA RAID firmware to configure Adaptec s SATA RAID settings The options are Intel and Adaptec SATA AHCI This feature is available when the option AHCI is selected Select Enable to enable the function of Serial ATA Advanced Host Interface Take caution when using this function This feature is for advanced programmers only The options are Enabled and Disabled If the option Enabled is selected the following item will display 7 11 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Hot Plug This feature is available when the option Enabled is selected
80. r DIMM Slots per Populated Registered any combination Channel per Channel SR Single Rank DRzDual Rank QR Quad Rank 2 1 Reg DDR3 ECC 800 1066 1333 SR or DR 2 1 Reg DDR3 ECC 800 1066 Note 1 QR 2 2 Reg DDR3 ECC 800 1066 1333 Mixing SR DR 2 2 Reg DDR3 ECC 800 Note 2 Mixing SR DR QR Note 1 1333 RDIMMs MHz will run at 1066 MHz BIOS automatic downgrading Note 2 1333 1066 RDIMMs MHz will run at 800 MHz BIOS automatic downgrading Note 3 Mixing of 1 35V and 1 5V DIMMs is not recommended 1 5V UDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Unb Speeds in MHz Ranks per DIMM Slots per Populated Unbuffered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank 2 1 Unb DDR3 ECC Non ECC 800 1066 1333 SR or DR 2 2 Unb DDR3 ECC Non ECC 800 1066 1333 Mixing SR DR Note 1 1333 MHz for two DIMMs per channel is supported when Unbuf ECC DIMMs are used Note 2 Mixing of 1 35V and 1 5V DIMMs is not recommended 1 35V RDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Reg Speeds in MHz Ranks per DIMM Slots per Populated Registered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank 2 1 Reg DDR3 ECC 800 1066 1333 SR or DR 2 1 Reg DDR3 ECC 800 Note 1 QR 2 2 Reg DDR3 ECC 800 1066 Note 2 Mixing SR DR 2 2 Reg DDR3 ECC 800 Note 3 Mixing SR
81. r blockage High The processor is running hot This is a caution level since the CPU s Tem perature Tolerance has been reached or has been exceeded and may activate an overheat alarm 7 17 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual User intervention If the system buzzer and Overheat LED has activated take action immediately by checking the system fans chassis ventilation and room temperature to correct any problems Notes 1 The system may shut down if it continues for a long period to prevent damage to the CPU 2 The information provided above is for your reference only For more information on thermal management please refer to Intel s Web site at www Intel com System Temperature The system temperature will be displayed in degrees in Celsius and Fahrenheit as it is detected by the BIOS Fan Speed Control Monitor This feature allows the user to decide how the system controls the speeds of the onboard fans The CPU temperature and the fan speed are correlative When the CPU on die temperature increases the fan speed will also increase and vice versa Select Workstation if your system is used as a Workstation Select Server if your system is used as a Server Select Disabled Full Speed 12V to disable the fan speed control function and allow the onboard fans to constantly run at the full speed 12V The Options are 1 Disabled Full Speed 2 Server Mode 3 Workstation Mod
82. r body which are excellent metal 4 3 conductors that can create short circuits and harm you if they come into contact with printed circuit boards or areas where power is present After accessing the inside of the system close the system back up and secure it to the rack unit with the retention screws after ensuring that all connections have been made ESD Precautions A Electrostatic discharge ESD is generated by two objects with different electrical charges coming into contact with each other An electrical discharge is created to neutralize this difference which can damage electronic components and printed circuit boards The following measures are generally sufficient to neutralize this difference before contact is made to protect your equipment from ESD Use a grounded wrist strap designed to prevent static discharge Keep all components and printed circuit boards PCBs in their antistatic bags until ready for use Touch a grounded metal object before removing the board from the antistatic bag Do not let components or PCBs come into contact with your clothing which may retain a charge even if you are wearing a wrist strap Handle a board by its edges only do not touch its components peripheral chips memory modules or contacts When handling chips or modules avoid touching their pins Put the serverboard and peripherals back into their antistatic bags when not in use For grounding purposes make sure yo
83. re Enabled and Disabled Intel C STATE Tech If enabled C State is set by the system automatically to either C2 C3 or C4 state The options are Disabled and Enabled C State package limit setting If set to Auto the AMI BIOS will automatically set the limit on the C State package register The options are Auto C1 C3 C6 and C7 C1 Auto Demotion When enabled the CPU will conditionally demote C3 C6 or C7 requests to C1 based on un core auto demote information The options are Disabled and Enabled C3 Auto Demotion When enabled the CPU will conditionally demote C6 or C7 requests to C3 based on un core auto demote information The options are Disabled and Enabled Clock Spread Spectrum Select Enable to use the feature of Clock Spectrum which will allow the BIOS to monitor and attempt to reduce the level of Electromagnetic Interference caused by the components whenever needed The options are Disabled and Enabled gt Advanced Chipset Control The items included in the Advanced Settings submenu are listed below gt CPU Bridge Configuration QPI Links Speed This feature selects QPI s data transfer speed The options are Slow mode and Full Speed QPI Frequency This selects the desired QPI frequency The options are Auto 4 800 GT 5 866GT 6 400 GT 7 7 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual QPI LOs and L1 This enables the QPI power state to low power LOs and L1 are automatically selected by
84. re boot the system before proceeding with the next item on the list The bottom icon with a CD on it allows you to view the entire contents of the CD 5 22 Chapter 5 Advanced Serverboard Setup 5 14 Configuring Supero Doctor Ill The Supero Doctor Ill program is a web based management tool that supports remote management capability It includes Remote and Local Management tools The local management is called the SD III Client The Supero Doctor III program included on the CDROM that came with your motherboard allows you to monitor the environment and operations of your system Supero Doctor Ill displays crucial System information such as CPU temperature system voltages and fan status See the Figure below for a display of the Supero Doctor III interface Notes The default User Name and the Password are ADMIN In the Windows OS environment the Supero Doctor Ill settings take precedence over the BIOS settings When first installed Supero Doctor Ill adopts the temperature threshold settings previously set in the BIOS Any subsequent changes to these thresholds must be made within Supero Doctor since the SD III settings override the BIOS settings For the Windows OS to adopt the BIOS temperature threshold settings please change the SDIII settings to be the same as those set in the BIOS Supero Doctor III Interface Display Screen Health Information 5 23 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual
85. removed tions below to prevent damage to the CPU or the CPU socket 1 Remove power from the system and unplug the AC power cord from the power supply 2 Disconnect the heatsink fan wires from the CPU fan header 3 Using a screwdriver loosen and remove the heatsink screws from the motherboard in the sequence as show in the picture on the right Remove Screw 1 4 Hold the heatsink as shown in the picture on the right and gently wriggle the heatsink to loosen it from the CPU Do not use excessive force when wriggling the heatsink 5 Once the heatsink is loose remove it from the CPU socket 6 To reinstall the CPU and the heatsink clean the surface of the CPU and the heatsink to get rid of the old thermal grease Reapply the proper amount of thermal grease on the CPU surface before reinstalling the heatsink 5 7 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 5 Installing Memory CAUTION Exercise extreme care when installing or removing DIMM modules to prevent any possible damage Memory Support Each X8DTT HEF HIBXF HIBQF has twelve 240 pin DIMM slots that can support up to 192 GB of registered ECC DDR3 1333 1066 800 SDRAM for a total of 768 GB in the system or up to 48 GB of unbuffered ECC non ECC DDR3 1333 1066 800 SDRAM for a total of 384 GB in the system Note Check the Supermicro web site for recommended DIMMs Installing Memory Modules 1 Insert each memory modul
86. rottling Open Loop Throttling improves reliability and reduces power in the processor by automatic voltage control during processor idle states Available options are Disabled and Enabled If Enabled the following items will appear Hysteresis Temperature Temperature Hysteresis is the temperature lag in degrees Celsius after the set DIMM temperature threshold is reached before Closed Loop Throttling begins The options are Disabled 1 5 C 3 0 C and 6 0 C Guardband Temperature This is the temperature which applies to the DIMM temperature threshold Each step is in 0 5 C increment The default is 006 Press or on your keyboard to change this value Inlet Temperature This is the temperature detected at the chassis inlet Each step is in 0 5 C increment The default is 070 Press or on your keyboard to change this value Temperature Rise This is the temperature rise to the DIMM thermal zone Each step is in 0 5 C increment The default is 020 Press or on your keyboard to change this value Air Flow This is the air flow speed to the DIMM modules Each step is one mm sec The default is 1500 Press or on your keyboard to change this value Altitude This feature defines how many meters above or below sea level the system is located The options are Sea Level or Below 1 300 301 600 601 900 901 1200 1201 1500 1501 1800 1801 2100 2101 2400 2401 2700 2701 3000
87. sert the driver diskette Intel AA RAID XP 2000 2003 Driver for ICH10R into the floppy drive and press the Enter key Choose the Intel R ICH10R SATA RAID Controller from the list indicated in the XP 2003 Setup Screen and press the Enter key Press the Enter key to continue the installation process If you need to specify any additional devices to be installed do it at this time Once all devices are specified press the lt Enter gt key to continue with the installation From the Windows XP 2003 Setup screen press the Enter key The XP 2003 Setup will automatically load all device files and then continue the Windows XP 2003 installation After the Windows XP 2003 OS Installation is completed the system will automatically reboot B 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 2 1 Installing Windows for a Non RAID System Insert Microsoft s Windows XP 2003 Setup CD in the CD drive and the system will start booting up from CD Continue with the OS installation The Windows OS Setup screen will display From the Windows XP 2003 Setup screen press the lt Enter gt key The XP 2003 Setup will automatically load all device files and then continue with the Windows XP 2003 installation After the Windows XP 2003 OS Installation is completed the system will automatically reboot Insert the Supermicro Setup CD that came with your motherboard into the CD Drive during system boot and th
88. sociated with each serverboard node in the chassis Each control panel has LEDs to indicate power on network activity power fail fan fail system overheat conditions and the UID LED Each control panel also includes a main power button and a UID button Rear I O Panel The SC827HQ R1400B is a 2U rackmount chassis Its I O panel provides a slots for four low profile PCI Express x16 expansion cards four COM ports eight USB ports four VGA ports and eight Gb Ethernet ports See Chapter 6 for details Cooling System The SC827HQ R1400B chassis has an innovative cooling design that features four 8 cm high performance fans A fan speed control setting in BIOS allows fan speed to be determined by system temperature See Chapter 6 for details SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 1 4 2U Twin System Notes As a 2U Twin configuration the SYS 6026TT H6RF H6IBXRF H6IBQRF is a unique server system With four system boards incorporated into a single chassis acting as four separate nodes there are several points you should keep in mind Nodes Each of the four serverboards act as a separate node in the system As independant nodes each may be powered off and on without affecting the others In addition each node is a hot swappable unit that may be removed from the rear of the chassis The nodes are connected to the server backplane by means of an adapter card System Power The SYS 6026TT H6RF H6IBXRF H6IBQRF h
89. te Options printed in Bold are default settings How To Change the Configuration Data The configuration data that determines the system parameters may be changed by entering the AMI BIOS Setup utility This Setup utility can be accessed by pressing Del at the appropriate time during system boot 7 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Starting the Setup Utility Normally the only visible Power On Self Test POST routine is the memory test As the memory is being tested press the lt Delete gt key to enter the main menu of the AMI BIOS Setup Utility From the main menu you can access the other setup screens An AMI BIOS identification string is displayed at the left bottom corner of the screen below the copyright message Warning Do not upgrade the BIOS unless your system has a BIOS related issue Flashing the wrong BIOS can cause irreparable damage to the system In no event shall Supermicro be liable for direct indirect special incidental or consequential damages arising from a BIOS update If you have to update the BIOS do not shut down or reset the system while the BIOS is updating This is to avoid possible boot failure 7 2 Main Setup When you first enter the AMI BIOS Setup Utility you will enter the Main setup screen You can always return to the Main setup screen by selecting the Main tab on the top of the screen The Main BIOS Setup screen is shown below BIOS SETUP UTILITY System T
90. te haee 7 1 Starting BIOS Setup Utilily aui ceo rrt neon eee 7 1 How To Change the Configuration Data ssssssssssseeeeenees 7 1 Starting the Setup Utility 7 2 72 gt Main Set p oe eee Eh 7 2 7 8 Advanced Setup Configurations esee 7 4 4 4 Security Settings eei edere ener cce ree re e dre 7 23 4 bo Boot Configutalior neo io emere ere EEA EE OREA 7 24 7 6 Exit Options vis 7 7 BIOS RECOVERY iuste cen ton enin n dieser tiani dE d Ga cen 7 26 How to Recover the AMIBIOS Image the Main BIOS Block 7 27 Boot Sector Recovery from a USB Device sseee 7 27 Boot Sector Recovery from an IDE CD ROM see 7 27 Boot Sector Recovery from a Serial Port Serial Flash 7 28 Appendix A BIOS Error Beep Codes A 1 BIOS Error Beep Cogs sissies a ueteres A 1 Appendix B Installing Windows viii Table of Contents B 1 Installing Windows for a RAID System B 2 Installing Windows for a Non RAID System sessen B 2 Appendix C System Specifications SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Notes Chapter 1 Introduction 1 1 Chapter 1 Introduction Overview The SuperServer SYS 6026TT H6RF H6IBXRF H6IBQRF is a 2U Twin2 server comprised of the SC827HQ R1400B 2U chassis and four X8DTT HEF HIBXF HIBQF serverboards Please refer to our web site for information on op
91. ted Avoid areas where heat electrical noise and electromagnetic fields are generated You will also need it placed near a grounded power outlet Be sure to read the Rack and Server Precautions in the next section 2 3 Preparing for Setup The box the server was shipped in should include the rackmount hardware needed to install the system into the rack Follow the steps in the order given to complete the installation process in a minimum amount of time Please read this section in its entirety before you begin the installation procedure outlined in the sections that follow 2 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Choosing a Setup Location Leave enough clearance in front of the rack to enable you to open the front door completely 725 inches Leave approximately 30 inches of clearance in the back of the rack to allow for sufficient airflow and ease in servicing This product is for installation only in a Restricted Access Location dedicated equipment rooms service closets and the like This product is not suitable for use with visual display work place devices accord ing to 2 of the the German Ordinance for Work with Visual Display Units A N Warnings and Precautions ZN Rack Precautions Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them In single rack installation stabilizers should be atta
92. ter 7 BIOS Introduction This chapter describes the AMI BIOS Setup Utility for the X8DTT HEF HIBXF HIBQF The AMI ROM BIOS is stored in a Flash EEPROM and can be easily updated This chapter describes the basic navigation of the AMI BIOS Setup Utility setup screens Starting BIOS Setup Utility To enter the AMI BIOS Setup Utility screens press the lt Delete gt key while the system is booting up Note In most cases the lt Delete gt key is used to invoke the AMI BIOS setup screen There are a few cases when other keys are used such as F1 F2 etc Each main BIOS menu option is described in this manual The Main BIOS setup menu screen has two main frames The left frame displays all the options that can be configured Grayed out options cannot be configured Options in blue can be configured by the user The right frame displays the key legend Above the key legend is an area reserved for a text message When an option is selected in the left frame it is highlighted in white Often a text message will accompany it Note the AMI BIOS has default text messages built in Supermicro retains the option to include omit or change any of these text messages The AMI BIOS Setup Utility uses a key based navigation system called hot keys Most of the AMI BIOS setup utility hot keys can be used at any time during the setup navigation process These keys include F1 lt F10 gt Enter ESC ar row keys etc No
93. the motherboard The options are Disabled and Enabled Memory Frequency This feature forces a DDR3 frequency slower than what the system has detected The available options are Auto Force DDR 800 Force DDR 1066 and Force DDR 1333 Memory Mode The options are Independent Channel Mirror Lockstep and Sparing Independent All DIMMs are available to the operating system Channel Mirror The motherboard maintains two identical copies of all data in memory for redundancy Lockstep The motherboard uses two areas of memory to run the same set of operations in parallel Sparing A preset threshold of correctable errors is used to trigger fail over The spare memory is put online and used as active memory in place of the failed memory Demand Scrubbing A memory error correction scheme where the Processor writes corrected data back into the memory block from where it was read by the Processor The op tions are Enabled and Disabled Patrol Scrubbing A memory error correction scheme that works in the background looking for and correcting resident errors The options are Enabled and Disabled NUMA Support Select Enabled to use the feature of Non Uniform Memory Access to improve CPU performance The options are Enabled and Disabled Memory ECC Error Threshold This feature allows the user to set the threshold for the ECC memory errors The default setting is 2047 7 8 Chapter 7 BIOS Throttling Closed Loop Th
94. tions e Use a grounded wrist strap designed to prevent static discharge Touch a grounded metal object before removing any board from its antistatic bag Handle a board by its edges only do not touch its components peripheral chips memory modules or gold contacts When handling chips or modules avoid touching their pins Put the serverboard add on cards and peripherals back into their antistatic bags when not in use For grounding purposes make sure your computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard Unpacking The serverboard is shipped in antistatic packaging to avoid static damage When unpacking the board make sure the person handling it is static protected 6 1 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Figure 6 1 Chassis Front View Node B Control Panel Node D Control Panel ki S co Ss a a e SEITE Ka en SATA Drives Node A Control Panel Node C Control Panel Figure 6 2 Chassis Rear View
95. to the SC827HQ R1400B chassis Following the steps in the order given will eliminate the most common problems encountered in such an installation To remove the serverboard follow the procedure in reverse order Accessing the Inside of the System 1 Remove all four screws securing the top cover of the chassis two at the top rear of the cover and one on each side lip also near the back Place both thumbs in the indentations and push the cover back until it slides off Lift the top cover from the chassis to gain full access to the inside of the server If already installed in a rack grasp the two handles on either side and pull the unit straight out until the rails lock into place See Figure 2 4 Check Compatibility of Serverboard Ports and I O Shield 1 The X8DTT HEF HIBXF HIBQF in a Twin 1U configuration requires the use of Supermicro s 1U Twin chassis the SC827HQ R1400B Make sure that the I O ports on the serverboards align properly with their respective holes in the I O shield at the back of the chassis when installing Mounting the Serverboard onto the Serverboard Tray 1 Carefully mount the serverboards by aligning the board holes with the raised metal standoffs that are visible in the chassis Insert screws into all the mounting holes on your serverboards that line up with the standoffs and tighten until snug if you screw them in too tight you might strip the threads Metal screws provide an electrica
96. tree denen 5 Serverboard Details ete i ende en redeo 5 8 Connector Definitions enne nennen 5 9 Jumper Settings cei tracer ri eite teoria Pura re tnter sb eda 5 10 Onboard Indicators 511 SATAand SAS POMS ence a a ep E ea e REA P Pd do vii SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 5 12 Installing Additional Drivers eee sess eesee cence eeeeeeeeeeeseaeeeeeeeeeeseeeeees 5 22 5 14 Configuring Supero Doctor lll 5 23 Chapter 6 Advanced Chassis Setup 6 1 Static Sensitive Devices recedere tee per aa 6 1 Precautions acini r a a E aE 6 1 Unpacking 6 2 Comro Panel ergangen ita eA AS P AEE EARE 6 2 6 3 System Falle ecrire rarae re eee ie D E REP Ha E tics 6 2 Fan Configuration ice e ceti t teta pcc der bares endete rta 6 3 System Far Falle uis cea ee eto e Rr i e idees 6 3 6 4 Hard Drive Installation Removal seen 6 4 ou 6 4 Installing and Removing Hard Drives eene 6 4 6 5 Node Installation REMOWVAl irren niens 6 7 6 6 Installing the Air Shrouds Air Shirouds crat me nt e odere ra aite TOR ET ERE 6 7 Power SUPPI icici etate tt tono en inan cat d e de deste Power Supply Failure Single Power Supply Module 6 9 Power Supply Failure Redundant Power Two Modules 6 10 Chapter 7 BIOS 7 1 IntrodUctlOh etm retten te
97. ur computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 4 4 Operating Precautions A Care must be taken to assure that the chassis cover is in place when the SYS 6026TT H6RF H6IBXRF H6IBQRF is operating to assure proper cooling Out of warranty damage to the system can occur if this practice is not strictly followed Figure 4 1 Installing the CR2032 Onboard Battery LITHIUM BATTERY BATTERY HOLDER any way a damaged battery may release hazardous materials into the environment Do not discard a used battery in the garbage or a public landfill Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly Please handle used batteries carefully Do not damage the battery in 4 4 Chapter 5 Advanced Serverboard Setup Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to install the X8DTT HEF HIBXF HIBQF serverboard into the SC827HQ R1400B chassis connect the data and power cables and install add on cards All serverboard jumpers and connections are also described A layout and quick reference chart are included in this chapter for your reference Remember to completely close the chassis when you have finished working with the serverboard to better cool and protect the system 5 1 Ha
98. v hazardouswaste perchlorate C 3 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Notes continued from front The products sold by Supermicro are not intended for and will not be used in life support systems medical equipment nuclear facilities or systems aircraft aircraft devices aircraft emergency com munication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage Accordingly Supermicro dis claims any and all liability and should buyer use or sell such products for use in such ultra hazardous applications it does so entirely at its own risk Furthermore buyer agrees to fully indemnify defend and hold Supermicro harmless for and against any and all claims demands actions litigation and proceedings of any kind arising out of or related to such ultra hazardous use or sale C4
99. ve a second or less to do so 7 29 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual 6 Once you ve completed the instructions given a screen will display to indicate that remote flashing is starting and the new BIOS file is being uploaded 7 To use Hyper Terminal to transfer the XModem protocol by using the Send File dialog under the Transfer menu follow the instructions below to complete XModem transfers a b Select the Transfer menu and enter lt Send gt Specify the location of the ROM file and select the proper protocol XMo dem Press lt Send gt to start ROM File extraction See the picture below Once the ROM file extraction is completed the message New BIOS re ceived OK will display 8 Once remote BIOS flash is completed the system will reboot Note AMIBIOS Serial Flash will work with any terminal communications program that supports VT 100 and XModem protocols including protocols designed for GNU LINUX amp BSD operating systems such as minicom It is recommended that the terminal program be configured to use the CR LF style of line termination 7 30 Appendix A BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the POST Power On Self Test routines which are performed each time the system is powered on errors may occur Non fatal errors are those which in most cases allow the system to continue the boot up process The error messages norm
100. will automatically enter the IP address of this machine however it may be over ridden IP addresses are 6 two digit hexadecimal numbers separated by dots Current IP Address in BMC This item displays the current IP address used for your IPMI connection MAC Address Configuration Enter the Mac address for this machine This should be in decimal and in dotted quad form i e 192 168 10 253 The value of each three digit number separated by dots should not exceed 255 as shown in the screen below Parameter Selector Use this feature to select the parameter of your Mac Address configuration Mac Address The BIOS will automatically enter the Mac address of this machine however it may be over ridden Mac addresses are 6 two digit hexadecimal numbers Separated by dots Current Mac Address in BMC This item displays the current Mac address used for your IPMI connection gt Subnet Mask Configuration Subnet masks tell the network which subnet this machine belongs to The value of each three digit number separated by dots should not exceed 255 Parameter Selector Use this feature to select the parameter of your Subnet Masks configuration 7 21 SUPERSERVER SYS 6026TT H6RF H6IBXRF H6IBQRF User s Manual Subnet Mask This item displays the current subnet mask setting for your IPMI connection Current Subnet Mask in BMC This item displays the current subnet mask used for your IPMI connection gt Gateway Address Conf

Supermicro 6026TT-HDIBQRF

Contents

Download Pdf Manuals

Related Search

Related Contents