Home

Mellanox Technologies VLT-30034 network switch

1. cccccsssecccccceeeseeeeceeeseceeesseeeceeesseeeeeeesaeaseeeessaaeeeess 47 Figure 16 Installing a Cabling Guide Bracket sliding rail 47 Figure 17 Cable ManagemMeEnt i 47 Figure 18 Gonsole Cable KIMANO i ibtd albi ciali alal 50 Figure 19 QSFP Connector DIMENSIONS iii 54 Figure 20 QSFP and 10 GDE COME io ete lella 55 Figure 21 SFP Conecto DIMENSION Staves vse iaia Wat gusta Du qa 56 Figure 22 Straight through CAES ii 57 Figure 23 Cross connect Cables sse eee a du alal 57 List of Tables Table 1 Grid Director 4036E Front Panel Components nennen 16 il able 2 RearPanerComponenis Leelee bian 17 Table 3 Ordering Information for the Grid Director 4036E i 19 Table 4 Ordering Information for the Grid Director 4036E MOdUleS 19 Table 5 Grid Director 4036E List of Parts According to Configuration 20 Table 6 Grid Director 4036E Technical Data ii 21 Table 7 Power Supply Module Data iii 23 Table 8 Gd Director 4036E EED Indications suu oreet es i ae ea e 23 N77 1717712171717 Contents aple o TOGDE LED MAIC S erario a 25 gio wird 27 Table 11 Free Falla afosa east 28 Table 12 Clearance Requirements lella ela 28 Table 13 Unpacked Weights amp Dimensions o
2. Technical Specifications and Certifications Test Description half sine Shock test for Z axis 3 shocks 10ms duration each shock Table 11 Free Fall Test Description Number of drops of test The packaged equipment is dropped once on each of its six surfaces item 5 9 Chassis Clearance Requirements The following table details the Grid Director 4036E clearance requirements Table 12 Clearance Requirements Area Recommended Minimum Clearance 5 10 Weights and Dimensions The following table details the Grid Director 4036E and modules weights and dimensions Table 13 Unpacked Weights amp Dimensions Module English Ibs in Metric kg cm Wim D w mH Wei o w ju Power Supply 2 8 10 2 4 9 1 6 1 3 26 12 4 4 in 2 54 cm kg 2 205 Ibs Including handles Without rack brackets Table 14 Packed Weights amp Dimensions Module English Ibs in Metric kg cm Grid Director 4036E Installation Manual 5 11 Acoustic Data The Grid Director 4036E acoustic noise Sound Pressure Level is 64 3 dB A 5 12 Export Information The Grid Director Export Control Classification Number ECCN is 5A002 a 1 5 13 Shipping Restrictions None Hardware Installation 6 Hardware Installation 6 1 Hardware Installation Overview This chapter describes how to prepare your site for installation and how to prepare and install the Grid Director 4036E The Grid Director
3. gt Case 3 When the physical link indicator is OFF is the InfiniBand cable or connector faulty When the physical link indicator is ON the logical link indicator is OFF and the SM indicator is ON the InfiniBand cable or the connector is faulty In case the InfiniBand cable is faulty replace the cable If you could not solve the problem contact your Support representative 9 3 Preparation before Contacting Customer Support If you are unable to solve a startup problem after using the troubleshooting suggestions in this chapter contact a customer service representative for assistance and further instructions Before you call have the following information ready to help your service representative assist you as quickly as possible e Date you received the Mellanox Grid Director 4036E e Chassis serial number located on a label on the bottom of the chassis e Type of software and release number e Maintenance agreement or warranty information e Brief description of the problem e Brief explanation of the steps you have already taken to isolate and solve the problem 53 Troubleshooting Appendix A Cabling Information and Specifications A 1 QSFP Cable QSFP Quad Small Form factor Pluggable Key Features e Small size high density hot pluggable connector with four transmit and four receive channels Supports both types of cables Copper active or passive cable Copper passive cable equipped with two sim
4. InfiniBand Port 34 Connector copper cables active optical cables and connect optical cables 10Gbps Ethernet SFP IGbE IOGbE SFP ports ports RS232 serial interface Fe D sub 9 pin connector serial interface for the CLI 10 100 1000 Ethernet Gigabit Ethernet auto negotiating RJ 45 Connector for port management purposes RJ 45 Connector Speed 1Gbps 100Mbps 10Mbps amp LED Provides out of band management interface over a local network 4X QSFP InfiniBand connectors for passive copper cables active LEDs Status 4 Rear panel LEDs Indicators Pwr PS FAN Info SM T O Status Refer to LED Indicators on page 23 for the list of LEDs and their descriptions InfiniBand Port Indicators Indicate the physical and logical status of each InfiniBand port 2 LEDs per port 4 10Gb E port indicators 10GbE port indicators Indicate the physical and logical status of each IOGDbE port 2 LEDs per port Getting Started Item Component Qty Description Green Physical link LED Orange Logical link USB connector Type One USB 2 0 Host interface allows you to increase the CPU flash A memory by a connection to a standard Disk On Key device Chassis reset button When pressed for more than 1 second resets the entire unit NOTE InfiniBand port 1 is located at the bottom left hand side of the rear panel InfiniBand port 34 is at the top right hand side gie Grid Director 4036E Installation M
5. Table 16 Site Preparation Checklist Task Prepared by Date Notes Measure space for the rack including specified maintenance pee 6 5 Measuring the Distance between Mounting Rails To measure the distance between the rack s mounting rails 1 Place the 4036E chassis on a flat surface 2 With the use of a measuring tape measure the front to back distance between the rack vertical mounting rails This step is very important so that you know exactly how to calculate the exact rail length 3 Mark the rack s U levels at which you would like to mount the switch This is important so that you can install the clip nuts in the adequate holes and ensure that the chassis 1s leveled 4 Using a flat screwdriver install the clip nuts in the rack at the U level noted in 3 6 6 Assembling and Mounting the Rail 6 6 1 Rail Kit Mellanox supplies the fixed rail as part of the rail kit and accommodates different rack depths The rail mounting has holes that are spaced two inches apart You can mount them in several positions along the side of the chassis to accommodate the depth of the rack The following table shows the list of items required for the installation of the fixed rail Note Item sizes are not proportional 32 Grid Director 4036E Installation Manual Table 17 Rail Kit P N KIT 00008 Detailed Part List Item Illustration P N 2 x short bracket 290000169 2 x Mounting Bar MEC 0055 6 14 x Pan Head FA
6. 1000 Fast Ethernet port supports a RJ 45 connector 97
7. 4036E before connecting to the Power Supply Voir la notice d installation avant de reccorder au reseau VLT XXX XXR Vordem ansch liessen ans PIN OO rte S N MMWWY Yxxxxxx 100 240V 50 60Hz 5 0A CELLULE DET acd woo iL This device complies with part 15 of FCC rules RSS Operation is subject to the following two conditions C A A i A 1 This device may not cause harmful interference cv med i J 2 This device must accept any interference received including interference that may cause undesired operation PG fue z a l re aia Canada CES NMB 003 Class Classe A us E112713 LOXNIX 2 DA ARMENI CI ONNTENERUR CU 03 5 ETEGUGEES AIT T LHDN ET TORRITA D AA x EMPSIIERIENDIEPDD AS VCCI A VOLTAIRE Shock and Vibration Prepare the Grid Director 4036E to ship by carefully following the rail kit installation instructions as detailed in Hardware Installation on page 30 The Grid Director 4036E is susceptible to shock and vibration if the rail kit installation instructions are not followed precisely The following tables detail the Grid Director 4036E vibration and free fall tests for transportation Table 10 Vibration Test Description Non Operating Random Frequency range 5 300Hz Vibration uu Vibration level Z axis 1 03g RMS X Y axis 0 698g RMS Operating Sine Frequency range 5 500Hz Vibration mM Vibration level 0 1G peak Operating Shock Vibration Level Z axis 5g peak
8. 4036E is a 19 rack mounted 1U high chassis provided with a rail kit accommodating racks of different depths with a front to back distance between mounting rails of 26 to 36 660 mm to 914 mm Mellanox recommends using the optional Grid Director 4036E Cabling Guide Brackets to arrange the numerous cables that are connected to a chassis 6 2 Installation Options Option 1 Install the front of the switch facing the front of the rack and with a 5 in indentation This allows AC inlets accessibility from the front of the rack while the power cables are routed sideways to the power source Refer to Option 1 on page 34 for more details Option 2 The rear of the switch InfiniBand connector side faces the front of the rack and is installed in line with the rack s front rails Refer to Option 2 on page 40 for more details CAUTION Before installing the Grid Director 4036E in a rack read the sections on Site Planning on page 31 and Safety Information to get familiar with proper site and environmental conditions 6 2 1 Cooling For both option 1 and option 2 above the switch can support both front to rear and rear to front cooling options based on the specific part number that was ordered different fan unit 6 3 Required Tools This section lists the materials and tools required for mounting the Grid Director 4036E into a rack Table 15 Material and Tools Required Quantity Description ri 00 Ma _
9. Phillips screws not provided by Mellanox Grid Director 4036E Installation Manual 6 4 Site Planning Planning the proper location and layout of your equipment rack or wiring closet is essential for successful Grid Director 4036E operation Placing the equipment too close together or in an inadequately ventilated area can result in overheating of the system In addition poor equipment placement can render system panels inaccessible and difficult to maintain To ensure normal operation and avoid unnecessary maintenance plan your site configuration and prepare your site before installation 6 4 1 Rack and Clearance Requirements The Grid Director 4036E occupies 1U in a 19 rack You can mount it either way with the InfiniBand ports facing the rear or the front of the rack Switch cooling direction 1s either from back to front or front to back according to the switch fan unit configuration The rack brackets mounting holes conform to the IEA 310 standard for 19 inch racks There are no restrictions on rack location Mellanox recommends e Mounting the Grid Director 4036E near the middle of the rack at or near eye level to make It easy to see status indicators port numbers etc e Mounting the rear side of the Grid Director 4036E in a way that enables easy access to the InfiniBand cables connectors and LED indicators e Leavinga4 10 cm for chassis clearance both at the front and the rear of the chassis These requiremen
10. gt Mellanox CLI Guest Mode Mellanox CLI admin mode Mellanox CLI admin mode String lt gt or Strings in lt gt or are descriptions of what will actually be shown on the screen for example the contents of lt your ip gt could be 192 168 1 1 Management GUI label item New Network Management GUI labels and item name New Environment names appear in bold whether or not the name is explicitly displayed for example buttons and icons User text entered into Manager Env1 Network1 Note the quotes The text entered e g to assign as the name of a does not include the quotes logical object Grid Director 4036E Installation Manual 1 Introduction 1 1 Grid Director 4036E Overview The Mellanox Grid Director 4036E is a high performance low latency and fully non blocking InfiniBand switch which includes a built in low latency Ethernet gateway for bridging traffic to and from Ethernet based networks or storage With thirty four 40 Gbps InfiniBand ports delivering 2 72 Tbps less than 100 nanoseconds of port to port latency and two 1 10Gb Ethernet ports bridging traffic in less than two microseconds I O bottlenecks are removed making applications operate at maximum efficiency The Grid Director 4036E is a self contained full solution including an InfiniBand switch an embedded subnet manager and a built in hardware based cut thru low latency Ethernet gateway in a compact 1U device The following fi
11. gt To connect a cable to a Grid Director 4036E 1 Insert the cable into the Cabling Guide bracket if it applies 2 Position the connector opposite a connector located on the rear of the 4036E chassis Depending upon the connector type squeeze the tabs on either side of the head shell and push the connector in place OR Gently push the latch and push the connector in place 3 Verify that the cable is inserted properly into the connector by gently tugging the cable verify that the Link State green colored LED lights and does not flash indicating a good physical connection 48 Grid Director 4036E Installation Manual 4 Route the cable to the nearest convenient rack location and gently fasten in place with Velcro tie or tie wraps CAUTION Avoid using tie wrap guns or similar tools do not fasten the cables too tightly as this may cause irreversible damage Tie wraps and zip ties could cause potential damage to the cables We recommend Velcro tie Do not bend the InfiniBand cables too sharply The minimum bend radius is 4 10 cm gt Cabling Do s and Don ts Do not kink the cable Do not over bend the cable behind the connector Do not twist the connector For Port Cable Specifications refer to Cabling Information and Specifications on page 54 7 4 Multipurpose Management Mng Console Cable For out of band management of a Grid Director 4036E Mellanox provides a single Multi purpose cab
12. 0mm Every 10G port on the switch is connected via an AEL2005 PHY device that can adjust to fit different types of link characteristics with either optical or copper cables The SFP cable transmits and receives up to 10 Gbps per port over a single optical or copper cable Active copper and optic cables consume up to 1 Watt Passive copper cables do not consume additional power This appendix provides cabling and port pinout information for the Grid Director 4036E A 3 IB Port Cable Specifications For information regarding which specific cable vendors lengths are supported with Mellanox switches please contact Mellanox support A 4 SFP Port cable Specifications The following table describes cabling specifications for the 4036E 10Gb E ports Table 18 4036E 10Gb E Ports Cabling Specifications Type Maximum Fiber Length Supported Length ft Length m Mellanox Cable P N modules Optic SR Finisar 4036E lt gt Cisco Pro Curve Grid Director 4036E Installation Manual Type Maximum Fiber Length A 5 1 GbE Ports Management Use modular RJ 45 straight through UTP cables to connect the 10 100 1000 Fast Ethernet ports to external switches and routers Use modular RJ 45 cross connect cables to connect to end systems Figure 22 Straight through Cables Pin mumbai Pin rbai Figure 23 Cross connect Cables Pin number Pin number mi ser DO 4 gm gc Ki M En Tx ra _ Em The 10 100
13. 1 A2 2003 EN 61000 3 2 00 A2 05 Harmonic current emissions EN 61000 4 2 1995 Al 98 A2 2001 EN 61000 4 3 02 Al 2002 EN 61000 4 4 1995 Al 01 A2 2001 EN 61000 4 5 1995 Al 2001 EN 61000 4 6 1996 Al 2001 EN 61000 4 8 1993 A1 2000 EN 61000 4 11 1994 Al 2001 EN 61000 3 3 95 A1 01 Voltage fluctuations and flicker Japan VCCI Technical Requirements V 3 2001 04 CISPR 22 1997 A1 2000 A2 2002 Class A Australian New Zealand C Tick AS NZS CISPR22 2009 Class A e KCC Korea gt Restricted Hazardous Substances Certification RoHS 6 gt InfiniBand Certification IBTA 1 2 Note For information about the certifications for each Mellanox product see the Mellanox Regulatory and Compliance document 5 5 Gost R Certification Mellanox products comply with the Gost R Russian safety regulations 5 6 Declarations 5 6 1 Declaration of Conformity Mellanox products comply with the Radio amp Telecommunications Terminal Equipment Directive 99 5 EEC the EMC Directive 2004 108 EC and of the Low Voltage Directive 2006 95 EC 5 6 2 Hazardous Substances RoHS 6 Compliance Declaration Mellanox products comply with the RoHS directive Grid Director 4036E Installation Manual 9 7 5 8 Label s The following Grid Director 4036E label example shows all safety and EMC text and logos pertaining to the 4036E Figure 8 Grid Director 4036E Label Example See Installation Instructions v
14. Mellanox TECHNOLOGIES Grid Director 4036E Installation Manual www mellanox com NOTE MELLANOX TECHNOLOGIES INC AND ITS AFFILIATES MELLANOX FURNISH THIS DOCUMENT AS IS WITHOUT WARRANTY OF ANY KIND MELLANOX DISCLAIMS ALL WARRANTIES EXPRESS OR IMPLIED INCLUDING WITHOUT LIMITATION THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE NON INFRINGEMENT AND THOSE ARISING FROM A COURSE OF PERFORMANCE A COURSE OF DEALING OR TRADE USAGE MELLANOX SHALL NOT BE LIABLE FOR ANY ERROR OMISSION DEFECT DEFICIENCY OR NONCONFORMITY IN THIS DOCUMENT AND DISCLAIMS ALL LIABILITY INCLUDING LIABILITY FOR INFRINGEMENT OF ANY INTELLECTUAL PROPERTY RIGHTS RELATED TO THE INFORMATION CONTAINED IN THIS DOCUMENT No license expressed or implied to any intellectual property rights is granted under this document This document as well as the software described in it are furnished under a separate license and shall only be used or copied in accordance with the terms of the applicable license The information in this document is furnished for informational use only is subject to change without notice and should not be construed as any commitment by Mellanox Except as permitted by the applicable license no part of this document may be reproduced stored in a retrieval system or transmitted in any form or by any means without the express written consent of Mellanox Names and logos identifying products of Mellanox in this do
15. QSFP port Eth link Rear panel RJ45 connector Grid Director 4036E Installation Manual LED Name Color Location Status Functionality ol NN BLINK Traffic on the link 5 3 1 Ethernet Gateway LED Indicators Three LEDs are located on the face of the module indicating link status of the combined interfaces in the integrated Management port mgmt and overall system status Table 9 10GbE LED Indicators LED Type Function Status Description I O green I O state controlled 10 GbE Gateway is active by Gateway FW ue VN Blinking 10 GbE Gateway is initializing slow Blinking 10 GbE Gateway fault Software in safe mode fast t amb ETO tome Blinking Data traffic over the logical link indication per port Blinking Unstable physical link green Link down no physical link 5 4 Certifications The Grid Director 4036E has the following certifications Safety e cMETus UL 60950 1 07 Second Ed e CSA C22 2 No 60950 1 07 Second Ed e cTUVus UL60950 1 07 Second Ed e S Mark Argentina e CB Certificate and report according to IEC 60950 1 Second Ed e KCC Korea e Gost R e CE according to EN 60950 1 06 Second Ed e S Mark gt EMC Certifications e FCC Part 15 Subpart B Class A and testing to ANSI 63 4 25 Technical Specifications and Certifications e Industry Canada ICES 003 CAN CSA CEI IEC CISPR 22 02 e CE EN55022 1998 A1 2000 A2 2003 EN55024 1998 A1 200
16. S 00044 Philips Screw 8 32 x 1 4 with tooth lock washer and nylon patch Long Bracket right MEC 0055 side 5 Long Bracket left MEC 0055 side 4 Rear side of the chassis 3 3 Hardware Installation 6 6 2 Option 1 This option describes how to assemble and mount the rail and install the switch where the front of the switch faces the front of the rack The front of the switch is recessed by 5 inches from the vertical rail of the rack to allow connecting the power cords from the front side of the rack Figure 9 4036E Option 1 Rack Mount Assembly Short Bracket Rail Assembly NOTE Mellanox does not provide standard rack clip nuts and rack screws To mount the 4036E in a rack using Option 1 Put the chassis on a flat surface 2 Mount the long bracket at the front of the chassis using three 8 32x1 4 pan head Philips screws 34 Grid Director 4036E Installation Manual Important Left and right long brackets are different Make sure that you are using the correct bracket The mounting ear at the end of the bracket should face out 3 Position the mounting bar and adjust it according to the rack measurements you made in Measuring the Distance between Mounting Rails on page 32 Note Make sure that the distance is between 0 5 to 1 smaller than the distance you measured between the two vertical rack rails Total distance rack measurements you made in Meas
17. anel e Chassis Reset Button on the front and rear panels 21 Technical Specifications and Certifications Features Details e USB port on the rear panel Device Management e CLI e SNMP Fabric Management On board SM for fabrics up to 648 nodes Mellanox Unified Fabric Manager UFM Indicators Fan unit LED indicator on the fan unit PSU LED indicator on the power supply Power supply fan LED indicator on the front and rear panels Info LED indicator on the front and rear panels SM LED indicator on the front and rear panels System Power LED indicator on the front and rear panels System Temp LED indicator on the rear panel I O LED indicator on the rear panel Refer to LED Indicators on page 23 for more details Hot swappable fan unit containing three fans for high availability Auto heat sensing for silent fan operation Front to rear or rear to front cooling different fan unit Part Numbers Airflow 52 CFM in turbo mode 43 CFM in normal mode Physical 19 inch front or rear rack mountable chassis Characteristics Dimensions H x W x D 1 69 in 43 mm x 16 93 in 430 mm x 20 9 in 530 mm including handles Fixed rack mount bracket kit included Optional cabling guide bracket kit designed for cable management Weight 28 7 Ib 13 Kg including accessories and box Environmental Operating Temperature e 32 F to 113 F 0 C to 45 C e Humidity 15 to 80 non condensing e Altitude 0 to 9843 ft 3000
18. anual 4 Product Options 4 1 Grid Director 4036E Available Configurations The Grid Director 4036E is a 1U entry level switch with 34 InfiniBand 4X and 2 1GbE 10GbE ports providing bidirectional 40 Gbps 20 Gbps per port grid connectivity The Grid Director can serve as an edge switch in large fabrics where the Grid Director 4036E is serving as core switch or as a standalone managed unit in smaller clusters 4 2 InfiniBand Clusters Using the Grid Director 4036E The Grid Director 4036E acts as a standalone unit or as a building block for larger clusters The following figure show a mid size two tier triple hop non blocking configuration based on multiple Grid Directors 4036E functioning as the cluster s building blocks Figure 7 Mid size two tier CLOS InfiniBand Cluster Connected to Ethernet based High Performance Storage 6 10 GbE links connected to clustered file system Lg m RS MME NM M EM M M EMI E m m m ESA Lu M NI Lu m ug m Nu I Lamm m MEENE B Blade Chassis with internal IB switch 84 108 servers 4 3 Ordering Options This section provides the Grid Director 4036E and modules ordering information Table 3 Ordering Information for the Grid Director 4036E Number Name Description VLT 30034 4036E 34 Port QDR Switch Grid Director 4036E 1U 34 port QDR Switch ETH Gateway front to back cooling dual PS VLT 30035 4036E 34 Port QDR Switch Grid Director 4036E 1U 34 port QDR Switch ETH Gat
19. ble Kit i 14 2 6 Packing the Grid Director 4036E eene 14 3 Getting Sstartedi czaictiaile lilla as 16 3 1 Getting SIA Ned OVerieW AI 16 32 Front Panel Descriptor tai ic O 16 did Bear Panel DESErplioA siciliani ilaria 17 4 Produc ODHONS iria ia 19 4 1 Grid Director 4036E Available Configurations 19 4 2 InfiniBand Clusters Using the Grid Director 4036 19 AS sOVOCHIMG OD HONS esac cece E o NUR ee 19 5 Technical Specifications and Certifications cccccscsessseeeeseeesseeeseeeesseeeseoesseeeeseoensseessenenss 21 5 1 Grid Director 4036E Technical Specifications nnn 21 5 2 Power Specifications Power Supply MOdUle 22 Dio TEED INGIGAION EU UU DTE 23 5 3 1 Ethernet Gateway LED Indicators sees 25 Sd GT eco cR Tm tUm 25 s EE Come seule E EU T m 26 967 BI e UIROS TTE E 26 556 1 Declaration Of Gonformily i lella 26 5 6 2 Hazardous Substances RoHS 6 Compliance Declaration 26 A a a a a 27 5 5 conock ana VIDRIO sarria ila 27 5 9 Chassis Clearance Requirements cccccsssccccccsseeceeeeeessecceesseeeceeesseaseceessuaaeeeeessaageeeeseaas 28 9 10 WWelghis ana DIMENSIONS sirana a iii 28 SN A A O 29 o Contents SP NE EXPOR INTO Mal T UT NUTUS 29 Delo SOMIDPING Rest CON Sisa 29 O Hardware Instala ON aca 30 6 1 Hardware Installa
20. cument are registered trademarks or trademarks of Mellanox Voltaire is a registered trademark of Mellanox Technologies Ltd All other trademarks mentioned in this document are the property of their respective Owners Copyright 2011 Mellanox Technologies Inc All rights reserved Mellanox TECHNOLOGIES Mellanox Technologies Inc Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 PO Box 586 Hermon Building Sunnyvale CA 94085 Yokneam 20692 U S A Israel www mellanox com Tel 972 4 909 7200 Tel 408 970 3400 Fax 972 4 959 3245 Fax 408 970 3403 Copyright 2011 Mellanox Technologies All rights reserved Mellanox BridgeX ConnectX CORE Direct InfiniBlast InfiniBridge InfiniHost InfiniRISC InfiniScale InfiniPCI PhyX Virtual Protocol Interconnect and Voltaire are registered trademarks of Mellanox Technologies Ltd FabricIT and SwitchX are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners Document Number DOC 00911 A02 Contents Contents PEC CO bilia 7 introduction lalla 9 1 1 Gig Direcior4036E OVOTVIQW iui a ici 9 t2 Gig Direcior40 6E Fees 9 L3 Management 10 2 A aa 12 2 1 Overview of Unpacking the 40396E iii 12 2 2 Package COMLCINS assi dida 12 2 3 Unpacking the Grid Director 4036E i 12 24 RAITT CKO O0008 rusia iii S 14 2 5 Multipurpose Mng Console Ca
21. data throughput 2 72 Tb s QDR 1360 Gbps DDR or 680Gbps SDR Specifications Port to port Latency Jess than 100 nanoseconds InfiniBand to InfiniBand Jess than 2 microseconds InfiniBand to Ethernet Linear Forwarding Table 48K entries Multicast Table Size 1K entries Virtual Lanes 8 Data virtual lanes and 1 management virtual lane MTU 4096 Bytes max InfiniBand Ports 34 QSFP interfaces 34 4X Quad Data Rate ports QDR 40 or 20 or 10 Gbps auto negotiate Interconnect options QSFP passive and or active copper fibre optic cables All ports are located on the rear panel Indicators physical and logical status Fan OK Info I O and Power I O LED Ethernet Ports Two 1 10 GbE interconnect ports SFP interfaces IEEE 802 3ab and 802ad link aggregation compliant IEEE P802 3ak and IEEE P802 3ae IOGBASE SR IOGBASELR Support for Jumbo frames IETF Protocols TCP IP IETF RFC 793 IETF RFC 791 IETF RFC 768 RFC 926 RFC 1812 RFC 1027 IPoIB IETF RFC 4391 4392 VLAN support according IEEE 802 1q up to 64 VLANS IP multicast IETF RFC 3171 and IGMPv2 up to 3000 multicast groups SNMP v2c IETF RFC190x Management The Grid Director 4036E has an active CPU with a Subnet Manager chassis management UFM agent enabling for low level chassis management purposes and cable optimization Physical Ports e EIA TIA 232 console DB 9 connector on the rear panel e RJ45 jack connector for 10 100 1000 Ethernet port on the rear p
22. e using three 8 32x1 4 pan head Philips screws as shown on the picture Grid Director 4036E Installation Manual 3 Mount the long bracket at the front of the chassis using two 8 32x1 4 pan head Philips screws Use the long bracket middle row orifices and the holes of top row on the rail Note that the left and right long brackets are different Make sure that you are using the correct bracket The mounting ear at the end of the bracket should face out Important At this stage do not fully tighten the screws 4 Position the mounting bar and adjust it according to the rack measurements you made in Measuring the Distance between Mounting Rails on page 32 Note Make sure that the distance is between 0 5 to 1 greater than the distance you measured between the two vertical rack rails to allow adjustment at a later stage Rear of Rack Rail Assembly Front of Rack Total distance rack measurements 0 5 to 1 for adjustment 41 Hardware Installation 5 Secure the rail on the side of the switch using two 8 32x1 4 pan head Philips screws use the holes on the top row Make sure you install one screw in the middle of the switch and the other screw at the edge use the holes on the top row of the rail 6 Ensure that the clip nuts are already installed in the rack holes of the correct U level on all four vertical rack rails as described in Measuring the Distance between Mounting Rails on
23. ecommend using the Cabling Guide Brackets You can install the rack mounted Cabling Guide Brackets CG 24 in the back of the rack itself facing out Rack rails should be free of PDU and power inlets Figure 14 Cabling Guide Bracket CG 24 gt To Install the Cabling Guide Brackets CG 24 1 Install the Cabling Guide Bracket at the rear of the rack itself on top or the rail bracket using two standard rack screws as shown in Figure 7 2 2 Repeat on the other side 46 Grid Director 4036E Installation Manual 3 Tighten the screws Figure 15 Installing a Cabling Guide Bracket Figure 16 Installing a Cabling Guide Bracket sliding rail You can see the results in the following figures Figure 17 Cable Management 47 Cabling 7 3 Cabling Consider the overall cluster configuration to determine the optimal cable length Proper planning will produce orderly and maintainable cabling For the InfiniBand cables we recommend dressing the cables from each row of QSFP connectors into two groups running them left and right fastening them down gently after verifying the connectivity and routing them down along the rack sidewall This section assumes that you have already determined the cable lengths and inter rack cable routing The cables are connected to the Grid Director 4036E rear panel NOTE You can connect and disconnect cables while the Grid Director 4036E is powered on
24. ector 4036E has two identical hot swap Power Supplies in the side bays of the unit chassis to maintain proper cooling as shown below e The Grid Director 4036E supports current sharing operation of the two power supplies if applicable e When removing a power supply from the chassis the additional power supply can power the entire chassis Figure 13 Replacing the Power Supply gt To replace a hot swappable power supply module Release the captive fasteners at each side of the power supply and gently remove the power supply from its bay 2 Position the rear of the new power supply in the bay 3 Slide the power supply into the slot until it meets resistance at the level of the chassis connector It should slide smoothly and easily 4 Push the module further until it is seated completely 5 Use the captive fasteners at each side of the power supply to secure it in place 6 Cabling 7 Cabling 7 1 Cabling Overview This chapter provides details on the Grid Director 4036E cable guide brackets installation and cable management 7 2 Cabling Guide Bracket Installation gt NOTES Consider the overall cluster configuration to determine the optimal InfiniBand cable length Proper planning will produce orderly and maintainable cabling The rack space for the Grid Director 4036E should be free from obstructions such as power strips The Cabling Guide brackets CG 24 are optional however we r
25. er source 2 Before turning on the power verify that the power supplies and fan tray are properly inserted 3 Connect the power supply cords to the AC inlets of the Power Supplies PSU located at the front of the chassis 4 Connect the other side of the power cords to the PDU 5 The PWR LED indicator lights up 6 8 Field Replaceable Units 6 8 1 Fan Unit The Grid Director 4036E has a hot swappable Fan Unit with three fans that are used to maintain proper cooling e In normal operation the three fans work at 50 utilization e Incase of fan failure or high temperature detection the fans go into Turbo mode In case of fan failure the fan drawer LED and the PS FAN LED on the rear panel blink e When removing the fan unit the system can continue to function for up to 5 minutes before installing a new fan unit 44 Grid Director 4036E Installation Manual Figure 12 Replacing the Fan Captive Fasteners To replace the hot swappable Fan module Release the captive fasteners at each side of the fan and gently remove it from its slot Position the rear of the new fan in the slot Q N n y Holding the fan level slide it into the slot until it meets resistance at the chassis connector It should slide smoothly and easily p Push the module further until it is seated completely 5 Use the captive fasteners at each side of the fan to secure it in place 6 8 2 Power Supplies The Grid Dir
26. es do not consume any additional power while active copper and optic cables consume up to 2 5 Watt The following figure shows the QSFP module with Copper or Optical cables You can install any combination of the three cable types in any of the 36E QSFP cages Figure 20 QSFP and 10 GbE Connectors Active Passive Copper Cable Fibre Optic Cable attached to connector delivered as as single unit Detachable Fibre Optic Cable A 2 10 GbE SFP Ethernet Cable SFP Key Features e Small size high density hot pluggable connector with a transmit and a receive channel e Supports both types of cables Copper active or passive cable Copper passive cable is equipped with two simple passive connectors and a standard copper cable Copper active cable equipped with an active device to optimize signal quality Fibre optic cable delivered as either Fibre cable with two separate modules Active optic cable where cable and optic adaptors are delivered as a single unit permanently attached cable 55 Troubleshooting e Data rate 10 100 1000 10000 Mbps e SFP optic modules Small Form factor Pluggable use standard LC LC coupled single fibre jacketed optical connector e Provides manageability discovery and identification capability such as vendor identification module part number serial number cable type using low speed two wire I2C interface Figure 21 SFP Connector Dimensions Typical 6
27. eway Low Mem front to back cooling dual PS low memory Table 4 Ordering Information for the Grid Director 4036E Modules Number Name Description VLT 30029 F PS 36 AC FRU PS 36 AC FRU ss Product Options Number Name Description VLT 30030 F FAN 1U Unit Back To Front FAN 1U unit back to front cooling FRU FRU VLT 30031 F FAN 1U Unit Front to Back FAN 1U unit front to back cooling FRU FRU 510K00022 F CG 24 Cabling guide bracket kit Table 5 Grid Director 4036E List of Parts According to Configuration Chassis P N Powe Power Fan Rail Cabli Mult Prod Getti r cord unit kit ng ipur uct ng suppl PDU Air guide pose CD Start yunit plug En brack Man docu ed et kit agem ment Guid ent ation e cons amp hard ole softw copy cable are kit PSU 1 Power Fan KIT CG 24 Mng U Cord Unit 0008 1U i i Optional COEN COEN 20 j Grid Director 4036E Installation Manual 5 1 Technical Specifications and Certifications Grid Director 4036E Technical Specifications The following table details the Grid Director 4036E general technical specifications Table 6 Grid Director 4036E Technical Data Features Details Grid Director 19 inch mountable chassis height 1U depth 21 530 mm including handles 4036E General 34 Quad Data Rate QDR 40 Gbps ports and 1 10 GbE interconnect ports SFP interfaces Switch Aggregate
28. gure shows the front view of a Grid Director 4036E Unit Figure 1 Grid Director 4036E Front View The following figure shows the rear view of a Grid Director 4036E Unit Figure 2 Grid Director 4036E Rear View 1 2 Grid Director 4036E Features The main features of the 4036E gateway include e 19 rack mountable chassis 1U height configurable with redundant power supplies and fan units OJ l Introduction e Aggregate data throughput 2 72 Tb s QDR 1360 Gbps DDR or 680Gbps SDR e 34 QDR 40 Gbps ports and two 1 10 GbE SFP ports in a 1U switch e Ultra low latency less than 100 nanoseconds between InfiniBand ports less than two microseconds between InfiniBand and Ethernet e Virtual lanes 8 data and for management e MTU 4096 Bytes max Additional features include e Low latency hardware based cut thru bridging between InfiniBand and Ethernet e Provides high performance connectivity to Ethernet based services and resources e Consolidates network and I O infrastructure e Plug amp play standards based protocol bridging with zero configuration required on the Grid Director 4036E itself or on the servers e Embedded subnet manager e Transparent mapping between Ethernet VLANs and InfiniBand partitions to ensure continuity of security and service levels e Accelerating IP multicast over InfiniBand using hardware based multicast e Flow control support over both InfiniBand and Ethernet links for efficien
29. le kit Figure 7 6 It contains the Mng cable and the two following adaptors e RJ45 to RJ45 cable e A RJ45 to DB 9 cross adaptor for RS 232 console connection CLI The DB 9 adaptor has a number 26 printed on it This means that pins 2 and 6 are crossed Cabling e A RJ45 to DB 9 adaptor for RS 232 console connection Figure 18 Console Cable Kit Mng NOTE You can connect the serial and Ethernet management ports of a Grid Director 4036E simultaneously However you cannot connect the Ethernet ports of the front and the rear panels simultaneously gt To connect multi purpose cable of a Grid Director 4036E 1 Connect the DB 9 connector and the RJ45 connector to each extremity of the multipurpose console cable Mng 2 Connect the DB 9 connector to the Grid Director 4036E CLI port 3 Connect the RJ45 connector to the Ethernet port either on the rear panel or on the front panel but not to both 50 j Grid Director 4036E Installation Manual 8 Operation 8 1 Operation Overview This chapter describes how to power on and operate the Grid Director 4036E once the installation is complete The Grid Director 4036E operation consists of making sure that the switch starts up properly and that any initialization problems are resolved 8 2 Powering the Grid Director 4036E To start up the 4036E unit e Verify that the 4036E chassis is secure within the rack e Verify that the InfiniBand cables are plugged in
30. m Storage Temperature e 13 to 158 F 25 to 70 C e Humidity 5 to 90 non condensing e Altitude 0 ft to 15 000 ft 4570 m Maximum Ambient Temperature e 45 C 5 2 Power Specifications Power Supply Module The following table details the Power Supply specifications 22 Grid Director 4036E Installation Manual 5 3 Table 7 Power Supply Module Data Attribute Specification Power Supplies e Dual redundant power supply slots e 1 or 2 hot swappable power supplies according to configuration e Power supply with built in power inlet Electrical ratings V A hz Power entries 100 240Vac 5 0A 50 60 Hz auto sensing 2 52A 115V ailto 2 52a 115v 1 32A 9 230V Power Inlet Type Power Rating Power consumption Maximum 240W Numbers relate to copper cables For optic cables add 1 5W per port Optical cables configuration 320W max Copper cables configuration 240W max Typical 106W BTU hour Watts x 3 413 Each QSFP optical adapter in use adds up to 2 5W max to the above consumption Power Factor 120 Vac 60 Hz Max Load 0 99 230 Vac 60 Hz Max Load 0 96 Power Supply Efficiency 83 115V 87 230V Leakage current 254V 2 422 mA 2 power cords 2 meter long with a universal plug for PDU Power Distribution Unit LED indicators The following table lists the LED indicators and their functions and descriptions in their various states Table 8 Grid Director 4036E LED I
31. ndications LED Name Color Location Status Functionality Front panel PSU DC OK On each PSU OFF PSU DC problem Front panel fan drawer ON All fans operational Nominal temperature OFF None of the fans are working BLINK At least one fan problem or high temperature Front panel fan drawer ON SM is active OFF SM is not active BLINK SM is in standby mode Technical Specifications and Certifications LED Name Color Location Status Functionality Pwr Green Front panel fan drawer System power ok System power problem I O LEDs reflect the link activity and status of the Ethernet part of the 4036E Refer to Ethernet Gateway LED Indicators on page 25 for details on the I O 1OGbE LEDs Info Green Front panel fan drawer lom The device does not require attention BLINK The device requires attention Pwr Fan Green Rear panel All fans operational Nominal temperature PSUs OK All fans are not working or power down BLINK At least one fan problem or high temperature One PSU problem Green Rear panel Pwr Green Rear panel Info Green Rear panel disconnected BLINK Eth tragic activity 10GbE Rear panel on each Port physical link is up Phvsical link SFP port ysical im P Port physical link is down or port is disconnected BLINK Error cannot happen 10GbE logical Rear panel on each Port physical link is up IB physical Rear panel on each link QSFP port IB logical link Rear panel on each
32. ntacting Customer Support i 53 Appendix A Cabling Information and Specifications cesses 54 LN MEES SENE m ad 54 A l0GbE SFEP Ethemercanle La ilaele 55 Ad IB Pon Cable peca INS o lia 56 e 66 t0 1 _ Contents Ad SFP4 POR cableSpeelicallons acconti 56 AS TGbE Pons Managementi ere ae e asini or List of Figures Foure Gra Director 4036E FOM VIEW da v DoD Ero d Uv vo Da dl va v c od VN dx 9 Figure 2 Grid Director 4036E Rear VIeW iii 9 Figure s Fixed Fall ETS00008 rule iaia 14 Figure 4 Console Cable Kit MING seite uisu orm ud ilaele bibi 14 Figure 5 Grid Director 4036E Front Panel nennen nnne nnn nnns 16 Figure 6 Grid Director 4036E Rear Panel esses eene nennen nnne nnns nnn nnns 17 Figure 7 Mid size two tier CLOS InfiniBand Cluster Connected to Ethernet based High Performance SONA Caisse Mc 19 Figure 8 Grid Director 4036E Label Example ii 27 Figure 9 4036E Option 1 Rack Mount Assembly i 34 Figure 10 Result Hack TONT VIOW A A A AA AAA ANA a a a 39 Figure 11 4036E Oplion2 Assembly acidi 40 Figure T2 Replacing the Edvard dildo 45 Figure 13 Replacing the Powel Supply anu i nee uui lella Lea ia 45 Figure 14 Cabling Guide Bracket CG 24 ii 46 Figure 15 Installing a Cabling Guide Bracket
33. o screws per bracket and tighten them 16 Mount a short bracket from the inner side of the mounting bar and fasten it using two 8 32x1 4 pan head Philips screws 37 Hardware Installation Use the lower holes in the short bracket as shown in the figure Important At this stage do not fully tighten the screws 17 Adjust the short brackets snuggly onto the rack s vertical rail using the adjusting holes make sure that the rail is perfectly aligned by using the same U as used in the front of the rack i d 18 Tighten the rack screws rack screws are not supplied 38 Grid Director 4036E Installation Manual 19 Tighten the short brackets to the mounting bars Figure 10 Result Rack front view Hardware Installation 6 6 3 Option 2 This option describes how to assemble and mount the rail and install the switch where the rear of the switch InfiniBand connector side faces the front of the rack This rear to front chassis installation is in line with the vertical front rails of the rack Figure 11 4036E Option 2 Assembly Long Bracket Rear of Rack Front of Rack a Short Bracket NOTE Mellanox does not provide standard rack clip nuts and rack screws gt To mount the 4036E in a rack using Option 2 1 Put the chassis on a flat surface 2 On each side of the chassis mount the short brackets on the rear side of the switch InfiniBand port sid
34. on components Power Supply or2 according The swappable power supply modules provide the Grid PSU to configuration Director 4036E DC supply You can install one or two AC DC 100 240Vac to 12Vdc 350W hot swappable redundant power supplies in the Grid Director 4036E The power supply has an IEC Power Receptacle that supplies the chassis input voltage as indicated in the power supply characteristics in Power Specifications Power Supply Module on page 22 LEDs Status 5 Front panels LEDs Indicators System Power Info SM Fan Unit Power Supply I O LED Refer to LED Indicators on page 23 for the list of LEDs and their descriptions a Power Supply power inlet type 6A type C14 When pressed for more than 1 second resets the entire AC power Inlet Reset Button Hot swappable fan unit hosting three internal fans for high availability Auto heat sensing allows for silent fan operation Grid Director 4036E Installation Manual Item Component No of Description components Two options are available e Front to rear cooling labeled as Air in e Rear to front cooling labeled as Air out 3 3 Rear Panel Description This section details the rear panel of a Grid Director 4036E Figure 6 Grid Director 4036E Rear Panel 2 IB Port 34 IB i 1 O 7 The following table details Grid Director 4036E rear panel components Table 2 Rear Panel Components Item Component Qty Description
35. oocccccccccncoconnnncconnnnnonononnnnonnnnnnnnnnonononcnnononnnnononnnnnonaneness 28 Table 14 Packed Weights Dimensions i 28 Table 15 Material and Tools Required occccccocnccccconcnnoconcnnoconnnnnonononnnnonnnnnnnnnnnnononnnnononnnnnnonnnnnonaneness 30 Table 16 ote Preparation Checklist o e dto te aede o t idees na cet alal 32 Table 17 Rail Kit P N KIT 00008 Detailed Part List 33 Table 18 4036E 10Gb E Ports Cabling Specifications i 56 Grid Director 4036E Installation Manual Preface About this Manual This manual provides installation instructions for the high bandwidth low latency scalable InfiniBand Mellanox Grid Director 4036E with 32 QDR and 2x10 GbE ports It includes the product specifications unpacking and installation information unit power up and initiation and troubleshooting procedures gt Refer to the official and latest product release notes for last minute updates a Technical support may be obtained directly from e Your regional distributor from whom this product was ordered e Your OEM customer representative For further information and assistance go to http www mellanox com content pages php pg support_index Audience This manual is for system administrators responsible for installing the Grid Director 4036E We assume that you are familiar with the concepts and terminology of InfiniBand Ethernet and local area netwo
36. page 32 Note Mellanox does not provide rack clip nuts 7 Go to the front of the rack Note For ease of installation at least two qualified people should perform the following steps 8 Lift and position the switch with the connectors facing towards you and insert it into the rack pu ud Grid Director 4036E Installation Manual 9 Align the short bracket holes with the rack holes of the correct U level and secure them using two rack screws on each side not provided by Mellanox PEE EEE TTT TPP rT Tai dl ae aes ey ES 10 Go to the rear of the rack 11 On each side align the long bracket holes with the rack holes of the correct U level and secure them using two rack screws not provided by Mellanox and two rail screws 12 Tighten the rack screws rack screws are not supplied A 13 Tighten the long brackets to the mounting bars Important This step should be done last 3 Hardware Installation E 14 Result Rac front view Mi fe gt i 1 gt Hi kh IW UP oW Serres ui RA ETES 6 7 Grid Director 4036E Power Up Once the 4036E chassis is secure within the rack prepare the electrical cables from the power distribution source for connection Mellanox supplies two power cords one per power supply unit gt To power up the Grid Director 4036E 1 Ensure you have met all site power requirements before connecting the chassis to a pow
37. ple passive connectors and a standard copper cable Copper active cable equipped with an active device to optimize signal quality Fibre optic cable delivered as either Fibre cable with two separate modules Active optic cable where cable and optic adaptors are delivered as a single unit permanently attached cable e Data rate 2 5 Gbps SDR 5 Gbps DDR and up to 10 Gbps QDR per channel e QSFP optic modules use standard MPO parallel 12 fibre jacketed ribbon optical connector e Provide manageability discovery and identification capability such as vendor identification module part number serial number cable type using low speed two wire I2C interface e Active cables Integrates digital diagnostic capability to monitor link performance e Latching mechanism e Mechanical Dimensions Figure 19 QSFP Comnector Dimensions f2mm max 18 35mm 6 5mm NOTE QSFP to CX4 cables are available to connect 4036E equipped with QSFP with legacy DDR SDR systems equipped with CX4 connectors 54 Grid Director 4036E Installation Manual QSFP Cable Overview Every 4036E port on the switch is equipped with transmit and receive circuits that can adjust to fit different types of link characteristics and either optical or copper cables The QSFP cables shown below transmit and receive up to 10 Gbps per channel total up to 40 Gbps per port over a single active passive optical or copper cable Passive copper cabl
38. properly powered and the fan unit is functioning adequately O LED Indicates that the Ethernet gateway is functional Led State Indication Comment Slow blink System initializing Blinking frequency 1 Hz ei System OK Takes about 2 minutes from reset power up If some of these conditions are not met refer to Solving Startup Problems on page 53 to isolate and if possible resolve the problem 8 3 Where to Go Next Once you have installed the 4036E hardware you can start the system configuration To configure the system refer to the Grid Director 4036E User Manual 52 Grid Director 4036E Installation Manual 9 Troubleshooting 9 1 Troubleshooting Overview This chapter provides suggestions for solving startup problems and useful information when contacting Mellanox Customer Service 9 2 Solving Startup Problems Try to solve startup problems using the Grid Director 4036E LED indicators gt Case 1 Problem with power supply How do I know that my power supply is not functional Check the power cord and its connections Check the installation of the power supply module If the indicator is blinking the 4036E power supply is faulty Replace the power supply module if necessary NOTE In single power supply systems the AC power cord must be plugged into the same side of the chassis as the power supply Case 2 What to do when there is a Fan indication problem Replace the Fan Unit
39. rking Related Documentation For additional information refer to the following documents e Grid Director Family Getting Started Guide LIT 00037 e Grid Director Family User Manual DOC 00785 e Grid Director Family Release Notes DOC 00962 e Regulatory and Compliance Reference Guide DOC 00859 Document Conventions The following lists conventions used in this document Y NOTE Identifies important information that contains helpful suggestions r OOO por 4 Preface CAUTION Alerts you to the risk of personal injury system damage or loss of data A WARNING Warns you that failure to take or avoid a specific action might result in Wm personal injury or a malfunction of the hardware or software Be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents before you work on any equipment Typography The following table describes typographical conventions in Mellanox documentation All terms refer to isolated terms within body text or regular table text unless otherwise mentioned in the Notes column Term Construct Example Notes Text Block File name pathname oplconfe cf Console session code flashClear CR Complete sample line or block Comprises both input and output The code can also be shaded Linux shell prompt The character stands for the as ia shell prompt Mellanox CLI Guest Mode CLI Guest Mode EX
40. s according to configuration and one hot swappable fan unit Additional components include e Two power cords e Rail kit refer to Rail Kit KIT 00008 on page 14 for details e A multipurpose console cable kit Mng Refer to Multipurpose Mng Console Cable Kit on page 14 for details e Grid Director Getting Started Guide hard copy e A product CD containing Grid Director 4036E documentation and software gt Before You Begin e Before unpacking make sure that the box is sealed and undamaged e Before beginning the installation of the Grid Director 4036E verify that the package contains all the items as detailed in the Getting Started Guide For alist of parts delivered with the product see Ordering Options on page 19 e Check for loose parts or any visible damage to the contents Notify your supplier if you detected damaged or missing parts 2 3 Unpacking the Grid Director 4036E This section details the Grid Director 4036E package contents and provides instructions on how to unpack the chassis gt To unpack the Grid Director 4036E perform the following steps 1 Open the box and check that it contains the items as shown in the following figure Grid Director 4036E Installation Manual Rail Kit Getting Started Guide Hard Copy Product CD containing Documentation and Software Multipurpose Console Cable Kit Mng Power Power Cord Cord 2 Remove the box containing the Rail Kit the Po
41. t handling of congestion e Layer 2 3 4 based packet filtering and classification e Link aggregation LAG between Ethernet ports e Aggregation of Ethernet ports from multiple gateways for scalability or redundancy purposes e Designed to provide high MTBF e Redundant hot swappable power supplies e Supported cables InfiniBand QSFP and Ethernet 10G 1G Copper or Optical e Built in cable detection and optimization to achieve the longest available cable distance and highest performance e Built in high availability 1 3 Management The 4036E Gateway includes smart device management that provides a simple Command Line interface for deploying troubleshooting maintaining and upgrading the switch You can use the CLI to perform routine tasks such as monitoring the switch operation or upgrade the software and firmware om 7 Grid Director 4036E Installation Manual The 4036E Gateway comes with an onboard subnet manager enabling simple out of the box fabric bring up for small to medium clusters Refer to the Grid Director 4000 Family User Manual for details on 4036E software requirements and configuration Unpacking 2 Unpacking 2 1 Overview of Unpacking the 4036E This chapter provides step by step instructions for the packing and unpacking the 4036E Gateway 2 2 Package Contents Mellanox delivers the 4036E Gateway in a cardboard box The gateway comes with one or two pre installed hot swappable power supplie
42. tion OvVervieW oooccccccccccccconnccnnonononononncnnnnnononnnnnnnnnnnnnnnnnnnnnnnnnnnnnononanennnns 30 62 Installation Oprionsisssca lalla 30 621 O00 A a a a 30 6 3 Required Tools e 30 64 SIEPI licei aa 31 6 4 1 Rack and Clearance RequireMents eese 31 6 4 2 Site Environment Specification ii 31 6 4 3 Power Requirements 31 6 44 Site Preparation Checklist ii 32 6 5 Measuring the Distance between Mounting Rails 32 6 6 Assembling and Mounting the Flall aiii si 32 661 EMITIR Me ccc 32 60 Iii n tuU MEI UPC Eu LIO E MED EIS INN ID IA QURE 34 E o o a a a a 40 6 7 Grid Director 4036E Power UP 44 6 8 Field Replaceable UNItS nennen nnne nnne 44 s ME Iii ie baia alla 44 63 2 PoWerSUpplies rie ee eee lear 45 7 A E a 46 7 1 MON i 46 7 2 Cabling Guide Bracket Installation nen 46 Hor AIM EU Em 48 7 4 Multipurpose Management Mng Console Cable 49 O PN 51 8 1 Operation OVelVIGW s Sevan ted even dest ad Meta tees iaia 51 82 Powering the Grid Director 4096E 100 cee 51 83 Where to GO NO erette nale 52 Y Troubleshooting aac 53 9 1 Troubleshooting OVErvieW nennen nennen nnnm nnne nnn annia nnn nnn 53 9 Solving etabtup Problem 2 9 x Uoc comp Tee pei sees Dis sere sees oed o cese uius a 53 9 3 Preparation before Co
43. to the rear panel ports e Verify that the AC electrical mains outlet s is available to connect the 4036E AC cable s CAUTION Ensure that all site power requirements have been met before connecting the chassis to the power source gt NOTE o Line cords should be connected to separate AC circuits for maximum fault tolerance in the event of power problems For more details regarding the unit s indicators refer to Grid Director 4036E LED Indicators on page 23 Once the 4036E chassis is secure within the rack you can prepare the electrical cables to connect to the power distribution source gt To start up the Grid Director 4036E 1 Ensure that all site power requirements have been met before connecting the chassis to a power source 2 Before turning on the power verify that the power supplies and fan tray are properly inserted 3 At the front of the Grid Director 4036E plug the power cord into the power receptacle Repeat for the other power supply if present 4 Check that the power supply indicator light is green Repeat for the other power supply if present 5 Check for the following Grid Director 4036E status indicators PWR Lights in green indicating that the Grid Director 4036E is functional Nt Z7 Operation SM Indicates the subnet management functionality on for active mode blinking for standby mode PS FAN Lights solid green indicating that the Grid Director 4036E is
44. tor 4036E from the rack Ze 3 4 Disassemble the rail brackets and pack the parts in the rail kit box Insert the Grid Director 4036E into its antistatic bag Carefully lift the switch making sure that the bottom of the switch is facing down Tip you can easily identify the bottom of the switch since it has a certification label Insert the switch into the cardboard box and place it on the bottom foam Place the top foam on top of the switch Slide the rail kit box in the dedicated niche alongside of the switch When sending the switch for repair without the rail kit secure it by filling this niche with a filler This will protect the switch and prevent it from moving during transportation Place the Getting Started Guide and the Multipurpose Console Kit Mng on top of the top foam Place the power cords in the allocated spaces in the foam 10 Use tape to close the box and verify that the box is securely closed Getting Started 3 Getting Started 3 1 Getting Started Overview The following sections provide a detailed description of the front and rear panels of the Grid Director 4036E 3 2 Front Panel Description This section details the front panel Grid Director 4036E Figure 5 Grid Director 4036E Front Panel 2 OO 00 8 2 4 The following table details Grid Director 4036E front panel components Table 1 Grid Director 4036E Front Panel Components Item Component No of Descripti
45. ts are also listed in Chassis Clearance Requirements on page 28 6 4 2 Site Environment Specification For the operating and non operating environmental site requirements refer to Power Specifications Power Supply Module on page 22 The system can continue to operate within specified environmental ranges however a measurement that approaches the minimum or maximum of a range indicates a potential problem You can maintain normal operation by anticipating and correcting environmental conditions before they exceed the maximum operating range 6 4 3 Power Requirements Power requirements are useful for planning the power distribution system needed to support the Grid Director 4036E Heat dissipation 1s an important consideration for sizing the air conditioning requirements for an installation Verify the available power source at the site for the type of device you are installing e The Grid Director 4036E requires at least one power connection using standard 3 wire AC power cords including a safety ground e The Grid Director 4036E includes two hot swappable redundant power supplies providing full back up purposes Sos Hardware Installation For the Grid Director 4036E power requirements and input voltage characteristics refer to Power Specifications Power Supply Module on page 22 6 4 4 Site Preparation Checklist To help prepare your site for installing the Grid Director 4036E chassis use the checklist below
46. uring the Distance between Mounting Rails on page 32 4 Connect the mounting bar to the side of the switch using two 8 32x1 4 pan head Philips screws using the top holes of the mounting bar Make sure to install one screw at the center of the switch and the second one at the rear of the switch 5 Repeat the above steps on the other side of the chassis 6 Ensure that the clip nuts are already installed in the rack holes of the correct U level on all four vertical rack rails as described in Measuring the Distance between Mounting Rails on page 32 Hardware Installation Note Mellanox does not provide rack clip nuts 7 Place the power cords with the female connector facing the front of the rack or the switch with approximately 10 hanging out of the front 8 Route the other side male connector of the power cord to the rear of the rack Do not connect it to the PDU at this stage 9 Lift and position the chassis aligning the holes of all brackets with the rack holes of the correct U level 10 Gently push the switch inwards leaving it slightly protruded 36 Grid Director 4036E Installation Manual 12 Secure each power cord with a cable tie wrap so that you can still adjust the length of the cord if required 14 Push the switch inwards from the front side of rack until the long bracket comes together with the rail 15 Fasten the long brackets to the rack s vertical rails using tw
47. wer Cords and the multipurpose console cable kit Mng 3 Remove the Getting Started Guide 4 Remove the top foam 5 Carefully remove the Grid Director 4036E Use the dedicated niche to lift the switch as shown in the following figure Lift the switch from here using the dedicated niche Unpacking 6 Remove the protective antistatic bag from the Grid Director 4036E 2 4 Rail Kit KIT 00008 The rail kit entails e 2 Short Brackets Angular bracket mount e 2 Long Brackets Left and Right e 2 mounting bars e 14 pan head Philips screws 8 32 x 1 4 with tooth lock washers and nylon patch Figure 3 Fixed Rail KIT 00008 Long Bracket Short Brackets Long Bracket Right Left Mounting bars Screws 2 5 Multipurpose Mng Console Cable Kit The multipurpose console kit Mng contains e RJ45 to RJ45 cable e A RJ45 to DB 9 cross adaptor for RS 232 console connection CLI the DB 9 adaptor has a number 26 printed on it which means that pins 2 and 6 are crossed e A RJ45 to DB 9 adaptor for RS 232 console connection Figure 4 Console Cable Kit Mng de 2 6 Packing the Grid Director 4036E You may need to move the Grid Director 4036E to a different location or send it for repair should this be necessary pack the equipment as described below Grid Director 4036E Installation Manual UA 9 To pack the Grid Director 4036E perform the following steps Unmount the Grid Direc

Mellanox Technologies VLT-30034 network switch

Contents

Download Pdf Manuals

Related Search

Related Contents