Mellanox Technologies MSX6025F-1SFR network switch
Contents
1. Second side 5 Clip 6 caged nuts into the holes in the rack on the side of the rack you will be sliding the switch into Check that both sides of the switch power side and connector side are at the same level in the rack 6 _ Clip 4 more caged nuts into the holes on the opposite side of the rack Check that both sides of the switch left and right are the same level in the rack 7 Slide the rail into the rail slide 8 Using two of the bolts for each corner install the rails and rail slides in the rack Do not tighten the bolts yet Figure 6 Slide the Rail into the Rail Slide w This side of the rail kit goes on the side of the rack you will slide the switch into This is the same side of the switch that will be next to the vertical support 14 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 9 Slide the switch into the rails 10 Tighten the bolts to 9 2 Nm or 81 5 pound inches 11 Put the switch into place and screw the bolts into the nuts Tighten the bolts to 9 2 Nm or 81 5 pound inches 12 Ground the switch 13 Plug in the power cables 14 Check the Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation Figure 7 Status LEDs 5 Minutes After Power On Mellanox A s PS1 PS2 D UID RST Bgeoood Warning Any yellow or red status LEDs are cause for concern and must be dealt with immediately It can2. The following is an example of the output Interface mgmt0 state Admin up Link up IP address Netmask Speed Duplex Interface type Interface source MTU HW address yes yes 192 168 10 43 255 255 255 0 1000Mb s auto full auto ethernet physical 1500 00 02 C9 11 2A AE Comment RX bytes 1343502058 TX RX packets 17589211 TX RX mcast packets 0 TX RX discards 0 TX RX errors 0 TX RX overruns 0 TX RX frame 0 TX 3 4 Rerunning the Wizard If you want to rerun the wizard run the following commands sx 43 standalone master gt enable Rev1 5 Configuring the Switch bytes 313920869 packets 992717 discards 0 errors 0 overruns 0 carrier 0 collisions 0 TX queue len sx 43 standalone master configure terminal sx 43 standalone master configuration jump start 1000 24 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 4 Connecting to the Switch Platform 4 1 Starting an SSH Connection to the Switch CLI Step 1 Set up an Ethernet connection between the switch and a local network machine the remote machine henceforth using a standard RJ 45 connector Step 2 Connect to the remote machine rem machl is used as an example Step 3 Start a remote shell to the switch using the following command using lt switch_IP_address gt is the IP address of the switch or its DNS name rem machl gt ssh l lt usern
3. standard depth B short depth Y Air Flow R Connector side to PSU side airflow direction F PSU side to Connector side airflow R RoHS R RoHS6 8 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 1 Installing the Switch in the Rack 1 1 Minimum and Maximum Rack Depth for these Switches This switch can be installed in any standard 19 rack with depths of 40cm to 80cm Make sure that the Installation kit you have is compatible with your rack To use the SwitchX series switch in a rack deeper than 60cm order the switch with the standard depth or order the MSX60 SKIT installation kit The both of these solutions will allow you to install the switch in a 19 rack whose vertical supports are between 60cm and 80cm apart 1 2 Rack Mounting The switch platform can be rack mounted and is designed for installation in a standard 19 rack The power side of the switch includes a hot swap power supply module a blank cover for an optional second PSU for redundancy and a hot swap fan tray There are two possible air flow directions Be sure that the switch air flow direction is compatible with your system rack and PSUs The connector side of the switch has the OSFP ports system LEDs and management con nection ports The switch platform contains auto sensing 100 240 VAC connections for all possible PSUs The installer should use a rack capable of supporting the mechanical and enviro
4. USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 Beit Mellanox Sunnyvale CA 94085 PO Box 586 Yokneam 20692 U S A Israel www mellanox com www mellanox com Tel 408 970 3400 Tel 972 0 74 723 7200 Fax 408 970 3403 Fax 972 0 4 959 3245 Copyright 2012 Mellanox Technologies All Rights Reserved Mellanox Mellanox logo BridgeX ConnectX CORE Direct InfiniBridge InfiniHost InfiniScale PhyX SwitchX Virtual Protocol Interconnect and Voltaire are registered trademarks of Mellanox Technologies Ltd Connect IB FabricITTM MLNX OSTM ScalableHPCTM Unbreakable Link UFM and Unified Fabric Manager are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners 2 Mellanox Technologies Document Number 3489 Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Table of Contents Table of Contents 3 List of Figures 4 Revision History 5 About this Manual 6 Intended Audience 6 Related Documentation 6 Document Conventions 6 Mellanox Part Numbering Legend 8 Chapter 1 Installing the Switch in the Rack 9 1 1 Minimum and Maximum Rack Depth for these Switches 9 1 2 Rack Mounting 9 1 2 1 Installation Kits 9 1 2 2 Mechanical Installation 10 1 3 Package Contents and Installati
5. the Switch for the First Time Step 1 Connect the host PC to the Console RJ 45 port of the switch system using the supplied cable The Console ports for SX60XX systems are shown below as examples Figure 9 Console Port the host AMGTV Connect 34 356 W36 Mellanox Technologies 19 Rev1 5 Configuring the Switch Make sure to connect to the Console RJ 45 port of the switch and not to the Ethernet MGT port gt Step 2 Configure a serial terminal program for example HyperTerminal minicom or Tera Term on No remote IP connection is available at this stage your host PC with the settings described in Table 5 Table 5 Serial Terminal Program Configuration Parameter Setting Baud Rate 9600 Data bits 8 Stop bits 1 Parity None Flow Control None Step 3 Login froma serial terminal program as admin and use admin as password This starts the Mellanox configuration wizard Step 4 Go through the Mellanox configuration wizard Table 6 shows an example of a wizard session Table 6 Configuration Wizard Session IP Configuration by DHCP Sheet 1 of 2 Wizard Session Display Example Comments Mellanox configuration wizard You must perform this configuration the first time you Do you want to use the wizard for initial configura operate the switch or after resetting the switch Type tion yes y and then press lt Enter gt If you wish to accept the defau
6. which of the four mounting options you choose Figure 12 Transfer Power Cord 3 Put the power cord in the switch slide channel e 4 Screw the switch slides to the switch 28 Mellanox Technologies J Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Figure 13 Install the Switch Slide Mellanox Technologies 29 Rev 1 5 Connecting to the Switch Platform Figure 14 Transfer Power Cord Finished 5 Return to step 4 on page 13 and continue the installation 30 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Appendix B QSFP Interface 20 GND GND 12 21 Rn Rxin 18 Table 9 QSFP Connector Pinout 22 Rx2p Rip 17 23 GND GND 16 Comnector Connector Sr DA 15 Pin Pin Name Signal Description Rx4n Ran 77 Number Pr gr Er 1 GND Ground da PAR sa ja 2 Tx2n Transmitter Inverted Data Input 28 11 3 Tx2p Transmitter Non Inverted Data Input zo WN UM o 4 GND Ground 30 as n 9 5 Tx4n Transmitter Inverted Data Input 6 Tx4p Transmitter Non Inverted Data Input eT LPMode ModSelL a OND MG ni oe 8 ModSelL Module Select 34 Tx3n Tx4n 5 9 ResetL Module Reset 35 GND GND 4 10 Vcc Rx 3 3 V Power supply receiver Txip Tx2p i 11 SCL 2 wire serial interface clock ag 8 a an 1 12 SDA 2 wire se
7. 168 10 1 Step 5 Primary DNS server Step 6 Domain name Step 7 Enable IPv6 yes yes Step 8 Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 9 Admin password Enter to leave unchanged Step 9 Confirm admin password Enter to leave unchanged You have entered the following information Hostname switch 112126 Use DHCP on mgmt0 interface no Use zeroconf on mgmt0 interface no yes Default gateway 192 168 10 1 Primary DNS server Domain name Enable IPv6 yes Enable IPv6 autoconfig SLAAC on mgmt0 interface no Admin password Enter to leave unchanged unchanged 0 DL KISIU DBPUWUN To change an answer enter the step number to return to Otherwise hit lt enter gt to save changes and exit Choice Configuration changes saved To return to the wizard from the CLI enter the configuration jump start command from configure mode Launching CLI switch 1 gt 22 Mellanox Technologies J Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Table 8 Configuration Wizard Session Static IP Configuration Wizard Session Display Static IP Configuration Example Mellanox configuration wizard Do you want to use the wizard for initial configuration y Step 1 Hostname switch 112126 Step 2 Use DHCP on mgmt0 interface yes n Step 3 Use zeroconf on mgmt0 interface no Step 4 Primary IP address for example 192 168 10 4
8. Mask length may not be zero if address is not zero interface eth0 Step 5 Netmask 0 0 0 0 255 255 255 0 Step 6 Default gateway for example 192 168 10 1 Step 7 Primary DNS server Step 8 Domain name Step 9 Enable IPv6 yes yes Step 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 11 Admin password Enter to leave unchanged You have entered the following information Hostname switch 112126 Use DHCP on mgmt0 interface no Use zeroconf on mgmt0 interface no Primary IP address 192 168 10 4 Netmask 255 255 255 0 Default gateway 192 168 10 1 Primary DNS server Domain name 9 Enable IPv6 yes 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no 11 Admin password Enter to leave unchanged unchanged IRN BWIN To change an answer enter the step number to return to Otherwise hit lt enter gt to save changes and exit Choice Configuration changes saved To return to the wizard from the CLI enter the configuration jump start command from configure mode Launching CLI switch 1 gt Step 5 Before attempting a remote for example SSH connection to the switch check the mgmt0 interface configuration Specifically verify the existence of an IP address To check the current mgmt0 configuration enter the following commands sx 43 standalone master gt enable sx 43 standalone master show interfaces mgmt0 Mellanox Technologies 23
9. Mellanox TECHNOLOGIES SwitchX 36 Port FDR IB Switch Installation Guide P N MSX6025T 1SFR MSX6025T 1BRR MSX6025F 1SFR MSX6025F 1BRR MSX6036T 1SFR MSX6036T 1BRR MSX6036F 1SFR MSX6036F 1BRR Rev 1 5 www mellanox com Rev 1 5 NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY OUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST OUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEOUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE
10. RJ45 included in the box to connect to host PC for managed initial configuration of the switch After initial configuration the switch can be managed through the Ethernet port using a remote connection 18 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 3 Configuring the Switch 3 1 Introduction The procedures described in this chapter assume that you have already installed and powered on your switch according to the instructions in the Switch Installation Guide this document 3 2 Externally Managed Switches Unmanaged Externally managed switches that is the SX6025 switches do not get configured On unmanaged switches the CONSOLE Ethernet and USB connectors are not found do not work Instead there is an I2C connector The unmanaged switches are Plug and Play and all firmware updates should be done in band The I2C connection should only be used if the firmware image was corrupted to the point that the reg ular firmware tools cannot successfully reburn the correct image When you install the switch it comes with the latest firmware burned on the board You will not need to burn firmware unless you get notification from Mellanox that a newer version of firmware for your switch has been released 3 3 Managed Internally Managed Switches Internally managed switches must be configured before they will work Follow the procedures below to configure the switch 3 3 1 Configuring
11. The RJ45 Console and Ethernet interfaces uses the EIA 568A standard wiring color coding CONSOLE J34 Table 10 RJ45 Pinout TXD e Pin 1 a 7 o rss RTS w Connection Signal Pin Color GND RJ45_DTR _ RJ45_TXD TXD RJ45_RTS 1 G W GND RXD CD p TXD RJ45_DTR 2 G GND ee GND RXD RJ45_TXD 3 O W GND Pin 8 GND GND 4 Bl Looking into the Socket ookINg INTO e ocke GND GND 5 BW RXD RJ45_RXD 6 O GND GND 7 Br w GND GND 8 Br Mellanox Technologies 33 Rev1 5 Connecting to the Switch Platform Appendix D Replacement Parts Ordering Numbers Table 11 Replacement Parts Ordering Numbers Part Description OPN I2C DB9 or RJ45 to USB Adapter MTUSB 1 Fan module with power supply side to connector side air flow MSX60 FF Fan module with connector side to power supply side air flow MSX60 FR 300W Power Supply w Power Supply Side to Connector side air flow MSX60 PF 300W Power Supply w Connector side to Power Supply side air flow MSX60 PR Power cord Type C13 C14 ACC000251 Power cord Type B for USA Canada Mexico Taiwan ACC000204 Power cord Type H for Israel ACC000205 Power cord Type E F for Sweden France Germany Netherlands Russia ACC000207 Power cord Type G for UK ACC000208 Power cord Type D for India ACC000209 Power cord Type I for China ACC000210 Power cord Type J
12. ame gt lt switch ip address gt Mellanox MLNX OS Switch Management Password Last login Thu Apr 28 11 24 13 2011 from 192 168 10 1 Mellanox Switch sx 43 standalone master gt Step 4 You can enter any supported command now 4 2 Starting a WebUl Connection to the Switch Step 1 Set up an Ethernet connection between the switch and a local network machine the remote machine henceforth using a standard RJ 45 connector Step2 Start a Web browse Google Chrome Microsoft Internet Explorer 7 0 or Mozilla Firefox 3 0 Make sure the screen resolution is set to 1024 768 or higher gt Step 3 Enter as URL the following http lt switch_IP_address gt where lt switch_IP_address gt is the IP address of the switch or its DNS name Mellanox Technologies 25 Rev 1 5 Connecting to the Switch Platform Step 4 You will receive the login window for remote management of the switch The following figure shows an example Note that the default username is admin Figure 10 Web UI Login Page Mellanox MLNX OS Management Console Mellanox TECHNOLOGIES Host Piranha SX 1 User not logged in Login oe Gio re ge inau REE ie Please enter your username and password then click Login Account admin 4 3 Resetting the Switch On the connector side panel under the system LEDs is a reset button This reset button requires a tool to be pressed DO NOT use a sharp pointed object s
13. and the door can be as little as 4 cm on one side of the rack and as much as 18 cm on the other side of the rack Keep in mind that there can be as many as 3618 cables connected to the switch Do you want the connector side recessed in the rack to allow for a larger cable bending radius It is possible to recess the connector side by 5cm by optional placement of the switch rails See Figure 3 Mounting Options Will the connector side be recessed past other equipment in the rack and will this be prob lematic The installation kit allows for a 2 recess of the switch past the vertical support 12 Mellanox Technologies J Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Figure 3 Mounting Options 3 Decide which mounting option you want to use To use the rail kit to transfer the power cord from the connector side to the power side go now to Transferring the Power Cord on page 28 4 Screw the switch slides onto the switch Use 5 flat head screws for short switches and 7 screws for standard depth switches to connect each switch slide Figure 4 Screwing on the Rail 5 screws per side are needed for the short switch 7 screws per side are needed for the standard switch There are 16 screws in the kit you will have left over screws Mellanox Technologies 13 Rev 1 5 Installing the Switch in the Rack Figure 5 Inserting the Caged Nuts Side you will slide the switch into
14. e password by re entering it Note that password characters are not printed You have entered the following information 1 Hostname lt switch name gt 2 Use DHCP on mgmt0 interface yes 3 Enable IPv6 yes 4 Enable IPv6 autoconfig SLAAC on mgmt0 interface no 5 Admin password Enter to leave unchanged CHANGED To change an answer enter the step number to return to Otherwise hit lt enter gt to save changes and exit Choice lt Enter gt Configuration changes saved To return to the wizard from the CLI enter the con figuration jump start command from configuration mode Launching CLI lt switch name gt gt The wizard displays a summary of your choices and then asks you to confirm the choices or to re edit them Either press lt Enter gt to save changes and exit or enter the configuration step number that you wish to return to Note To run the command configuration jump start you must be in Config mode Mellanox Technologies 21 Rev1 5 Configuring the Switch Table 7 Configuration Wizard Session IP Zeroconf Configuration Wizard Session Display IP Zeroconf Configuration Example Mellanox configuration wizard Do you want to use the wizard for initial configuration y Step 1 Hostname switch 112126 Step 2 Use DHCP on mgmt0 interface yes no Step 3 Use zeroconf on mgmt0 interface no yes Step 4 Default gateway For example 192
15. for Switzerland ACC000211 Power cord Type B for Japan ACC000212 Power cord Type I for Australia ACC000213 Installation Kit for short switches in racks 40 60 cm deep MSX60 BKIT Installation Kit for short or standard switches in racks 60 80 cm deep MSX60 SKIT 34 Mellanox Technologies
16. frei zu machen _ gu un module Alimentation Sta ensure a powered down state inside sind die Netzstecker aller bilise e Pour isoler com of the switch platform Netzteile zu entfernen pletement le module en cause Il faut de brancher toutes les alimen tations stabilise es Mellanox Technologies 17 Rev 1 5 Internally Managed Vs Externally Managed 2 internally Managed Vs Externally Managed The following table shows which switches come with a management CPU and which do not Externally managed unmanaged switches are plug and play out of the box All switches come with the latest firmware burned on the flash Updating the firmware stack for the externally man aged switches is done in band only When a new firmware release is available e mail notification you can upgrade the device through a link to the Mellanox web page firmware download site All internally managed switches have internal chassis management and can support IB fabric of up to 648 nodes Internally managed switches need an initial configuration before they will start working Table 4 Switch Management Internally Family Externally Management Connections Managed SX6025 Externally Plug and Play managed All firmware updates should be done in band using Mellanox firmware unmanaged management tools I2C port access using MTUSB 1 device is reguired for firmware updates if in band burning is not possible SX6036 Internally RS232 cable DB9 to
17. ftware This document contains information regarding configuring User Manual and managing Mellanox Technologies SwitchX Switch Platforms MLNX OS Software WebUI User s Manual WebUI user s manual for MLNX OS MLNX OS Software Command Reference Guide Command Reference Guide for MLNX OS listing all of the commands available through MLNX OS with explanations and examples MLNX OS Software Configuration Guide Configuration Guide for MLNX OS displaying different configuration scenarios All of these documents can be found on the Mellanox Website They are available either through the product pages or through the support page with a login of user and password Document Conventions When discussing memory sizes MB and MBytes are used in this document to mean size in mega bytes The use of Mb or Mbits small b indicates size in mega bits 6 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Mellanox Technologies 7 Rev 1 5 Mellanox Part Numbering Legend Mellanox Part Numbering Legend Place Field Decoder M Mellanox Technologies SX System Type SwitchX Switch P Protocol 60 IB 90 VPI MM Port and 25 36 Ports externally managed Management 36 36 ports internally managed Options C InfiniBand F FDR T FDR10 O QDR D DDR Port Config Separator P ff Power Sup 0 0 1 1 2 2 plies F Form factor S
18. g a safety ground and rated for 15A or higher Caution The switch platform will automatically power on when AC power is applied There is no power switch Check all boards power supplies and fan tray modules for proper insertion before plugging in a power cable Caution After inserting a power cable and confirming the green system status LED light is on make sure that the Fan Status indicator shows green If the fan status indicator is not green then unplug the power connection and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and or obstacles Caution When turning off the switch make sure ALL Connector LEDS are off to ensure a powered down status 16 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Do not hot swap the power supply if your switch has only one power supply You must power down the system to replace the power supply unit when there is only one PSU in the switch Figure 8 Two Power Inlets Electric Caution Notifications CAUTION ACHTUNG ATTENTION Risk of electric shock and energy Gafahr des elektrischen Risque de choc et de danger hazard The two PSUs are indepen Schocks Entferrnen des e lectrigues Le de branchment dent Netzsteckers elnes Netzteils d une seule alimentation stabi spannungsfrei Um alle Einhi lise e ne de branch uniquement Disconnect all power supplies to eten spannungs
19. istory Table 1 Revision History of this Installation Guide Revision Date Details 1 5 September 2012 Reduced the OPNs on the title page to those in the Price book 14 August 2012 Converted Visio graphics to Mechanical drawings Added figure 2 1 3 January 2012 Fixed wizards Added IPv6 1 2 Oct 2011 Removed clip references from Appendix A 1 1 July 17 2011 Replaced the reference to Har 000022 Har 000022 is now in the MTUSB kit and not packed with the switch 1 0 July 04 2011 Initial release Mellanox Technologies 5 Rev 1 5 About this Manual This manual describes the installation and set up instructions of the Mellanox SX60XX switch family which is based on the SwitchX IB switch device Intended Audience This manual is intended for users and system administrators responsible for installing and setting up the switch platform The manual assumes familiarity with the InfiniB and architecture specification Related Documentation The documentation set accompanying the SX60XX top of rack switch platform includes the fol lowing Table 2 Reference Documents Document Name Description InfiniBand Architecture Specification Vol 1 The InfiniBand Architecture Specification that is provided Release 1 2 1 by IBTA Switch Hardware User Manual This document contains HW descriptions LED assign ments and HW specifications among other things Mellanox MLNX OS SwitchX So
20. llips Screwdrivers 1 and 2 e Grounding screw ESD strap e Grounding wire sufficient to reach a valid ground ESD mat 10 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 For racks from 60cm to 80cm deep either use the standard depth switches with the long rail kit or the short switches with the long rail kit Parts included in the rail kit 2rails e 16 recessed flat head screws You will have extras e 2 rail slides 10 caged nuts e 2 switch slides e 10 pan head screws M6 Figure 1 Rack Rail Kit Parts Switch slide x2 Rail x2 Rail slide x2 TTTTI eevee do do dd oe TITTI 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Choose which side of the switch you want even with the rack vertical support Either the side with the power supply units or the side with the OSFP connectors can be even with one of the vertical rack supports Mellanox Technologies 11 Rev 1 5 Installing the Switch in the Rack Figure 2 Placement of Switch in Rack Doors Connector side Cable with recommended bending radius 19 482 6mm Switch Insufficient room for recommended bending radius Spine side Doors Things to consider before choosing where to mount the rails and rail slides The distance between the rack
21. lt hostname then press lt Enter gt Otherwise type a different hostname and press lt Enter gt Stepl Hostname switch 1 20 Mellanox Technologies J Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Table 6 Configuration Wizard Session IP Configuration by DHCP Sheet 2 of 2 Wizard Session Display Example Comments Step 2 Use DHCP on mgmt0 interface no Perform this step to obtain an IP address for the switch eth0 is the management port of the switch If you wish the DHCP server to assign the IP address type yes and press lt Enter gt If you type no no DHCP then you will be asked whether you wish to use the zeroconf configuration or not If you enter yes yes Zeroconf the session will continue as shown in Table 7 If you enter no no Zeroconf then you need to enter a static IP and the session will continue as shown in Table 8 Step 3 Enable IPv6 yes yes The management interface will be able to use IPv6 addresses Step 4 Enable IPv6 autoconfig SLAAC on mgmt0 interface no no This turns on autoconfiguration of the IPv6 addresses This is unsuitable for DHCPv6 Step 5 Admin password Press lt Enter gt to leave unchanged lt new_password gt Step 6 Confirm admin password lt new_password gt To avoid illegal access to the machine please type a password and then press lt Enter gt Then confirm th
22. nmental character istics of a fully populated platform The rack mounting holes conform to the EIA 310 standard for 19 inch racks Take pre cautions to guarantee proper ventilation in order to maintain good airflow at ambient temperature Cable routing in particular should not impede the air exhaust from the chassis 1 2 1 Installation Kits There are two Installation kit options One long and one short Both the standard and the short switches can be mounted using the long rail kit The short kit will only work with the short switch See Mellanox Part Numbering Legend on page 8 for explanation of the switch depth according to the Model numbers Table 3 Installation Kit According to Rack Size Kit OPN Rack Size MSX60 BKIT 40 60 cm MSX60 SKIT 60 80 cm Mellanox Technologies 9 Rev 1 5 Installing the Switch in the Rack 1 2 2 Mechanical Installation The switch platform can be rack mounted and is designed for installation in a standard 19 rack The power side of the switch includes a hot swap power supply module a blank cover for an optional second PS unit for redundancy and a hot swap fan tray There are two possible air flow directions Be sure that the switch air flow direction is compatible with your system rack and PS units The connector side of the switch has the QSFP ports system LEDs and management con nection ports The switch platform contains auto sensing 100 240 VAC connection
23. on 10 1 3 1 Installing the Switch in the Rack 10 1 3 2 Grounding the Switch 15 1 3 3 Power Connections and Initial Power On 16 Chapter 2 Internally Managed Vs Externally Managed 18 Chapter 3 Configuring the Switch 19 3 1 Introduction 19 3 2 Externally Managed Switches 19 3 3 Managed Internally Managed Switches 19 3 3 1 Configuring the Switch for the First Time 19 3 4 Rerunning the Wizard 24 Chapter 4 Connecting to the Switch Platform 25 4 1 Starting an SSH Connection to the Switch CLI 25 4 2 Starting a WebUI Connection to the Switch 25 4 3 Resetting the Switch 26 Appendix A Transferring the Power Cord 28 Appendix B QSFP Interface 31 Appendix C RJ45 Console and Ethernet Interfaces 33 Appendix D Replacement Parts Ordering Numbers 34 Mellanox Technologies 3 Rev 1 5 List of Figures Figure 1 Rack Rail Kit Parts 11 Figure 2 Placement of Switch in Rack 12 Figure 3 Mounting Options 13 Figure 4 Screwing on the Rail 13 Figure 5 Inserting the Caged Nuts 14 Figure 6 Slide the Rail into the Rail Slide 14 Figure 7 Status LEDs 5 Minutes After Power On 15 Figure 8 Two Power Inlets Electric Caution Notifications 17 Figure 9 Console Port 19 Figure 10 Web UI Login Page 26 Figure 11 Reset Button 26 Figure 12 Transfer Power Cord 28 Figure 13 Install the Switch Slide 29 Figure 14 Transfer Power Cord Finished 30 4 Mellanox Technologies Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Revision H
24. rial interface data 13 GND Ground 14 Rx3p Receiver Non Inverted Data Output 15 Rx3n Receiver Inverted Data Output 16 GND Ground 17 Rxlp Receiver Non Inverted Data Output 18 Rxln Receiver Inverted Data Output 19 GND Ground 20 GND Ground 21 Rx2n Receiver Inverted Data Output 3 22 Rx2p Receiver Non Inverted Data Output 3 23 GND Ground 24 Rx4n Receiver Inverted Data Output 3 25 Rx4p Receiver Non Inverted Data Output 3 26 GND Ground 27 ModPrsL Module Present 28 IntL Interrupt 29 Vcc Tx 3 3 V Power supply transmitter 30 Vcc 1 3 3 V Power Supply 31 LPMode Low Power Mode 32 GND Ground 33 Tx3p Transmitter Non Inverted Data Input 34 Tx3n Transmitter Inverted Data Input 35 GND Ground 36 Tx1p Transmitter Non Inverted Data Input 37 Txin Transmitter Inverted Data Input 38 GND Ground Mellanox Technologies 31 Connecting to the Switch Platform Rev 1 5 GND An TXIp GND i TX3n i TX3p GND LPMode 18 35 Top Vcc1 VccTx IntL ModPrsL View into Rear of Connector GND i RX4p i RX4n GND RX2p x RX2n GND x x Sa GND TX2n TX2p GND TX4n TX4p GND ModSelL ResetL VecRx SCL SDA T JP 18 35 O GND RX3p RX3n GND RX1p RX1n GND View into Front of Cage 8 50 Mellanox Technologies 32 Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 Appendix C RJ45 Console and Ethernet Interfaces
25. s for all possible PS units The installer should use a rack capable of supporting the mechanical and environmental character istics of a fully populated platform i The rack mounting holes conform to the EIA 310 standard for 19 inch racks Take pre N cautions to guarantee proper ventilation in order to maintain good airflow at ambient temperature Cable routing in particular should not impede the air exhaust from the chassis 1 3 Package Contents and Installation Before you install your new SX6036 switch unpack the system and check to make sure that all the parts have been sent check this against the parts list below Check the parts for visible damage that may have occurred during shipping The switch comes packed with the following items e 1X switch e 1X installation kit e 1X power cable for each PS unit Type C13 C14 See Replacement Parts Ordering Numbers on page 34 to order power cords for various countries A single power cord for each power supply unit can be ordered at no extra charge e 1 X Harness HAR000028 Harness RS232 2M cable DB9 to RJ 45 for SX6036 switches e 1 X Quick Start Guide 1 X China RoHS statement If anything is damaged or missing contact your customer representative immediately For customer support go to www mellanox com gt Support gt Customer Support Portal Login 1 3 1 Installing the Switch in the Rack Tools and Customer Supplied Parts Phi
26. take up to 5 minutes to boot up during which time the status LED may indicate red 15 You can start connecting all of the cables to the switch FDR and FDR10 are only guaranteed to work with approved Mellanox Cables aa Caution Slide rail mounted equipment is not to be used as a shelf or a work space 1 3 2 Grounding the Switch Check to determine if your local or national electrical codes require an external ground to all IT components If so connect a ground wire to one of the casing screws and connect the other end to a valid ground If you choose to not use the ground screw make sure that the rack is properly Mellanox Technologies 15 Rev 1 5 Installing the Switch in the Rack grounded and that there is a valid ground connection between the chassis of the switch and the rack Test the ground using an Ohm meter Some national and or local codes may reguire IT components to be bonded and exter nally grounded not including the power cord ground You must follow all national all and local codes when installing this equipment 1 3 3 Power Connections and Initial Power On The switch platform ships with one or two Power Supply Units For switches with only one unit installed a second PSU may be installed at a later time Each supply has a separate AC receptacle The input voltage is auto adjusting for 100 240 VAC 50 60Hz power connections The power cords should be standard 3 wire AC power cords includin
27. uch as needle or push pin for pressing the Reset button Sharp objects can cause damage use a flat object to press this reset button Figure 11 Reset Button Press the reset button to reset the main and EUEHEEEEEE management CPUs and to delete the existing password AV AV 26 Mellanox Technologies J Switch X SX60XX 36 port FDR Switch Installation Guide Rev 1 5 This button resets both the CPU of the switch device and the CPU of the management module It thereby resets all of the ports by bringing them down and powering them up when the button is pushed A quick push of this button performs this reset When the button is held down for 15 sec onds the switch is reset and the password is deleted You will then be able to enter without a pass word and make a new password for the user admin The SwitchX Series User Manuals can be found at http www mellanox com Mellanox Technologies 27 Rev 1 5 Connecting to the Switch Platform Appendix A Transferring the Power Cord To use the rail kit to transfer the power cord from the connector side to the power side follow these directions Do you want to install power cords on both sides of the switch or only one side For each power cord you want to transfer 1 Once you have decided which side of the switch will be next to the vertical support 2 Make sure that you place the cord so that the correct end of the cord will be at the power side of the switch This will depend on
Download Pdf Manuals
Related Search