Home

HW User Manual

1. 10 11 12 13
2. 13 14 15 17 UL 4mA RER EE an i 15 1 TRA 18 UL CSA WEE he 4 AS UL CSA BE 82888 16 AWG 125 1 5 4 5 ARN BRR AERA lt gt Fi 1 0 300 V RA PVC
3. BBU Mellanox Technologies gt gt 90 Mellanox Technologies Rev 1 5 BBU B E 9 Avertismente privind siguran a la instalare Romanian 1 Instructiuni de instalare y N Cititi toate instructiunile de instalare nainte de a conecta N 2 Accidentare cauzat de greutate da Apelati la un num r suficient de persoane pentru a ridica n sigurant acest produs 40 lbs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32
4. 20 22 23 WEEE 2002 96 EC WEEE 24 BBU BBU
5. H PamapOoBaHHPIN 88 Mellanox Technologies Rev 1 5 14 16 17
6. 6 Mellanox Technologies Rev 1 5 12 4 13 14 DINI 3 15 3 16 mn 215 YN UL CSA 3 16 AWG 125V 13 mam 1 5 6 4 5 235 gt HAR
7. lt 40 lbs 40 70 16 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 4 IN N CHAT y N 5 AA He 45 113 F 8 3
8. DINA D lt 22 mm MINI mam AT pr DMA gt gt gt 68 Mellanox Technologies Rev 1 5 A DPN INV e INN NOW 2909 n DIN EA Chinese 1
9. BBU gt Db Mellanox Technologies 73 Rev 1 5 26 China CCC Warning Statement English translation disconnect all power sources before service SD For non tropical use dried Gl 5 208 im od roel re e DIO IR kek aki Dan hab yungh youq gij dienheiq diuzgen mbouj dwg diegndat haenx ancienz sawjyungh gado ASAS axo Yos il 55 pw 2000 a p Warning for Class A E Ich APR EERTE English translation of above statement This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures 74 Mellanox Technologies Rev 5 E 5 Avertissements de s curit pour l installation French 1 Instructions d installation Veuillez lire la totalit des instructions d installation avant de relier l quipement au secteur 2 Blessures cause du poids da
10. 250 V 10 A Mellanox Technologies 71 Rev 1 5 19 VAWTHRER ARBRE 20 gt 21 EERE RS232 SEN CARRIE 7 UL DP 1 2 LPS BERE 20 A a 22 BA 89 RAN SH TERA SEINE 23 WEEE 4 WEEE 2002 96 EC PPAR ESA ERES TA EEE FONE BEE PABBARAWHAR FE MM MAS ES gt lt 24 TN IT 25 BBU 72 Mellanox Technologies Rev 1 5 BBU Mellanox Technologies BBU
11. Date Revision Description October 2015 1 5 Edited Battery Backup Unit BBU Installation for SX6720 on page 16 August 2015 1 4 Minor fixes May 2015 1 3 Added Hebrew safety warnings Added BBU safety warnings in all languages April 2015 1 2 Added 19 Systems Mounting Telescopic Rail Kit on page 23 January 2015 1 1 Minor formatting edits January 2015 1 0 Initial release of the first edition 8 Mellanox Technologies Rev 1 5 About this Manual This manual describes the installation and basic use of the Mellanox InfiniBand systems Intended Audience This manual is intended for 11 managers and system administrators References Table 2 References Document Description InfiniBand Architecture Specifica The InfiniBand Architecture Specification that is provided by IBTA tion Volume 1 Release 1 2 1 and Volume 2 Release 1 3 MLNX OS User Manual This document contains information regarding configuring and managing MLNX OS software see http www mellanox com page mlnx os Conventions The following icons are used throughout this document to indicate information that 1s important to the user This icon makes recommendations to the user p This icon indicates information that is helpful to the user This icon indicates situation that can potentially cause damage to hardware or software gp This icon indicates a situation that can po
12. 2 0 lt 40 lbs 40 70 lbs 70 121 8 gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 EXE A KRENE ERES DEBRA REA 4 ER AA Ta SRE EY ERS i Mellanox Technologies 69 45 C 113 HA 8 3 KN 6 HERE N ROT MEME EM E MRA TERENA BS SBIH Ho 7 ERE fe ERMES E EVERT A EAR WREERHERZE E KAZA IEA 525528 mo PERRI 9 KAMAR EM AS EA BBE 9 EF Ed BER fo SH f BR o LA PSU 10 A TEBA IE Si Beo 11 7 Sp BEE HALA DEBRA FLX ABIES EAN Em EROR RE AR EROR EIS o 70 Mellanox Technologies Rev 1 5 12
13. 300 250 10 19 Mellanox Technologies 89 Rev 1 5 20 21 RS232 Ethernet DP 1 DP 2 UL
14. Rev 5 Figure 35 Connector Male and Female Views View into Rear of Connector GND uzXU dexu QN9 U XH dbxH GND ESPON View into Front of Cage 8 50 6 2 RJ45 to DB9 Harness Pinout In order to connect a host PC to the Console RJ45 port of the system a RS232 harness cable DB9 to RJ45 is supplied 58 Mellanox Technologies Rev 1 5 Figure 36 RJ45 089 Harness Pinout Mellanox Technologies 59 Rev 1 5 Appendix D Disassembly and Disposal D 1 Disassembly Procedure gt To disassemble the system from the rack 1 Unplug and remove all connectors 2 Unplug all power cords 3 4 Unscrew the center bolts from the side of the system with the bracket Remove the ground wire Support the weight of the system when you remove the screws so that the system does not fall Slide the system from the rack 6 Remove the rail slides from the rack 7 Remove the caged nuts 0 2 Disposal According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way Follow the instructions found at http www mellanox com page dismantling procedures for proper disassembly and disposal of the switch according to the WEEE direct
15. LED Behavior Description Action Required Solid Green The system is up and running nor N A mally Flashing Green The system is booting up Wait up to five minutes for the end of the booting process Solid Red Major error has occurred For exam If the System Status LED shows red five ple corrupted firmware system is minutes after starting the system unplug the overheated etc system and call your Mellanox representa tive for assistance 4 2 1 2 Fan Status LED Figure 30 Fan Status LED Front and Rear Sides Both of these LEDs in the red circles show the fans status 46 Mellanox Technologies Rev 1 5 Table 15 Fan Status Front LED Assignments usen Description Action Required Solid Green All fans are up and running N A Solid Red Error one or more fans not operating prop The faulty FRUs should be replaced erly Off System boot N A Table 16 Fan Status Rear LED Assignments One LED per Fan DON Description Action Required Solid Green A specific fan unit is operating N A Solid Red A specific fan unit is missing or not The fan unit should be replaced operating properly Off System boot N A Risk of Electric Shock A With the fan module removed power pins are accessible within the module cavity Do not insert tools or body parts into the fan module cavity 4 2 1 3 Power Supply Status LEDs Figure 31 Power S
16. UL 4 18 UL CSA IN UL CSA 3 16 AWG 1 5 M 6 4 5 125 13 A lt HAR gt 3 1 0 MM
17. Za sjevernoameri ku mre u odaberite kabel napajanja koji je na UL listi 1 sa CSA certifikatom 3 ilni 16 AWG 16 AWG koji zavr ava lijevanim uti ka em nazivnog napona od 125 V 13 A minimalne duljine od 1 5 m six feet est stopa ali ne dulji od 4 5 m Za europsku mre u odaberite kabel napajanja koji je me unarodno uskla en i ozna en lt HAR gt 3 ilni s najmanje 1 0 mm ice nazivnog napona od 300 V s PVC izolacijom Kabel mora imati lijevani utika nazivnog napona od 250 V nazivne struje od 10 A 19 Veliko curenje struje da Upozorenje Veliko curenje struje Prije spajanja napajanja nuZno je spojiti uzeml jenje 20 Dodaj informaciju o GND spoju hh Prije spajanja ovog ure aja na elektri ni vod vijci terminala za titnog uzemljenja ure aja moraju se spojiti na za titno uzemljenje u instalacijama zgrade Informacija o GND spajanju Instalacije u zgradi omogu it e sredstva za spajanje na za titno uzemljenje a servisno osoblje e trajno odr avati spoj opreme s uzemljenjem SERVISNO OSOBLJE e provjeriti omogu uje li ili ne zidna uti nica napajanja za opremu spoj na za titno uzemljenje zgrade Ako ne SERVISNO OSOBLJE e organi zirati instaliranje VODI A ZA TITNOG UZEMLJENJA iz posebnog terminala za titnog uzemljenja na icu za titnog uzemljenja u zgradi Oprema e se instalirati u podru je gdje postoje ekvipotencijalni spojevi poput telekomunikacijskog cen
18. 6 N He Mellanox Technologies 87 Rev 1 5 7 8 Ha H 9
19. iletken en az 1 0 mmo tel 300 V de erinde ve PVC yal t ml bir g kayna kablosu se in Kablonun 250 V 10 A de erinde bir kal planm fi i olmas gerekmektedir 19 Y ksek Ka ak Ak m Y ksek ka ak ak m varsa g kayna na ba lanmadan nce mutlaka topraklama ba lant s yap lmal d r 20 Montaj Kodlar i Bu cihaz n lke ulusal elektrik kodlar n n son s r m ne g re monte edilmesi gerekir Kuzey Amerika i in ekipman n ABD Ulusal Elektrik Kodu ve Kanada Elektrik Kodu nun uygulama ko ullar na g re monte edilmesi gerekir 106 Mellanox Technologies Rev 5 21 Unitelerin Ara Ba lantisi 5232 nitesini ve Ethernet Arabirimlerini ba layacak olan kablolar n UL onayli DP 1 veya DP 2 tipi olmas1 gerekir Not LPS olmayan devreye aitse A r Ak m Korumas Kolayca eri ilebilecek 20 V Kay tl devre par as a r ak m koruma cihaz n n bina elektrik ebekesinde kurulu olmas gerekir 22 Anahtar Raf veya al ma Alan olarak kullanmayinl Dikkat S rg l rayl ekipman raf veya al ma alan olarak kullan lamaz Raylar niteyi iskeleden uza a kayd rmak i in yap lmam t r Sadece ekipman n son olarak duraca yerdeki kal c montaj i indir servis veya bak m i in kullan lamaz 23 WEEE Y nergesi WEEE Y nergesi 2002 96 EC uyar nca t m elektrikli ve elektronik ekipman at klar EEE ayr olarak toplanmal ve evsel at klar
20. 19 Curent de scurgere de nalt frecven Avertisment Curent de scurgere de nalt frecven Imp m ntarea este esen ial nainte de a conecta sursa de alimentare Mellanox Technologies 93 Rev 1 5 20 Ad ugarea de informatii privind legarea la pamant Inainte de a conecta acest dispozitiv la o linie electric de energie suruburile bornelor de protec ie de legare la p m nt ale acestui dispozitiv trebuie s conectate la priza de p m nt de protec ie din instala ia cl dirii Informa ii privind legarea la p m nt Instala ia cl dirii va asigura un mijloc de conectare la priza de p m nt iar echipamen tul va fi n mod permanent conectat la priza de p m nt de un agent de ntre inere UN AGENT DE NTRE INERE va verifica dac priza borna de ie ire prin interme diul c reia va fi alimentat echipamentul cu energie electric asigur o conexiune la priza de p m nt a cl dirii n caz contrar AGENTUL DE NTRE INERE va dispune instalarea unui CONDUCTOR DE PROTEC IE DE LEGARE LA P M NT de la borna separat de protec ie de legare la p m nt la cablul de protec ie de legare la p m nt al cl dirii Echipamentul va fi instalat ntr o zon unde exist leg turi echipo tentiale precum un centru de telecomunica ii sau o camer a computerelor dedicat 21 Codurile de instalare Acest dispozitiv trebuie s fie instalat n conformitate cu ultima versiune a codurilor electric
21. Mellanox Technologies 350 Oakmead Parkway Suite 100 Sunnyvale CA 94085 U S A www mellanox com Tel 408 970 3400 Fax 408 970 3403 O Copyright 2015 Mellanox Technologies All Rights Reserved Mellanox Mellanox logo BridgeX ConnectX Connect IB CoolBox amp CORE Direct amp GPUDirect InfiniBridge InfiniHost InfiniScale Kotura Kotura logo MetroX MLNX OS PhyX ScalableHPC SwitchX TestX UFM Virtual Protocol Interconnect Voltaire amp and Voltaire logo are registered trademarks of Mellanox Technologies Ltd CyPUTM ExtendXTM FabricITTM FPGADirectTM HPC X Mellanox Care Mellanox CloudX Mellanox NEO Mellanox Open Ethernet Mellanox PeerDirect Mellanox Virtual Modular Switch MetroDX NVMeDirect StPUTM Switch IBTM Unbreakable LinkTM are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners 2 Mellanox Technologies Document Number MLNX 15 4241 Rev 1 5 Table of Contents Revision PUSO Vs sadaka ARA AAA A 8 About this Manual au is A L L RA A 9 Chapter 1 Introduction to Mellanox SX67X0 Systems 10 121 Overview sm ne ee ee nal 10 1 2 Speed and Switching es se sun ces RR da dra 11 1 3 Management Interfaces and FRUSs 11 BC Fe t res see ee OE aly ete fe om ces alien 11 1 57 Certifications us gla en ne CEN
22. Power Input Voltage 100 240 50 60Hz Global Power Consumption Typical ATIS score under snake topology with passive cables 83 55 Maximum with passive cables 208W Maximum with active optical cables 300W assuming QSFP at 2 0W Main Devices CPU Intel Celeron 1047UE x86 Switch Mellanox SwitchX 2 Memory SSD 16G system can support up to 64G on single SSD slot SDRAM 4G Switching Capacity 2 88Tb s 54 Mellanox Technologies Rev 1 5 Appendix A Accessory and Replacement Parts Table 23 OPNs for Replacement Parts OPN Part Description MTEF KIT B Rack installation kit for short depth 1U systems to be mounted into short depth racks MTEF KIT S Rack installation kit for standard depth 1U systems to be mounted into stan dard depth racks MTEF KIT T Rack installation kit for standard depth 1U systems to be mounted into Telco NEBS Seismic racks MTEF PSF AC A 460W AC Power Supply w rear to front air flow MTEF PSF AC B 400W battery backup ready AC Power Supply w rear to front air flow MTEF PSF DC A 800W DC Power Supply rear to front air flow NEBS 1v3 certified MTEF PSR AC A 460W AC Power Supply w front to rear air flow HAR000028 Harness RS232 2M cable DB9 to RJ 45 ACC000501 Power cord Type C13 C14 MTEF FANF A Fan module w rear to front airflow fan for SX67X0 SX1710 switch systems MTEF FANF B Fan module w
23. Turn off the system and disconnect it from peripherals and from the electrical outlet Step 2 Unscrew the two M6 screws securing the front of the inner rails ears to the outer rails and to the rack Step3 Pull the unit out until braking is felt For safety purposes the locking mechanism will not allow a complete removal of the unit at this stage Step 4 Press on the locking spring appears in red in Figure 21 on both sides simultaneously and con tinue pulling the unit towards you until it is fully removed Figure 20 Pulling the Unit Outwards 8 Mellanox Technologies Rev 1 5 Figure 21 Locking Mechanism 2 6 Cable Installation All cables can be inserted or removed with the unit powered on gt To insert a cable press the connector into the port receptacle until the connector is firmly seated The LED indica tor corresponding to each data port will light when the physical connection is established When a logical connection is made the relevant port LED will turn on gt To remove a cable disengage the locks and slowly pull the connector away from the port receptacle The LED indi cator for that port will turn off when the cable is unseated For more information about port LEDs refer to Section 4 2 1 6 Port LEDs on page 50 4kg force Greater insertion force may cause damage to the cable or the cage A Do not force the cable into the cage with more than 40 newtons 9 0
24. hilo de 1 0 mm2 como m nimo 300 voltios nominal con cobertura protectora aislante de PVC El cable debe tener un enchufe moldeado con capuch n de 250 voltios nominal 10 A 19 Alta corriente de fuga ADVERTENCIA Alta corriente de fuga Es esencial efectuar la conexi n a tierra antes de conectar la alimentaci n 20 C digos de instalaci n Este dispositivo se debe instalar conforme a la versi n m s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad Mellanox Technologies 85 Rev 1 5 21 Interconexi n de unidades Los cables para la conexi n con las interfaces RS232 y Ethernet de la unidad deben estar homologados por UL tipo DP 1 o DP 2 Nota cuando residen en circuito no de tipo LPS Protecci n contra sobrecargas Al cableado del edificio se debe incorporar un disposi tivo de protecci n contra sobrecargas de circuito derivado de f cil acceso con una corriente nominal de 20 A 22 No utilizar el conmutador como estante ni como espacio de trabajo Cuidado Equipos montados en deslizadores o rieles no se deben utilizar como estantes ni como espacio de trabajo La finalidad de los rieles no es deslizar la unidad hacia afuera del bastidor Sirven solo para la instalaci n permanente en el lugar de destino fin
25. n vac a no utilizar el producto si su tapa est quitada o no est bien cerrada 8 Fusible neutro o de polo doble Dos fusibles uno en el polo y otro en el neutro Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno 9 Tomas de alimentaci n m ltiples Riesgo de descarga el ctrica y peligro de corriente Todas las fuentes de alimentaci n son independientes Desconecte todas las fuentes de alimentaci n para asegurar que no haya corriente alguna dentro de la plataforma de conmutaci n 10 Al haber rayos peligro de descarga No utilizar el equipo ni conectar o desconectar cables durante per odos de actividad de rayos 4 11 La conexi n y desconexi n de cables de cobre Dado que los cables de cobre son pesados y no son flexibles su conexi n a los conec tores y su desconexi n se deben efectuar con mucho cuidado Para ver advertencias o instrucciones especiales consultar al fabricante del cable 12 Montaje y mantenimiento del bastidor Al instalar o realizar el mantenimiento de este aparato en un bastidor es preciso adoptar precauciones especiales para garantizar que el sistema se mantenga estable En general en un bastidor los equipos se deben instalar comenzando desde abajo hacia arriba 13 Instalaci n del equipo La instalaci n el reemplazo y el mantenimiento de este equipo estar n a cargo nica mente de personal capa
26. Kit Parts T 99999 999393 Ire nm zena LIL CES ETES Figure 15 Rails Separation To separate the rails 1 Extend the rail assembly by pulling the extension outwards D 2 Extract rail A from rail C by pushing it outside from the rear part of the assembly by pushing it outside from the rear part of the assembly To allow complete separation of rail A from rail C press the quick release latch D A C 1 nn s A C 2 A masa Mellanox Technologies 25 Rev 1 5 Installation gt Planning the system s placement in the rack Before mounting the system to the rack select the way you wish to place the system Pay atten tion to the airflow within the rack cooling connector and cabling options While planning how to place the system review the following points Make sure the system air flow is compatible with your installation selection It 8 important to keep the airflow within the rack in the same direction Incase there are cables that cannot bend within the rack or in case more space is needed for cable bending radius it is possible to recess the connector side or the FRU side by 3 or 4 7 62 or 10 16cm by optional placement of the system s rails The FRU side is extractable Mounting the sliding rail inverted to the system will allow you to slide the FRU side of the system in and out Step 1 Install 10 cage nuts into the desired 1U slot of the rack 4 cage nuts in the non extractable
27. connector of the new unit is free of any dirt and or obstacles Step 2 Insert the fan unit by sliding it into the opening until slight resistance is felt Continue pressing the fan unit until it seats completely two unsuccessful attempts to install the fan unit power off the system before attempt The green Fan Status LED should light If not extract the fan unit and reinsert it After MA ing any system debug 40 Mellanox Technologies Rev 1 5 3 Software Management The systems include an embedded management CPU card that runs MLNX OS management software The MLNX OS systems management package and related documentation can be downloaded via the product page http www mellanox com page mlnx os 3 1 InfiniBand Subnet Manager The InfiniBand Subnet Manager SM is a centralized entity running in the system The SM applies network traffic related configurations such as QoS routing partitioning to the fabric devices You can view and configure the Subnet Manager parameters via the CLI WebUI Each subnet needs one subnet manager to discover activate and manage the subnet Each network requires a Subnet Manager to be running in either the system itself system based or on one of the nodes which is connected to the fabric host based Y No more than two subnet managers are recommended for any single fabric The InfiniBand Subnet Manager running on the system supports up to 648 nodes If the fabric includes more t
28. gt 3 DITA TINA 1 0 V 2 300 Dy PVC 250 10A 17 Mellanox Technologies 67 Rev 1 5 18 m sa pa A 19 05725 Ethernet RS232 UL DP 1 non DP 2 mo nnn NIN y N CA 20 20 PR PN nov 2 N 1 WEEE nipn 29 WEEE 2002 96 EC
29. i na elektri ni sustav s IT uzemljenjem dr ave Norve ke 26 BBU Ako je zamjenska baterija Backup Battery Unit deformirana curi korozivna ili jasno o te ena odmah ju zamijenite Koristite samo zamjensku bateriju Backup Battery Unit tvrtke Mellanox Technolo gies Ako zamjenska baterija Backup Battery Unit nije bila kori tena dvije godine ili dulje od datuma proizvodnje onda ista nije uporabljiva gt Db Ako se baterija treba zamijeniti dobijat ete obavje tenje softvera mjese no tri mjeseca prije isteka roka Mellanox Technologies 99 Rev 1 5 E 11 Avvertenze di sicurezza per l installazione Italian 1 Istruzioni di installazione Leggere tutte le istruzioni di installazione prima di collegare l apparecchiatura all alimentazione 2 Lesioni a causa del peso da Usare un numero di persone sufficiente per sollevare in sicurezza questo prodotto lt 40 lbs 40 lbs 70 121 lbs gt 121 lbs lt 18 kg 18 32 kg 32 55 kg gt 55 kg 3 Apparecchiatura pesante 4 Questa apparecchiatura molto pesante e va spostata mediante un sollevatore meccanico per evitare lesioni 4 Rischio di scosse elettriche Rischio di scosse elettriche Con il modulo ventola rimosso i pin di alimentazione sono accessibili all interno della cavit del modulo NON inserire strumenti o parti del corpo nella cavit del modulo della ventola 5 Temperatura eccessiva Questa apparecchiatura non va
30. in the non extractable side and 4 cage nuts in the extractable side Note that while each rack U unit consists of three holes the cage nut should be installed vertically with its ears engaging the top and bottom holes only While your installation partner is supporting the system s weight perform Steps 4 5 and 6 Step 7 Mount the system into the rack enclosure and attach the brackets installed on the system to the rack s posts Secure the brackets to the rack s posts by inserting four M6 screws in the desig nated cage nuts See Figure 12 Do not tighten the screws yet Step8 Slide the two blades into the left and right rails and adjust them to fit your rack s depth Use four M6 screws D to fix the blades into the rack Do not tighten the screws yet Figure 12 Attaching the Brackets to the Rack 22 Mellanox Technologies Rev 1 5 Figure 13 Sliding the Blades in the Rails Step 9 Secure the system in the rack by tightening the 8 screws inserted in Step 4 and Step 5 with a torque of 4 5 0 5 Nm 2 5 1 1 Removing the System from the Rack gt To remove a unit from the rack Step 1 Turn off the system and disconnect it from peripherals and from the electrical outlet While your installation partner is supporting the system s weight Step 2 Loosen the screws attaching the brackets to the rack Do not remove them yet Step3 Loosen the screws attaching the blades to the rack and pull the blades towards you while
31. installation Cet appareil doit tre install conform ment la version la plus r cente des codes lec trique nationaux En Am rique du Nord l quipement doit tre install en respectant les exigences de l US National Electrical Code et du Code canadien de l lectricit 17 Remplacement de la batterie Avertissement ne remplacer qu avec une batterie UL certifi e pour accepter un cou rant de charge anormal maximal sup rieur ou gal 4 mA Si la batterie n est pas remplac e par un type correct il y a un risque d explosion Les batteries usag es doivent tre mises au rebut conform ment aux instructions 18 Cordon d alimentation UL Listed et certifi CSA Pour le branchement lectrique en Am rique du Nord utiliser un cordon d alimenta tion UL Listed et CSA Certified 3 conducteurs calibre 16 AWG avec une prise moul e 125 V 13 A faisant au moins 1 5 m de long six pieds et au plus 4 5 m Pour le branchement lectrique en Europe utiliser un cordon d alimentation au format international harmonis marqu lt HAR gt 3 conducteurs d au moins 1 mm2 de sec tion 300 V avec une gaine isolante en PVC Le cordon doit avoir une prise moul e 250 V 10 A 19 Courant de fuite lev Avertissement courant de fuite lev une connexion la terre est indispensable avant de brancher l alimentation 20 Codes d installation trique nationaux En Am rique du Nord l quipement doit tre ins
32. kalmas i in zel nlemler al nmal d r Genelde ekipmanlar iskeleye a a dan yukar do ru doldurman z gerekir 13 Ekipman Montaj Ekipman n yaln zca e itimli ve nitelikli personel taraf ndan monte edilmesi de i tirilmesi ve veya bak m n n yap lmas gerekir Mellanox Technologies 105 Rev 1 5 14 Ekipmanin Atilmasi Bu ekipmanin imhasinda tim ulusal yasalara ve d zenlemelere uyulmas gerekir Bu ekipmanin montajinda yerel ve ulusal elektrik kodlar na uyulmas gerekir 16 Montaj Kodlari Bu cihazin lke ulusal elektrik kodlarmin son s r m ne g re monte edilmesi gerekir Kuzey Amerika icin ekipmanin ABD Ulusal Elektrik ve Kanada Elektrik Kodu nun uygulama kosullarina g re monte edilmesi gerekir 17 Pilin Degistirilmesi Uyar Yaln zca maksimum d zg s z Sar ak m 4mA dan az olmayan UL Onayli pillerle degistirin Yanlis pil t r ile de istirildi inde patlama tehlikesi bulunmaktadir Kullanilmis pillerden talimatlara uygun bir sekilde kurtulun 18 UL Kay tl ve CSA Onayl G Kayna Kablosu Kuzey Amerika da g ba lant s i in UL Kay tl ve CSA Onayl bir g kayna kablosu se in 3 iletken 16 AWG 125 V de erinde kal planm bir fi le biten 13 A en az 1 5 m alt fit uzunlu unda fakat 4 5 m den uzun olmayan bir kablo Avrupa da g ba lant s i in uluslararas uyumlu ve lt HAR gt i aretli 3
33. of its management board and the admin password perform the following Push the reset button and keep it pressed for at least 15 seconds You will then be able to enter without a password and set a new password for the user admin In the externally managed systems the reset button resets the device 42 LEDs 4 2 1 LED Notifications The system s LEDs are an important tool for hardware event notification and troubleshooting Table 13 LEDs Symbols Symbol Name Description Normal Conditions System Status LED Shows the health of the system Green Flashing green when booting Fan Status LED Shows the health of the fans Green Power supply units Shows the health of the power supply units Green Bad Port LED Lights up when a symbol error is detected on one Off of the ports Unit Identifier LED Lights up on command through the CLI Off or blue when 1 identifying a port Mellanox Technologies 45 Rev 1 5 Interfaces 4 2 1 1 System Status LED Figure 29 System Status LEDs Front and Rear sides Both of these LEDs in the red circles show the system s status Both of the System Status LEDs front and back supply identical information red after five minutes unplug the system and call your Mellanox representative for It may take up to five minutes to turn on the system If the System Status LED shows MA assistance Table 14 System Status LED Assignments
34. side and 6 cage nuts in the extractable side Step 2 Mount both of the outer rails C D into the rack as illustrated in Figure 16 and use 8 stan dard pan head screws E to fix them to the rack Do not tighten the screws yet Step 3 If cable accommodation is required route the power cable and or Eth cable through either of the outer rails Step 4 Secure the switch to the left and right inner rails A B by gently pushing the switch chassis pins through the slider key holes until locking occurs Step 5 Secure the chassis in the inner rails screwing the 2 flat head Phillips screws in the desig nated points with a torque of 1 5 0 2 Nm Figure 16 Mounting the Outer Rails into the Rack L m n a 4 26 Mellanox Technologies Rev1 5 Figure 17 Attaching the Inner Rails to the Chassis gt Figure 18 Securing the Chassis in the Inner Rails gt Step 6 Slide the switch into the rack by carefully pushing the inner rails into the outer rails installed on the rack Step 7 When fully inserted fix the switch by closing the remaining 2 screws in the middle and tighten ing the 8 screws inserted in Step 2 with a torque of 4 5 0 5 Nm Mellanox Technologies 27 Rev 1 5 Installation Figure 19 Sliding the Switch into the Rack LN TEI i leis IRR sma 2 5 2 1 Removing the System from the Rack gt To remove a unit from the rack Step 1
35. these ports Bad cable Bad connection Bad connector Mellanox Technologies 49 Rev 1 5 Interfaces 4 2 1 6 Port LEDs Figure 33 Port LEDs Table 20 Port LEDs in InfiniBand System Mode LED Behavior Description Action Required Off Link is down Check the cable Solid Green Link is up N A Flashing Green Data activity flashing speed is pro N A portional to data transfer speed Solid Orange Link is up Wait for the Logical link to raise Check that the SM is up Flashing Orange A problem with the link Check that the SM is up In InfiniBand system mode the LED indicator corresponding to each data port will light orange when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port When a logical connection is made the LED will change to green When data is being transferred the light will blink green 50 Mellanox Technologies Rev 1 5 4 3 Inventory Pull out Tab The system s inventory parameters such as serial number part number GUID and MAC address can be extracted from the Inventory pull out tab on the lower right side of the front panel Figure 34 Pull out Tab SX6710 AY 36 AA Melano 2 8 it TE 2 235 Mellanox Technologies 51 Rev 1 5 Troubleshooting 5 Troubleshooting 5 1 Trouble
36. utilizzata in un area con una temperatura ambiente superiore a quella massima consigliata 45 C 113 F Inoltre per assicurare un flusso d aria adeguato lasciare almeno 8 cm 3 pollici di spazio attorno alle aperture di ventilazione 6 Impilare lo chassis Ku i te se ne bi trebalo slagati na drugu opremu Ako ku i te padne mo e izazvati tje lesne ozljede i o te enje opreme 100 Mellanox Technologies Rev 1 5 7 Collegamento di alimentazione ridondante Pericoli elettrici Questo prodotto dotato di un alimentatore ridondante o qualora esso non sia installato di uno spazio vuoto Qualora l alimentatore non sia installato non utilizzare 1l prodotto con il coperchio rimosso o non fissato correttamente 8 Fusibili fase neutro Questo sistema dispone di fusibili fase neutro Rimuovere tutti 1 cavi di alimentazione prima di aprire il coperchio di questo prodotto o di toccare parti interne 9 Prese di alimentazione multiple Rischio e pericolo di scosse elettriche Gli alimentatori sono tutti indipendenti Scollegare tutti gli alimentatori per assicurarsi che 1 commutatore non sia sotto tensione 10 Durante i temporali pericolo di scosse elettriche Durante i temporali non effettuare interventi sull apparecchiatura e non collegare o scollegare i cavi 11 Collegamento scollegamento del cavo di rame I cavi di rame sono pesanti e non flessibili Di conseguenza vanno
37. von Kupferkabel Kupferkabel sind schwer und nicht flexible Deshalb m ssen sie vorsichtig an die Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnun gen und Anleitungen des Kabelherstellers 11 Rack Montage und Wartung sichtsmaBnahmen zu ergreifen um die Stabilit t des Systems zu gew hrleisten Im Wenn dieses Produkt in einem Rack montiert oder gewartet wird sind besondere Vor A Allgemeinen sollten Sie das Gestell von unten nach oben mit Geraten fiillen 12 Ger teinstallation A PS Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert aus getauscht oder gewartet werden 13 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen 80 Mellanox Technologies Rev 1 5 14 Regionale und nationale elektrische Bestimmungen Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen Bes timmungen installiert werden 15 Installationscodes Dieses Ger t muss entsprechend der aktuellsten Version des National Electrical Code installiert weden In Nodamerika muss das Ger t gem den geltenden Anforderungen des US National Electrical Code und des Canadian Electrical Code installiert werden 16 Akkuaustausch Warnung Nur durch von UL anerkannten Akkus ersetzen die fir maximalen malen Ladestrom von nicht weniger als 4mA zertifiziert sind gp Es best
38. 1 5 6 YN PN 45 C 113 F ITI NOW DYP 8 3 DID 7 TPS 01092 PN 4 bawn 8 MI pav PINI IN PN 9 MID 4 TON mon ITI gm DITO NIWAN 10 meto PN 4 11 man
39. 55 kgs gt 55 kgs 3 Echipament greu i Acest echipament este greu si trebuie sa fie mutat folosind un dispozitiv mecanic de ridicare pentru a evita producerea de leziuni 4 Risc de soc electric IN Risc de soc electric y N Odat ce modulul ventilator este indep rtat pinii electrici sunt accesibili n cavitatea modulului NU introduce i instrumente sau p r i din corp n cavitatea modulului ventilator 5 Temperatur n exces Acest echipament nu trebuie s fie ac ionat ntr o zon unde temperatura ambiant IMA dep seste valoarea maxim recomandat 45 C 113 F In plus pentru a asigura un flux de aer adecvat l sati un spatiu liber de cel putin 8 cm 3 inchi jurul fantelor de ventilare Mellanox Technologies 91 Rev 1 5 6 Suprapunerea cadrului Cadrul nu trebuie s fie suprapus peste niciun alt echipament in cazul in care cadrul cade poate cauza leziuni corporale si deterior ri ale echipamentului 7 Conexiunea la o surs de alimentare electric suplimentar pericol electric Acest produs include o surs de alimentare suplimentar sau un spatiu gol n locul acestela In cazul in care spatiul pentru sursa de alimentare este gol nu operati produ sul c nd capacul orb este indep rtat sau nu este fixat in mod sigur 8 Siguran fuzibil bipolara neutra doanele de alimentare inainte de a deschide capacul acestui produs sau inainte de a atinge orice componente inter
40. 7X0 Splitting Options 31 Figure 25 System Status LEDs 5 Minutes After Power On 32 Figure 26 Two Power Inlets Electric Caution Notifications 33 Figure 27 PS Umt Pulled Out rent A una 39 Figure 28 Fan Module Latches ge er aeg EU Der ned 40 Figure 29 System Status LEDs Front and Rear sides 46 Figure 30 Fan Status LED Front and Rear Sides 46 Figure 31 Power Status er a ben pe 47 Figure 32 Rear Side Panel ee li plaka nso 48 Figure 33 Port BEDS ge e HE ges GUL Bee Be E SX 50 Figure 34 Pullout Tab st ere etes aa Ba ORT ae un 51 Figure 35 QSFP Connector Male and Female Views 58 Mellanox Technologies 5 Rev 1 5 Figure 36 RJ45 to DB9 Harness Pinout 59 6 Mellanox Technologies Rev 1 5 List of Tables Table 1 Revision History Table sa end ee a 8 Table 2 References uns eb ara a 9 Table 3 Speed and Switching Capabilities 11 Table 4 Management Interfaces and FRUs 11 Table 5 Ordering Part Numbers OPNs 12 Table 6 oAirFlowColorLegend i e 14 Tab
41. 8 1 2 2 8 1 1 Disable Dynamic Host Configuration Protocol DHCP DHCP is used for automatic retrieval of management IP addresses If a user connects through SSH runs the wizard and turns off DHCP the connection 1s immediately terminated as the management interface loses its IP address Il q lt localhost gt ssh admin lt ip address gt Mellanox MLNX OS Switch Management Password Mellanox Switch Mellanox configuration wizard Do you want to use the wizard for initial configuration yes Step 1 Hostname my switch Step 2 Use DHCP on mgmt0 interface yes no lt localhost gt In such case the serial connection should be used Mellanox Technologies 33 Rev 1 5 Installation 2 8 1 2 Manual Host Configuration gt To perform initial configuration of the system Step 1 Connect a host PC to the Console RJ45 JOIOI port of the system using the supplied harness cable DB9 to RJ45 Make sure to connect to the Console RJ45 port and not to the Ethernet MGT port Step 2 Configure a serial terminal program for example HyperTerminal minicom or Tera Term on your host PC with the settings described in Table 10 Once you perform that you should get the CLI prompt of the system Table 10 Serial Terminal Program Configuration Parameter Setting Baud Rate 115200 Data bits 8 Stop bits 1 Parity None Flow Control None Step 3 Login as admin and use admin as password On t
42. Antes de conectar el equipo a la fuente de alimentaci n leer todas las instrucciones de instalaci n 2 Lesi n corporal a causa de peso A Recurra a suficientes personas para levantar este producto sin 40 lbs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Equipos pesados mec nico para evitar lesiones Lh Dado que el equipo es pesado se debe mover nicamente mediante un elevador 4 Riesgo de descarga el ctrica iRiesgo de descarga el ctrica Con el m dulo del ventilador quitado se obtiene acceso a las clavijas de alimentaci n desde dentro de la cavidad del m dulo NO introducir herramientas ni partes del cuerpo en la cavidad del m dulo del ventila dor 5 Sobretemperatura No se debe utilizar el equipo en un rea con una temperatura ambiente superior a la m xima recomendada 45 C Adem s para garantizar una circulaci n de aire adec uada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n 6 Apilamiento del chasis Los chasis no se deben apilar sobre otros equipos La ca da del chasis podr a causar lesiones corporales as como da os al equipo Mellanox Technologies 83 Rev 1 5 7 Conexi n redundante de fuente de alimentaci n peligro de descarga Este producto incluye una fuente de alimentaci n redundante o en su lugar una vac a Si se dispone de una fuente de alimentaci
43. E tada 11 1 6 Ordering Information 12 Chapter 2 Installation ss it TA RG Ra er E R 13 2 1 Safety Warnings ir bei a ES E 13 2 25 ATE EIOW a bct Ea 14 2 3 Package Contents ii ea sao 15 2 4 Battery Backup Unit BBU Installation for SX6720 16 24 1 Installing the Battery oo Een een 16 2 4 2 Extracting the Battery 16 2 5 Mounting Options 19 2 5 1 19 Systems Mounting Static Ra l Kit 19 2 5 2 19 Systems Mounting Telescopic Rail Kit 23 2 67 Cable Installation 5o mr para 29 2 6 1 Using a Breakout Cable 30 2 7 Initial Power On i e ete eet roe de ia ER OR aS 32 2 87 Bing Up 0 33 2 8 1 Configuring Network Attributes 33 2 8 2 Remote Connection Mt Deu AAA sleek see IDEAS NU EU REL 37 2 9 FRU Replacements sa geye e ie a a gi 38 29 1 Power Supply ii nun id 38 rb DNO OG iaia 39 Chapter3 SoftwareManagement 00000000 41 3 1 InfiniBand Subnet Manager 41 3 2 Fabric Inspector Diagnostics 41 3 3 Upgrading Software on Managed Systems 42 Chapter 4 In
44. Mellanox TECHNOLOGIES Mellanox SX67X0 1U Switch Systems Hardware User Manual www mellanox com Rev 1 5 NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE Mellanox TECHNOLOGIES
45. Pr voyez assez de personnel pour soulever ce produit en toute s curit lt 40 lbs 40 70 lbs 70 121 8 gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 quipement lourd Cet quipement est lourd et doit tre d plac avec un syst me de levage m canique pour viter les blessures 4 Danger d lectrocution Danger d lectrocution Lorsque le module de ventilation est retir les broches d alimentation sont expos es dans l emplacement du module NE PAS ins rer d outils ou la main dans l emplacement du module 5 Surchauffe Cet quipement ne doit pas tre en service dans un local dont la temp rature d passe le maximum recommand de 45 C 113 F En outre et pour garantir une circulation d air correcte laisser un espace d au moins 8 cm 3 autour des orifices de ventilation 6 Ch ssis empil sur d autres quipements Le ch ssis ne doit pas tre empil sur d autres quipements S il tombe il peut endom mager l quipement ou entrainer des blessures Mellanox Technologies 75 Rev 1 5 7 Connexion de l alimentation redondante danger d lectrocution Ce produit est quip d une alimentation redondante ou d un cache si elle est absente Dans ce dernier cas ne pas faire fonctionner le produit si le cache est retir ou mal fix 8 Fusibles phase neutre Ce syst me dispose de fusibles phase neutre D branchez tous les cordons d alimenta tion avant d ouvri
46. Step 4 Enable IPv6 auto config SLAAC mgmt0 interface no This turns on auto configuration of the IPv6 addresses This is unsuitable for DHCPv6 Step 5 Enable DHCPv6 on mgmt0 interface no To enable DHCPv6 on the MGMTO interface Step 6 Admin password Press lt Enter gt to leave unchanged new password gt Step 6 Confirm admin pass word new password gt To avoid illegal access to the machine please type a password and then press Enter Then confirm the password by re entering it Note that password characters are not printed You have entered the following information A summary of the configura tion is now displayed To change an answer enter the step number to return to or hit lt enter gt to save changes and exit Choice lt Enter gt Configuration changes saved The wizard displays a summary of your choices and then asks you to confirm the choices or to re edit them Either press lt Enter gt to save changes and exit or enter the configu ration step number that you wish to return to Note To re run the configuration wizard run the command configura tion jump start in Config mode Mellanox Technologies 35 Rev 1 5 Installation The table below shows an example of static IP configuration for mgmt0 interface Table 12 Configuration Wizard Session Static IP Configuration Wizard Session Display Static IP Configuration Example M
47. able requirements in the US National Electrical Code and the Canadian Electri cal Code Mellanox Technologies 63 Rev 1 5 20 Interconnection Of Units Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL certified type DP 1 or DP 2 Note when residing in non LPS circuit 21 Overcurrent Protection A readily accessible Listed branch circuit overcurrent protective device rated 20 A must be incorporated in the building wiring 22 Do Not Use the Switch as a Shelf or Work Space Caution Slide rail mounted equipment is not to be used as a shelf or a work space The rails are not intended for sliding the unit away from the rack It is for permanent instal lation at final resting place only not used for service and maintenance 23 WEEE Directive According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way 24 Country of Norway Power Restrictions This unit is intended for connection to a TN power system and an IT power system of Norway only 25 BBU If the BBU is deformed leaking corroded or visually damaged replace it immedi ately Do not use a BBU that was not provided by Mellanox Technologies gt gt 64 Mellanox Technologies Rev 1 5 A BBU that has not
48. akte in der Modulvertiefung zug nglich Es diirfen KEINE Werkzeuge oder K rperteile in die Vertiefung des Ventilatormoduls gelangen 5 Ubertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 45 C 113 F betrieben werden Es ist ein Luft strom von 200 LFM bei maximaler Umgebungstemperatur erforderlich AuBerdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 6 Stapeln des Chassis F Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herunt erf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren Mellanox Technologies 79 Rev 1 5 7 Zweipolig Neutrale Sicherung Achtung N Zweipolige bzw Neutralleiter Sicherung im Netzteil Netzstecker ziehen um sicher zustellen da keine Spannung am Ger t anliegt Entfernen Sie alle Netzkabel vor dem Offnen der Abdeckung dieses Produkts oder dem Ber hren der Innenteile 8 Mehrere Stromeing nge Risiko eines Stromschlags und Stomgefahr Alle Stromversorgungseinheiten sind unabh ngig Trennen Sie alle Stomversorgungen um einen abgeschalteten Zustand im Inneren der 7 Switch Plattform sicherzustellen 9 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab 10 AnschlieBen Trennen
49. al no para fines de servicio o mantenimiento 2 23 Directiva WEEE Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el c tricos y electr nicos EEE se deben recolectar por separado y no se deben eliminar junto con residuos dom sticos Al deshacerse de este producto y de todas sus partes h galo de una manera respons able y respetuosa con el medio ambiente Si la BBU Unidad de Bater a de Respaldo est deformad tiene fugas est corro da o se ve da ada reempl cela inmediatamente No utilice una BBU Unidad de Bater a de Respaldo que no haya sido provista por Mellanox Technologies Una BBU Unidad de Bater a de Respaldo que no ha sido utilizada durante dos a os o m s luego de su fecha de fabricaci n impresa no es utilizable gt gt gt bi Si la bater a debe ser reemplazada aparecer n mensualmente notificaciones de soft ware empezando tres meses antes del tiempo de fin de vida 86 Mellanox Technologies Rev 5 E 8 Rus sian 1 N C 2
50. al Electrical Codes This equipment should be installed in compliance with local and national electrical codes 16 Installation Codes This device must be installed according to the latest version of the country national electrical codes For North America equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electrical Code 17 Battery Replacement Warning Replace only with UL Recognized battery certified for maximum abnormal charging current not less than 4mA There is a risk of explosion should the battery be replaced with a battery of an incorrect type Dispose of used batteries according to the instructions 18 UL Listed and CSA Certified Power Supply Cord For North American power connection select a power supply cord that is UL Listed and CSA Certified 3 conductor 16 AWG terminated with a molded plug rated at 125 V 13 A with a minimum length of 1 5m six feet but no longer than 4 5m For European connection select a power supply cord that is internationally harmonized and marked lt HAR gt 3 conductor minimum 1 0 mm wire rated at 300 V with a PVC insulated jacket The cord must have a molded plug rated at 250 V 10 A 19 Installation codes This device must be installed according to the latest version of the country national electrical codes For North America equipment must be installed in accordance to the applic
51. ansmitter Inverted Data Input 3 Tx2p Transmitter Non Inverted Data Input 4 GND Ground J3 and J6 5 Tx4n Transmitter Inverted Data Input 20 EN cnp SSE 6 Tx4p Transmitter Non Inverted Data Input 21 Rx2n Rxin 18 7 GND Ground 22 Rx2p Rxtp 17 8 ModSelL Module Select 2 GND END 9 ResetL Module Reset E pen A 10 VecRx 3 3 V Power supply receiver PR Se PeR 13 11 SCL 2 wire serial interface clock 27 Soa d 12 12 SDA 2 wire serial interface data 28 ore jasa 11 13 GND Ground IntL SCL 29 VecTx DM 0 14 Rx3p Receiver Non Inverted Data Output 30 Veci Resetl 9 15 Rx3n Receiver Inverted Data Output 31 LPMode ModSelL 16 GND Ground 32 GND 7 17 Rxlp O Receiver Non Inverted Data Output 33 Tx3p Tx4p 9 18 Rxln Receiver Inverted Data Output 5 Tn Tian 19 GND Ground 35 GND GND gt gt 36 TX2p 3 20 GND Ground EN Tx2n gt gt 2 21 Rx2n Receiver Inverted Data Output 3 E eno 22 Rx2p Receiver Non Inverted Data Output 3 23 GND Ground 24 Rx4n Receiver Inverted Data Output 3 25 Rx4p Receiver Non Inverted Data Output 3 26 GND Ground 27 ModPrsL Module Present 28 IntL Interrupt 29 Tx 13 3 V Power supply transmitter 30 1 3 3 V Power Supply 31 LPMode Low Power Mode 32 GND Ground 33 Tx3p Transmitter Non Inverted Data Input 34 Tx3n Transmitter Inverted Data Input 35 GND Ground 36 Txlp Transmitter Non Inverted Data Input 37 Txin Transmitter Inverted Data Input Mellanox Technologies 57
52. are ready to use the system For additional information about MLNX OS refer to MLNX OS User Manual located on Mellanox sup port web 2 9 FRU Replacements 2 9 1 Power Supply Mellanox systems equipped with two replaceable power supply units work in a redundant config uration Either unit may be extracted without bringing down the system Make sure that the power supply unit that you are NOT replacing is showing all green for both the power supply unit and System Status LEDs Ad Power supply units have directional air flows similar to the fan module The fan mod a ule airflow must coincide with the airflow of all of the power supply units If the power supply unit airflow direction is different from the fan module airflow direction the system s internal temperature will be affected For power supply unit air flow direction refer to Section 2 2 on page 14 To extract a power supply unit Step 1 Remove the power cord from the power supply unit Step 2 Grasping the handle with your hand push the latch release with your thumb while pulling the handle outward As the power supply unit unseats the power supply unit status LEDs will turn off Step3 Remove the power supply unit 38 Mellanox Technologies Rev 1 5 Figure 27 PS Unit Pulled Out gt To insert a power supply unit Step 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles Ah Do not attempt to insert a power s
53. atus LED shows green If the Fan Status LED is not green unplug the power connection and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and or obstacles If no obstacles were found and the problem persists call your Mellanox representative for assistance Figure 26 Two Power Inlets Electric Caution Notifications CAUTION ACHTUNG ATTENTION Risk of electric shock and energy Gafahr des elektrischen Risque de choc et de danger hazard The two power supply Schocks Entferrnen des e lectriques Le de branch units are independent Netzsteckers elnes Netz ment d une seule alimentation teils spannungsfrei Um stabilise e ne de branch Disconnect all power supplies to alle Einhieten spannungs uniquement qu un module ensure a powered down state frei zu machen sind die Alimentation Stabilise e inside of the switch platform Netzstecker aller Netzteile Pour isoler completement le zu entfernen module en cause Il faut de brancher toutes les alimen tations stabilise es 2 8 Bring Up 2 8 4 Configuring Network Attributes The procedures described in this chapter assume that you have already installed and powered on the system according to the instructions in this document Since the system comes with a pre configured DHCP you may find the explanation in Section 2 8 1 1 sufficient In case a manual configuration is required please refer to the instructions in Section 2
54. been used for two years or longer past its printed manu facturing date is unusable A BBU that is older than five years according to the printed manufacturing date has reached its end of life state and may not provide enough energy to handle the platform In case the battery should be replaced software notifications will appear on a monthly basis starting three months before EOL time manna Hebrew 1 Y SS 2 A mo Pm 32 3 19 4 4 5 mao 4 PN qn Mellanox Technologies 65 Rev
55. blank in its place In case of a blank power supply do not operate the product with the blank cover removed or not securely fastened 8 Double Pole Neutral Fusing This system has double pole neutral fusing Remove all power cords before opening the cover of this product or touching any internal parts 9 Multiple Power Inlets Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform 10 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or dis connect cables 11 Copper Cable Connecting Disconnecting Copper cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the cable manufacturer for special warnings instructions 12 Rack Mounting and Servicing to ensure that the system remains stable In general you should fill the rack with equip When this product is mounted or serviced in a rack special precautions must be taken AA ment starting from the bottom to the top 62 Mellanox Technologies Rev 1 5 13 Equipment Installation This equipment should be installed replaced and or serviced only by trained and qual ified personnel Disposal of this equipment should be in accordance to all national laws and regula tions 15 Local and Nation
56. citado y competente 84 Mellanox Technologies Rev 1 5 14 Eliminaci n del equipo La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales Este equipo se debe instalar conforme a los c digos el ctricos locales y nacio nales 16 C digos de instalaci n Este dispositivo se debe instalar conforme a la versi n m s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad 17 Cambio de bater a II y a danger d explosion s il y a remplacement incorrect de la batterie Remplacer uniquement avec une batterie du m me type ou d un type quivalent recommand par le constructeur Mettre au rebut les batteries usag es conform ment aux instructions du fabricant 18 Cable de alimentaci n homologado por UL y con certificaci n CSA IN En conexiones de America del Norte seleccionar un cable de alimentaci n homologado por UL y con certificaci n CSA de tres conductores 16 AWG termi nado en un enchufe moldeado con capuch n de 125 voltios nominal 13 A con una longitud m nima de 1 5 metros pero no m s de 4 5 metros En conexiones europeas seleccionar un cable de alimentaci n armonizado internacionalmente y marcado lt HAR gt de tres conductores
57. collegati o scollegati con cura dai connettori Per avvertenze istruzioni speciali rivolgersi al produttore di cavi 12 Montaggio su rack e manutenzione Quando questo prodotto viene montato o sottoposto a manutenzione su un rack A necessario adottare delle precauzioni speciali per assicurarsi che il sistema resti stabile In generale il rack va riempito con apparecchiature procedendo dal basso verso l alto 13 Installazione dell apparecchiatura Questa apparecchiatura va installata sostituita e o sottoposta a manutenzione solo da personale addestrato e qualificato Mellanox Technologies 101 Rev 1 5 14 Smaltimento dell apparecchiatura Lo smaltimento di questa apparecchiatura va effettuato in conformita con tutte le leggi e le normative nazionali 15 Codici elettrici locali e nazionali Questa apparecchiatura va installata in conformita con le norme elettriche locali e nazionali 16 Codici di installazione Questo dispositivo va installato in conformit con l ultima versione dei codici elettrici nazionali del Paese Per il Nord America l apparecchiatura va installata in conformit con i requisiti applicabili del codice elettrico nazionale USA e del codice elettrico canadese 17 Sostituzione della batteria Avvertenza Sostituire solo con una batteria UL certificata per accettare una corrente di ricarica anomala massima non inferiore a 4 mA Se la batteria non viene sostitui
58. d essere del tipo DP 1 o DP 2 Nota in caso di installazione su un circuito la cui potenza non limitata Protezione contro le sovracorrenti la cablatura dell edificio deve integrare un dispositivo di protezione contro le sovracorrenti di potenza nominale pari a 20 22 Non utilizzare lo switch come scaffale o piano di lavorol Attenzione un apparecchiatura scorrevole o montata su binari non va utilizzata come scaffale o piano di lavoro I binari non sono progettati per far scorrere e allontanare Punit dal rack Essi sono destinati all installazione permanente solo nel luogo di lavoro e non vengono utilizzati per assistenza e manutenzione 23 Direttiva RAEE Secondo la direttiva RAEE 2002 96 EC tutti 1 rifiuti da apparecchiature elettriche ed elettroniche RAEE vanno raccolti separatamente e non smaltiti nei normali rifiuti domestici Smaltire questo prodotto e tutte le sue parti in modo responsabile e rispettoso dell ambiente 24 Limitazioni relative all alimentazione per la Norvegia Questa apparecchiatura 6 progettata esclusivamente per il collegamento a un sistema di alimentazione TN e a un sistema di alimentazione IT 25 BBU Se la BBU Batteria 61 backup e deformata presenta perdite 6 corrosa o visivamente danneggiata sostituirla immediatamente Non usare una BBU Batteria di backup che non 6 stata fornita da Mellanox Technol ogies Una BBU Batteria di backup che non stata utilizzata per due ann
59. d may not provide enough energy to handle the platform Incase the battery should be replaced software notifications will appear on a monthly basis starting three months before EOL time A new Battery Back up Unit BBU will be approximately 5096 charged when you receive it In case of a power outage only a fully charged BBU can supply power of up to 5 minutes to the sys tem 2 4 4 Installing the Battery Step 1 Extract the power FRU module from the chassis of the switch by unlocking all latches Step 2 Insert the BBU into the empty slot in the module by sliding it in and pushing the top end of it down until it snaps into place as illustrated in the left image of Figure 7 Step3 Slide the module back into the chassis 2 4 2 Extracting the Battery Step 1 Extract the power FRU module from the chassis of the switch by unlocking all latches Step 2 Press both release buttons simultaneously and lift the battery up to remove it as illustrated in the right image of Figure 7 16 Mellanox Technologies Rev 1 5 Step 3 Slide the module back into the chassis Figure 5 Unlocking the Latches and Extracting the PSU Figure 6 BBU Location Mellanox Technologies 17 Rev 1 5 Installation Figure 7 BBU Insertion Left and Extraction Right 1 slide in 1 press lift up press till snaps 2 2 18 Mellanox Technologies Rev 1 5 2 5 Mounting Options By default the system is sold with t
60. e nationale ale rii n cauz Pentru America de Nord echipamentul trebuie s fie instalat conform cerin elor aplicabile din Codul electric na ional al SUA i Codul electric canadian 22 Interconectarea unit ilor Cablurile pentru conectarea la unitatea RS232 i la interfe ele Ethernet trebuie s de tipul DP 1 sau DP 2 certificate UL Not c nd se reg sesc ntr un circuit non LPS Protec ie la supracurent Un dispozitiv de protec ie la supracurent nregistrat n cir cuitul de ramificare u or accesibil i cu o putere nominal egal cu 20 A trebuie s fie integrat n cablajul cl dirii 23 Nu utiliza i comutatorul ca raft sau spa iu de lucru Aten ie Echipamentul montat pe o linie de alunecare in nu va fi utilizat ca raft sau spa iu de lucru Scopul inelor nu este de a glisa unitatea de pe rack Acestea sunt des tinate instal rii permanente numai la punctul final de oprire i nu vor fi folosite pentru depanare i ntre inere 24 Directiva DEEE n conformitate cu Directiva DEEE 2002 96 CE toate de eurile de echipamente elec trice i electronice EEE trebuie colectate separat i nu trebuie eliminate mpreun cu de eurile menajere obi nuite Eliminati acest produs i toate componentele sale n mod responsabil si ecologic 94 Mellanox Technologies Rev 1 5 25 RestrictionsRestrictii electrice pentru Norvegia This unit is intended for connection to a TN power
61. eht Explosiionsgefahr wenn der Akku durch einen Akku eines falschen Typs ersetzt wird Akkus gem den Anweisungen entsorgen 17 UL und CSA zertifiziertes Netzkabel F r Nordamerika Stromanschluss w hlen Sie ein Netzkabel das UL und CSA Certi fied 3 Leiter 18 AWG mit einem angespritztem Stecker bewertet bei 125 V 15 mit einer Mindestl nge von 1 5 m Six Feet aber nicht mehr als 4 5 m F r die europ ischen Zusammenhang w hlen Sie ein Netzkabel das international harmonisiert und der Aufschrift lt HAR gt 3 Leiter mindestens 0 75 mm2 Draht bewertet mit 300 V mit einem PVC Mantel isoliert Das Kabel muss eine angespritztem Stecker bewertet bei 250 V 10 A 18 Hoher Ableitstrom WARNUNG Hohe Ableitstrom Earth Verbindung bevor Sie die Verbindung von wesentlicher Bedeutung werden 19 Installationscodes Dieses Ger t muss installiert sein entsprechend auf die neueste Version des Landes National Electrical Code F r Nordamerika m ssen in bereinstimmung mit den gel tenden Vorschriften in der US amerikanischen National Electrical Code und dem Canadian Electrical Code Mellanox Technologies 81 Rev 1 5 20 Verbindung der Ger te untereinander Kabel fiir den Anschluss an das Ger t RS232 und Ethernet Schnittstellen m ssen UL zertifiziert Typ DP 1 oder DP 2 Hinweis wenn nicht mit Wohnsitz in LPS Schal tung Uberstromschutz Eine leicht zug ngliche Auflistung Abzweigleitung Ube
62. ellanox configuration wizard Do you want to use the wizard for initial configuration yes Step 1 Hostname Step 2 Use DHCP mgmtO interface yes no Step 3 Use zeroconf on mgmt0 interface no Step 4 Primary IP address for example 192 168 10 4 10 10 10 10 Mask length may not be zero if address is not zero interface eth0 Step 5 Netmask 0 0 0 0 255 255 255 0 Step 6 Default gateway for example 192 168 10 1 10 10 10 255 Step 7 Primary DNS server Step 8 Domain name Step 9 Enable IPv6 yes Step 10 Enable IPv6 autoconfig SLAAC mgmt0 interface no Step 11 Admin password Enter to leave unchanged To change an answer enter the step number to return to Otherwise hit lt enter gt to save changes and exit Choice Configuration changes saved To return to the wizard from the CLI enter the configuration jump start command from configure mode Launching CLI gt 36 Mellanox Technologies Rev 1 5 Step 5 Before attempting a remote for example SSH connection to the system check the mgmt0 interface configuration Specifically verify the existence of an IP address To check the current mgmt0 configuration enter the following command r ga sit sx01 config show interfaces mgmt0 Interface mgmt0 status Comment Admin up yes Link up yes DHCP running yes IP address 10 209 28 50 Netmask 25520952550 IPv6 enabled yes Autoconf enabled no Autoconf rou
63. es 4 1 4 Management The two 1145 Ethernet ports labeled MGT de provide access for remote management The management ports are configured with auto negotiation capabilities by default 100MDbE to 1000GbE The management ports network attributes such as IP address need to be pre config ured via the RS232 serial console port or by DHCP before use Refer to Section 2 8 1 to view the full procedure Make sure you use only FCC compliant Ethernet cables 4 1 5 USB The USB interface is USB 2 0 compliant and can be used by MLNX OS software to connect to an external disk for software upgrade or file management The connector comes in a standard USB shape To view the full matrix of the USB configuration options refer to Table 4 Management Inter faces and FRUs USB 1 0 is not supported 5 Do not use excessive force when inserting or extracting the USB disk from the con nector 4 1 6 Reset Button The reset button is located on the rear side of the system next to the fan status LEDs This reset button requires a tool to be pressed Do not use a sharp pointed object such as a needle or a push pin for pressing the reset button Use a flat object to push the reset button gt To reset the system and CPU of its management board perform the following Push the reset button and keep it pressed for up to 15 seconds 44 Mellanox Technologies Rev 1 5 gt To reset the system the CPU
64. han 648 nodes you may need to purchase Mellanox s Unified Fabric Manager UFMO software package Each subnet needs one subnet manager to discover activate and manage the subnet Each network requires a Subnet Manager to be running in either the system itself system based or on one of the nodes which is connected to the fabric host based The subnet manager OpenSM assigns Local IDentifiers LIDs to each port connected to the fabric and develops a routing table based on the assigned LIDs A typical installation using the OFED package will run the OpenSM subnet manager at system start up after the drivers are loaded This automatic OpenSM is resident in memory and sweeps the fabric approximately every 5 seconds for new adapters to add to the subnet routing tables 3 2 Fabric Inspector Diagnostics Fabric Inspector is a plug amp play licensed software within MLNX OSQ displaying and filtering all identified systems and nodes within the fabric Fabric Inspector includes a complete set of InfiniBand tools for fabric wide diagnostics to check node node and node switch connectivity and to verify routes within the fabric Advanced filtering allows creating filtering rules on a system wide basis between nodes or port connections based on traffic patterns and user assigned system names GUIDs Mellanox Technologies 41 Rev 1 5 Software Management 3 3 Upgrading Software on Managed Systems Software and firmware updates are ava
65. he Static Rail kit described in Section 2 5 1 For SX1410 sys tems this rail kit can be installed in short racks 17 24 only For installation in deep racks telescopic rail kit must be used Such a rail kit can be purchased separately For the Telescopic Rail kit installation instructions see Section 2 5 2 2 5 1 19 Systems Mounting Static Rail Kit At least two people are required to safely mount the system in the rack The following parts are included in the Static Rail kit see Figure 8 Table 7 Installation Kit Kit OPN Rack Size and Rack Depth Range MTEF KIT A Short 17 24 or Standard 24 34 2x Rack mount rails A 2x Rack mount brackets B 2x Rack mount blades C 8x M6 Standard cage nuts and 8x M6 Standard pan head Phillips screws D e 4x Phillips100 DEG F H TYPE I ST ST 6 32 X 1 4 screw with around patch E Mellanox Technologies 19 Rev 1 5 Installation Figure 8 Rack Rail Kit Parts 2 s gt Planning the system s placement in the rack Before mounting the system to the rack select the way you wish to place the system Pay atten tion to the airflow within the rack cooling connector and cabling options While planning how to place the system consider the two installation options shown in Figure 9 and review the following points Make sure the system air flow is compatible with your installation selection It is important to keep the airfl
66. he first login the MLNX OS configuration wizard will start Step 4 To configure network attributes and other initial parameters to the system follow the configu ration wizard as shown in Table 11 Table 11 Configuration Wizard Session Wizard Session Display Comments Mellanox configuration wizard You must perform this configuration the first time you operate the Do you want to use the wizard system or after resetting the system Type and then press for initial configuration yes lt Enter gt Step 1 Hostname switch If you wish to accept the default hostname press lt Enter gt Other wise type a different hostname and press lt Enter gt Step 2 Use DHCP on mgmt0 Perform this step to obtain an IP address for the system mgmt0 is interface no yes the management port of the system If you wish the DHCP server to assign the IP address type yes and press lt Enter gt If you type no DHCP then you will be asked whether you wish to use the zeroconf configuration or not If you enter no Zeroconf you must enter a static IP and the session will continue Step 3 Enable IPv6 yes The management interface will be able to use IPv6 addresses If you enter no no IPv6 you will automatically be referred to Step 6 34 Mellanox Technologies Rev 1 5 Table 11 Configuration Wizard Session Wizard Session Display Comments
67. he full list of interfaces per system is provided in Table 3 Speed and Switching Capabilities Each QSFP port can be connected with QSFP cable or connector for 40 56Gb s or 1 10Gb s when connecting through Mellanox QSFP to SFP QSA adapters or split cables The system offers High Power LR4 transceivers support in all ports 4 1 2 Speed InfiniBand speed is auto adjusted by the infiniBand protocol Mellanox systems support FDR FDR 10 InfiniBand e FDR is an InfiniBand data rate where each lane of a 4X port runs a bit rate of 14 0625 Gb s with 64b 66b encoding resulting in an effective bandwidth of 56 25 Gb s FDRIO is a non standard InfiniBand data rate where each lane of a 4X port runs a bit rate of 10 3125 Gb s with a 64b 66b encoding resulting in an effective bandwidth of 40 Gb s FDR10 supports 20 more bandwidth over QDR due to better encoding rate Both FDR and FDR10 support Forward Error Correction FEC as defined in IEEE 802 3ap chapter 74 4 1 3 RS232 Console This interface is not found in externally managed systems 5 The port labeled Console 0101 is an RS232 serial port on the back side of the chassis that is used for initial configuration and debugging Upon first installation of the system you need to connect a PC to this interface and configure network parameters for remote connections Refer to Section 2 8 1 to view the full procedure Mellanox Technologies 43 Rev 1 5 Interfac
68. i o per piu tempo oltre la sua data di produzione stampata e inutilizzabile gt Db Nel caso in cui la batteria debba essere sostituita le notifiche software appariranno su base mensile iniziando tre mesi prima della fine del ciclo di vita Mellanox Technologies 103 Rev 1 5 E 12 Monta G venlik Uyarilari Turkish 1 Montaj Talimatlari Ekipman g kayna na ba lamadan nce t m montaj talimatlar n okuyun 2 A rl k Nedeniyle Fiziksel Yaralanma Bu r n g venli bir ekilde kald rabilmek i in yeterli say da insandan yard m al n A lt 40 lbs 40 lbs 70 121 lbs gt 121 lbs lt 18 kg 18 32 kg 32 55 kg gt 55 kg 3 A r Ekipman Bu ekipman ok a rd r ve yaralanmalar nlemek i in ekipman n mekanik asans r kullan larak ta nmas gerekir 4 Elektrik arpmas Riski Bu ekipman nerilen maksimum ortam s cakl n a an alanlarda calistirilmamalidir 45 113 Ayr ca d zg n hava ak sa lamak i in havaland rma deliklerinin etraf nda en az 8 cm 3 in a kl k b rak lmal d r 5 A r s nma Bu ekipman nerilen maksimum ortam s cakl n a an alanlarda calistirilmamalidir 45 113 Ayr ca d zg n hava ak sa lamak i in havaland rma deliklerinin etraf nda en az 8 cm 3 in a kl k b rak lmal d r 6 asi stif 4 Sasinin diger herhangi bir ekipmanin zerine istiflen
69. ilable from the Mellanox Support website Check that your current revision is the same one that is on the Mellanox website If not upgrade your soft ware Copy the update to a known location on a Remote server within the user s LAN Use the CLI or the GUI in order to perform software upgrades For further information please refer to the MLNX OS Software User Manual section Upgrading MLNX OS Software Be sure to read and follow all of the instructions regarding the updating of the software on your system The systems do not require Firmware updating Firmware updating is done through the MLNX OS management software The system comes standard with a management software module for system management called Mellanox Operating System MLNX OS MLNX OSQ includes a CLI WebUI SNMP system management software and IB management software OpenSM The Ethernet ports for remote management connect to Ethernet systems These sys tems must be configured to 100Mb 1 Gb auto negotiation 42 Mellanox Technologies Rev 1 5 4 Interfaces 4 1 Supported Interfaces The systems support the following interfaces Data interfaces InfiniBand 100 1000 MbE RJ45 management interface s USB port e RS232 Console port Reset button Status and Port LEDs In order to review the full configuration options matrix refer to Table 4 Management Interfaces and FRUs 4 1 1 Data Interfaces The data interfaces use QSFP connectors T
70. ir Flow Direction Marking Power Side Inlet to Connector Side Outlet RAS I 1 2 3 Package Contents Before installing your new system unpack it and check against the parts list below that all the parts have been sent Check the parts for visible damage that may have occurred during shipping The SX6710 SX6720 package content is as follows 1 System e 1 Rail kit Power cables Type C13 to C14 length 183cm Harness DB9 to RJ 45 Quick Start Guide 7 V If anything is damaged or missing contact your sales representative at support mella nox com Mellanox Technologies 15 Rev 1 5 Installation 2 4 Battery Backup Unit BBU Installation for SX6720 A BBU compatible system is available by ordering an SX6720 system with an appro priate license Ah If the BBU is deformed leaking corroded or visually damaged replace it immediately Do not use a BBU that was not provided by Mellanox Technologies The BBU maximum storage temperature is 25 C Following a long storage period 1 5 years or longer the BBU cells might be imbalanced and a COV Cell over Voltage alarm might be activated In order to balance the cells and clear the alarm the BBU must be charged for 24 hours ABBU that has not been used for two years or longer past ts printed manufacturing date is unusable e A BBU that is older than five years according to the printed manufacturing date has reached its end of life state an
71. ive 60 Mellanox Technologies Rev 1 5 Appendix Safety Warnings Multiple Languages E 1 Nordic Countries Notices In Finland Laite on liitett v suojakoskettimilla varustettuun pistorasiaan Ah In Norway Apparatet m tilkoples jordet stikkontakt In Sweden Apparaten skall anslutas till jordat uttag 2 Installation Safety Warnings English 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Bodily Injury Due to Weight 4 Use enough people to safely lift this product 3 Heavy Equipment gp This eguipment is heavy and should be moved using a mechanical lift to avoid injuries 4 Risk of Electric Shock Risk of Electric Shock N With the fan module removed power pins are accessible within the module cavity Do not insert tools or body parts into the fan module cavity 5 Over temperature This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 45 C 113 F Moreover to guarantee proper allow at least 8cm 3 inches of clearance around the ventilation openings Mellanox Technologies 61 Rev 1 5 6 Stacking the Chassis The chassis should not be stacked on any other equipment If the chassis falls it can cause bodily injury and equipment damage 7 Redundant Power Supply Connection Electrical Hazard This product includes a redundant power or a
72. ivi i kao takvi se moraju pa ljivo priklju iti na isk lju iti iz konektora Obratite se proizvo a u kabela za posebna upozorenja upute 12 Monta a ormari a i servisiranje Kad se proizvod montira ili se servisira u ormari u moraju se poduzeti posebne mjere opreza kako bi se osiguralo da sustav ostane stabilan Op enito trebali biste ispunja vati ormari s opremom po ev i od dna prema vrhu 13 Instaliranje opreme 7A N Ovu bi opremu trebalo instalirati zamjenjivati i ili servisirati 1 kvalifici rano osoblje 14 Odlaganje opreme Odlaganje opreme trebalo bi se vr iti sukladno nacionalnim zakonima i propisima 15 Lokalni i nacionalni elektri ni kodovi Ova oprema trebala bi se instalirati u skladu s lokalnim i nacionalnim elektri nim kodovima 16 Instalacijski kodovi Ovaj se ure aj mora instalirati sukladno najnovijoj verziji nacionalnih elek tri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati suk ladno va e im zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code Mellanox Technologies 97 Rev 1 5 17 Zamjena baterije Upozorenje Bateriju zamijenite samo baterijom 12 serije UL koja je certifici rana za maksimalnu nepravilnu struju punjenja ne manju od 4 mA Postoji rizik od eksplozije ako se baterija zamijeni neodgovaraju om vrstom Odlo ite prazne baterije sukladno uputama 18 UL CSA kabel napajanja
73. jelove tijela u otvor modula ventilatora 5 Pregrijavanje Ovom se opremom ne bi trebalo rukovati u podru jima s temperaturom okoline koja prema uje najvi e preporu ene vrijednosti 45 113 Osim toga kako bi se osigu rao odgovaraju i protok zraka omogu ite najmanje 8 cm 3 in a razmaka oko otvora ventilatora 6 Slaganje ku i ta i Ku i te se ne bi trebalo slagati na drugu opremu Ako ku i te padne mo e izazvati tje lesne ozljede i o te enje opreme 7 Redundantno napajanje Opasnost od elektri ne energije U slu aju praznog prostora za napajanje nemojte rukovati proizvodom ako je pok Ovaj proizvod uklju uje redundantno napajanje ili prazan prostor na njegovu mjestu A lopac uklonjen ili ako nije dobro pri vr en 8 Dvopolni neutralni osigura i i Ovaj sustav raspola e dvopolnim neutralnim osigura ima Uklonite sve kabele napa janja prije otvaranja poklopca proizvoda ili dodirivanja unutarnjih dijelova 9 Vi estruki ulazi za napajanje Rizik od strujnog udara i opasnost od elektri ne energije PSU jedinice su neovisne Odspojite sva napajanja kako biste osigurali stanje bez napajanja unutar platforme preklopnika 96 Mellanox Technologies Rev 1 5 10 Tijekom udara munje Opasnost od elektri ne energije N Tijekom djelovanja munja nemojte raditi na opremi ili spajati ili odspajati kabele 11 Spajanje Odspajanje bakrenog kabela Bakreni kabeli su te ki i nesavitlj
74. l est pr vu pour tre reli un syst me d alimentation TN et un syst me d alimentation informatique de Norv ge uniquement 25 BBU Si l UBS Unit de Batterie de Secours est d form e corrod e pr sente des fuites ou des d fauts visibles remplacez la imm diatement Une UBS Unit de Batterie de Secours non utilis e pendant deux ans ou plus depuis la date de fabrication imprim e est inutilisable Une UBS Unit de Batterie de Secours g e de plus de cinq ans d apr s la date de fabrication imprim e a atteint sa fin de vie et ne peut pas fournir l nergie n cessaire la plateforme gt gt gt S1 la batterie doit tre remplac e des notifications logicielles apparaitront a une fr quence mensuelle trois mois avant la date de fin de vie 8 Mellanox Technologies Rev 5 E 6 Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromversorgung anschlieBen 2 Verletzungsgefahr wegen des Gewichts Um das Produkt sicher anzuheben geniigend Personen einsetzen A eee lt 40 lbs 40 70 lbs 70 121 8 gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Schweres Ger t Dieses Ger t ist schwer und muss mit einem mechanischen Hebeger t verschoben werden um Verletzungen zu vermeiden 4 Stromschlagrisiko Stromschlagrisiko Bei abgenommenem Ventilatormodul sind die Stromkont
75. la birlikte pe at lmamal d r X Bu r n ve t m par alar evreye dost ve sorumlu bir ekilde imha edilmelidir 24 Norve G K s tlamalar Bu nite bir TN g sistemine ve sadece Norve in TT g sistemine ba lanmak i indir 25 BBU Se la BBU Batteria di backup amp deformata presenta perdite amp corrosa o visivamente danneggiata sostituirla immediatamente Non usare una BBU Batteria di backup che non e stata fornita da Mellanox Technol ogies Una BBU Batteria di backup che non 6 stata utilizzata per due anni o per pi tempo oltre la sua data di produzione stampata e inutilizzabile gt gt gt Nel caso in cui la batteria debba essere sostituita le notifiche software appariranno su base mensile iniziando tre mesi prima della fine del ciclo di vita Mellanox Technologies 107 Rev 1 5 E 13 Japan VCCI Statement COBB 772 CI TER FT 5 7 20 6 9 ES Ek 16 CEMHVET VCCI A 108 Mellanox Technologies
76. le Mmstallation mel pry een arm cs ame lad enge 19 Fables dInistallation Kit cite ds ss VLL S 23 Table 9 Port Splitting Options 31 Table 10 Serial Terminal Program Configuration 34 Table 11 Configuration Wizard Session 34 Table 12 Configuration Wizard Session Static IP Configuration 36 Table 13 LEDs Symbols oc e ette mut Delete uns 45 Table 14 System Status LED Assignments 46 Table 15 Fan Status Front LED Assignments 47 Table 16 Fan Status Rear LED Assignments One LED per Fan 47 Table 17 Power Supply Unit Status Front LED Assignments 48 Table 18 Power Supply Unit Status Rear LED Assignments 48 Table 19 Bad Port LED Assignments 49 Table 20 Port LEDs in InfiniBand System Mode 50 Table 21 lt Troubleshooting gt tre ea CE ame ga de 52 Table 22 SX67X0 Specifications iui du aee Pan i RR CERE RACER S 54 Table 23 OPNs for Replacement Parts 55 Mellanox Technologies 7 Rev 1 5 Revision History Table 1 Revision History Table
77. memesi gerekir Sasi diiserse fiziksel yaralanmalara ve ekipmanda hasara neden olabilir 104 Mellanox Technologies Rev 1 5 7 Yedekli G Ba lantysy Elektrik arpma Tehlikesi Bu r n yedekli g kayna veya onun yerine bo elektrik kutusu i erir G kayna i i in bo elektrik kutusu varsa kutunun kapa a kken veya tam olarak kapat lmam ken r n al t rmay n 8 ift Kutuplu N tr Kesmeli Sigorta Bu sistemde ift kutuplu n tr kesmeli sigorta kullan lmaktad r r n n kapa n A a madan veya herhangi bir i par aya dokunmadan nce b t n g kablolar n kart n 9 oklu G Giri leri Elektrik arpmas riski ve enerji tehlikesi B t n PSU lar G Kayna niteleri ayr d r Anahtar platformundaki g c kapatmak i in t m g kaynaklar n n ba lant lar n kesin 10 im ek Elektrik arpma Tehlikesi G ky z nde im ek akt zamanlarda ekipman zerinde al may n veya kablo ba lamay n ya da kablo ba lant s kesmeyin 11 Bak r Kablo Ba lama Ba lant y Kesme Bak r kablolar a rd r ve esnemezler Bu nedenle ba lant lara ok dikkatli bir ekilde tak lmalar veya kar lmalar gerekir zel uyar lar talimatlar i in kablo reticinize ba vurun 12 skele Montaj ve Bak m Bu r n bir iskelede monte edildiyse veya bir iskele ile sunulduysa sistemin sabit
78. nd siguranta la instalare Romanian on page 91 For Safety Warnings in Croatian see Section E 10 Sigurnosna upozorenja za instaliranje Croa tian on page 5 For Safety Warnings in Italian see Section E 11 Avvertenze di sicurezza per l installazione Italian on page 100 Mellanox Technologies 13 Rev 1 5 Installation For Safety Warnings in Turkish see Section 2 12 Montaj G venlik Uyar lar Turkish on page 104 2 2 Air Flow Mellanox systems are offered with two air flow patterns Power rear side inlet to connector side outlet marked with blue power supplies fans FRUs handles as shown in Figure 3 Connector front side inlet to power side outlet marked with red power supplies fans FRUs handles as shown in figure Figure 4 A All servers and systems in the same rack should be planned with the same airflow direction All FRU components need to have the same air flow direction A mismatch in the air flow will affect the heat dissipation Table 6 provides an air flow color legend and respective OPN designations Table 6 Air Flow Color Legend OPN Direction Designation Description R Connector side inlet to power side outlet Red latches are placed on the power inlet side F Power side inlet to connector side outlet Blue latches are placed on the power inlet side 14 Mellanox Technologies Rev 1 5 Figure 3 A
79. ne I Acest sistem este prev zut cu sigurant fuzibil bipolar neutr Indep rtati toate cor 9 Multiple mufe electrice Risc de soc electric si pericol electric Toate aparatele cu alimentare de la retea sunt independente Deconectati toate sursele de alimentare cu energie pentru a asigura decuplarea in inter iorul platformei de comutare 10 in timpul desc rc rilor electrice pericol electric In timpul perioadelor cu desc rc ri electrice luminoase nu lucrati cu echipamentul sau nu conectati sau deconectati cablurile 11 Conectarea deconectarea cablului din cupru Cablurile din cupru sunt grele si inflexibile de aceea trebuie s fie atasate sau detasate de conectori cu grij Consultati produc torul de cabluri pentru avertismente instructi uni speciale 12 Montarea sau depanarea intr un rack C nd acest produs este montat sau depanat ntr un rack trebuie s fie luate m suri de precau ie speciale pentru a se asigura c sistemul r m ne stabil n general trebuie s umpleti rack ul cu echipamente ncep nd de jos n sus 92 Mellanox Technologies Rev 1 5 13 Instalarea echipamentului Acest echipament trebuie s instalat inlocuit si sau depanat numai de personal instruit si calificat Eliminarea acestui echipament trebuie s se realizeze in conformitate cu toate legile si regulamentele nationale Acest echipament trebuie s fie instalat conform codurilo
80. o No 33 No No 16 No No 34 No Yes 17 No No 35 No No 18 Yes disables port 17 Yes 36 Yes disables port 35 Yes Mellanox Technologies 31 Rev 1 5 Installation 27 Initial Power On The system s input voltage is auto adjusting for 100 240VAC 50 60Hz power connections The power cords should be standard 3 wire AC power cords including a safety ground and rated for 15A or higher N Caution The system platform will automatically power on when AC power is ala e applied There is no power system Check all boards power supplies and fan tray modules for proper insertion before plugging in a power cable Step 1 Plug in the first power cable Step 2 Plug in the second power cable Step 3 Wait for the system upload process A It may take up to five minutes to turn on the system If the System Status LED shows 4 N red after five minutes unplug the system and call your Mellanox representative for assistance Step 4 Check the System Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation initially flashing and then moving to a steady color as shown in Figure 25 below For more information refer to LEDs on page 45 Figure 25 Sys tem Status LEDs 5 Minutes After Power On 32 Mellanox Technologies Rev 1 5 Ad Caution After inserting a power cable and confirming the green System Status LED a light is on make sure that the Fan St
81. ocation a un geli ENDE EUER PESO de eds 17 Figure 7 BBU Insertion Left and Extraction Right 18 Figure 8 Rack Rall Kit Parts ass es aan RERUM ERR da y 20 Figure9 Installation Options 21 Figure 10 Attaching the Rails to the Chassis 21 Figure 11 Attaching the Brackets to the Chassis 22 Figure 12 Attaching the Brackets to the Rack 22 Figure 13 Sliding the Blades in the Rails 23 Figure 14 Rack Rail Kit Parts sans sea en euren 25 Figure 15 Rails Separation 22 edel dus ees aee ERG ana wees cas kan 25 Figure 16 Mounting the Outer Rails into the Rack 26 Figure 17 Attaching the Inner Rails to the Chassis 27 Figure 18 Securing the Chassis in the Inner Rails 27 Figure 19 Sliding the Switch into the Rack 28 Figure 20 Pulling the Unit Outwards 28 Figure 215 Locking Mechanism eces eus rase art gay di ik ES 29 Figure 22 Cable Orientation Orne ve liga Aa s 30 Figure 23 Breakout or Fanout Cable 30 Figure 24 SX6
82. ot GRUB menu will appear For example Default image SX X86 64 SX 3 4 0008 2014 11 10 20 07 51 x86 64 Press enter to boot this image or any other key for boot menu Booting default image in 3 seconds Boot Menu 0 SX X86 64 SX 3 4 0008 2014 11 10 20 07 51 x86 64 1 SX X86 64 SX 3 4 0007 2014 10 23 17 27 34 x86 64 Use the and keys to select which entry is highlighted Press enter to boot the selected image or p to enter a password to unlock the next set of features Highlighted entry is 0 e Select previous image to boot by pressing an arrow key and choosing the appropriate image Mellanox Technologies 53 Rev 1 5 Specifications 6 Specifications 6 1 SX67X0 Series Table 22 SX67X0 Specifications Feature Value Mechanical Size Short 1 716 H x 16 85 W x16 8 D 43 6mm H x 428mm W x 428 9 mm D Standard 1 716 H x 16 85 W x24 75 D 43 6mm H x 428mm W x 722 3 mm D Mounting 19 Rack mount Weight SX6710 Long 2 PSUs 10 86kg Short 2 PSUs 8 5kg SX6720 Long 2 PSUs 11 75kg SX6790 Long 2 PSUs 10 80kg Speed 40 56Gb s per port Connector cage 36 QSFP Air flow 100 Environmental Temperature Operating 0 to 45 C Storage 40 to 70 C Humidity Operating 10 85 non condensing Storage 10 90 non condensing Altitude Operating 3200m Storage 3200m
83. ow within the rack in the same direction that the part of the system to which you choose to attach the rails the front panel direction as demonstrated in Option 1 or the FRUs direction as demonstrated in Option 2 will determine the system s adjustable side The system s part to which the brackets are attached will be adjacent to the cabinet The FRU side is extractable Mounting the rack brackets inverted to the FRU side Option 2 will allow you to slide the FRUs in and out 20 Mellanox Technologies Rev 1 5 Figure 9 Installation Options Step 4 Attach the left and right rack mount rails A to the switch by gently pushing the switch chas sis pins through the slider key holes until locking occurs Secure the chassis in the rails screwing 2 flat head Phillips screws E in the designated points with a torque of 1 5 0 2 Nm See Figure 10 Figure 10 Attaching the Rails to the Chassis Step 5 Attach the left and right rack mount brackets B to the switch by gently pushing the switch chassis pins through the slider key holes until locking occurs Secure the system in the brack ets by screwing the remaining 2 flat head Phillips screws E in the designated points with a torque of 1 5 0 2 Nm See Figure 11 Mellanox Technologies 21 Rev 1 5 Installation Figure 11 Attaching the Brackets to the Chassis Step 6 Install 8 cage nuts in the desired 1U slots of the rack 4 cage nuts
84. pounds force Mellanox Technologies 29 Rev 1 5 Installation Figure 22 Cable Orientation 2 6 1 Using a Breakout Cable A 40GbE port can be split to 4 or less 10GbE ports using a Mellanox breakout cable When using a port to split a data stream into four 10Gb s data streams one of the other switch ports will be disabled and unmapped When using this feature you should log into the MLNX OS and configure the individual ports to be split 2 or split 4 Figure 23 Breakout or Fanout Cable 30 Mellanox Technologies Rev 1 5 2 6 1 1 SX67X0 Splitting Options Figure 24 SX67X0 Splitting Options sum This port can be split into 4 10 Gb s SFP mwws This port can be split into 2 10 Gb s SFP lt gt This port is unmapped according to the Port Splitting Table Table 9 Port Splitting Options Port Can be split to 4 Can be split to 2 Port Can be split to 4 Can be split to 2 1 No No 19 No No 2 Yes disables port 1 Yes 20 Yes disables port 19 Yes 3 No No 21 No No 4 No Yes 22 No No 5 No No 23 No No 6 Yes disables port 5 Yes 24 Yes disables port 23 Yes 7 No No 25 No No 8 Yes disables port 7 Yes 26 Yes disables port 19 Yes 9 No No 27 No No 10 No Yes 28 No Yes 11 No No 29 No No 12 Yes disables port 11 Yes 30 Yes disables port 23 Yes 13 No No 31 No No 14 Yes disables port 13 Yes 32 Yes disables port 31 Yes 15 N
85. r electrice locale si nationale 16 Codurile ed instalare Acest dispozitiv trebuie s instalat in conformitate cu ultima versiune a codurilor electrice nationale ale t rii in cauz Pentru America de Nord echipamentul trebuie s fie instalat conform cerintelor aplicabile din Codul electric national al SUA si Codul electric canadian 17 nlocuirea bateriei Avertisment inlocuiti numai cu o baterie recunoscut UL certificat pentru curent de inc rcare anormal maxim de minimum 4 mA Exist risc de explozie in cazul in care bateria este inlocuit cu o baterie necorespun z toare Eliminati bateriile folosite in conformitate cu instructiunile 18 Cordon de alimentare electric inregistrat UL si certificat CSA Pentru conectarea la o surs de alimentare pentru America de Nord selectati un cordon de alimentare care este inregistrat UL si certificat CSA cu 3 conductoare 16 AWG terminat cu o fisa turnat cu putere nominal egal cu 125 V 13 A cu o lungime de minimum 1 5 m sase picioare dar nu mai lung de 4 5 m Pentru conectarea la o surs de alimentare in Europa selectati un cordon de alimentare care este armonizat la nivel international i marcat lt HAR gt cu 3 conductoare cu minimum 2 fire de 1 0 mm cu putere nominal egal cu 300 V i cu o manta izolant din PVC Cordonul de alimentare trebuie s fie prev zut cu o fi turnat cu putere nominal egal cu 250 V 10 A
86. r le capot ou de toucher tout l ment l int rieur 9 Plusieurs prises d alimentation Risque et danger d lectrocution Les alimentations sont toutes ind pendantes Pour s assurer que le commutateur est bien hors tension d branchez toutes les alimen tations 10 En cas d orage danger d lectrocution Pendant un orage ne pas travailler sur l quipement ni brancher ou d brancher des c bles 11 Connexion et d connexion du c ble en cuivre Les c bles en cuivre sont lourds et peu flexibles Par cons quent il faut proc der avec soin pour les brancher ou les d brancher des connecteurs Consulter le fabricant du c ble pour obtenir des instructions ou des avertissements sp cifiques 12 Montage en rack et maintenance ment attention pour s assurer que l ensemble reste stable En r gle g n rale le rack doit Lors du montage ou de la maintenance de ce produit dans un rack il faut faire sp ciale A tre rempli en commengant par le bas 13 Installation de l quipement Cet quipement ne doit tre install remplac et maintenu que par un personnel form et qualifi 76 Mellanox Technologies Rev 1 5 14 Mise au rebut de l quipement La mise au rebut de cet quipement doit se faire conform ment toutes les lois et r glementations nationales Cet quipement doit tre install conform ment aux codes lectriques locaux et nation aux 16 Codes d
87. rd unplugged or AC power lost while Plug in the AC cord of the faulty PSU the second power supply still has AC input power PS failure including voltage out of range and Check voltage If OK call your Mella power cord disconnected nox representative for assistance 48 Mellanox Technologies Rev 1 5 Table 18 Power Supply Unit Status Rear LED Assignments LED Behavior Description Action Required Flashing Amber Power supply warning events where the power Call your Mellanox representative for supply continues to operate high temp high assistance power high current slow fan Off No AC power to all power supplies Call your Mellanox representative for assistance 4 2 1 4 UID LED The UID LED is a debug feature that the user can use to find a particular system within a cluster by turning on the UID blue LED This is a future feature that is not yet available 4 2 1 5 Bad Port LED The Bad Port LED indicator is used to indicate symbol errors in one or more system ports Table 19 shows the bad port status LED assignment Table 19 Bad Port LED Assignments LED Configuration Description Action Required Off No symbol errors have been received in last N A few seconds normal condition Flashing Amber Error one or more ports have received symbol Check symbol error counters on the sys errors tem UI to identify the ports Possible causes are Replace the cable on
88. rear to front airflow fan with Orange cap for SX67X0 switch systems MTEF FANR A Fan module w front to rear airflow fan for SX67X0 SX1710 switch systems MTEF BBU A Battery Backup Unit for MSX67X0 switch systems Lithium ion batteries in compliance with Section II of PI 965 Mellanox Technologies 55 Rev 1 5 Thermal Threshold Definitions There are three thermal threshold definitions for the witch device which impact the overall switch system operation state Warning Critical and Emergency 1 Warning 105 C When the device crosses the 100 threshold a Warning Threshold message will be issued by the MLNX OS management SW indicating to system administration that the switch has crossed the Warning threshold Note that this temperature threshold does not require nor lead to any action by hardware such as switch shutdown 2 Critical 120 When the device crosses this temperature the firmware will automatically shut it down 3 Emergency 130 C In case the firmware fails to shut the device down upon crossing the Critical threshold the device will auto shutdown upon crossing the Emergency 130 C threshold 56 Mellanox Technologies Rev 1 5 Appendix C Interface Specifications 60 1 QSFP Interface or Comestor Senat sep 1 GND Ground 2 Tx2n Tr
89. rstrom Schutzeinrichtung 20 A bewertet werden m ssen in dem Geb ude Verkabelung 21 Switch nicht als Regal oder Arbeitsplatz nutzen Achtung Auf Schieber Schienen montiertes Ger t ist nicht als Regal oder Arbeitsbere ich zu nutzen Die Schienen sind nicht daf r bestimmt die Einheit aus dem Gestell weg zu ziehen Sie sind nur f r die permanente Installation an einem endg ltigen Stan dort gedacht nicht f r Instandhaltung und Wartung 2 22 WEEE Direktive Gem WEEE Directive 2002 96 EC m ssen alle elektrischen und elektronischen Abfallger te EEE separat gesammelt und nichit mit normalem Haushaltsm ll ensorgt werden Dieses Produkt und alle seine Teile in verantwortungsvoller und umweltfreundlicher Art und Weise entsorgen Ist die BBU Batterie Backup Einheit verformt undicht ver tzt oder sichtbar bes ch digt muss diese unverz glich ausgetauscht werden Ausschlie lich BBUs Batterie Backup Einheit verwenden die ein Originalprodukt von Mellanox Technolgies sind Wurde eine BBU Batterie Backup Einheit f r zwei Jahre oder l nger nach dem aufgedruckten Herstellungsdatum nicht verwendet ist sie unbrauchbar gt lt gt Lx Im Fall eines notwendigen Batterieaustausches sendet die Software ab drei Monaten vor Erreichung des EOL monatliche Benachrichtigungen 82 Mellanox Technologies Rev 5 E 7 Advertencias de seguridad de instalaci n Spanish 1 Instrucciones de instalaci n
90. s 61 E 2 Installation Safety Warnings English 61 E 3 mpnonmmeanmmmw Hebrew esses 65 EA FEZ SS Chinese 69 5 Avertissements de s curit pour l installation French 75 E 6 Installation Sicherheitshinweise German 79 E 7 Advertencias de seguridad de instalaci n Spanish 83 8 Russian 87 E 9 Avertismente privind siguran a la instalare Romanian 91 E 10 Sigurnosna upozorenja za instaliranje Croatian 95 E 11 Avvertenze di sicurezza per l installazione Italian 100 E 12 MontajG venlikUyar lar Turkish 104 E 13 Japan VECI Statement excep a X ee dg 108 4 Mellanox Technologies Rev 1 5 List of Figures Figure 1 SX67X0FrontSideVlew 0 00 10 Figure 2 SX6710 SX6720 Rear Side View 11 Figure 3 Air Flow Direction Marking Power Side Inlet to Connector Side Outlet 15 Figure 4 Air Flow Direction Marking Connector Side Inlet to Power Side Outlet 15 Figure 5 Unlocking the Latches and Extracting the PSU 17 Figur 6 BBU L
91. s 11 Rev 1 5 Introduction to Mellanox SX67X0 Systems 1 6 Ordering Information the following table lists ordering information for the available systems Please pay attention to the airflow direction when ordering your system For more details see Air Flow on page 14 Table 5 Ordering Part Numbers OPNs System M Model OPN Description SX6710 MSX6710 FB2F2 SwitchX amp 2 based FDR InfiniBand 1U Switch 36 QSFP ports 2 Power Supplies AC x86 dual core short depth rear to front air flow Rail Kit RoHS6 MSX6710 FS2F2 SwitchX amp 2 based FDR InfiniBand 1U Switch 36 QSFP ports 2 Power Supplies AC x86 dual core standard depth rear to front airflow Rail Kit RoHS6 SX6720 MSX6720 FS2F2 SwitchX amp 2 based FDR InfiniBand 1U Switch BBU ready 36 QSFP ports 2 Power Supplies AC x86 dual core standard depth rear to front airflow Rail Kit RoHS6 12 Mellanox Technologies Rev 1 5 2 Installation Installation and initialization of the system require attention to the normal mechanical power and thermal precautions for rack mounted equipment The rack mounting holes conform to the EIA 310 standard for 19 inch racks Take precautions to guarantee proper ventilation in order to maintain good airflow at ambi ent temperature gt The installation procedure for the system involves the following phases 1 Follow the safety warnings in Section 2 1 2 Pay at
92. seamlessly connecting to 1 10 and 40GbE networks with low latency 400ns Existing LAN infrastructures and management practices can be preserved easing deployment and provid ing significant return on investment Figure 1 SX67X0 Front Side View an 10 Mellanox Technologies Rev 1 5 1 2 Speed and Switching Table 3 describes maximum throughput and interface speed per system model Table 3 Speed and Switching Capabilities 10GbE SFP 40 56GbE QSFP Interfaces Interfaces roe SX6710 N A 36 4 032Tb s SX6720 N A 36 4 032Tb s The system can support 1Gb s and 10Gb s interfaces using QSFP to SFP adapters or split cables Up to 64x10GbE interfaces via breakout cables 1 3 Management Interfaces and FRUs Table 4 lists the various management interfaces and available replacement parts per system model Table 4 Management Interfaces and FRUs Replaceable Replaceable System Model USB MGT 2 Ports Console PSU Fan SX6710 Rear Rear Rear Yes Yes SX6720 Rear Rear Rear Yes Yes 1 4 Features For a full feature list please refer to the system s product brief SX67X0 http www mellanox com related docs prod_ib_switch_systems PB_SX6710 pdf 1 5 Certifications The list of certifications such as EMC Safety and others per system for different regions of the world is located on the Mellanox website at http www mellanox com page environmental compliance Mellanox Technologie
93. shooting Instructions Table 21 Troubleshooting Problem Indicator Symptoms Corrective Measures LEDs System Status LED is This state means that the MLNX OS software did not blinking for more than 5 boot properly and only firmware is running minutes To overcome it connect to the system via the console port and check the software status You might need to contact an FAE ifthe MLNX OS software did not load properly System Status LED is red This state can indicate a number of problems Critical system fault CPU error bad firmware Over Temperature To overcome it Check Environmental conditions room temperature Fan Status LED is red This state is indicative of a problem with the FAN Check that the FAN is fully inserted and nothing blocks the airflow Replace the FAN FRU if needed PSU Status LED is red This state is indicative of a problem with the PSU e Check replace the power cable Replace the PSU if needed The activity LED does not Make sure that there is an SM running in the fabric light up InfiniBand 52 Mellanox Technologies Rev 1 5 Table 21 Troubleshooting Problem Symptoms Corrective Measures Indicator Systemboot The last software upgrade Connect the RS232 connector CONSOLE to a laptop failure failed on x86 based sys Push the system s reset button tems Press the ArrowUp or ArrowDown key during the system bo
94. system and an IT power system of Norway only 26 BBU Dac Unitatea de baterie de rezerv este deformat prezint scurgeri este corodat sau deteriorat din punct de vedere vizual inlocuiti o imediat Nu utilizati o Unitate de baterie de rezerv ce nu a fost furnizat de Mellanox Technol ogies O Unitate de baterie de rezerv care nu a fost folosit doi ani sau mai mult de la data produceri ce este imprimat pe aceasta nu poate fi utilizat gt gt gt O Unitate de baterie de rezerva care este mai veche de cinci ani conform datei de fabricatie inscriptionate a atins sfarsitului duratei de viata si nu poate furniza sufi cient energie pentru manevrarea platformei E 10 Sigurnosna upozorenja za instaliranje Croatian 1 Upute za instaliranje Pa ljivo pro itajte upute za instaliranje prije spajanja opreme na izvor elektri ne energije 2 Tjelesne ozljede uslijed te ine Kako biste sigurno podignuli ovaj proizvod koristite dovoljan broj ljudi lt 40 lbs 40 lbs 70 121 lbs gt 121 lbs lt 18 kg 18 32 kg 32 55 kg gt 55 kg Mellanox Technologies 95 Rev 1 5 3 Te ka oprema Ova oprema je vrlo te ka i treba se premje tati pomo u mehani kog dizala kako bi se izbjegle ozljede 4 Rizik od strujnog udara Ad Rizik od strujnog udara y N S uklonjenim modulom ventilatora perima napajanja se mo e pristupiti u otvoru mod 4 ula NEMOJTE umetati alat 111 di
95. ta con una batteria di tipo corretto vi 6 1l rischio di esplosione Smaltire le batterie usate in conformita con le istruzioni 18 Cavo di alimentazione UL e munito di certificazione CSA Per una connessione di alimentazione nordamericana selezionare un cavo di alimentazione di tipo UL e munito di certificazione CSA a 3 conduttori 16 AWG terminato con una spina stampata con tensione nominale pari a 125 V 13 A di lunghezza minima pari 1 5 m sei piedi ma non piu lunga di 4 5 m Per una connessione europea selezionare un cavo di alimentazione armonizzato a livello internazionale e contrassegnato da lt HAR gt a 3 conduttori minimo 1 0 mm2 fili con guaina isolante in PVC Il cavo deve disporre di una spina stampata di potenza nominale pari a 250 V 10 A 19 Corrente di dispersione elevata IA Avvertenza corrente di dispersione elevata il collegamento a terra 6 essenziale prima di collegare l alimentazione 20 Codici di installazionei Questo dispositivo va installato in conformit con l ultima versione dei codici elettrici nazionali del Paese Per il Nord America l apparecchiatura va installata in conformita 4 con 1 requisiti applicabili del codice elettrico nazionale USA e del codice elettrico canadese 102 Mellanox Technologies Rev 5 21 Interconnessione delle unita I cavi per il collegamento all unita RS232 e alle interfacce Ethernet devono disporre della certificazione UL e
96. tall en respectant Cet appareil doit tre install conform ment la version la plus r cente des codes lec N les exigences de l US National Electrical Code et du Code canadien de l lectricit Mellanox Technologies 77 Rev 1 5 21 Interconnexion des unit s Les c bles de connexion aux interfaces RS232 et Ethernet de l appareil doivent tre certifi UL de type DP 1 ou DP 2 Note en cas d installation sur un circuit dont la puissance n est pas limit e Protection contre les surintensit s le cablage de l immeuble doit int grer un dispositif certifi de protection contre les surintensit s calibr a 20 A et aisement accessible 22 Ne pas utiliser comme tag re ou plan de travail Attention un quipement coulissant ou mont sur rail ne doit pas servir d tag re ni de plan de travail Les rails ne sont pas destin s faire coulisser l unit hors du rack Ils sont destin s une installation permanente l emplacement final pas pour l entretien ni la maintenance 2 23 Directive DEEE Selon la Directive 2002 96 CE DEEE tous les d chets d quipements lectriques et lectroniques EEE doivent tre collect s s par ment et ne pas tre mis au rebut avec les d chets m nagers habituels Ce produit et toutes ses pieces doivent tre mis au rebut d une mani re responsable respectant l environnement D lt 24 Restrictions concernant l alimentation pour la Norv ge Cet apparei
97. tatus LED There are two power supply inlets in the system for redundancy The system can operate with only one power supply connected In case the power supply is an FRU a second power supply unit can be added to support hot swap ability Each power supply unit has a single 2 color LED on the right side of the unit that indicates the status of the unit Mellanox Technologies 47 Rev 1 5 Interfaces Figure 32 Rear Side Panel The primary power supply PS unit is located on the left side and the secondary unit is located on the right side Table 17 Power Supply Unit Status Front LED Assignments LED Behavior Description Action Required Solid Green plugged one or two power supplies are N A running normally Solid Red One or both of the power supplies are not Make sure the AC cable is plugged in operational or not powered up the AC power and active If the problem resumes the cable is disconnected FRUs might be faulty and should then be replaced Off N A N A The power supply status LEDs on the rear side of the system are located on the PSUs themselves Each PSU has one LED of its own Table 18 Power Supply Unit Status Rear LED Assignments LED Behavior Description Action Required Solid Green The PSU is running normally N A Flashing Green 1Hz AC present Only 12VSB on PSU off or Call your Mellanox representative for PSU in Smart on state assistance Amber AC co
98. te yes Autoconf privacy no DHCPv6 running no IPv6 addresses 1 IPv6 address fe80 202 c9ff fe63 b55a 64 Speed 1000Mb s auto Duplex full auto Interface type ethernet Interface source physical MTU 1500 HW address 00 02 C9 63 B5 5A RX bytes 968810197 TX bytes 1172590194 RX packets 10982099 TX packets 10921755 RX mcast packets 0 TX discards 0 RX discards 0 TX errors 0 RX errors 0 TX overruns 0 RX overruns 0 TX carrier 0 RX frame 0 TX collisions 0 TX queue len 1000 r qa sit sx01 config Step 6 You are advised to check the software version embedded in your system using the command show version you can continue and compare this version to the latest version that can be retrieved from Mellanox support site To upgrade software simply refer to MLNX OS user manual 2 8 2 Remote Connection Once the network attributes are set you can access the CLI via SSH or the WebUI via HTTP HTTPs To access the CLI perform the following steps Step 1 Set up an Ethernet connection between the system and a local network machine using a stan dard RJ45 connector Step 2 Start a remote secured shell SSH using the command ssh l username IP address gt ssh 1 username ip address Mellanox Technologies 37 Rev 1 5 Installation Mellanox MLNX OS Switch Management Password Step 3 Login as admin default username is admin password admin Step 4 Once you get the CLI prompt you
99. tentially cause personal injury Mellanox Technologies 9 Rev 1 5 Introduction to Mellanox SX67X0 Systems 1 Introduction to Mellanox SX67X0 Systems 1 1 Overview The SX67X0 systems provide the highest performing fabric solution in a 1U form factor by delivering up to 4Tb s of non blocking bandwidth with 200ns port to port latency These systems are the industry s most cost effective building blocks for embedded systems and storage witha need for low port density systems Whether looking at price to performance or energy to performance these systems offer superior performance power and space reducing capital and operating expenses and providing the best return on investment The systems are an ideal choice for smaller departmental or back end clustering uses with high performance needs such as storage data base and GPGPU clusters Powerful servers combined with high performance storage and applications that use increasingly complex computations are causing data bandwidth requirements to spiral upward As servers are deployed with next generation processors High Performance Computing HPC environments and Enterprise Data Centers EDC need every last bit of bandwidth delivered with Mellanox s FDR InfiniBand systems Built with Mellanox s sixth generation SwitchX amp 2 InfiniBand FDR 56Gb s system device these standalone systems are an ideal choice for top of rack leaf connectivity or for building small to extremely large sized cl
100. tention to the air flow consideration within the system and rack refer to Air Flow page 14 3 sure that none of the package contents is missing or damaged see Package Contents on page 15 4 Power on the system refer to Initial Power On on page 32 5 Perform system bring up see Bring Up on page 33 FRU replacements are described in Section 2 9 on page 38 2 1 Safety Warnings Prior to the installation please review the safety warnings as follows For Nordic Countries Notices see Section E 1 Nordic Countries Notices on page 61 For Safety Warnings in English see Section E 2 Installation Safety Warnings English on page 61 For Safety Warnings in Hebrew see Section E 3 mante Hebrew on page 65 For Safety Warnings in Chinese see Section 1 on page 69 For Safety Warnings in French see Section E 5 Avertissements de s curit pour l installation French on page 75 For Safety Warnings in German Section E 6 Installation Sicherheitshinweise German on page 79 For Safety Warnings in Spanish see Section E 7 Advertencias de seguridad de instalaci n Spanish on page 83 For Safety Warnings in Russian see Section E 8 Russian on page 87 For Safety Warnings in Romanian see Section E 9 Avertismente privi
101. terfaces AE tds 43 41 Supported Interfaces una sus Ae ita eR 43 4 1 1 Data Interfaces T 43 eC o EE 43 41 3 RS232 Console eee Rt eate ay tip es 43 4 14 Management secre one a A RICE eI EET aeta 44 USB ober E CEDE SUE PE rale pae 44 4 1 6 Reset Button a se eR nee IER RES e ace 44 Mellanox Technologies 3 Rev 1 5 A2 EDS lr REDE FEN ee ey 45 422 1 LED Notifications pla alts 45 4 3 Inventory Pull out Tab 51 Chapter 5 Troubleshooting 000 088100 4010 rire 52 5 1 Troubleshooting Instructions 52 Chapter 6 Specifications sies due ss e er a an 54 6 1 SOT XO EMS a xe eed WEINE EY SEE NETT ET bp Ce ge 54 Appendix A Accessory and Replacement Parts 55 Appendix Thermal Threshold Definitions 56 Appendix C Interface Specifications S7 1 QSFP Interface 57 C2 RJ45 to DB9 Harness Pinout 58 Appendix D Disassembly and Disposal 60 D 1 Disassembly Procedure 60 D2 Disposals ee dn arie plan De ze S 60 Appendix E Safety Warnings Multiple Languages 61 E 1 Nordic Countries Notice
102. tra ili namjenske ra unalne sobe 21 Instalacijski kodovi da Ovaj se ure aj mora instalirati sukladno najnovijoj verziji nacionalnih elektri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati sukladno va e im zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code 98 Mellanox Technologies Rev 5 22 Interkonekcija uredaja Kabeli za spajanje na jedinicu RS232 i Ethernet su elja moraju biti UL cer tifikatom vrste DP 1 ili DP 2 Napomena kad se nalazi u krugu bez LPS vodi a Za tita od strujnog preoptere enja Uvijek dostupni odobreni za titni ure aji od strujnog preoptere enja nazivne struje od 20 A moraju se ugraditi u o i enje zgrade 23 Nemojte koristiti preklopnik kao policu ili radnu povr inu Pozor Oprema montirana na kliza e vodilice ne bi se trebala koristiti kao polica ili radna povr ina Vodilice nisu namijenjene za povla enje ure aja iz ormari a Slu e samo za trajnu instalaciju na kona nom polo aju a ne za servisiranje i odr avanje 24 WEEE direktiva Sukladno WEEE direktivi 2002 96 EZ sav elektri ni i elektroni ki otpad EEE trebao bi se prikupljati zasebno 1 ne bi se trebao odlagati kao obi an ku anski otpad Odlaganje ovog proizvoda i svih njegovih dijelova vr ite na odgovoran i ekolo ki na in 25 Elektri na ograni enja dr ave Norve ke Ovaj je ure aj namijenjen samo za spajanje na elektri ni sustav s TN uzemljenjem
103. upply unit with a power cord connected to it Step 2 Insert the power supply unit by sliding it into the opening until a slight resistance is felt Step3 Continue pressing the power supply unit until it seats completely The latch will snap into place confirming the proper installation Step 4 Insert the power cord into the supply connector Step 5 Insert the other end of the power cord into an outlet of the correct voltage The green power supply unit indicator should light If not repeat the whole procedure to extract the power supply unit and re insert it 2 9 2 Fans The system can fully operate if one fan FRU is dysfunctional or missing Failure of more than one fan is not supported Make sure that the fans have the air flow that matches the model number An air flow opposite to the system design will cause the system to operate at a higher less than optimal temperature For power supply unit air flow direction refer to Section 2 2 on page 14 Mellanox Technologies 39 Rev 1 5 Installation gt To extract a fan unit Step 1 Grasping the handle with your right hand push the latch release with your thumb while pulling the handle outward As the fan unit unseats the fan unit status LEDs will turn off Step 2 Remove the fan unit To remove or replace a fan unit gently pull out its black handle while pushing the latch release with your thumb gt To insert a fan unit Step 1 Make sure the mating
104. usters These systems enable efficient computing with features such as static routing adaptive routing and advanced congestion management These features ensure the maximum effective fabric bandwidth by eliminating congestion The managed systems comes with an onboard subnet manager enabling simple out of the box fabric bring up for up to 648 nodes MLNX OSQ software delivers complete chassis manage ment of firmware power supplies fans ports and other interfaces Mellanox s edge systems can also be coupled with Mellanox s Unified Fabric Manager UFM amp software for managing scale out InfiniBand computing environments UFM enables data center operators to efficiently provision monitor and operate the modern data center fabric UFM boosts application performance and ensures that the fabric is up and running at all times InfiniBand systems come as internally or externally managed Internally managed systems come with a CPU that runs the management software MLNX OS and management ports which are used to transfer management traffic into the system Externally managed systems come without the CPU and management ports and are managed using firmware tools Mellanox s InfiniBand to Ethernet gateway built with Mellanox s SwitchX 2 based systems provides the most cost effective high performance solution for data center unified connectivity solutions Mellanox s gateways enable data centers to operate at up to 56Gb s network speeds while
105. your partner is holding the system Step 4 Extract the loosened screws from Step 2 and dismount the system from the rack Steps Remove the rails and brackets from the chassis by unscrewing 8 screws 2 5 2 19 Systems Mounting Telescopic Rail Kit Note the Telescopic Rail Kit 1s not included in the system s package and can be pur chased separately There are two installation kit options standard and short Standard depth systems should be mounted using the standard rail kit short systems can be mounted using either of the rail kits The following parts are included in the rail kit rack see Figure 14 Table 8 Installation Kit Kit OPN Rack Size Rack Depth Range MTEF KIT B Short 17 24 Mellanox Technologies 23 Rev 1 5 Installation Table 8 Installation Kit Kit OPN Rack Size Rack Depth Range MTEF KIT S Standard long 24 34 lx Right inner rail A Left inner rail B 2x Outer rails C 2x Outer rails D 10x M6 Standard cage nuts and 10x M6 Standard pan head Phillips screws E 2x Phillips100 DEG F H TYPE I ST ST 6 32 X 1 4 screw with around patch F Other threads are available by special order M5 10 32 12 24 G type cage nut is available by special order NOTE The rails must be separated prior to the installation procedure See Figure 15 24 Mellanox Technologies Rev 1 5 Figure 14 Rack Rail

HW User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents