BridgeX BX4010 Gateway Platform IB to Ethernet/Fibre
Contents
1. Part Description Product Number Power Supply Unit PSU MTP000018 This Replacement part is for both the PSU 1 and PSU 2 Power blank cover MTM003600 Fan Unit MTF 000960 Rack installation Kit MTR003600 DB9 to RJ45 Harness for power PC management module HAR000028 Power cord Type C13 C14 ACC000242 250V 15A 2M RIGHT ANGLE Power cord Type B for USA Canada Mexico Taiwan ACC000204 Type B 6ft US 125V 10A chord Power cord Type B for USA Canada Mexico Taiwan ACC000241 125V15A 4M USA UL Type B RIGHT ANGLE Power cord Type H for Israel ACC000205 Power cord Type E F for Sweden France Germany Neth ACC000207 erlands Russia Power cord Type G for UK ACC000208 Power cord Type D for India ACC000209 Power cord Type I for China ACC000210 Power cord Type J for Switzerland ACC000211 Power cord Type B for Japan ACC000212 Power cord Type I for Australia ACC000213 BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Appendix E Avertissements de s curit d installation French 1 Instructions d installation Lisez toutes les instructions d installation avant de brancher le mat riel la source d alimentation lectrique gt 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambiante d passant le maximum recommand de 55 C 131 F Un flux d air de 200LFM cette temp rature ambiante maximale est n cessaire En outre pour gara2. ATTENTION La connexion la terre des forts courants de fuite est essentielle avant le branchement de l alimentation Avant de brancher l appareil la conduite d alimentation les vis de protection la terre du terminal de l appareil doivent tre appliqu es l installation de protection la Terre du b timent gt 9 Forts Courants de Fuite High Leakage Current Attention Forts courants de fuite Il est essentiel de relier a la terre avant de brancher l alimentation gt 10 Ajouter une information de connexion la masse Connect a Valid Ground to this Device Avant de brancher l appareil la conduite d alimentation les vis de protection la terre du terminal de l appareil doivent tre appliqu es l installation de protection la Terre du b timent gt 11 Installation du mat riel Ce mat riel ne doit tre install remplac ou entretenu que par du personnel form et qualifi gt 12 Elimination du mat riel L limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur gt 13 Codes lectriques locaux et nationaux Ce mat riel doit tre install dans le respect des codes lectriques locaux et nationaux gt 50 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 14 Codes d installation INSTALLATION CODES
3. L appareil doit tre install selon l ancienne version des codes lectriques nationaux du pays Pour l Am rique du Nord l quipement doit tre install conform ment aux sp cifications du Code Electrique National Am ricain et du Code Electrique Canadien gt 15 Interconnexion des unites INTERCONNECTION OF UNITS Les c bles de branchement l unit RS232 et les interfaces Ethernet doivent tre certi fies UL de type DP 1 ou DP 2 Note lorsqu il existe dans un circuit non LPS Protection contre la surintensit Un appareil de protection r pertori facilement accessible contre la surintensit du circuit de branchement et calibr 20A doit tre incorpor dans le c blage lectrique du b timent 16 Exposition au rayonnement grave Mise en garde l utilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE CLASSE 1 et r f rences aux normes laser les plus r centes CEI 60 825 1 1993 A1 1997 A2 2001 et NE 60825 1 1994 A1 1996 A2 2001 17 S assurer que les enceintes sont appropri es Des enceintes lectriques m caniques et incendie adapt es doivent tre fournies par le fabricant du produit final ou par l utilisateur final gt 18 Cordons lectriques CA homologu s UL Pour les prises lectriques en Am rique du Nord choisissez un cordon
4. Troubleshooting on page 37 O O Error The system detects a fault Most likely O Off The system has no power off off 2 2 6 2 Fan Status Indicators The indicators labeled Fans are located below the Sys LEDs The following fan status conditions are possible Table 7 Fan Status LED Configurations LED Configuration Status O O OK All fans are operating Green on off Error One or more fans is not operating Repair or replace the fan unit See Section 4 Troubleshooting on page 37 off yellow on Off The fan unit is not receiving any power O Check that the fan unit is properly and com pletely inserted off off 18 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 All fans must be operating while the power supply is plugged in Power must be removed within one minute of the fans failing to prevent damage to the gateway The gateway can run on two of the three fans at an ambient temp of 45 C or less All fans must be operating while the power supply is plugged in Ifthe gateway shuts down due to over temperature unplug the gateway wait 5 minutes and replug in the gateway For more information See Troubleshooting on page 37 2 2 6 3 PSU Status Indicators The indicators labeled PSU are located below the Fan LEDs The following PSU status condi tions are p
5. SFP Humidity 10 90 non condensing Protocol Support Regulatory Compliance InfiniBand Auto Negotiation of Safety UL60950 40Gb s 20Gb s 10Gb s C UL to CAN CSA 22 2 No 60950 1 QoS 8 InfiniBand Virtual Lanes for all TUV GS to EN 60950 1 ports Amendment A1 A4 All CB IEC60950 1 all coun Management Baseboard Performance and try deviations Device management Agents for full InfiniBand In Band Management EMC Emis CC 47CFR Part 15 Class A sions EN 55022 Class A ICES 003 Class A VCCI Class A AS NZS CISPR 22 Class A CISPR 22 Class A EN 55024 EN 300386 CE Environmental EU IEC 60068 2 64 Ran dom Vibration EU IEC 60068 2 29 Shocks Type I II EU IEC 60068 2 32 Fall Test Mellanox Technologies 39 Rev 1 5 Power and Environmental Physical Reliability Availability and Serviceability Scalability and Performance Features Hot Swappable Fan Module and Power 1 1 Redundant Supplies Power Supplies Switching Perfor Simultaneous wire speed any port to mance any port 48K Unicast Addresses Max per Addressing Subnet Bridging Capacity 16K Multicast Addresses per Subnet 320Gb s Table 11 MTB4010B PC Specification Data Physical Power and Environmental Connectors and 11 74 1U H x 19 W x 21 26 D 44mm X 442mm X 540 mm 25 Ibs 11 3Kg with 2 PSUs 19 Rack mount SerDes Speeds IB 10 20 40 Gb s per port Ethernet 1 10 Gb
6. Rev 1 5 About this Manual This manual describes the installation and basic use of Mellanox BridgeX BX4010B Gateway products and development platforms based on the MT68102 BridgeX gateway device Intended Audience This manual is intended for users and system administrators responsible for installing and setting up BridgeX gateways from InfiniBand to Ethernet and or Fibre Channel fabrics and networks The manual assumes familiarity with the InfiniBand Architecture Specification as well as the Ethernet Architecture Related Documentation Additional documentation available from Mellanox is provided in Table 2 Table 2 Reference Documents BridgeX Programmer s Reference Man User guide describing the interface used by developers to write a ual driver between system software and the Mellanox BridgeX device Document 2936PM FabricIT BX Management Software CLI User manual describing the software interface including examples for User s Manual using the BX manager and for installing EoIB and FCoE Host stacks www mellanox com gt Products gt Gateway Software gt Software and Documentation Download You will need a valid Mellanox Gateway S N Mellanox Firmware Tools MFT User s The MFT Mellanox Firmware Tools package is a set of firmware Manual tools The manual supplied with this package provides an overview Document 2329 of the firmware its installation and replacement The MFT can be downloaded with its docume
7. lectrique homologu UL et certifi CSA 3 conducteurs 18 AWG termin par une fiche moul e d une tension nominale de 125 V 15 A avec une longueur minimale de 1 5 m 6 pieds et d une longueur maxi male de 4 5 m 18 pieds Pour les prises lectriques en Europe choisissez un cordon lectrique harmonis inter nationalement et marqu lt HAR gt gt 3 conducteurs d un diam tre de fil minimum de 0 75 mm2 d une tension nominale de 300 V avec une gaine isol e en PVC Le cordon doit avoir une fiche moul e d une tension nominale de 250 V et d une intensit nominale de 10 A Mellanox Technologies 51 Rev 1 5 Anhang F Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromversorgung anschlie en gt 2 bertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von C F betrieben werden Es ist ein Luftstrom von 200 LFM bei maximaler Umgebungstemperatur erforderlich Au erdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen ein wandfreien Luftstrom zu gew hrleisten gt 3 Stapeln des Chassis Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herunt erf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren gt 4 Redundan
8. A13 B12 B10 as aad aud Lai B BX4010 l2C RS232 1 GigE Gateway Port Group A BridgeX controller 1 White Gateway Port Group B BridgeX controller 1 Orange Table 5 MTB 4010 Port Numbering shows the uplink and downlink ports by color and alpha numeric id identifying the port groups Table 5 MTB 4010 Port Numbering ei BridgeX Uplink Corresponding Corresponding Gro Controller ts Downlink Downlink P Number FC Ports Ethernet Ports by Color White 1 A20 A10 All A12 A13 A10 All AI2 Orange 1 B20 B10 Bll B12 B13 BIO Bll B12 1 1 Features The BX4000 series has the following features Uplink ports e 2 ports of 10 20 40G InfiniBand Downlink ports e 6 ports of 1 10 GigE or 8 ports of 2 4 8G Fibre Channel or a flexible mix of Ethernet and Fibre Channel ports Down link ports are configured in groups of 3 for Ethernet and in groups of 4 for Fibre Channel Down link ports within a group must run the same protocol Ethernet or Fibre Channel e A down link port group running Ethernet must run the same speed on all ports within the group 10Gbps or 1Gbps Mellanox Technologies 11 Rev 1 5 Overview 1024 virtual NICs per Ethernet port 1024 virtual HBAs per FC port Total of 8K MAC VLAN addresses Total of SK WWN addresses InfiniBand ports e IBTA spec 1 2 compliant e Automatic link speed negotiation e Hardware based congestion control Ethernet ports IEEE 802 3ae 10Gigab
9. Configuring the Port Gateway Groups See the FabricIT BXM Management Software CLI User Manual for CLI commands to configure the gateway You can also configure the gateway using the WebUI 2 2 4 Making Connections to Other Formats Hybrid CX4 to QSFP cables are supported on the uplink side SR and LR modules can be used on the downlink side The following downlink options are also supported SFP modules for GigE SFP modules for 1 2 4 8G FC 2 2 5 SFP Transceiver Module The gateways are shipped without optical modules Approved Mellanox modules must be pur chased from Mellanox The OPNs for the approved Mellanox modules are MFM1T02A SR and MFMITO2A LR The figure below shows the Mellanox approved SFP module SR and LR modules not recommended by Mellanox may not work with the adapter Figure 5 SFP Transceiver Module IT Mellanox 50 nm TECHNOLOGIES 08 21 MFM1T02A S en R SN UDLOSJC 190 rruxesrioseci me lI MINIM MINI Class 1 21CFR1040 10 LN 50 7 01 MADE IN MALAYSIA Mellanox Technologies 15 Rev 1 5 Installation and Basic Operation 2 2 5 1 Inserting the Optical Transceiver Module To insert the module into the cage 1 Open the module s locking mechanism see Figure 6 and Figure 7 2 Make sure that the male connectors on the module will align with the female connectors inside of the cage Also check that there is no dirt or foreign matter in the module or in the cag
10. LED for PSU1 or PSU2 does not come on 1 Ifthe LED on the PSU is off check that the Sys is off 2 Remove and reinstall the power cable Check that the power outlet in the wall is working 3 Remove and reinstall the PSU Make sure the mating connector of the new unit is free of any dirt and or obstacles 4 Replace the PSU The power LED for the gateway shuts off 1 Check that the there is adequate ventilation 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan mod ules and ventilation holes are not blocked especially dust over the holes 3 Use the FabricIT BXM manager to check the temperature of the gateway If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the gateway using a vacuum cleaner The green power LED for the fans does not come on 1 Check that the Power LEDs are on 2 Remove and reinstall the fan unit Make sure the mating connector of the new unit is free of any dirt and or obstacles Caution Do not run the gateway if the System Status LED for the Fans is Red The link LED for the connector does not come on 1 Check that both ends of the cable are connected 2 Check that the locks on the ends are secured 3 Make sure that the latest FW version is installed on both the HCA NIC cards and the gateway 4 If media adapters are used check that the all connections are good tight a
11. a power cable Warning Any yellow status LEDs is cause for concern and must be dealt with immediately It can take up to 2 minutes to boot up during which time the status LED may indicate red Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Caution After inserting a power cable and confirming the green system status LED is on make sure that the Fan Status indicator shows green If the fan status indicator is not green then unplug the power connection and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and or obstacles Caution When turning off the gateway use the proper shut down procedure see Section 2 4 6 and make sure ALL LEDS are off to ensure a powered down status Do not hot swap the power supply if your gateway has only one working power supply You must power down the system to replace the power supply unit when there is only one working PSU in the gateway Figure 14 Two Power Inlets Electric Caution Notifications CAUTION ACHTUNG ATTENTION Risk of electric shock and energy Gafahr des elektrischen Risque de choc et de danger hazard The two PSUs are inde Schocks Entferrnen des e lectriques Le de branch pendent Netzsteckers elnes Netz ment d une seule alimentation teils spannungsfrei Um stabilise e ne de branch Disconnect all power supplies to alle Einhieten spannungs
12. allows Ethernet Fibre Channel and InfiniBand payloads to be carried over a common converged high performance 40Gbps InfiniBand fabric without any changes to existing server applications Data on the converged fabric requiring access to Ethernet LAN and iSCSI or Fibre Channel SANs is bridged by the BX4010B gateway preserving existing LAN and SAN invest ments and management practices The BridgeX BX4010B gateway along with ConnectX adapters converge different networks onto a single fabric reducing the number of adapters cables and switch ports by a factor of three and reducing capital expenditure The high port density of the BX4010B within a 1U form factor low power consumption and ease of management also reduces operating expenses The uplink and downlink ports are separated into gateway port groups Specific uplink ports are assigned corresponding downlink ports The BX4010B gateway is by default enabled only for EoIB bridging A seperate license should be purchased from Mellanox to enable FCoIB bridging Contact your Mellanox representative for more details Each gateway port group is assigned a color in the figures in this document to easily associate the uplink ports to the corresponding downlink ports of the gateway port group 10 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Figure 1 BX4010 Gateway Port Groups Distinguished by Color A10 A12 B13 B11 mm A11
13. o LO x m N DD DD ED D GD I D D D cc n 3 9 3 lt E a r a gt Q te x Q Q x oc O E gt E Table 14 SFP Pinout Pin Symbol Name Description l VeeT Transmitter Ground Common with Receiver Ground 2 TX_Fault Transmitter Fault 3 TX Disable Transmitter Disable Laser output disabled on high or open 4 SDA 2 wire Serial Interface Data Line 5 SCL 2 wire Serial Interface Clock Line 4 6 MOD_ABS Module Absent Grounded within the module 7 RSO No connection required 8 RX_LOS Loss of Signal indication Logic 0 indicates normal operation 9 RSI No connection required 10 VeeR Receiver Ground Common with Transmitter Ground 11 VeeR Receiver Ground Common with Transmitter Ground 12 RD Receiver Inverted DATA out AC Coupled 13 RD Receiver Non inverted DATA out AC Coupled 14 VeeR Receiver Ground Common with Transmitter Ground 15 VecR Receiver Power Supply 16 VecT Transmitter Power Supply Mellanox Technologies 45 Rev 1 5 Table 14 SFP Pinout Pin Symbol Name Description 17 VeeT Transmitter Ground Common with Receiver Ground 18 TD Transmitter Non Inverted DATA in AC Coupled 19 TD Transmitter Inverted DATA in AC Coupled 20 VeeT Transmitter Ground Common with Receiver Ground P Q Circuit ground is internally isolated from chassis ground Tpaurr is an open collector drain output which should be pulled up
14. s 2 4 8G Fibre Channel Active Cables Typ Power Passive Cables Input Voltage 100 240VAC 50 60Hz Max Power 114 81 W 111 58 W Max Power 93 39 W Typ Power 90 17 W Cabling Uplink CX4 Cable Downlink SFP Fibre Channel Temperature 0 to 55 Celsius Humidity 10 90 non condensing Regulatory Compliance Protocol Support 40 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Physical Power and Environmental InfiniBand Auto Negotiation of 40Gb s 20Gb Safety UL60950 s 10Gb s C UL to CAN CSA 22 2 Ethernet 10 Gig Ethernet No 60950 1 TUV GS to EN 60950 1 Fibre Channel 8G Fibre Channel Amendment A1 A4 A11 CB IEC60950 1 all coun QoS 8 InfiniBand Virtual Lanes for all try deviations ports Laser Class I IEC EN 60825 1 IEC EN Management Management is done through a CPU 60825 2 CDRH 21 Remotely CFR1040 EMC Emis sions CC 47CFR Part 15 Class A EN 55022 Class A ICES 003 Class A VCCI Class A ASINZS CISPR 22 Class A CISPR 22 Class A EN 55024 EN 300386 CE Environmental EU IEC 60068 2 64 Ran dom Vibration EU IEC 60068 2 29 Shocks Type I II EU IEC 60068 2 32 Fall Test Reliability Availability and Serviceability Scalability and Performance Features Switching Perfor Simultaneous wire speed any port to Hot Swappable Fan Module and Power manc
15. se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad 16 Interconexi n de unidades Los cables para la conexi n con las interfaces RS232 y Ethernet de la unidad deben estar homologados por UL tipo DP 1 o DP 2 Nota cuando residen en circuito no de tipo LPS Protecci n contra sobrecargas Al cableado del edificio se debe incorporar un disposi tivo de protecci n contra sobrecargas de circuito derivado de f cil acceso con una cor riente nominal de 20 A Mellanox Technologies 57 Rev 1 5 17 Exposici n a niveles de radiaci n peligrosos 18 Directiva sobre RAEE Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el ct ricos y electr nicos EEE se deben recolectar por separado y no se deben eliminar junto con residuos dom sticos Al deshacerse de este producto y de todas sus partes h galo de una manera responsable Precauci n el uso de controles o ajustes o la realizaci n de procedimientos distintos de los que aqu se especifican podr an causar exposici n a niveles de radiaci n peligrosos PRODUCTO L SER DE CLASE 1 y referencia a las normas de l ser m s recientes IEC 60825 1 2007 03 y EN 60825 1 2007 y respetuosa con el medio ambiente 58 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Appendix H SFP Modul
16. 29 Figure 14 Two Power Inlets Electric Caution Notifications 31 Figure 15 Power Supply Unit Extraction 32 Figure 16 Top and Bottom Ports 34 Figure 17 Fan Unit Pulled Out 34 Figure 18 CX4 Connector Pinout 44 Figure 19 SFP Connector Pinout Rear View of Module With Pin Placement 45 Figure 20 RJ45 Connector Pinout 47 Figure 21 Rear View of Module With Pin Placement 60 6 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Revision History Table 1 Revision History Table Date Revision Description Aug 2010 1 5 New power numbers to specs in Appendix Added Weight to specs in Appendix Fixed the description of the power cord in the Package contents section Jan 2010 1 4 Changed MT64102 to MT68102 Changed BX4010B to BX4010 Removed Licensing fro BXM Fixed misnaming of Fabric IT Oct 2009 1 3 6 Added Safety Warning for Laser Class 1 Sept 2009 1 3 5 Added Note To access this document please contact your local Mellanox rep resentative Sept 2009 1 3 4 Added Note to section 2 4 5 2 and 2 4 5 3 Sept 2009 1 3 3 Removed redundant section regarding Management and Software Sept 2009 1 3 2 Replaced references from SW UM to FabricIT BXM Sept 2009 1 3 1 Updated revision table July 2009 1 2 Implemented new template July 2009 1 1 Verified installation kit July 2009 1 0 Initial Release Mellanox Technologies 7
17. A low output indicates normal operation In the low state the output is pulled to lt 0 8V c Laser output disabled on TDIS gt 2 0V or open enabled on TDIS lt 0 8V d Should be pulled up with 4 7kQ 10kQ on host board to a voltage between 2 0V and 3 6V MOD_ABS pulls line low to indicate module is plugged in e LOS is open collector output Should be pulled up with 4 7kQ 10kQ on host board to a voltage between 2 0V and 3 6V Logic 0 indicates normal operation logic 1 indicates loss of signal H 5 Power Dissipation Max power dissipation 1 00 W Mellanox Technologies 61
18. Mellanox TECHNOLOGIES BridgeX BX4010 Gateway Platform IB to Ethernet Fibre Channel User Manual P N MTB4010B PC Rev 1 5 www mellanox com Rev 1 5 NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF
19. SUCH DAMAGE Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 PO Box 586 Hermon Building Sunnyvale CA 94085 Yokneam 20692 U S A Israel www mellanox com Tel 972 4 909 7200 Tel 408 970 3400 Fax 972 4 959 3245 Fax 408 970 3403 Copyright 2010 Mellanox Technologies All rights reserved Mellanox BridgeX ConnectX Virtual Protocol Interconnect InfiniBlast InfiniBridge InfiniHost InfiniRISC InfiniScale and InfiniPCI are registered trademarks of Mellanox Technologies Ltd CORE Direct FabricIT and PhyX are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners All other marks and names mentioned herein may be trademarks of their respective companies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual 2 Mellanox Technologies Document Number 3109 BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Table of Contents Table of Contents 3 List of Tables 5 List of Figures 6 Revision History 7 About this Manual 8 Intended Audience 8 Related Documentation 8 Conventions 8 Gateway Products Covered in this User Manual 9 Mellanox Part Numbering Legend 9 Chapter 1 Overview 10 1 1 Features 11 1 2 Serial Number and Product Version Information 13 1 3 Gateway Port Groups 13 Chapter 2 Installation and Basic Operation 14 2 1 Unpacking the Gateway 14 2 2 Bridge
20. X Gateway Platform Hardware Overview 14 2 2 1 Downlink Ports 14 2 2 2 Uplink Ports 15 2 2 3 Configuring the Port Gateway Groups 15 2 2 4 Making Connections to Other Formats 15 2 2 5 SFP Transceiver Module 15 2 2 6 Status LEDs 17 2 2 7 I2C Connector 20 2 2 8 Management Interfaces 20 2 3 Package Contents 21 2 4 Gateway Platform Installation and Operation 21 2 4 1 Installation Safety Warnings 22 2 4 2 Mechanical Installation 24 2 4 3 Grounding the Gateway 29 2 4 4 Disassembling the Gateway from the Rack 30 2 4 5 Power Connections and Initial Power On 30 2 4 6 Shut Down Procedure 31 2 4 7 Extracting and Inserting the Power Supply Unit 32 2 4 8 Cable Installation 33 2 4 9 Extracting and Inserting the Fan Unit 34 Chapter 3 Management and Software 36 3 1 FabricIT BKM Management 36 Chapter 4 Troubleshooting 37 Appendix A Specifications 39 Appendix B EMC Certification Statements 42 B 1 FCC Statements USA 42 Appendix C Interface Connector Pinouts 44 C 1 CX4Interface 44 C 2 SFP Interface 45 C 3 RS232 to RJ45 Connector Interface 47 Appendix D Replacement Parts Ordering Numbers 48 Mellanox Technologies 3 Rev 1 5 Appendix E Avertissements de s curit d installation French 49 Appendix F Installation Sicherheitshinweise German 52 Appendix G Advertencias de seguridad para la instalaci n Spanish 55 Appendix H SFP Modules 59 H 1 Product Features 59 H 2 Applications 59 H 3 Dimensions 59 H 4 Pin Descriptio
21. a Setup Showing a Port Group Uplink 19 20 21 i2 2 29 24 25 26 27 28 29 30 Sl e ee SL ES 6 BR DONS 5 DS DS ON ON ON DS ON ON EN EN EN coco SSE EEE ee Oe eee ea InfiniBand Switch 1 2 3 4 5 6 7 8 9 10 amp 12 18 44 15 16 17 18 Hybrid QSFP to CX4 cable Mellanox Technologies 13 Rev 1 5 Installation and Basic Operation 2 Installation and Basic Operation 2 1 Unpacking the Gateway Before you install your new BX4010 PC unpack the system and check to make sure that all the parts have been sent check this against the parts list Check the parts for visible damage that may have occurred during shipping If anything is damaged or missing contact your customer representative imme diately See the package contents in Section 2 3 2 2 BridgeX Gateway Platform Hardware Overview The figures below show dual hot swap power supplies and the hot swap fan module on the power side and and various status LEDs on the connector side All connectivity is via the connector panel All connectors can support active cables Figure 4 BX4010 Gateway System Power and Connector Panels Power Side Panel i Fan Unit iii 2 Power Supply Unit 1 90 264 V 2 47 63 Hz 47 63 Hz BA max 8A max Connector Side Panel A10 A12 B13 B11 zum A11 A13 B12 B10 12C RS232 1 GigE 2 2 1 Downlink Ports There are four downlink ports per gateway port group These ports have SFP connector
22. ateway into place and screw the bolts into the nuts from Step 7 11 Tighten the pan head screws to 9 2 Nm or 81 5 pound inches 12 Ground the gateway See Section 2 4 3 for details 13 Plug in the power cables There is no On Off switch on the gateway The gateway will come on when one plug is plugged in When the gateway is plugged in the status LED may be RED for up to three minutes until the system completes booting up 14 Check the Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation Warning Any yellow status LEDs is cause for concern and must be dealt with immediately 15 You can start connecting all of the cables to the gateway 2 4 3 Grounding the Gateway Make sure to connect the ground post to a valid electrical ground Use a grounding lug and a ground wire of sufficient capacity to safely convey a potential discharge A ground wire of AWG 6 or 4mm diameter is recommended for grounding this device The chassis is concurrently grounded through each of the PSUs Only connect the PSU cords to properly grounded outlets Do not rely on the PSU grounds It is absolutely necessary to physically ground the casing Make sure the con Mellanox Technologies 29 Rev 1 5 Installation and Basic Operation 2 4 4 2 4 5 30 nections are solid and permanent If you choose to make sure that the rack is properly grounded and that there is a valid ground connection between the chass
23. ck 24 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 The installer should use a rack capable of supporting the mechanical and environmental character istics of a fully populated platform The rack mounting holes conform to the EIA 310 standard for 19 inch racks Take pre cautions to guarantee proper ventilation for air intake at the front of the chassis and exhaust at the rear in order to maintain good airflow at ambient temperature Cable routing in particular should not impede the air exhaust from the chassis The gateway platform can be either front or rear mounted The notion of front and back is arbitrary This document uses the terms power side and connector side to reduce ambiguity 2 4 2 1 Minimum and Maximum Rack Depth for this Gateway This gateway can go into 19 racks whose vertical supports are between 550mm and 800mm apart 2 4 2 2 Installing the Gateway in the Rack Tools required and customer supplied parts Phillips Screwdrivers 1 and 2 e Grounding screw e ESD Strap e Grounding wire sufficient to reach a valid ground ESD mat Table 9 Installation Kit Parts 2 rails 1 right hand rail slide 1 left hand rail slide 16 recessed flat head screws 4 pan head screws 2 metal washers 4 sets of caged nuts and bolts for the mounting plates Note There may be more screws in the kit than are required for installing the gateway Me
24. ctioning port After plugging in a cable lock the connector using the latch ing mechanism particular to the cable vendor When a logical connection is made the yellow light will come on When data is being transferred the yellow light will blink Always install and remove cables by pushing or pulling the cable and connector in a straight line with the gateway To remove disengage the locks and slowly pull the connector away from the port receptacle Both LED indicators will turn off when the cable is unseated Care should be taken not to impede the air exhaust flow through the ventilation holes next to the ports Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack Cables especially long copper cables can weigh a substantial amount Make sure that the weight of the cable is supported on its own and not hanging from the gateway These gateways are able to support direct attached copper cables optical FC cables and cables with media adapters at various lengths and gauges Check www mellanox com gt Products gt Cables for cable recommendations regarding Mellanox approved cables and recommended maxi mum cable lengths Cables in the bottom row should be inserted up side down in relation to the how the cables are inserted in the top row Mellanox Technologies 33 Rev 1 5 Installation and Basic Operation Figure 16 Top and Bottom Por
25. der regionalen und nationalen elektrischen Bestimmungen installiert werden gt 11 Richtigen Schutz sicherstellen Geeigneter elekrischer mechanischer und Feuerschutz sind vom Hersteller des Endprodukts oder dem Endbenutzer bereitzustellen 12 Strahlenkontakt Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Proze duren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkontakt f hren Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards ICE 60 825 1 1993 A1 1997 A2 2001 und EN 60825 1 1994 A1 1996 A2 2001 13 UL und CSA Certified Netzkabel UL Listed and CSA Certified Power Supply Cord F r Nordamerika Stromanschluss w hlen Sie ein Netzkabel das UL und CSA Certi fied 3 Leiter 18 AWG mit einem angespritztem Stecker bewertet bei 125 V 15 mit einer Mindestl nge von 1 5 m Six Feet aber nicht mehr als 4 5 m gt F r die europ ischen Zusammenhang w hlen Sie ein Netzkabel das international harmonisiert und der Aufschrift lt HAR gt 3 Leiter mindestens 0 75 mm2 Draht bewertet mit 300 V mit einem PVC Mantel isoliert Das Kabel muss eine angespritztem Stecker bewertet bei 250 V 10 A Mellanox Technologies 53 Rev 1 5 14 Ableitstrom gt 3 5mA LEAKAGE gt 3 5mA WARNUNG Hohe Ableitstrom Earth Verbindung bevor Sie die Verbindung von wesentlicher Bedeutung werden gt 15 Add GND Verbindung Informa
26. e Figure 6 Module With Locking Mechanism Closed Mellano sr 850 nm NOLOGIES eN a MFM1TO2A S iin NT e rh Ne nie LUI in LR YSIA Class 1 21CFR1040 10 LN 50 7 01 MA Mellanox m NOLOGICS MTSFPP prisgsrioneci me Ph w AYSIA Clans Y 21CFR1040 10 LN S0 7 01 MADE IN MAL 3 Insert the module into the adapter card module cage 4 Close the locking Mechanism To remove the module from the cage 1 Unlock the locking mechanism by opening the handle 2 Pull the module out of the cage 16 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 2 2 6 Status LEDs Figure 8 Power and System LEDs DC output from the PSU is OK p Hd OK R There is a fault D gt D ve EE Input AC voltage is good Latch Mechanism Handle STATUS System Status Indicators Sys Fans Gateway Fan PSU 1 Status Indicators PSU 2 PSU Status Indicators 2 2 6 1 System Status Indicators The System Status Indicators are located next to the Ethernet ports The following status condi tions are possible Mellanox Technologies 17 Rev 1 5 Installation and Basic Operation Table 6 System Status LED Configurations LED Configuration Status O O OK The system is up and running Green on off the firmware did not BOOT properly In any case determine the problem and fix it off yellow on See Section 4
27. e any port 1 1 Redundant Supplies 48K Unicast Addresses Max per Power Supplies Addressing Subnet Bridging Capacity 16K Multicast Addresses per Subnet Mellanox Technologies 41 Rev 1 5 Appendix B EMC Certification Statements Table 12 lists the approved certification status per bridge in different regions of the world Table 12 Bridge Certification Status Bridge P N FCC Class EN Class ICES Class VCCI 8 USA Europe Canada Japan BX4010 series A A A A B 1 FCC Statements USA B 1 1 FCC Statements USA Class A Statements 8 15 19 a 4 This device complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 This device may not cause harmful interference and 2 This device must accept any interference received including interference that may cause undesired operation 15 21 Statement Warning Changes or modifications to this equipment not expressly approved by the party responsible for compliance Mellanox Technologies could void the user s authority to operate the equipment 815 105 a Statement NOTE This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial envi ronment This equipment generates uses and ca
28. e 3 Management and Software The BX4000 series gateway contains a management module that gives the user the ability to man age the gateway This management module runs Mellanox proprietary software For information regarding the software see the FabricIT BX Management Software CLI User s Manual To access this document download the User Manual from www mellanox com gt Products gt Gateway Software gt Software and Documentation Download You will need a valid Mellanox Gateway S N 3 1 FabriclT BXM Management FabricIT BXM is a software based management system that can be run with either a command line interface or with a GUI interface The GUI interface can be run through the Web The standard management module allows for managing the gateway using the Web interface or the command line interface and software supplied on the management chip See the FabricIT BXM Management Software CLI User s Manual for instructions and commands available 36 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 4 Troubleshooting As soon as a gateway is plugged in make sure that the green power LEDs on the PSU are on Power supply unit 1 Ifthe AC power LED is off check that the power cable is plugged into a working outlet Check that the power cable has a voltage within the range of 100 260 volts AC Remove and reinstall the power cable 3 Replace the PSU The Status green power
29. e 11 Which Side of the Rack Do You Want the Connectors The figure above shows the power side next to the door and the connector side away from the door This configuration has more room for the cables and a larger bending radius This configuration also allows you to put the power cord through the bracket The figure below shows the connector side next to the door and the power side away from the door This configuration may be necessary to conform to your rack config uration n 8000000000000000000000000000 3 If you are using the second option insert the power cable before screwing the bracket to the vertical support Note If you need room to bring the power cord from the other side of the rack recess the gate way and run the power cord through the bracket The installation kit can be reversed so that the bracket can be installed on either side of the gateway the power side or the connector side Mellanox Technologies 27 Rev 1 5 Installation and Basic Operation Figure 12 Making Room for the Power Cord Power cord 4 Take the 2 rail slides and screw them to the gateway with the notched side up Use eight of the flat head screws for each rail slide You can choose from two options for mounting the rail slide one option puts the end of the rail slide even with the end of the gateway and the second option recesses the gateway past the end of the rack First catch all of the
30. e debe tener un enchufe moldeado con capuch n de 250 voltios nominal 10 A ADVERTENCIA Alta corriente de fuga Es esencial efectuar la conexi n a tierra antes de conectar la alimentaci n 14 A adir conexi n a tierra Antes de conectar el dispositivo a la l nea de alimentaci n los tornillos del terminal de la puesta a tierra de protecci n del dispositivo se deben conectar a la puesta a tierra de protecci n de la instalaci n del edificio Informaci n de conexi n a tierra La instalaci n del edificio deber prover un medio para la conexi n con la puesta a tierra de protecci n y un t cnico de servicio deber conectar permanentemente el equipo a dicho medio de conexi n Un T CNICO DE SERVICIO comprobar si la toma el ctrica de la que se suminis trar corriente al equipo provee una conexi n con la puesta a tierra de protecci n del edificio De no ser as el T CNICO DE SERVICIO se encargar de instalar un CON DUCTOR DE CONEXI N A TIERRA DE PROTECCI N del terminal de puesta a tierra de protecci n separado al conductor de tierra de protecci n del edificio El equipo se instalar en un rea donde haya conexi n equipotencial como por ejemplo un centro de telecomunicaciones o una sala de computadoras dedicada 15 C digos de instalaci n Este dispositivo se debe instalar conforme a la versi n m s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo
31. e the power cord from the power supply unit 2 Grasping the handle with your right hand push the latch release with your thumb while pulling the handle outward As the PSU unseats the PSU status indicators will turn off 3 Remove the PSU 2 4 7 2 To insert a PSU 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles Do not attempt to insert the PSU with a power cord connected to it 32 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 2 Insert the PSU by sliding it into the opening until a slight resistance is felt 3 Continue pressing the PSU until it seats completely The latch will snap into place confirming proper installation Insert the power cord into the supply connector 5 Insert the other end of the power cord into an outlet of the correct voltage The green PSU indicator should light and the yellow indicator should remain off If not Repeat the procedure starting with Section 2 4 7 1 2 4 8 Cable Installation All cables can be inserted or removed with the unit powered on To insert a cable press the con nector into the port receptacle until the connector is firmly seated The indicator above of each CX4 ports or above each port will light green when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connec tor plugged into a fun
32. en instalar comenzando desde abajo hacia arriba gt 9 Instalaci n de equipos La instalaci n el reemplazo y el mantenimiento de este equipo estar n a cargo nicamente de personal capacitado y competente gt 10 Asegurar confinamientos adecuados El fabricante del producto final o el usuario final deber n suministrar un confinamiento adecuado para componentes el ctricos y mec nicos y contra incen dio 11 Eliminaci n de equipos La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales 12 C digos el ctricos locales y nacionales Este equipo se debe instalar conforme a los c digos el ctricos locales y nacionales gt 13 Cable de alimentaci n homologado por UL y con certificaci n CSA Fuga gt 3 5 mA 56 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 En conexiones de Am rica del Norte seleccionar un cable de alimentaci n homologado por UL y con certificaci n CSA de tres conductores 16 AWG termi nado en un enchufe moldeado con capuch n de 125 voltios nominal 13 A con una longitud minima de 1 5 metros pero no m s de 4 5 metros En conexiones europeas seleccionar un cable de alimentaci n armonizado internacionalmente y marcado lt HAR gt de tres conductores hilo de 1 0 mm2 como m nimo 300 voltios nominal con cobertura protectora aislante de PVC El cabl
33. eratura ambiente superior a la m xima recomendada 45 C Adem s para garantizar una circulaci n de aire adecuada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alre dedor de las aberturas de ventilaci n gt 4 Apilamiento del chasis Los chasis no se deben apilar sobre otros equipos La caida del chasis podr a causar lesiones corporales as como da os al equipo 5 Conexi n de fuente de alimentaci n redundante peligro de descarga el ctrica Este producto incluye una fuente de alimentaci n redundante o en su lugar una vac a Si se dispone de una fuente de alimentaci n vac a no utilizar el producto si su tapa est quitada o no est bien cerrada 6 Cuando hay rayos peligro de descarga el ctrica No utilizar el equipo ni conectar o desconectar cables durante per odos de activ idad de rayos Mellanox Technologies 55 Rev 1 5 7 Conexi n y desconexi n del cable Copper InfiniBand Dado que los cables de cobre InfiniBand son pesados y no son flexibles su con exi n a los conectores y su desconexi n se deben efectuar con mucho cuidado Para ver advertencias o instrucciones especiales consultar al fabricante del cable gt 8 Montaje y mantenimiento de bastidores Al instalar o realizar el mantenimiento de este aparato en un bastidor es preciso adoptar precauciones especiales para garantizar que el sistema se mantenga estable En general en un bastidor los equipos se deb
34. es H 1 Product Features e Hot pluggable SFP footprint e Maximum link length of 300m on 2000 MHZ km MMF Supports 9 95 to 10 3 Gb s bit rates Power dissipation lt 1W e Commercial temperature range 0 C to 70 C e US VIOLIN AWW OF OPOL MIDI SHLD TIBOO e Single 3 3 Vpower supply Uncooled 850nm VCSEL laser Receiver limiting electrical interface LOL OSONT OF CT ni zm Ti Pa os 25 a g 3 2760 1ON N S 2 90 Duplex LC connector vw Ni aav LL LE NI EDI e Built in digital diagnostic functions RoHS 6 compliant lead free e H 2 Applications 10GBASE SR SW 10G Ethernet H 3 Dimensions 56 50 gt 1480 13 60 E Mellanox Technologies DE MTSFPP SR Module 13 70 44 95 gt Mellanox Technologies 59 Rev 1 5 H 4 Pin Descriptions Figure 21 Rear View of Module With Pin Placement Top 13 70 8 50 ps il Cai ES n A a o 0 N o al gt w D H D a a o N E E E 3 T D Table 16 SFP Pinout Pin Symbol Name Description l VeeT Transmitter Ground Common with Receiver Ground 2 TX_Fault Transmitter Fault P 3 TX Disable Transmitter Disable Lase
35. iew 1 Overview The Mellanox BridgeX BX4010B gateway series is a 1U top of rack gateway that provides server VO consolidation over an InfiniBand network The product supports 10 20 40Gb s InfiniBand to 1GigE 10GigE Ethernet and 1 2 4 8G Fibre Channel bridging The device supports 1 10 Gigabit Ethernet to both 1GigE 10GigE Ethernet and 2 4 8G Fibre Channel bridging Ethernet over InfiniBand EolB and Fibre Channel over InfiniBand FColB protocols are used for I O consolidation on a single physical InfiniBand wire The BridgeX Gateway is a multi protocol bridge that enables InfiniBand connectivity to native Ethernet and or Fibre Channel networks The gateway implements stateless bridging protocols by encapsulating Ethernet over InfiniBand EolB and Fibre Channel over InfiniBand FCoIB acting as a packet relay based on read only context Bridging with the BX4010B requires the use of Mel lanox ConnectX adapters on the server to implement server side processing of EoIB and FCoIB protocols EoIB and FCoIB capable ConnectX adapters present standard Ethernet Sockets and Fibre Channel SCSI software interfaces to server applications providing transparent connectivity for existing Enterprise Data Center EDC and High Performance Computing HPC applications to Ethernet LAN and iSCSI or Fibre Channel SANs ConnectX adapters also present a standard InfiniBand Verbs software interface to server applications for Inter Process Communication IPC This
36. is of the gateway and the rack Test the ground using an Ohm meter Disassembling the Gateway from the Rack To disassemble the gateway from the rack Put on an ESD strap and connect to a valid ground Shut down the gateway using the procedure in Section 2 4 6 Unplug all power supplies Disconnect all cables Disconnect any grounds if hard wired ONY LE SR Unscrew three of the four screws connecting the gateway brackets to the rack Support the gateway while you unscrew the last screw The gateway will drop and could become damaged or it could damage other equipment in the rack While supporting the gateway unscrew the last screw 8 Slide the gateway out of the rails This is easier with two people Remove the rail slides from the other side of the rack Power Connections and Initial Power On The gateway platform ships with one Power Supply Unit A second PSU can be ordered for redun dancy Each supply has a separate AC receptacle The input voltage is auto adjusting for 100 240 VAC 50 60Hz power connections The power cords should be standard 3 wire AC power cords including a safety ground See Table 15 Replacement Parts Ordering Numbers for ordering the cables compatible with the electrical system of your country Caution The gateway platform will automatically power on when AC power is applied There is no power switch Check all boards power supplies and fan tray modules for proper insertion before plugging in
37. it Ethernet support IEEE 802 3z Gigabit Ethernet e IEEE 802 1D Spanning Tree IEEE 802 1p QoS COS e IEEE 802 1Q VLAN Tagging IEEE 802 1AB Link Layer Discovery IEEE 802 3ad Link Aggregation with LACP IEEE 802 3x Flow Control Per Priority Flow Control e Virtual lanes support e Jumbo Frames up to 9K support Connectors and Cabling e CX4 connectors for 10 20 40Gb s InfiniBand and 10GigE on the Uplink e CX4 to SFP Hybrid Cables e SFP connectors for downlink 10GigE and 2 4 8 FC ports e Optical transceiver modules for SR and LR for Ethernet Indicators Per port status LEDs Link Activity e System status LEDs system fans power supply Management Options e 1 1000BASE T Ethernet port Power Supply Dual redundant slots e 1 PSU is required for device functioning 12 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 1 2 Serial Number and Product Version Information The serial number and product version information are found on the label seen in the figure below The product version information tab location is on the power side of the gateway next to the right side PSU See Figure 4 on page 14 Figure 2 Generic Product Label P N MTB4010B PC G WUD MOMO AVA AU LUNA A GUID 0002C902002642 FC NEA INTENDA AON UNE IDA Made in IL MGT MAC 00 02 C9 02 3C A6 0 0 0 2 Cc 9 0 2 3 CA 6 1 3 Gateway Port Groups Figure 3 Example of
38. llanox Technologies 25 Rev 1 5 Installation and Basic Operation Figure 10 Installation Kit Parts Rail a g Rail slide gt silla Before you install your new gateway unpack the system and check to make sure that all the parts have been sent check this against the parts list Check the parts for visible damages that may have occurred during shipping If anything is damaged or missing contact your customer representative imme diately Procedure The following procedure can be done by one person but inserting the gateway is much easier with two people 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Decide on Placement of the Gateway within the Rack The gateway can be installed with either side even with the rack vertical support The distance between the rack and the door can be as little as 4 cm on one side of the rack and as much as 18 cm on the other side of the rack Keep in mind that there can be as many as10 cables connected to the gateway Do you want the connector side recessed in the rack to allow for a larger cable bending radius e Will the connector side be recessed past other equipment in the rack and will this be problem atic 26 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Figur
39. n radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense B 1 2 EN Statements Europe EN55022 Class A Statement 42 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Warning This is a class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures B 1 3 ICES Statements Canada Class A Statement This Class A digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la classe A est conforme la norme NMB 003 du Canada B 1 4 VCCI Statements Japan Class A Statement CORE FRAEREFER HER EHE MRS VCCI DEE CESTA A RME CT CORES RIERA CERT 5 CBR Hesse TL EN EURE ZLOSELKERETEYN ZNR ARS BEDPBKENSCECPHVET Translation This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this equipment is used in a domestic environment radio interference may occur in which case the user may be required to take corrective actions Mellanox Technologies 43 Rev 1 5 Appendix C Interface Co
40. nd secure The activity LED does not come on Check that the Subnet Manager has been started Mellanox Technologies 37 Rev 1 5 Troubleshooting The management module does not start 1 Check that the OpenSM has been started Power Cycle the Gateway If the Gateway is powered off for any reason without using the proper shut down procedure the Flash memory may be corrupted If the Flash memory is corrupted the Gateway may fail to boot If this happens talk to your Mellanox representative To run the gateway through a power cycle 1 Run config reload halt 2 Wait long enough to let the gateway halt and verify there is no ping to it 3 Unplug the power cord 4 Plug in the power cord Gateway Fails to Boot 1 Reburn the firmware to the Flash memory using the MFT tools 38 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Appendix A Specifications Table 10 MTB4010B NC Specification Data SerDes Speeds 10 20 40 Gb s per port Passive Cables Physical Power and Environmental Size 1 74 1U H x 19 W x 21 26 D Input Voltage 100 240 VAC 50 60Hz 44mm X 442mm X 540 mm Active Cables Weight 25lbs 11 3kg Max Power 114 81 W Mounting 19 Rack mount Typ Power 111 58 W Connectors and Max Power 93 39 W Cabling CX4 Cable Typ Power 90 17 W SFP Temperature 0 to 55 Celsius Port Types Cx4
41. nnector Pinouts C 1 CX4 Interface Figure 18 CX4 Connector Pinout G5 S10 S8 S12 S6 G7 G3 S14 S4 S16 S2 G9 G1 o SS S15 S1 G8 G2 13 3 S11 S5 G6 G4 S9 S7 44 Mellanox Technologies Table 13 InfiniBand 4X Connector Pinout Connector Connector IB Port A IB Port B Pin Number Pin Name Signal Name Signal Name S1 IBtxIp 0 Rx Al Rx BI S2 IBtxIn 0 Rx A0 Rx B0 S3 IBtxIp 1 Rx A3 Rx_B3 S4 IBtxIn 1 Rx_A2 Rx_B2 S5 IBtxIp 2 Rx AS Rx_B5 S6 IBtxIn 2 Rx A4 Rx B4 S7 IBtxIp 3 Rx_A7 Rx_B7 S8 IBtxIn 3 Rx A6 Rx_B6 S9 IBtxOn 3 Tx_ A6 Tx_B6 S10 IBtxOp 3 Tx_A7 Tx_B7 S11 IBtxOn 2 Tx_A4 Tx_B4 S12 IBtxOp 2 Tx AS Tx_B5 S13 IBtxOn 1 Tx _ A2 Tx_B2 S14 IBtxOp 1 Tx_A3 Tx_B3 S15 IBtxOn 0 Tx_A0 Tx_B0 S16 IBtxOp 0 Tx AI Tx BI G1 G6 G9 Signal Ground GND GND H1 H2 G7a Sense 3 3V SENSE PI SENSE_P2 G8 Vec MC POWER MC POWER _PI _P2 BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 C 2 SFP Interface Figure 19 SFP Connector Pinout Rear View of Module With Pin Placement a oc oc E A ro O E e A gt rt 2 2 g BF S D Eb b D GED D ZZ a 4 zZ N m x LO co N 00 o o vr y a 2 o 0 N
42. ns 60 H 5 PowerDissipation 61 4 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 List of Tables Table 1 Revision History Table 7 Table 2 Reference Documents 8 Table 3 Gateway Products Covered by this User s Manual 9 Table 4 Part Numbering Legend 9 Table 5 MTB 4010 Port Numbering 11 Table 6 System Status LED Configurations 18 Table 7 Fan Status LED Configurations 18 Table 8 PSU Status LED Configurations 19 Table 9 Installation Kit Parts 25 Table 10 MTB4010B NC Specification Data 39 Table 11 MTB4010B PC Specification Data 40 Table 12 Bridge Certification Status 42 Table 13 InfiniBand 4X Connector Pinout 44 Table 14 SFP Pinout 45 Table 15 Replacement Parts Ordering Numbers 48 Table 16 SFP Pinout 60 Mellanox Technologies 5 Rev 1 5 List of Figures Figure 1 BX4010 Gateway Port Groups Distinguished by Color 11 Figure 2 Generic Product Label 13 Figure 3 Example of a Setup Showing a Port Group 13 Figure 4 BX4010 Gateway System Power and Connector Panels 14 Figure 5 SFP Transceiver Module 15 Figure 6 Module With Locking Mechanism Closed 16 Figure 7 Module With Locking Mechanism Open 16 Figure 8 Power and System LEDs 17 Figure 9 BX4000 series Power Side Panel 20 Figure 10 Installation Kit Parts 26 Figure 11 Which Side of the Rack Do You Want the Connectors 27 Figure 12 Making Room for the Power Cord 28 Figure 13 Clipping in the Caged Nuts
43. ntation at www mellanox com gt Downloads gt Firmware Tools Conventions The terms uplink internal and downlink external are used throughout the document Uplink refers to the server switch facing ports where InfiniBand IB is used Downlink refers to the Local Area Network LAN or Storage Area Network SAN switch facing ports where Fibre Channel FC and or Ethernet EN are used Caution This symbol indicates the possibility of physical injury to the user or installer 8 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Gateway Products Covered in this User Manual Table 3 Gateway Products Covered by this User s Manual Family Product Number Description BridgeX EolB system single controller 2 CX4 uplink ports SRA Ne and 6 SFP downlink ports without CPU RoHS5 BridgeX Gateways BridgeX EoIB single controller 2 CX4 uplink ports and 8 MIRAE ES SFP downlink ports with CPU RoHS5 Mellanox Part Numbering Legend Table 4 Part Numbering Legend Place Field Decoder MT Mellanox Technologies B System Type BridgeX based Bridge System 4 Gateway protocols 4 VPI Uplinks 0 For future use 1 of BridgeX devices 1 1 BridgeX device 2 2 BridgeX device2 0 Separator P P Management PC N no management PC R RoHS C RoHS5 X RoHS6 Mellanox Technologies 9 Rev 1 5 Overv
44. ntir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation gt 3 Empilage du ch ssis Le ch ssis ne doit pas tre empil sur un autre mat riel Si le ch ssis tombe il peut pro voquer des blessures corporelles et des d gradations de biens 4 Connection d Alimentation electrique excedentaire dangers lectriques Ce produit comporte un couvercle transparent sur l espace pour l alimentation lec trique redondante Ne pas faire fonctionner le produit si le couvercle transparent n est pas solidement fix ou s il est enlev 5 Orages dangers lectriques Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d brancher les c bles gt 6 Branchement debranchement des c bles InfiniBand en cuivre Les c bles InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire tr s attention en les branchant et en les d branchant des connecteurs Consultez le fab ricant des c bles pour conna tre les mises en garde et les instructions sp ciales gt Mellanox Technologies 49 Rev 1 5 7 Montage et entretien sur baie Lorsque ce produit est mont ou entretenu sur baie il faut prendre des pr cautions sp ciales pour s assurer que le syst me reste stable En g n ral il faut remplir la baie avec du mat riel de bas en haut gt 8 Fuite gt 3 5mA Leakage gt 3 5mA
45. ossible Table 8 PSU Status LED Configurations LED Configuration Status O OK This power supply unit is delivering the correct DC supply Green on off Error This power supply unit is NOT deliver O O ing the correct DC supply off yellow on Off This power supply unit is NOT receiving O O any input power or this PSU is not installed off off Mellanox Technologies 19 Rev 1 5 Installation and Basic Operation 2 2 6 4 Power Supply Status Indicators The BX4000 series gateways are available with one or two factory installed Power Supply Units For gateways with only one unit installed a second Power Supply Unit can be added to increase power supply integrity through redundancy Figure 9 BX4000 series Power Side Panel Optional i Power Supply Unit 2 pan Unit en 1 90 264 V di 47 63 Hz i 8A max The primary power supply unit PSU1 is located on the right side of the power panel with PSU2 on the left side Each PSU has three status LEDs on the right side of the PSU that indicate the internal status of the unit AC This LED when lit indicates input voltage between 90 and 264 Volts A This LED when lit indicates a fault in the power supply OK This LED when lit indicates that the output from the power supply is 12VDC 2 2 7 1 C Connector There is an I2C connector located on the connector side panel This connector can be used to install firmware upgrades sh
46. ould the FW image be damaged and cannot be upgraded through a host PC or remotely This interface is for troubleshooting and debugging for FAEs and advanced users only 2 2 8 Management Interfaces The following interfaces allow access to the management module 2 2 8 1 RS232 RJ45 Connector This RS232 connection provides access for local management through connection to a host The BX series gateways can be connected to the RJ45 connector of a computer This connection is needed for the initial configuration of the gateway For the initial configuration procedure for the gateway see the Installation Guide 20 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 2 2 8 2 GigE Ethernet Connector The gateway has one Ethernet connector This Ethernet connection provides access for remote management The BX series gateways can be connected to a network through the RJ45 connectors Each Ethernet port gets connected to Ethernet switches These switches must be configured to 10 100M auto negotiation 2 3 Package Contents The package should include all of the following parts e BridgeX Gateway e Installation kit for 19 Rack mounting 1 power cable for each PSU 125V 10A 1 83M USA UL STANDARD Type B e RS232 RJ45 to DB9 2meter cable e Quick Start Guide 2 4 Gateway Platform Installation and Operation Installation and initialization of the gateway platform are straightforward
47. processes requiring attention to the normal mechanical power and thermal precautions for rack mounted equipment The gateway platform requires programming and configuration to operate as a gateway The gate way platform includes all of the necessary functionality to operate with external standard Subnet Management software This section describes the installation process and basic operation of the gateway platform Please first read the warnings sub section carefully before carrying on with installation procedures If the Gateway is powered off for any reason without using the proper shut down procedure the Flash memory may be corrupted If the Flash memory is corrupted the Gateway may fail to boot Caution The gateway platform will automatically power on when AC power is applied There is no power switch Check all boards power supplies and fan tray mod ules for proper insertion before plugging in a power cable Mellanox Technologies 21 Rev 1 5 Installation and Basic Operation 2 4 1 Installation Safety Warnings For Safety Warnings in French see Section E Avertissements de s curit d installation French on page 49 for German see Section F Installation Sicherheitshinweise German on page 52 and for Spanish see Section G Advertencias de seguridad para la instalaci n Spanish on page 35 1 Installation Instructions Read all installation instructions before connecting the equipmen
48. r output disabled on high or open 4 SDA 2 wire Serial Interface Data Line 5 SCL 2 wire Serial Interface Clock Line 4 6 MOD_ABS Module Absent Grounded within the module 7 RSO No connection required 8 RX_LOS Loss of Signal indication Logic 0 indicates normal operation 9 RSI No connection required 10 VeeR Receiver Ground Common with Transmitter Ground 11 VeeR Receiver Ground Common with Transmitter Ground 60 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Pin Symbol Name Description 12 RD Receiver Inverted DATA out AC Coupled 13 RD Receiver Non inverted DATA out AC Coupled 14 VeeR Receiver Ground Common with Transmitter Ground 15 VecR Receiver Power Supply 16 VecT Transmitter Power Supply 17 VeeT Transmitter Ground Common with Receiver Ground 18 TD Transmitter Non Inverted DATA in AC Coupled 19 TD Transmitter Inverted DATA in AC Coupled 20 VeeT Transmitter Ground Common with Receiver Ground Circuit ground is internally isolated from chassis ground b TrauLr is an open collector drain output which should be pulled up with a 4 7k 10k Ohms resistor on the host board if intended for use Pull up voltage should be between 2 0V to Vcc 0 3V A high output indicates a transmitter fault caused by either the TX bias current or the TX output power exceed ing the preset alarm thresholds
49. s that sup port both direct attach copper cables and optical cables by using SR or LR modules The gateways with single controllers have eight downlink ports while gateways with dual controllers have 16 downlink ports The downlink ports are labelled alpha numerically and the diagrams in this man 14 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 ual are color coded to their corresponding uplink ports The downlink ports within a gateway group must all have the same protocol that is either Ethernet of Fibre Channel Different gateway groups can have different protocols When configured for Ethernet only 3 of the 4 downlink ports per gateway group are used and all downlink ports within the gateway group must have the same speed that is 1Gbps or 10Gbps See Figure 1 on page 11 for the port numbers of the active Ethernet ports When configured for Fibre Channel all four downlink ports per gateway group can be used and each port can independently auto negotiate its speed to 2Gbps 4Gbps or 8Gbps FC To operate a port at 1Gbps FC it needs to be manually configured 2 2 2 Uplink Ports There is one uplink port per gateway port group These ports have CX4 connectors These connec tors have support for powered cables and media adapter circuits The uplink ports are labelled alpha numerically and also the diagrams in this manual are color coded to their corresponding downlink ports 2 2 3
50. screws in the rail slide and then tighten all of the screws together to 3Nm or 26 5 pound inches This side of the Catch the gateway will be threads on all even with the 8 screws vertical rack sup before you port The other attempt to side of the gate tighten any of way will be them deeper inside of the rack than this side Notch side up Note The rail slides are right and left handed If you have the wrong rail slide the holes will not align properly with the holes in the gateway 5 Clip 4 caged nuts into the holes in the rack you will be using to connect the rail slides Check that both sides ofthe gateway left and right are the same level in the rack 28 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Figure 13 Clipping in the Caged Nuts es SN 20 The caged nuts are separated by 3 a single space i 6 Using two of the pan head screws and one washer for each rail install the rails to the end of the rack Place the rail behind the holes in the rack and screw the screws through the holes into the rails Do not tighten the screws just yet 7 Place the bolts for the caged nuts in a convenient location so as to be easily accessible when you install the gateway into the rails 8 Slide the gateway into the rails This is easier with two people 9 Make sure the gateway will be level after installation 10 Put the g
51. t to the power source gt 2 Over temperature This equipment should not be operated in an area with an ambient temperature exceeding the maximum recommended 55 C 131 F Moreover to guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings 3 Stacking the Chassis The chassis should not be stacked on any other equipment If the chassis falls it can cause bodily injury and equipment damage 4 Redundant Power Supply Connection Electrical Hazard This product includes a blank cover over the space for the redundant power sup ply Do not operate the product if the blank cover is not securely fastened or if it is removed gt 5 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or disconnect cables gt 6 Copper InfiniBand Cable Connecting Disconnecting Copper InfiniBand cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the cable manu facturer for special warnings and instructions gt 22 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 7 Rack Mounting and Servicing When this product is mounted or serviced in a rack special precautions must be taken to ensure that the system remains stable In general you should fill the rack with equipment starting from
52. ter Stromversorgungsanschluss Elektrische Gefahr Dieses Produkt verf gt ber eine Abdeckung ber dem Bereich f r die redundante Stromversorgung Betreiben Sie das Produkt nicht wenn diese Abdeckung nicht sicher festsitzt oder entfernt wurde gt 5 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab gt 6 Anschlie en Trennen von InfiniBand Kupferkabel InfiniBand Kupferkabel sind schwer und nicht flexible Deshalb m ssen sie vorsichtig an die Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnungen und Anleitungen des Kabelherstellers 7 Rack Montage und Wartung Wenn dieses Produkt in einem Rack montiert oder gewartet wird sind besondere Vor sichtsma nahmen zu ergreifen um die Stabilit t des Systems zu gew hrleisten Im Allgemeinen sollten Sie das Gestell von unten nach oben mit Ger ten f llen gt 52 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 8 Ger teinstallation Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausge tauscht oder gewartet werden gt 9 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen gt 10 Regionale und nationale elektrische Bestimmungen Dieses Ger t sollte unter Beachtung
53. the bottom to the top gt 8 Leakage gt 3 5mA WARNING High leakage current Earth connection essential before connecting sup ply gt 9 Add GND Connection Before connecting this device to the power line the protective earth terminal screws of this device must be connected to the protective earth in the building installation gt 10 Installation Codes This device must be installed according to the latest version of the country national electrical codes For North America equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electri cal Code gt 11 Interconnection of Units Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL certified type DP 1 or DP 2 Note when residing in non LPS circuit Overcurrent Protection A readily accessible Listed branch circuit overcurrent protec tive device rated 20 A must be incorporated in the building wiring gt 12 Equipment Installation This equipment should be installed replaced or serviced only by trained and qualified personnel gt 13 Equipment Disposal Disposal of this equipment should be in accordance to all national laws and reg ulations gt Mellanox Technologies 23 Rev 1 5 Installation and Basic Operation 14 Local and National Electrical Codes This equipment should be installed in compliance with local and national elec
54. tionen Add GND connection information Bevor Sie dieses Ger t an das Stromnetz die Schutzerde Terminal Schrauben dieses Ger t muss an den Schutzleiter in der Geb udeinstallation gt 16 INSTALLATION CODES INSTALLATION CODES Dieses Ger t muss installiert sein entsprechend auf die neueste Version des Landes National Electrical Code F r Nordamerika m ssen in bereinstimmung mit den geltenden Vorschriften in der US amerikanischen National Electrical Code und dem Canadian Electrical Code gt 17 Zusammenschaltung von EINHEITEN INTERCONNECTION OF UNITS Kabel f r den Anschluss an das Ger t RS232 und Ethernet Schnittstellen m ssen UL zertifiziert Typ DP 1 oder DP 2 Hinweis wenn nicht mit Wohnsitz in LPS Schal tung gt berstromschutz Eine leicht zug ngliche Auflistung Abzweigleitung berstrom Schutzeinrichtung 20 A bewertet werden m ssen in dem Geb ude Verkabelung 54 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 Appendix G Advertencias de seguridad para la instalaci n Spanish 1 Instrucciones de instalaci n Antes de conectar el equipo a la fuente de alimentaci n leer todas las instruc ciones de instalaci n gt 2 Instalaci n en un lugar con acceso restringido Esta unidad ha sido ideada para instalar en lugares de acceso restringido gt 3 Sobrecalentamiento No se debe utilizar el equipo en un rea con una temp
55. trical codes 15 Hazardous Radiation Exposure Caution Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 2001 16 UL Approved AC Power Cords For North American power connection select a power supply cord that is UL Listed and CSA Certified 3 conductor 18 AWG terminated in a molded on plug cap rated at 125 V 15 A with a minimum length of 1 5m six feet but no longer than 4 5m For European connection select a power supply cord that is internationally harmonized and marked lt HAR gt 3 conductor minimum 0 75 mm wire rated at 300 V with a PVC insulated jacket The cord must have a molded on plug cap rated 250 V 10 A 17 WEEE Directive According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly i way 2 4 2 Mechanical Installation The gateway platform can be rack mounted for installation in a standard 19 rack Front and back are arbitrary the rack kit can be mounted so that one side is even with the vertical rack support and the other side is recessed into the ra
56. ts 2 4 9 Extracting and Inserting the Fan Unit Operation without a fan unit should not exceed one minute During fan hot swap if the LED indicators are OFF then the fan unit is dis connected The hot swap fan module provides power side to connector side air flow The gateway can run on three of the four fans at an ambient temperature of 45 C or less indefi nitely To extract a Fan Unit Figure 17 Fan Unit Pulled Out Power Side Fan Unit 1 Loosen the two thumb screws locking the fan tray in place One of the fan status indicators either green or yellow will remain on 2 Pull the fan unit out by pulling on the thumbscrews As the fan unseats the fan status indicator will turn off To insert a FAN Unit 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles 34 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 2 Insert the fan unit by sliding it into the opening until slight resistance is felt Continue pressing the fan unit until it seats completely The green fan status indicator should light If not extract the fan unit and rein sert it After two unsuccessful attempts to install the fan unit power off the gateway before attempting any system debug 3 Turn the two thumb screws to lock the fan unit in place Mellanox Technologies 35 Rev 1 5 Management and Softwar
57. uniquement qu un module ensure a powered down state frei zu machen sind die Alimentation Stabilise e inside of the gateway platform Netzstecker aller Netzteile Pour isoler completement le zu entfernen module en cause Il faut de brancher toutes les ali mentations stabilise es 2 4 6 Shut Down Procedure If the Gateway is powered off for any reason without using the proper shut down procedure the Flash memory may be corrupted If the Flash memory is corrupted the Gateway may fail to boot Should this happen call your Mellanox representative for assistance To run the gateway through a power cycle l Run config reload halt 2 Wait long enough to let the gateway halt and verify there is no ping to it 3 Unplug the power cord Mellanox Technologies 31 Rev 1 5 Installation and Basic Operation Should the gateway fail to boot upon reinsertion of the power cord burn the latest FW image to the Flash memory 2 4 7 Extracting and Inserting the Power Supply Unit With both power supplies installed in the redundant configuration either PSU may be extracted without bringing down the system Make sure that the PSU that you are NOT replacing is showing all green for both the PSU and status indicators If your system does not have a redundant power supply you must bring down the system before you replace the PSU 2 4 7 1 To extract a PSU Figure 15 Power Supply Unit Extraction Remov
58. with a 4 7k 10k Ohms resistor on the host board if intended for use Pull up voltage should be between 2 0V to Vcc 0 3V A high output indicates a transmitter fault caused by either the TX bias cur rent or the TX output power exceeding the preset alarm thresholds A low output indicates normal operation In the low state the output is pulled to lt 0 8V Laser output disabled on TDIS gt 2 0V or open enabled on TDIS lt 0 8V Should be pulled up with 4 7kQ 10kQ on host board to a voltage between 2 0V and 3 6V MOD ABS pulls line low to indicate module is plugged in LOS is open collector output Should be pulled up with 4 7kQ 10kQ on host board to a voltage between 2 0V and 3 6V Logic 0 indicates normal operation logic 1 indicates loss of signal 46 Mellanox Technologies BridgeX Series Gateway Platform IB to Ethernet Fibre Channel User Manual Rev 1 5 C 3 RS232 to RJ45 Connector Interface Figure 20 RJ45 Connector Pinout m DSR Data Set Ready Ring indicator 1 Data Carrier Detect 2 DTR Data Terminal Ready 3 m Signal Ground 4 _ 5 6 __ RXDReceive Data 7 TXD Transmit Data 8 CTS Clear to Send RTS Request to Send Mellanox Technologies 47 Rev 1 5 Appendix D Replacement Parts Ordering Numbers 48 Mellanox Technologies Table 15 Replacement Parts Ordering Numbers
Download Pdf Manuals
Related Search