Dell 0J05YT Network Card User Manual
Contents
1. 23 Chapter 4 Driver Software and Firmware 24 4 1 Driver Software Sea s tale daw wee da dat thd ve das Dre da Bra ie 24 JM ECCE 24 412 Windows wen en mH AU BAS TAGE Ae Ba a is UESTRE 25 4 2 BlexBoot iaa UE hs he ON e AG e RUE EE d RR ARAS 26 4 3 Updating Mezzanine Card Firmware 26 Appendix Specifications 29 AppendixB Avertissements de s curit d installation 31 AppendixC Installation Sicherheitshinweise German 32 AppendixD Advertencias de seguridad para la instalaci n Warnings in Spanish 33 Mellanox Technologies 3 Rev 1 0 List of Tables Table 1 Revision History Table 6 Table2 Documents Lista t ee Baia ne ae et Rn T Table3 3 Mezzanine Card Details 9 Table4 Jumper Configuration 13 Table5 0 05 VPD Layout 13 Tablei6 0K6V3V VPD LEayQ t peres an as Ae X en eben 15 Table 7 Jumper Configuration 18 Table 8 Conn2. Mellanox Technologies 7 1 0 8 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 1 Overview This document is a User Manual for the Mellanox Technologies ConnectX 3 40Gb s and 56Gb s InfiniBand dual port mezzanine cards for the Dell Blade Servers The cards described in this manual have the following main features InfiniBand Architecture Specifications v1 2 1 compliant PCI Express 3 0 1 1 and 2 0 compatible through an x8 connector up to 8GT s lus MPI ping latency Up to 56Gb s InfiniBand per port CPU off load of transport operations Application Offload End to end QoS and congestion control Hardware based I O virtualization TCP UDP IP stateless offload RoHS R6 compliant 1 4 Cards Covered in this Manual Table 3 ConnectX 3 Mezzanine Card Details Ordering Part PCI Express SERDES InfiniBand Data Number OPN Speed Transmission Rate RoHS 0 05 PCIe 3 0 x8 8GT s InfiniBand 40Gb s QDR R 6 MT27508A1 FCCR QV 0K6V3V PCIe 3 0 x8 8GT s InfiniBand 56Gb s FDR R 6 MT27508A1 FCCR FV 1 2 Finding the GUID MAC and Serial Number on the Mezzanine Cards All cards include a label that has the card serial number and the card GUID for InfiniBand protocol on the print side of the card Mellanox Technologies 9 J Rev 1 0 Overview Figure 1 0J05YT Label
3. and focus on the Physical state attributes Example gt Host ibstat LCA mlx4 0 CA type MT4099 Number of ports 2 Firmware version 2 10 2000 Hardware version 0 Node GUID 0x0002c903002fefe0 System image GUID 0x0002c903002fefe3 State Active Physical state LinkUp Rate 56 Base lid 4 LMC 0 SM cla 12 Capability mask 0x02514868 Port GUID 0x0002c903002fefel Link layer InfiniBand Pose 28 State Active Physical state LinkUp 24 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Rate 56 Base lid 8 LMC 0 SM lics 12 Capability mask 0 02514868 Port GUID 0x0002c903002fefe2 Link layer InfiniBand Check the OFED version To get the version of the running Mellanox OFED BXOFED run the following command ofed info head 1 OID 1 So 225050 OE IL 552 2012 549 B KS NX OFED LINUX 1 5 3 0 1 6 OFED 1 5 3 0 1 6 Troubleshooting MLNX_OFED Installation For troubleshooting driver installation please check Mellanox OFED driver user manual ar http www mellanox com gt Support gt InfiniBand Products gt Mellanox OFED 4 1 2 Windows For Windows download and install the latest Mellanox WinOF VPI for Windows software pack age available via the Mellanox web site at http www mellanox com gt Products gt Software Drivers gt Infiniband amp VPI Software Driver
4. IL 0J05YT 74031 17 0001 00 Made in Israel DP N 0205 Figure 2 Board Label P N OJOSYT GUID 0002C903002EABFO UNI REV A1 INI MAC 0002C92EABF1 Model CX380A Figure 3 OK6V3V Label IL OK6V3V 74031 17R 0001 X00 Made in Israel DP N OK6V3V Figure 4 Board Label P N OK6V3V REV A1 GUID 0002C903002EA830 IL MAC 0002C92EA831 Model No CX380A 10 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 2 Card Interfaces 2 1 Interfaces Each mezzanine card includes the following interfaces PCI Express PCIe PC compatible connector for debug Figure 5 0J05YT 0K6V3V Card PCBUOU376 cm DP N OK6V3V Made in Israel 88 lt a CRI PEZ 2 1 4 InfiniBand Interface The ConnectX 3 mezzanine cards are compliant with the InfiniBand Architecture Specification Release 1 2 1 It has two compliant InfiniBand ports with four Tx Rx pairs of SerDes Mellanox Technologies 11 J Rev 1 0 Card Interfaces 2 1 2 PCI Express Interface The ConnectX 3 mezzanine cards support PCI Express 3 0 1 1 and 2 0 compatible The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations 2 1 3 lC compatible Interface A three pin header on the mezzanine cards is provided a
5. MMYMDSSSS 79 VPD Keyword vo STR Misc Information 81 Length 0x11 82 Data VPIFDR SFF STR_SPC mezz 99 VPD Keyword RV STR 101 Length 0 1 102 Data 0 101 CS0 103 Large Resource Type VPD W 0x91 Tag 0x11 104 Length 7 0 LSB 0x95 105 Length 15 8 MSB OxF 106 VPD Keyword VI STR EFI Driver version 108 Length 0x6 109 Data N A STR SPC 115 VPD Keyword YA STR Asset Tag 117 Length 0x18 118 Data N A STR_SPC N A 142 VPD Keyword RW STR Remaining read write area 144 Length Ox6f 145 Data STR_ZERO Reserved 0x00 256 VPD Keyword RW STR Remaining read write area 258 Length Oxfd 259 Data STR_ZERO Reserved 0x00 512 VPD Keyword RW STR Remaining read write area 514 Length Oxfd 515 Data STR_ZERO Reserved 0x00 768 VPD Keyword RW STR Remaining read write area 770 Length Oxfd 771 Data STR_ZERO Reserved 0x00 024 VPD Keyword RW STR Remaining read write area 026 Length Oxfd 027 Data STR_ZERO Reserved 0x00 280 VPD Keyword RW STR Remaining read write area 282 Length Oxfd 283 Data STR_ZERO Reserved 0x00 536 VPD Keyword RW STR Remaining read write area 538 Length Oxfd 539 Data STR_ZERO Reserved 0x00 792 VPD Keyword RW STR Remaining read write area 16 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Table 6 OK6V3V VPD Layout a Item Value Format Description 1794 Length Oxfd 17
6. Mechanical Drawing of 0J05YT OK6V3V Mezzanine Card q 23 92 i 64 08 72 36 78 91 57 08 Mellanox Technologies 29 Rev 1 0 A2 Specifications Table 8 ConnectX 3 0J05YT 0K6V3V Specifications Table Physical Size 3 11in x3 46 in 78 91mm X 88mm InfiniBand IBTA v1 2 1 QDR 10Gb s per lane or FDR 14 0625Gb s per lane port Protocol Support Data Rate Up to 56Gb s FDR InfiniBand PCI Express Gen3 3 0 SERDES 8 0 GT s 1 1 and 2 0 compatible Voltage 12V 3 3V 3 3 VAUX 0J05YT Typ Power 5 75W Max Power 7 56W Power and 0K6V3V Typ Power 8 84W Environmental Max Power 9 02W Temperature 0 C to 55 C Air Flow 200LFM EMC Refer to the following link www mellanox com related docs user manuals Regulatory and Compliance Guide pdf Safety IEC EN 60950 1 2006 Regulatory ETSI EN 300 019 2 2 IEC 60068 2 64 29 32 RoHS RoHS R6 Cable Support Please refer to Mellanox Products Approved Cable Lists at www mellanox com related docs user_manuals Mellanox_approved_cables pdf a Air flow is measured 1 from the heat sink between the heat sink and the cooling air inlet 30 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Appendix B Avertissements de s curit d installation French 1 Instructions d installation Lisez toutes les instructions d installa
7. This equipment should not be operated in an area with an ambient temperature exceeding the maximum recommended C F To guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings 3 Lightening Electrical Hazard 4 Installation of Equipment During periods of lightning activity do not work on the equipment This equipment should be installed replaced or serviced only by trained and qualified person nel 5 Disposal of Equipment Disposal of this equipment should be in accordance to all national laws and regulations 6 Compliance with Local and National Codes This equipment should be installed in compliance with local and national electrical codes Mellanox Technologies 23 J Rev 1 0 Driver Software and Firmware 4 4 1 Driver Software 4 1 1 Linux Driver Software and Firmware For Linux download and install the latest OpenFabrics Enterprise Distribution OFED software package available via the Mellanox web site at http www mellanox com gt Products gt Soft ware Drivers gt Infiniband amp VPI Software Drivers gt Mellanox OFED gt Download Follow the installation instructions included in the download package also available from the download page To ensure that communication has been established follow the instructions below Check the link status To check the IB link status for IB cards run ibstat
8. 15 b Enter your card PSID to display the latest firmware Mellanox Technologies 27 Rev 1 0 Driver Software and Firmware Figure 15 Support Download Assistant Mellanox TECHNOLOGIES Mellanox Support Download Assistant Support Index Documentation Login Customer Support Returns Home CLEAR MT 1020110019 PSID or OPN Identifying Adapter Cards PSID Browse for Product Support START OVER Select a Family Select a Line Select an OPN Select a PSID Rev Product Support Information Adapter Cards Select Switches Gateways 3 Ifa newer firmware version exists for your mezzanine card update the firmware as follows a Download the firmware image zip file from the Download Center see Step 2a above b Unzip the firmware image c Burn the firmware image Enter gt flint d dev mst mt4099 pci cr0 i binary image burn d Reboot the computer e Enter mst start f Verify that the card firmware was updated successfully gt flint d dev mst mt4099 pci cr0 Image type ConnectX FW Version 28 410 Device ID 4099 28 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Appendix A Specifications A 1 Board Mechanical Drawing and Dimensions The ConnectX 3 mezzanine card mechanical drawing is depicted in Figure 16 All dimensions are in millimeters All the mechanical tolerances are 0 1mm Figure 16
9. 95 Data STR_ZERO Reserved 0x00 2048 VPD Keyword RW STR Remaining read write area 2050 Length Oxfd 2051 Data STR_ZERO Reserved 0x00 2304 VPD Keyword RW STR Remaining read write area 2306 Length Oxfd 2307 Data STR_ZERO Reserved 0x00 2560 VPD Keyword RW STR Remaining read write area 2562 Length Oxfd 2563 Data STR_ZERO Reserved 0x00 2816 VPD Keyword RW STR Remaining read write area 2818 Length Oxfd 2819 Data STR_ZERO Reserved 0x00 3072 VPD Keyword RW STR Remaining read write area 3074 Length Oxfd 3075 Data STR_ZERO Reserved 0x00 3328 VPD Keyword RW STR Remaining read write area 3330 Length Oxfd 3331 Data STR_ZERO Reserved 0x00 3584 VPD Keyword RW STR Remaining read write area 3586 Length Oxfd 3587 Data STR_ZERO Reserved 0x00 3840 VPD Keyword RW STR Remaining read write area 3842 Length 0 3843 Data STR_ZERO Reserved 0x00 4095 Small Resource Type END 0x78 Tag 0x11 Mellanox Technologies 17 Rev 1 0 Card Installation 3 Installation 3 1 Hardware RequirementsTBD Before installing the mezzanine card make sure that the system meets the hardware and software requirements listed in Table 7 Jumper Configuration Requirement Description Hardware Used with Dell Blade Servers Software Operating Sys Refer to the Dell Blade Servers Manuals tems Distributions 3 2 Installation Kit Make sure all of the parts are in the kit before you start the installat
10. AM Mellanox TECHNOLOGIES Dell and the Dell logo are trademarks of Dell Inc ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual 0J05YT OK6V3V Rev 1 0 www mellanox com NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PRO VIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUS TOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CAN NOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MER CHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEM PLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCURE MENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RE
11. Asset Tag 121 Length 0x18 122 Data N A STR_SPC N A 146 VPD Keyword RW STR Remaining read write area 148 Length 0x6b 149 Data STR_ZERO Reserved 0x00 256 VPD Keyword RW STR Remaining read write area 258 Length Oxfd 259 Data STR_ZERO Reserved 0x00 512 VPD Keyword RW STR Remaining read write area 514 Length Oxfd 515 Data STR_ZERO Reserved 0x00 768 VPD Keyword RW STR Remaining read write area 770 Length Oxfd 771 Data STR_ZERO Reserved 0x00 024 VPD Keyword RW STR Remaining read write area 026 Length Oxfd 027 Data STR_ZERO Reserved 0x00 280 VPD Keyword RW STR Remaining read write area 282 Length Oxfd 283 Data STR_ZERO Reserved 0x00 536 VPD Keyword RW STR Remaining read write area 538 Length Oxfd 539 Data STR_ZERO Reserved 0x00 792 VPD Keyword RW STR Remaining read write area 794 Length Oxfd 795 Data STR_ZERO Reserved 0x00 2048 VPD Keyword RW STR Remaining read write area 14 Mellanox Technologies Table 5 0J05YT VPD Layout ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 ae Item Value Format Description 2050 Length Oxfd 2051 Data STR_ZERO Reserved 0x00 2304 VPD Keyword RW STR Remaining read write area 2306 Length Oxfd 2307 Data STR_ZERO Reserved 0x00 2560 VPD Keyword RW STR Remaining read write area 2562 Length Oxfd 2563 Data STR_ZERO Reser
12. D and FRU The PCI VPD Vital Product Data layout for each of the mezzanine cards com plies with the format defined in the PCI 3 0 Specification Appendix I Table 5 0J05YT VPD Layout Value Format Description 0 Large Resource Type ID 0x82 String Tag 0x02 1 Length 7 0 LSB 0x14 2 Length 15 8 MSB 0x0 3 Data DELL ConnectX 3 STR Mezz 23 Large Resource Type VPD R 0x90 Tag 0x10 24 Length 7 0 LSB 0x51 25 Length 15 8 MSB 0x00 26 VPD Keyword PN STR Add in Card Part Number 28 Length 0x15 29 Part Number PN STR_SPC 50 VPD Keyword EC STR Engineering Change Level of the card rev 52 Length 0x3 53 Revision RV STR PCB revision 56 VPD Keyword SN STR Serial Number 58 Length 0x14 Mellanox Technologies 13 J Rev 1 0 Card Interfaces Table 5 0J05YT VPD Layout a Item Value Format Description 59 SerialNumber O00J05YTMMM STR_SPC 00 00X XXX XX MMYMDSSSS 79 VPD Keyword vo STR Misc Information 81 Length 0 15 82 Data VPI QDR SFF STR_SPC mezz 103 VPD Keyword RV STR 105 Length 0 1 106 Data 0 105 50 107 Large Resource VPD W 0x91 Tag 0x11 108 Length 7 0 LSB 0x91 109 Length 15 8 MSB OxF 110 VPD Keyword VI STR EFI Driver version 112 Length 0x6 113 Data N A STR_SPC 119 VPD Keyword YA STR
13. LATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 PO Box 586 Hermon Building Sunnyvale CA 94085 Yokneam 20692 U S A Israel www mellanox com Tel 972 4 909 7200 Tel 408 970 3400 Fax 972 4 959 3245 Fax 408 970 3403 Copyright 2012 Mellanox Technologies All rights reserved Mellanox BridgeX ConnectX InfiniBlast InfiniBridge InfiniHost InfiniRISC InfiniScale InfiniPCI PhyX Direct Virtual Protocol Interconnect Voltaire and SwitchX are registered trademarks of Mellanox Technologies Ltd FabricIT MLNX OSTM and Unbreakable Link are trademarks of Mellanox Technologies Ltd All other marks and names mentioned herein may be trademarks of their respective companies 2 Mellanox Technologies Document Number 3526 ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Table of Contents Table Of Contents 0 ae detente Tente en ey we sev ee Listof Tables 4 eee etre Rennes ad List of F1gures ana eI T IVA Revision History edo Se ss ee ee e web ed ore ubi ede a About this Manual is 2 0 disc dise es ehe severe n ti e vpn n Serene dye die e nal Tritended Audience A as ce etre 7 Related Documentation eer EUER ERAT E
14. R AW NATU dre vds 7 Online Resources s licec See REPRE re Ou ERG UE ENG EHE BIE 7 Doc tnent Conventions iai IAN had ER eq a EE Re nel aud 7 Chapter 1 Overview e ley et He Oa erae ee drone re re ee D 1 1 Cards Covered in this Manual 9 12 Finding the GUID MAC and Serial Number on the Mezzanine Cards 9 Ch pter 2 Card Interfaces cce terre t eee 21 2 17 Odnterfaces ehh oh oe cA TAN iA GN nie ll A Ad Ae 11 21 4 InfiniBand Interface eR RE a ha 11 2 1 2 PCL Express Interfaces ar seat pay hay ceded cee ay edd bee 12 2 1 3 I2C compatible Interface cities ERE IA RE RR ERE RAS 12 2 21 LONA S does des EM DA AN Cecil O e eel ed AM o 12 2 3 5 x A aed AES Aveo ADU Ton A ABRE ERE aie de ees 12 System Memory de a EAR NEL ans Mes 12 LID SPI hus EA EA RR A E PANI 12 23 3 S ee ees Ple duse an O 13 Chapter3 Card Installation 18 34L Hardware Requirements dur ss astres ve cases at se Set Vp ede TBD 18 3 2 Installation Kit use erre a ts ee Se bide RAT NES 18 3 3 Safety Warnings
15. e command line gt sc start opensm 4 2 FlexBoot FlexBoot enables remote boot over Boot over InfiniBand BoIB or Boot over iSCSI Bo iSCSI This technology is based on the Preboot Execution Environment PXE standard specification and FlexBoot software is based on the open source EtherBoot gPXE project see www etherboot org For more information go to http www mellanox com gt Products gt InfiniBand amp VPI Soft ware Drivers gt FlexBoot gt User s Manual 4 3 Updating Mezzanine Card Firmware Each card is shipped with the latest version of qualified firmware at the time of manufacturing Firmware is updated occasionally and the most recent firmware can be obtained from http www mellanox com gt Support gt Download Firmware Check that the firmware on your card is the latest found on the Mellanox site if not update to the latest version found on the Mella nox web site Firmware can be updated on the stand alone single card using the flint tool of the Mellanox Firm ware Tools MFT package This package is available for download along with its user manual from the Mellanox Firmware Tools page See http www mellanox com gt Support gt Download Firmware Tools A firmware binaries table lists a binary file per mezzanine card The file name of each such binary is composed by combining the firmware name the firmware release version and the card part 26 Mellanox Technologies ConnectX 3 D
16. ectX 3 OJOSYT OK6V3V Specifications Table 30 4 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 List of Figures Figure 1i OJOSYT Label 5e RS Sea Boe eee ey eG elie 10 Figure 2 Board dt mei Elan RI D 10 Figure 3 OKOV3V Label ken sn RB 10 Figure 4 Board babel asset dunes e en ee ne nd 10 Figure 5 OJOSYT OK6V3V Card 11 Fipur 6 OC Connector ueste ere oepa a Cia La 12 Figure 7 Grounding Clip 19 Figure 8 7 Blade Servers er a RON M E 19 Figure 9 Protective Cover in Place 20 Figure 10 Removeithe Covers u ana tite ue bs 21 Figure 11 Press roe RE e ep Eee RA 21 Figure 12 Single Card in 22 Figure 13 Two Cards Installed ea es eee ER len ee chai ER 22 Figure 14 Device Manager 26 Figure 15 Support Download Assistant 28 Figure 16 Mechanical Drawing of 0J05Y T 0K6V3V Mezzanine Card 29 Mellanox Technologies 5 1 0 Revision History This doc
17. he socket to be used for the new card a When replacing an existing card remove the card from the socket Grab the card on the edge on the side with UPC number and pull up while gently rocking the card back and forth b For a new installation remove the protective cover enclosing the socket for the card Figure 9 Protective Cover in Place 20 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Figure 10 Remove the Cover Hold the mezzanine card by the edges only Line up the mezzanine card so that the pins of the mezzanine card are over the sockets in the blade server 5 Plug the card into the socket by placing your thumb over the UPC symbol and pressing down until the card reaches the bottom Figure 11 Press on the Card 6 Close the retaining clip Mellanox Technologies 21 J Rev 1 0 Card Installation Figure 12 Single Card in Slot C Socket for Fabric C Socket for Fabric B Figure 13 Two Cards Installed Socket for Fabric C Socket for Fabric B 7 Replace the blade server cover 8 Replace the blade server into the chassis 22 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 3 3 Safety Warnings 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Over Temperature
18. idad de LA rayos 4 Instalaci n de equipos La instalacion el reemplazo y el mantenimiento de este equipo estaran a cargo nica mente de personal capacitado y competente 5 Eliminaci n de equipos La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes reglamentaciones nacionales 6 C digos el ctricos locales y nacionales LA Este equipo debe instalar conforme los c digos el ctricos locales y nacionales Mellanox Technologies 33 J
19. ion If any parts are damaged or missing call your supplier immediately Installation Instructions Installation of this mezzanine card should only be done by a properly qualified technician or engi neer Installation or service not authorized by Dell or performed by unqualified personnel may void guarantees and warranties Read and follow all safety precautions specified in this document and in the PowerEdge documentation 18 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Use the documentation supplied with the Dell Blade Servers to remove and replace the blade from the chassis The card shown below has grounding clips that must come in contact with the chassis after the card is installed Figure 7 Grounding Clip E 2 3 engin REV AT Make sure that you are properly grounded Make sure that the equipment both while in the chas sis and while removed from the chassis is properly grounded to prevent ESD Figure 8 Blade Server Socket for Fabric C Retaining Clip Socket for Fabric B DIMMS Mellanox Technologies 19 J Card Installation Rev 1 0 DIMMS can be hot Allow sufficient time for the blade components to cool before starting this procedure 1 Remove the blade from the chassis Remove the cover from the blade 3 Open the retaining clip The card can be placed in either of the two available slots 4 Expose t
20. ndestens 8 cm 3 in Freiraum um die Bel f tungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 3 Bei Gewitter Elektrische Gefahr 4 Ger teinstallation Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausgetauscht oder gewartet werden 5 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestimmungen erfolgen 6 Regionale und nationale elektrische Bestimmungen Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden 32 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 Appendix D Advertencias de seguridad para la instalacion Warnings in Spanish 1 Instrucciones de instalaci n Antes de conectar el equipo a la fuente de alimentacion leer todas las instrucciones de instalacion 2 Sobrecalentamiento No se debe utilizar el equipo en un area con una temperatura ambiente superior a la maxima recomendada 55 C 131 F Ademas para garantizar una circulacion de aire adecuada se debe dejar como minimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilacion 3 Cuando hay rayos peligro de descarga el ctrica No utilizar el equipo ni conectar o desconectar cables durante periodos de activ
21. s gt Mellanox WinOF VPI gt Download Follow the installation instructions included in the download package also available from the download page To ensure that communication has been established follow the instructions below Displaying the Device Manager will show the Mellanox adapter devices and an IPoIB network device for each port Mellanox Technologies 25 J Rev 1 0 Driver Software and Firmware Figure 14 Device Manager example 2 Device Manager C3 x Action View Help e 97m 1 15 E Computer a Disk drives Display adapters 43 DVD CD ROM drives eE Floppy drive controllers 95 Human Interface Devices IDE ATAJATAPI controllers Y IEEE 1394 Bus host controllers 6 Texas Instruments OHCI Complant IEEE 1394 Host Controller 3 amp InfiniBand Channel Adapters Mellanox ConnectX Virtual Channel Adapter Keyboards Mice and other painting devices Monitors Network adapters Broadcom BCMS708C NetXtreme GigE NDIS Client Lu Broadcom BCM5708C NetXtreme I GigE NDIS VEO Client 2 a gt Mellanox ConnectX vPI MT26428 PCIe 2 0 SGT s QDR 1056 Network Adapter A IPoIB Adapter am x dE EHF Note If the cards are connected to a managed switch there is no need to run openSM Only one OpenSM should run per subnet In InfiniBand interfaces OpenSM is installed as a disabled Windows service To enable it enter at th
22. s the I C compatible interface Figure 6 2 Connector 2 2 Power All adapter cards receive 12V and 3 3V power from the PCI Express connector All other required power voltages are generated by on board switch mode regulators See Appendix 2 Specifications on page 30 2 3 Memory The mezzanine cards support multiple memory devices through the PCI Express SPI Flash and I C compatible interfaces 2 3 1 System Memory The mezzanine cards utilize the PCI Express interface to store and access fabric connection infor mation on the system memory 2 3 2 SPI The mezzanine cards include one SPI Flash device accessible via the Flash interface of the Con nectX 3 device 12 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 A jumper inserted into the drill on each adapter card indicates to the device whether an on board Flash device is to be used or not Table 4 provides information on this jumper Table 4 Jumper Configuration Card Default Description Option Configuration Flash present connection open Flash present connection open not present connection shorted Flash not present Flash present 2 3 3 EEPROM The mezzanine cards incorporate an EEPROM that is accessible through the inter face The EEPROM capacity is 4Kb The EEPROM is used for storing the Vital Product Data VP
23. tion avant de brancher le mat riel la source d alimentation lectrique 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambi ante d passant le maximum recommand de 55 C 131 F Un flux d air de 200LFM cette temp rature ambiante maximale est n cessaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouvertures de ventilation 3 Orages dangers lectriques 4 Installation du mat riel Pendant un orage il ne faut pas utiliser le mat riel Ce mat riel doit tre install remplac ou entretenu que par du personnel form et qualifi 5 Elimination du mat riel N L limination de ce mat riel doit s effectuer dans le respect de toutes les l gis N lations et r glementations nationales en vigueur 6 Codes lectriques locaux et nationaux Ce mat riel doit tre install dans le respect des codes lectriques locaux et L nationaux Mellanox Technologies 31 Rev 1 0 Appendix C Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromvers N orgung anschlie en 2 bertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 55 C 131 F betrieben werden Au erdem sollten mi
24. ual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 number Please contact Mellanox System Support if you cannot find the firmware binary for your mezzanine card The following steps describe how to retrieve the PSID firmware identification and programmed firmware version of your mezzanine card They also describe how to update the card with the lat est firmware version available 1 Retrieve the PSID and firmware version a Install the MFT package The package is available at www mellanox com gt Products gt Software Drivers gt InfiniBand amp VPI Software Drivers gt Firmware Tools Make sure to download the package corresponding to your computer s operating system b Enter mst start c Get the Mellanox mst device name using the command mst status The mst device name will be of the form dev mst mt4099 pci 0 d Get the PSID firmware identification and programmed firmware version using the command gt flint d dev mst mt4099 pci crO IMACS cree ConnectX FW Version 2 9 4000 Device ID 4099 Chip Revision 0 Description Node Powe 2 52 Sys image GUIDs 000002c900000200 000002c900000201 000002c900000202 000002c900000203 MACs 000002c90200 000002c90201 Board LD MT_1020110019 VSD PS IID 1020110019 2 Compare the programmed firmware version with the latest available a Go to Mellanox s web site http www mellanox com supportdownloader See Figure
25. ument was first printed on February 14 2012 Table 1 Revision History Table Date Rev Comments Changes February 1 0 Initial Release 2012 6 Mellanox Technologies ConnectX 3 Dual Port 40Gb s and 56Gb s Mezzanine Card for Dell User Manual Rev 1 0 About this Manual This User Manual describes ConnectX 3 Dual QSFP Port mezzanine card for the Dell Blade Servers It provides details as to the interfaces of the board specifications required software and firmware for operating the cards installation instructions and relevant documentation Intended Audience This manual is intended for the installer and user of the mezzanine cards The manual assumes basic familiarity with the InfiniBand IB network architecture specifica tions Related Documentation Table 2 Documents List IBTA Specification Release 1 2 1 InfiniBand Architecture Specification PCI Express 3 0 Specifications Industry Standard PCI Express 3 0 Base and Card Electromechanical Specifications Online Resources Mellanox Technologies Web pages http www mellanox com Dell Support Web pages http support dell com Document Conventions When discussing memory sizes MB and MBytes are used in this document to mean size in mega bytes The use of Mb or Mbits small b indicates size in mega bits These symbols indicate a situation status or condition that may cause harm to people or damage to the equipment
26. ved 0x00 2816 VPD Keyword RW STR Remaining read write area 2818 Length Oxfd 2819 Data STR_ZERO Reserved 0x00 3072 VPD Keyword RW STR Remaining read write area 3074 Length Oxfd 3075 Data STR_ZERO Reserved 0x00 3328 VPD Keyword RW STR Remaining read write area 3330 Length Oxfd 3331 Data STR_ZERO Reserved 0x00 3584 VPD Keyword RW STR Remaining read write area 3586 Length Oxfd 3587 Data STR_ZERO Reserved 0x00 3840 VPD Keyword RW STR Remaining read write area 3842 Length 0 3843 Data STR_ZERO Reserved 0x00 4095 Small Resource Type END 0x78 Tag 0x11 Table 6 OK6V3V VPD Layout Value Format Description 0 Large Resource Type ID 0x82 String Tag 0x02 1 Length 7 0 LSB 0x14 2 Length 15 8 MSB 0x0 3 Data DELL ConnectX 3 STR Mezz 23 Large Resource Type VPD R 0x90 Tag 0x10 24 Length 7 0 LSB 0x4D 25 Length 15 8 MSB 0x00 26 VPD Keyword PN STR Add in Card Part Number 28 Length 0x15 29 Part Number PN STR_SPC 50 VPD Keyword EC STR Engineering Change Level of the card rev 52 Length 0x3 Mellanox Technologies 15 J Rev 1 0 Card Interfaces Table 6 OK6V3V VPD Layout Value Format Description 53 Revision RV STR PCB revision 56 VPD Keyword SN STR Serial Number 58 Length 0x14 59 SerialNumber OO0K6V3VMMM STR_SPC 00 00X XXX XX
Download Pdf Manuals
Related Search