Home

InfiniHost III Ex User Manual

1. Offset Decimal Item Value Format Description 17 Length 0x15 18 Data MHEA28 XTC 39 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 41 Length 0x2 42 Data Al PCB revision 46 VPD Keyword SN Alphanumeric Serial Number 48 Length 0x18 49 Data 00 00XXXX XX 73 VPD Keyword V0 Misc Information 45 Length 0x10 76 Data PCIe x8 92 VPD Keyword RV 94 Length 0x1 95 Data Checksum 96 Large Resource Type VPD W Tag 0x11 0x91 97 Length Ox9F 99 VPD Keyword V1 EFI Driver version 101 Length 0x6 102 Data N A Number 108 VPD Keyword YA Asset Tag 110 Length 0x20 111 Data N A Alphanumeric N A 143 VPD Keyword RW Remaining read write area 145 Length 0x6D 146 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers Mellanox Technologies Rev 1 20 26 PCI VPD Layout for MHGA28 XSC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 13 MHGA28 XSC VPD Layout Rev 1 20 Mellanox Technologies Offset Decimal Item V
2. HCA Card Firmware Update as Part of a Cluster Firmware Update If the HCA card is part of an InfiniBand cluster its firmware can be updated as part of the entire cluster firmware update using the ibfwmgr tool of the IB administration IBADM tools package IBADM is available for download as part of IB stack distributions such as IB Gold and OFED available via http www mellanox com See Firmware Downloads under the same webpage for cluster update instructions 1 Currently only the Linux distributions support updating firmware for an entire InfiniBand cluster Mellanox Technologies Rev 1 20 16 Customized HCA Card Firmware Update OEM Only Note The procedure described in this section is normally not needed and applies to OEMs only To create a customized firmware binary the firmware image in MLX format needs to be downloaded along with the MFT tools package See http www mellanox com under Firmware Downloads for customized firmware update instructions Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Adapter Card Interfaces T O Interfaces Each HCA card includes the following interfaces e Two 4X InfiniBand copper connectors e PCI Express x8 edge connector e I O panel LEDs PC compatible connector for debug 1 0 2 InfiniBand Interface The InfiniHost M III Ex MT25208 device is compliant with the InfiniBand Architecture Spe
3. PCI VPD Layout for MHEA28 XTC on page 24 e Section PCI VPD Layout for MHGA28 XSC on page 26 e o Section PCI VPD Layout for MHGA28 XTC on page 27 e o Section PCI VPD Layout for MHEA28 1SC on page 28 e o Section PCI VPD Layout for MHEA28 1TC on page 29 e o Section PCI VPD Layout for MHGA28 1SC on page 31 e Section PCI VPD Layout for MHGA28 1TC on page 32 e Section PCI VPD Layout for MHEA28 2SC on page 35 e o Section PCI VPD Layout for MHEA28 2TC on page 36 e Section PCI VPD Layout for MHGA28 2SC on page 37 e o Section PCI VPD Layout for MHGA28 2TC on page 38 PCI VPD Layout for MHEA28 XSC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 11 MHEA28 XSC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0x9 3 Data Lion mini Alphanumeric 2 Large Resource Type VPD R Tag 0x10 0x90 13 Length Ox4F 15 VPD Keyword PN Numbers Add in Card Part Number 17 Length Ox15 18 Data MHEA28 XSC 39 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 41 Length 0x2 42 Data Al PCB revision 46 VPD Keyword SN Alphanumeric Serial Number 48 Length 0x18 49 Data 00 00XXXX XX 73 VPD Keyword V0 Misc Information Mel
4. I2C compatible Connector InfiniBand 4X Port Connector PCI Express x8 Connector Tall Bracket of a Dual IB Port HCA Card Connector Retention Clip Extracting Connector Clip Unscrew Bracket Screws Detach the Bracket in a Rotating Move HCA Card Ready for Short Bracket Place Tall Bracket onto Card Attach Bracket onto Card using Screws Sliding Connector Clip Evenly Fix Clip Hooks into Place Using Screwdriver Assembled Short Bracket View Mellanox Technologies 10 11 12 20 21 22 53 53 54 57 57 58 58 59 59 60 60 61 61 61 Rev 1 20 6 List of Tables Table 5 Table 6 Table 7 Table 8 Table 9 Table 10 Table 11 Table 12 Table 13 Table 14 Table 15 Table 16 Table 17 Table 18 Table 19 Table 20 Table 21 Table 22 Table 23 Table 24 Table 25 Table 26 Table 27 Table 28 Table 29 Table 30 Table 31 Table 32 Table 33 Table 34 Table 35 Table 36 Table 37 Table 38 Rev 1 20 Revision History Table Documents List Mem free HCA Cards HCA Cards with 128MB 256MB On board Memory Mellanox HCA Cards Part Numbering Key Hardware and Software Requirements Firmware Images for InfiniHostTM II Ex PCI Express HCA Cards LEDs I2C Connector Reference Designation Jumper Configuration MHEA28 XSC VPD Layout MHEA28 XTC VPD Layout MHGA28 XSC VPD Layout MHGA28 XTC VPD Layout MHEA28 1SC VPD Layout MHEA28 1TC VPD Layout MHGA28 1SC VPD Layout MHGA28 1TC VPD Layou
5. RV 95 Length Oxl 96 Data Checksum 97 Large Resource Type VPD W Tag 0x11 0x91 98 Length 0x9B 100 VPD Keyword V1 EFI Driver version 102 Length 0x6 103 Data N A Number 109 VPD Keyword YA Asset Tag 111 Length 0x20 112 Data N A Alphanumeric N A 144 VPD Keyword RW Remaining read write area 146 Length 0x6C 147 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHGA28 2TC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 23 MHGA28 2TC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0xC 3 Data Lion cub DDR Alphanumeric Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 23 MHGA28 2TC VPD Layout Mellanox Technologies Offset Decimal Item Value Format Description 15 Large Resource Type VPD R Tag 0x10 0x90 16 Length Ox4F 18 VPD Keyword PN Numbers Add in Card Part Number 20 Length 0x15 21 Data MHGA28 2TC 42 VPD Keyword EC Alphanumeric Engin
6. Class A Device This device is registered for EMC requirements for industrial use The seller or buyer should be aware of this If this type was sold or purchased by mistake it should be replaced with a residential use type Mellanox Technologies Rev 1 20 44 A 2 MHEA28 XSC and MHEA28 XTC Specifications Table 25 lists the specifications for the mem free HCA cards listed in Table 3 on page 10 with IB running at SDR Table 25 Specifications for Mem free HCA Cards IB SDR Physical Power and Environmental Size 2 5in x 4 6in 6 4cm x 11 7cm Voltage 12V 3 3V Air Flow 200LFM 55 C Maximum Power 7 8W 4X 10Gb s Connector InfiniBand Copper current rating 0 5A Temperature 0 C to 55 C max with active media adapter support On board Memory Size OMB Protocol Support Regulatory InfiniBand IBTA v1 2 Auto Negotiation 10Gb s EMC 2 5Gb s UL60950 1 2003R7 06 QoS 8 InfiniBand Virtual Lanes for each port cTuvus CAN CSA C22 2 No 60950 1 03 RDMA Support Yes All Ports TEC EN 60950 1 2001 RoHS ETSIEN 300 019 2 2 TEC 60068 2 64 29 32 FCC 47 CFR part 15 2005 subpart B class B ICES 003 2004 Issue 4 class B VCCI V 3 2005 04 class B EN 55022 1998 A 1 2000 A2 2003 class B EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Directive 89 336 EEC RoHS R5 Rev 1 20 Mellanox Technolo
7. EC Alphanumeric Engineering Change Level of the card rev 44 Length 0x2 45 Data Al PCB revision 47 VPD Keyword SN Alphanumeric Serial Number 49 Length 0x18 50 Data 00 00XXXX XX 74 VPD Keyword V0 Misc Information 76 Length 0x10 77 Data PCIe x8 Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 18 MHGA28 1TC VPD Layout Offset Decimal Item Value Format Description 93 VPD Keyword RV 95 Length 0x1 96 Data Checksum 97 Large Resource Type VPD W Tag 0x11 0x91 98 Length 0x9B 100 VPD Keyword V1 EFI Driver version 102 Length 0x6 103 Data N A Number 109 VPD Keyword YA Asset Tag 111 Length 0x20 112 Data N A Alphanumeric N A 144 VPD Keyword RW Remaining read write area 146 Length 0x6C 147 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHGA28D 1TC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 19 MHGA28D 1TC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxC 3 D
8. Europe 42 A 1 3 ICES Statements Canada 42 A 1 4 VCCI Statements Japan 42 A 1 5 MIC Statement Republic of Korea 42 MHEA28 XSC and MHEA28 XTC Specifications MHGA28 XSC and MHGA28 XTC Specifications MHEA28 1SC and MHEA28 1TC Specifications MHGA28 1SC Specifications MHGA28 1TC Specifications MHGA28D 1TC Specifications MHEA28 2SC Specifications MHEA28 2TC Specifications A 10 MHGA28 2SC and MHGA28 2TC Specifications Interface Connectors Pinout B 1 B 2 B 3 12C compatible Connector Pinout InfiniBand Connector Pinout PCI Express x8 Connector Pinout Appendix C Instructions for Replacing a Tall Bracket with a Short Bracket on HCA Cards C I C2 Removing Tall Bracket Assembling Short Bracket Appendix D Avertissements de s curit d installation Rev 1 20 Mellanox Technologies 35 36 37 38 41 41 44 45 46 47 48 49 50 51 52 53 53 53 54 57 57 59 62 InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual List of Figures Figure 1 Figure 2 Figure 3 Figure 4 Figure 5 Figure 6 Figure 7 Figure 8 Figure 9 Figure 10 Figure 11 Figure 12 Figure 13 Figure 14 Figure 15 Figure 16 Figure 17 Figure 18 Figure 19 Figure 20 MHEA28 XTC MHGA28 1TC Card Product Label Mem free HCA Cards Mechanical Drawing and Dimensions mm HCA Cards with On board Memory Mechanical Drawing and Dimensions mm I O Panel with Dual Ports and LEDs Tall Bracket
9. A Number 105 VPD Keyword YA Asset Tag 107 Length 0x20 108 Data N A Alphanumeric N A 140 VPD Keyword RW Remaining read write area 142 Length 0x70 143 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHGA28 2SC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 22 MHGA28 2SC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxC 3 Data Lion cub DDR Alphanumeric 15 Large Resource Type VPD R Tag 0x10 0x90 16 Length Ox4F 18 VPD Keyword PN Numbers Add in Card Part Number 20 Length 0x15 21 Data MHGA28 2SC 4 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 44 Length 0x2 45 Data Al PCB revision Mellanox Technologies Rev 1 20 38 Table 22 MHGA28 2SC VPD Layout Offset Decimal Item Value Format Description 47 VPD Keyword SN Alphanumeric Serial Number 49 Length 0x18 50 Data 00 00XXXX XX 74 VPD Keyword V0 Misc Information 76 Length 0x10 77 Data PCIe x8 93 VPD Keyword
10. Clip a Gently Push One Hook of Clip b Gently Push Other Hook of Clip c Pull Clip Away Repeat the above actions for the second connector s clip Step 2 Unscrew bracket screws Unscrew both screws from the card using a torque screwdriver as shown in Figure 13 Figure 13 Unscrew Bracket Screws Step 3 Detach bracket Grip the bracket as shown in Figure 14 placing your thumb on the LED component In a rotating move toward the component side of the card slide the bracket out of the connectors Figure 14 c gt Gently hold your thumb on the LED component gt At the same time extract the bracket as shown in image 18 Make sure to protect the LED while extracting the bracket Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual 59 Figure 14 Detach the Bracket in a Rotating Move a Card without Clips and Screws b Grip the Card in Prep for Detachment c Detach the Bracket in Rotating Move toward Component Side C 2 Assembling Short Bracket The short bracket can now be assembled onto the HCA card See Figure 15 Figure 15 HCA Card Ready for Short Bracket Mellanox Technologies Rev 1 20 60 Step 1 Place short bracket onto card Gently place the bracket onto the card fitting the connectors through the bracket connector holes Make sure the LEDs are aligned into their intended bracket holes Figure 16 Place Tall Bracket ont
11. SDR Table 32 Specifications for MHEA28 2TC 256MB Tall Bracket IB SDR Physical Power and Environmental Size 2 5in x 6 6in 6 4cm x 16 8cm Voltage 12V 3 3V Air Flow 200LFM 55 C Maximum Power 10 5W 4X 10Gb s Connector InfiniBand Copper current rating 0 5A Temperature 0 C to 55 C max with active media adapter support On board Memory Size 256MB Protocol Support Regulatory InfiniBand IBTA v1 2 Auto Negotiation 10Gb s EMC FCC 47 CFR part 15 2005 subpart B class 2 5Gb s A QoS 8 InfiniBand Virtual Lanes for each port RDMA Support Yes All Ports ICES 003 2004 Issue 4 class A VCCI V 3 2005 04 class A EN 55022 1998 A 1 2000 A2 2003 class A EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Direc tive 89 336 EEC CTUVUS UL60950 1 2003R7 06 CAN CSA C22 2 No 60950 1 03 Safety TEC EN 60950 1 2001 ETSI EN 300 019 2 2 Environmental TEC 60068 2 64 29 32 RoHS RoHS R5 Mellanox Technologies Rev 1 20 52 A 10 MHGA28 2SC and MHGA28 2TC Specifications Table 33 lists the specifications for HCA cards with 256MB on board memory listed in Table 4 on page 11 and IB running at DDR Table 33 Specifications for HCA Cards with 256MB On board Memory IB DDR RDMA Support Yes All Ports Physical Power and Environmental Size 2 5in x 6 6i
12. network is discovered over the physical link The activity link is a steady yellow when it is discovered but no data is being passed The activity link blinks when data is being passed If the LEDs are not active either the physical or the logical or both connections have not been established See Figure 6 I O Panel with Dual Ports and LEDs Tall Bracket on page 22 Table 8 LEDs Port 1 LED Name Physical Link Green Data Activity Yellow Port 2 LED Name Physical Link Green Data Activity Yellow Mellanox Technologies Rev 1 20 17 18 1 0 5 PC Compatible Interface A three pin header is provided as the PC compatible interface Table 9 provides the reference designation informa tion of the I C connector per HCA card type mem free or with on board memory Table 9 IC Connector Reference Designation Card Type Reference on Board Picture Mem free J3 With on board memory J1 For the I C connector location on mem free HCA cards see Figure 4 on page 20 For the 17C connector location on the HCA cards with on board memory see Figure 5 on page 21 Power All adapter cards receive power from the PCI Express Edge connector All other required power voltages are gener ated by on board switch mode regulators For power consumption see Appendix A Specifications on page 41 Memory Each adapter card supports multiple memory devices thr
13. 0 50 A 8 MHEA28 2SC Specifications Table 32 lists the specifications for the MHEA28 2SC Short Bracket HCA card with 256MB on board memory and IB running at SDR Table 31 Specifications for MHEA28 2SC 256MB Short Bracket IB SDR Physical Power and Environmental Size 2 5in x 6 6in 6 4cm x 16 8cm Voltage 12V 3 3V Air Flow 200LFM 55 C Maximum Power 10 5W 4X 10Gb s Connector InfiniBand Copper current rating 0 5A Temperature 0 C to 55 C max with active media adapter support On board Memory Size 256MB Protocol Support Regulatory InfiniBand IBTA v1 2 Auto Negotiation 10Gb s EMC FCC 47 CFR part 15 2005 subpart B class 2 5Gb s A QoS 8 InfiniBand Virtual Lanes for each port RDMA Support Yes All Ports ICES 003 2004 Issue 4 class A VCCI V 3 2005 04 class A EN 55022 1998 A 1 2000 A2 2003 class A EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Direc tive 89 336 EEC CTUVUS UL60950 1 2003R7 06 CAN CSA C22 2 No 60950 1 03 Safety TEC EN 60950 1 2001 ETSI EN 300 019 2 2 Environmental TEC 60068 2 64 29 32 RoHS RoHS R5 Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual A 9 MHEA28 2TC Specifications Table 32 lists the specifications for the MHEA28 2TC Tall Bracket HCA card with 256MB on board memory and IB running at
14. 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHEA28 2TC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 21 MHEA28 2TC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0x8 3 Data Lion cub Alphanumeric 11 Large Resource Type VPD R Tag 0x10 0x90 12 Length Ox4F 14 VPD Keyword PN Numbers Add in Card Part Number 16 Length 0x15 17 Data MHEA28 2TC 38 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 40 Length 0x2 41 Data Al PCB revision 43 VPD Keyword SN Alphanumeric Serial Number 45 Length 0x18 46 Data 00 00XXXX XX 70 VPD Keyword V0 Misc Information 72 Length 0x10 73 Data PCIe x8 89 VPD Keyword RV 91 Length 0x1 92 Data Checksum Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 21 MHEA28 2TC VPD Layout Offset Decimal Item Value Format Description 93 Large Resource Type VPD W Tag 0x11 0x91 94 Length Ox9F 96 VPD Keyword V1 EFI Driver version 98 Length 0x6 99 Data N
15. 1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHEA28 1SC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 15 MHEA28 1SC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0x8 3 Data Lion cub Alphanumeric 11 Large Resource Type VPD R Tag 0x10 0x90 12 Length Ox4F 14 VPD Keyword PN Numbers Add in Card Part Number 16 Length 0x15 17 Data MHEA28 1SC 38 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 40 Length 0x2 41 Data Al PCB revision Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 15 MHEA28 1SC VPD Layout Offset Decimal Item Value Format Description 43 VPD Keyword SN Alphanumeric Serial Number 45 Length 0x18 46 Data 00 00XXXX XX 70 VPD Keyword V0 Misc Information 72 Length 0x10 73 Data PCIe x8 89 VPD Keyword RV 91 Length Oxl 92 Data Checksum 93 Large Resource Type VPD W Tag 0x11 0x91 94 Length Ox9F 96 VPD Keyword VI EFI Driver version 98 Length 0x6 99 Data N A Number 105 VPD Keyword YA Asset Tag 107 Length 0x20 108 D
16. 1 0x91 94 Length Ox9F 96 VPD Keyword V1 EFI Driver version 98 Length 0x6 99 Data N A Number 105 VPD Keyword YA Asset Tag 107 Length 0x20 108 Data N A Alphanumeric N A 140 VPD Keyword RW Remaining read write area 142 Length 0x70 143 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 16 MHEA28 1TC VPD Layout Offset Decimal Item Value Format Description 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHGA28 1SC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 17 MHGA28 1SC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxC 3 Data Lion cub DDR Alphanumeric 15 Large Resource Type VPD R Tag 0x10 0x90 16 Length Ox4F 18 VPD Keyword PN Numbers Add in Card Part Number 20 Length 0x15 21 Data MHGA28 1SC 42 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 44 Length 0x2 45 Data Al PCB revision 47 VPD Keyword SN Alphanumeric Serial Numb
17. 12V 4 GND GND GND GND 5 SMCLK NC TCK NC 6 SMDAT NC TDI TDI2TDO 7 GND GND TDO TDI2TDO 8 3 3V 3 3V TMS NC 9 TRST NC 3 3V 3 3V 10 3 3 Vaux NC 3 3V 3 3V 11 WAKE NC PERST RST 12 RSVD NC GND GND 13 GND GND REFCLK REFCLKp_PCI 14 PETpO PERPO REFCLK REFCLKn PCI 15 PETnO PERNO GND GND 16 GND GND PERp0 PETPO Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 36 PCI Express x8 Connector Pinout Sheet 2 of 3 Side B Connector Side A Connector Pin Connector PCI Ex Port Signal Connector Pin PCI Ex Port Signal Number Pin Name Name Name Name 17 PRSNT2 NC PERn0 PETNO 18 GND GND GND GND 19 PETp1 PERP1 RSVD NC 20 PETn1 PERNI GND GND 21 GND GND PERp1 PETP1 22 GND GND PERn1 PETN1 23 PETp2 PERP2 GND GND 24 PETn2 PERN2 GND GND 25 GND GND PERp2 PETP2 26 GND GND PERn2 PETN2 27 PETp3 PERP3 GND GND 28 PETn3 PERN3 GND GND 29 GND GND PERp3 PETP3 30 RSVD NC PERn3 PETN3 31 PRSNT2 NC GND GND 32 GND GND RSVD NC 33 PETp4 PERP4 RSVD NC 34 PETn4 PERN4 GND GND 35 GND GND PERp4 PETP4 36 GND GND PERn4 PETN4 37 PETp5 PERP5 GND GND 38 PETn5 PERNS GND GND 39 GND GND PERp5 PETPS 40 GND GND PERn5 PETNS 41 PETp6 PERP6 RSVD NC 42 PETn6 PERN6 GND GND 43 GND GND PERp7 PETP7 44 GND GND PERn7 PETN7 45 PETp8 PERP8 GND GND 46 PETn8 PERN8 GND GND 47 GND GND PERp8 PE
18. A MHGA28 XTC MHEA28 1SC B B B B A MHEA28 1TC B B B B A MHGA28 1SC A A A A A MHGA28 1TC A A A A A MHGA28D 1TC A A A MHEA28 2SC A A A A MHEA28 2TC B B B B MHGA28 2SC Not available MHGA28 2TC A 1 1 FCC Statements USA Class A Statements 15 21 Statement Warning Changes or modifications to this equipment not expressly approved by the party responsible for compli ance Mellanox Technologies could void the user s authority to operate the equipment 15 105 a Mellanox Technologies Rev 1 20 42 Statement Note This equipment has been tested and found to comply with the limits for a Class A digital device pur suant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harm ful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residen tial area is likely to cause harmful interference in which case the user will be required to correct the interfer ence at his own expense A 1 2 EN Statements Europe EN55022 Class A Statement Warning This is a class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate m
19. AMN Mellanox TECHNOLOGIES InfiniHost III Ex PCI Express x8 RoHS HCA Adapter Cards User s Manual P N MHEA28 XSC MHEA28 XTC MHGA28 XSC MHGA28 XTC MHEA28 1SC MHEA28 1TC MHGA28 1SC MHGA28 1TC MHGA28D 1TC MHEA28 2SC MHEA28 2TC MHGA28 2SC MHGA28 2TC Rev 1 20 Mellanox Technologies 2 Copyright 2007 Mellanox Technologies Inc All Rights Reserved InfiniHost HI Ex PCI Express x8 RoHS HCA Adapter Cards User s Manual Document Number 2699 Mellanox Technologies Inc 2900 Stender Way Santa Clara CA 95054 U S A www mellanox com Tel 408 970 3400 Fax 408 970 3403 Mellanox Technologies Ltd PO Box 586 Hermon Building Yokneam 20692 Israel Tel 972 4 909 7200 Fax 972 4 959 3245 Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table of Contents Table of Contents List of Figures List of Tables Revision History About this Manual Chapter 1 Chapter 2 Chapter 3 Chapter 4 Chapter 5 Chapter 6 Overview 1 1 Mem free HCA Cards 12 HCA Cards with On board Memory 13 Mellanox HCA Cards Part Numbering Key 1 4 Finding the GUID and Serial Number on the Adapter Cards HCA Card Installation 2 1 Hardware and Software Requirements 22 Installation Instructions 2 2 1 Installation Instructions as per Host Machine 2 3 Safety Warnings Updating HCA Card Firmware 3 1 Single HCA Card Firmware Update 3 2 HCA Card Firmwa
20. IC Statement and Numbers and CTUVUS to Specifications December 1 11 Added EMC VCCI statements to Appendix A Specifications on page 41 2006 November 1 10 Added EMC Class A and Class B statements to Appendix A Specifications on page 41 2006 October 2006 1 00 First release Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual About this Manual This card User s Manual describes Mellanox Technologies InfiniHost III Ex PCI Express x8 RoHS compliant HCA cards It provides details as to the interfaces of the board specifications required software and firmware for operating the board and relevant documentation Intended Audience This manual is intended for the installer and user of the PCI Express x8 HCA cards listed in Overview on page 10 The manual assumes basic familiarity with the InfiniBand architecture specification Related Documentation Table 2 Documents List InfiniHost III Programmer s Reference Manual Reference describing the interface used by developers to write a driver Document no 2248PM for Mem free Mellanox InfiniHost III devices InfiniHost Programmer s Reference Manual Reference describing the interface used by developers to write a driver Document no 2111PM for Mellanox InfiniHost III devices with on board memory Infini Host mode InfiniHost III Ex MT25208 Hardware Reference Manual Reference for har
21. MHEA28 2SC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 20 MHEA28 2SC VPD Layout Mellanox Technologies Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0x8 3 Data Lion cub Alphanumeric 11 Large Resource Type VPD R Tag 0x10 0x90 12 Length 0x4F 14 VPD Keyword PN Numbers Add in Card Part Number 16 Length 0x15 17 Data MHEA28 2SC 38 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 40 Length 0x2 41 Data Al PCB revision 43 VPD Keyword SN Alphanumeric Serial Number 45 Length 0x18 46 Data 00 00XXXX XX 70 VPD Keyword V0 Misc Information 72 Length 0x10 73 Data PCIe x8 89 VPD Keyword RV 91 Length Oxl 92 Data Checksum 93 Large Resource Type VPD W Tag 0x11 0x91 94 Length Ox9F 96 VPD Keyword VI EFI Driver version 98 Length 0x6 99 Data N A Number 105 VPD Keyword YA Asset Tag 107 Length 0x20 108 Data N A Alphanumeric N A 140 VPD Keyword RW Remaining read write area Rev 1 20 36 Table 20 MHEA28 2SC VPD Layout Offset Decimal Item Value Format Description 142 Length 0x70 143 Data Reserved 0x00 255 Small Resource Type END Tag 0x11
22. TP8 48 PRSNT2 PRSNT PERn8 PETN8 Mellanox Technologies Rev 1 20 56 Rev 1 20 Table 36 PCI Express x8 Connector Pinout Sheet 3 of 3 Pin Number 49 Side B Connector Side A Connector Connector Pin Name GND PCI Ex Port Signal Connector Pin Name Name GND GND PCI Ex Port Signal Name GND Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual 57 Appendix C Instructions for Replacing a Tall Bracket with a Short Bracket on HCA Cards This appendix provides instructions on how to remove a tall bracket of an HCA card such as the one shown in Figure 10 and replace it with a short one Figure 10 Tall Bracket of a Dual IB Port HCA Card C 1 Removing Tall Bracket Step 1 Remove connector clips Figure 11 shows a connector retention clip and the designated names of its sec tions Figure 11 Connector Retention Clip Clip Top Clip Center embraces the connector Clip Hook grips onto the connector Using a small flat head screwdriver gently push up one hook of a connector s clip toward the connector s top side as shown in Figure 12 a on page 58 Then push the other hook each of the two clip s hook towards the connector s top side see Figure 12 b Finally pull the clip away from its center see Figure 12 c Mellanox Technologies Rev 1 20 58 Figure 12 Extracting Connector
23. alue Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0xD 3 Data Lion mini DDR Alphanumeric 16 Large Resource Type VPD R Tag 0x10 0x90 17 Length 0x4F 19 VPD Keyword PN Numbers Add in Card Part Number 21 Length 0x15 22 Data MHGA28 XSC 43 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 45 Length 0x2 46 Data Al PCB revision 48 VPD Keyword SN Alphanumeric Serial Number 50 Length 0x18 51 Data 00 00XXXX XX 75 VPD Keyword V0 Misc Information 77 Length 0x10 78 Data PCIe x8 94 VPD Keyword RV 96 Length Oxl 97 Data Checksum 98 Large Resource Type VPD W Tag 0x11 0x91 99 Length 0x9A 101 VPD Keyword V1 EFI Driver version 103 Length 0x6 104 Data N A Number 110 VPD Keyword YA Asset Tag 112 Length 0x20 113 Data N A Alphanumeric N A 145 VPD Keyword RW Remaining read write area InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 13 MHGA28 XSC VPD Layout Offset Decimal Item Value Format Description 147 Length 0x6B 148 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHGA28 XTC Note A1 was used as the HCA card PCB revision Later revisions of the HCA c
24. an HCA IC Part HCA Card with On board Memory Number OPN DDR Size p Number Photo Bracket ce Mem free MHGA28D 1TC DDR 128 Tall RoHS R5 MT25208A0 TBD MByte FCC D MHEA28 1SC SDR Short RoHS R5 MT25208A0 FCC MHEA28 1TC Tall MHGA28 1SC DDR Short RoHS R5 MT25208A0 FCC D MHGA28 1TC Tall Figure 2 MHGA28 1TC MHEA28 2SC SDR 256 Short RoHS R5 MT25208A0 FCC MByte MHEA28 2TC Tall MHGA28 2SC DDR Short RoHS R5 MT25208A0 Short Tall FCC D Bracket Bracket 2SC 2TC MHGA28 2TC Tall a HCA cards of the same generation have a similar form and fit The main visible difference is the bracket height Mellanox Technologies Rev 1 20 12 Mellanox HCA Cards Part Numbering Key Table 5 describes the Mellanox Technologies HCA cards part numbering key Table 5 Mellanox HCA Cards Part Numbering Key Free HCA Card OPN Field Decoder Example MHTS IG XBR MHGA28 2TC M Mellanox Technolo M gies H HCA H HCA Card S Express Card SIOM H T Media C Cu SDR E Cu SDR Active Cable G Cu DDR Active E Cable F Fiber SDR S HCA IC T InfiniHost A InfiniHost III Ex S InfiniHost III Lx A IB ports 1 1 2 2 A 10 B 11 lt limit to one character gt 2 I Interface X PCI X 4 PCle x4 8 PCle x8 8 G Generation lt blank gt Initial Generation D Gen D Separator X Memory Size X MemFree 1 128MB 2 256MB 3 512MB 2 B Bracket S Short T Tall N N
25. anual A 7 MHGA28D 1TC Specifications Table 28 lists the specifications for the MHGA28D 1TC Tall Bracket HCA card with 128MB on board memory and IB running at DDR Table 30 Specifications for MHGA28D 1TC 128MB Tall Bracket IB DDR Physical Power and Environmental Size Air Flow 4X 20Gb s Connector On board Memory Size 2 5in x 6 6in 6 4cm x 16 8cm 200LFM 55 C InfiniBand Copper current rating 0 5A max with active media adapter support 128MB Voltage Maximum Power Temperature 12V 3 3V 12 7W O C to 55 C Protocol Support Regulatory InfiniBand Qos RDMA Support IBTA v1 2 Auto Negotiation 20Gb s 5Gb s or 10Gb s 2 5Gb s 8 InfiniBand Virtual Lanes for each port Yes All Ports EMC CTUVUS Safety Environmental RoHS FCC 47 CFR part 15 2005 subpart B class A ICES 003 2004 Issue 4 class A VCCI V 3 2005 04 class A MIC class A EN 55022 1998 A 1 2000 A2 2003 class A EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Direc tive 89 336 EEC UL60950 1 2003R7 06 CAN CSA C22 2 No 60950 1 03 TEC EN 60950 1 2001 ETSI EN 300 019 2 2 IEC 60068 2 64 29 32 RoHS R5 a The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architecture Specification Release 1 2 Mellanox Technologies Rev 1 2
26. ard will have the same format Table 14 MHGA28 XTC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0xD 3 Data Lion mini DDR Alphanumeric 16 Large Resource Type VPD R Tag 0x10 0x90 17 Length Ox4F 19 VPD Keyword PN Numbers Add in Card Part Number 21 Length Ox15 22 Data MHGA28 XTC 43 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 45 Length 0x2 46 Data Al PCB revision 48 VPD Keyword SN Alphanumeric Serial Number 50 Length 0x18 51 Data 00 00XXXX XX 75 VPD Keyword V0 Misc Information 77 Length 0x10 78 Data PCIe x8 94 VPD Keyword RV 96 Length Oxl 97 Data Checksum 98 Large Resource Type VPD W Tag 0x11 0x91 Mellanox Technologies Rev 1 20 28 Table 14 MHGA28 XTC VPD Layout Offset Decimal Item Value Format Description 99 Length Ox9A 101 VPD Keyword V1 EFI Driver version 103 Length 0x6 104 Data N A Number 110 VPD Keyword YA Asset Tag 112 Length 0x20 113 Data N A Alphanumeric N A 145 VPD Keyword RW Remaining read write area 147 Length 0x6B 148 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox
27. as per Host Machine The adapter cards listed in Table 5 on page 12 are standard PCI Express cards each with a standard x edge connector Please consult the host machine documentation for instructions on how to install a PCI Express card Mellanox Technologies Rev 1 20 14 Safety Warnings 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Over temperature This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 55 C 131 F Moreover to guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings 3 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or dis connect cables 4 Equipment Installation This equipment should be installed replaced or serviced only by trained and qualified personnel 5 Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula tions 6 Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual 15 Updating HCA Card Firmware Each HCA card is shipped with the latest version of qualified firmware at the time of manufactur
28. ata Lion cub DDR Alphanumeric 15 Large Resource Type VPD R Tag 0x10 0x90 16 Length Ox4F 18 VPD Keyword PN Numbers Add in Card Part Number 20 Length 0x15 21 Data MHGA28D 1TC Mellanox Technologies Rev 1 20 34 Table 19 MHGA28D 1TC VPD Layout Offset Decimal Item Value Format Description 42 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 44 Length 0x2 45 Data Al PCB revision 47 VPD Keyword SN Alphanumeric Serial Number 49 Length 0x18 50 Data 00 00XXXX XX 74 VPD Keyword V0 Misc Information 76 Length 0x10 77 Data PCIe x8 93 VPD Keyword RV 95 Length Oxl 96 Data Checksum 97 Large Resource Type VPD W Tag 0x11 0x91 98 Length 0x9B 100 VPD Keyword V1 EFI Driver version 102 Length 0x6 103 Data N A Number 109 VPD Keyword YA Asset Tag 111 Length 0x20 112 Data N A Alphanumeric N A 144 VPD Keyword RW Remaining read write area 146 Length 0x6c 147 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 356 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual PCI VPD Layout for
29. ata N A Alphanumeric N A 140 VPD Keyword RW Remaining read write area 142 Length 0x70 143 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHEA28 1TC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 16 MHEA28 1TC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0x8 Mellanox Technologies Rev 1 20 30 Table 16 MHEA28 1TC VPD Layout Offset Decimal Item Value Format Description 3 Data Lion cub Alphanumeric 11 Large Resource Type VPD R Tag 0x10 0x90 12 Length Ox4F 14 VPD Keyword PN Numbers Add in Card Part Number 16 Length 0x15 17 Data MHEA28 1TC 38 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 40 Length 0x2 41 Data Al PCB revision 43 VPD Keyword SN Alphanumeric Serial Number 45 Length 0x18 46 Data 00 00XXXX XX 70 VPD Keyword V0 Misc Information 72 Length 0x10 73 Data PCIe x8 89 VPD Keyword RV 91 Length 0x1 92 Data Checksum 93 Large Resource Type VPD W Tag 0x1
30. cification Release 1 2 It has two compliant 4X InfiniBand ports A and B each having four Tx Rx pairs of SERDESs Each of the HCA cards listed in Table 3 and Table 4 based on this device provides access to these ports by means of two 4X Infini Band connectors for external InfiniBand copper cables also compliant with the IBTA specification 1 2 Connector 1 connects to port A of the device while connector 2 connects to port B Furthermore each of the HCA cards is embedded with a media detect circuit that supports external InfiniBand fiber solutions to be connected to the InfiniBand port connectors using active media converters such as Emcore s OTR3400 Smart Module or Fujitsu s FPD 010R008 0E o microGiGaCN 1 0 3 PCI Express Interface The InfiniHost III Ex MT25208 device has eight Tx Rx pairs of SERDESs providing for a PCI Express x8 inter face version 1 0a compatible The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations The PCI Express bus can connect to either a host CPU in an HCA application or to an I O device such as Gigabit Ethernet when used as a Target Channel Adapter 1 0 4 LED Assignment The board has four LEDs located on the I O panel 2 LEDs per 4X port The physical link green illuminates once VAPI InfiniBand Verbs API is started and a physical connection is made between two nodes The data activity link yellow illuminates once the InfiniBand
31. dware engineers responsible for designing systems and Document no 2246HM boards incorporating InfiniHost III Ex components Mellanox Firmware Tools MFT User s Manual User s Manual describing the set of MFT firmware management tools Document no 2204UG for a single InfiniBand node See http www mellanox com under Firm ware Downloads InfiniBand Administration IBADM Package User s Manual User s Manual describing the utilities included in the IBADM tools Document no 2130UM package for system administration of an InfiniBand cluster See http www mellanox com under Management Tools Online Resources e Mellanox Technologies Web pages http www mellanox com e Mellanox Technologies Firmware download Web page http www mellanox com under Firmware downloads e Mellanox Technologies Document Distribution System DDS http docs mellanox com requires a customer login account Document Conventions When discussing memory sizes MB and MBytes are used in this document to mean size in mega bytes The use of Mb small b indicates size in mega bits Mellanox Technologies Rev 1 20 10 1 Overvlew This document is a User s Manual for Mellanox Technologies host channel adapter HCA cards based on the MT25208 InfiniHost III Ex HCA IC device The cards described in this manual have the following main features e IBTA v1 2 compliant e Two 4X InfiniBand copper ports for connecting InfiniBand t
32. easures A 1 3 ICES Statements Canada Class A Statement This Class A digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la classe A est conforme a la norme NMB 003 du Canada A 1 4 VCCI Statements Japan Class A Statement CORB MAR E SENER M Z VCCI DAR EKT lt 772A RME CT DRE RE TEATS CER Hesse TL EN EUR TOBARRA BICHRERBT BLABKENSCECPHVET Translation This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this equipment is used in a domestic environment radio interference may occur in which case the user may be required to take corrective actions A 1 5 MIC Statement Republic of Korea Korea s Regulation for Certification of Information and Communication Equipment requires EMC testing and cer tification for many electronic products Korean EMC certifications are issued by Radio Research Laboratory RRL which is organized under the Ministry of Information and Communications MIC EMC testing includes electromag netic emissions EMI and susceptibility EMS Certified equipment is labeled with the MIC mark and certification number Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Class A Statement 0 77E DCE AAMAS SS H 71710 21 BHA HS AE Ol 28 FAR n rd i 23 aj FE TANE WE 714802 m s HAFT Translation
33. eering Change Level of the card rev 44 Length 0x2 45 Data Al PCB revision 47 VPD Keyword SN Alphanumeric Serial Number 49 Length 0x18 50 Data 00 00XXXX XX 74 VPD Keyword V0 Misc Information 76 Length 0x10 77 Data PCIe x8 93 VPD Keyword RV 95 Length 0x1 96 Data Checksum 97 Large Resource Type VPD W Tag 0x11 0x91 98 Length 0x9B 100 VPD Keyword V1 EFI Driver version 102 Length 0x6 103 Data N A Number 109 VPD Keyword YA Asset Tag 111 Length 0x20 112 Data N A Alphanumeric N A 144 VPD Keyword RW Remaining read write area 146 Length 0x6C 147 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers Rev 1 20 40 Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Appendix A Specifications A 1 EMC Certification Statements Table 24 lists the approved certification status per HCA card in different regions of the world Table 24 HCA Cards Certification Status C Tick FCC Class EN Class ICES Class Australiaand VCCI MIC HCA P Er USA Europe Canada New Zealand Japan Korea B B B A MHEA28 XSC B B B A MHEA28 XTC A A A A MHGA28 XSC A A A
34. er 49 Length 0x18 50 Data 00 00XXXX XX 74 VPD Keyword V0 Misc Information 76 Length 0x10 TA Data PCIe x8 93 VPD Keyword RV 95 Length Oxl 96 Data Checksum 97 Large Resource Type VPD W Tag 0x11 0x91 98 Length 0x9B 100 VPD Keyword V1 EFI Driver version 102 Length 0x6 103 Data N A Number 109 VPD Keyword YA Asset Tag Mellanox Technologies Rev 1 20 32 Table 17 MHGA28 1SC VPD Layout Offset Decimal Item Value Format Description 111 Length 0x20 112 Data N A Alphanumeric N A 144 VPD Keyword RW Remaining read write area 146 Length 0x6C 147 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHGA28 1TC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 18 MHGA28 1TC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxC 3 Data Lion cub DDR Alphanumeric 15 Large Resource Type VPD R Tag 0x10 0x90 16 Length Ox4F 18 VPD Keyword PN Numbers Add in Card Part Number 20 Length 0x15 21 Data MHGA28 1TC 4 VPD Keyword
35. gies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual A 3 MHGA28 XSC and MHGA28 XTC Specifications Table 26 lists the specifications for the mem free HCA cards listed in Table 3 on page 10 with IB running at DDR Table 26 Specifications for Mem free HCA Cards IB DDR Physical Power and Environmental Size 2 5in x 4 6in 6 4cm x 11 7cm Voltage 12V 3 3V Air Flow 200LFM 55 C Maximum Power 10 3W 4X 20Gb s Connector InfiniBand Copper current rating 0 5A Temperature 0 C to 55 C max with active media adapter support On board Memory Size OMB Protocol Support Regulatory InfiniBand IBTA v1 2 Auto Negotiation 20Gb s EMC FCC 47 CFR part 15 2005 subpart B class 5Gb s or 10Gb s 2 5Gb s A QoS 8 InfiniBand Virtual Lanes for each port RDMA Support Yes All Ports ICES 003 2004 Issue 4 class A VCCI V 3 2005 04 class A EN 55022 1998 A 1 2000 A2 2003 class A EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Direc tive 89 336 EEC CTUVUS UL60950 1 2003R7 06 CAN CSA C22 2 No 60950 1 03 Safety TEC EN 60950 1 2001 ETSI EN 300 019 2 2 Environmental IEC 60068 2 64 29 32 RoHS RoHS R5 a The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architecture Specification Release 1 2 Mellanox Technologies Re
36. ifications for the MHGA28 1TC Tall Bracket HCA card with 128MB on board memory and IB running at DDR Table 29 Specifications for MHGA28 1TC 128MB Tall Bracket IB DDR Physical Power and Environmental Size Air Flow 4X 20Gb s Connector On board Memory Size 2 5in x 6 6in 6 4cm x 16 8cm 200LFM 55 C InfiniBand Copper current rating 0 5A max with active media adapter support 128MB Voltage Maximum Power Temperature 12V 3 3V 12 7W O C to 55 C Protocol Support Regulatory InfiniBand Qos RDMA Support IBTA v1 2 Auto Negotiation 20Gb s 5Gb s or 10Gb s 2 5Gb s 8 InfiniBand Virtual Lanes for each port Yes All Ports EMC CTUVUS Safety Environmental RoHS FCC 47 CFR part 15 2005 subpart B class A ICES 003 2004 Issue 4 class A VCCI V 3 2005 04 class A MIC class A EN 55022 1998 A 1 2000 A2 2003 class A EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Direc tive 89 336 EEC UL60950 1 2003R7 06 CAN CSA C22 2 No 60950 1 03 TEC EN 60950 1 2001 ETSI EN 300 019 2 2 IEC 60068 2 64 29 32 RoHS R5 a The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architecture Specification Release 1 2 Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s M
37. ing Firmware is updated occasionally and the most recent firmware can be obtained from http www mellanox com through the Firmware Downloads link The HCA firmware download pages include the following firmware update options e Single HCA card firmware update e InfiniBand cluster firmware update e Customized firmware mlx ini firmware update OEMs Only Single HCA Card Firmware Update Firmware can be updated on the standalone single card using the flint tool of the Mellanox Firmware Tools MFT package This package is available for download along with its user s manual from the single HCA card firmware update page See http www mellanox com under Firmware Downloads A firmware binaries table lists a binary file per HCA card The file name of each such binary is composed by combin ing the firmware name the firmware release version and the card part number See Table 7 Table 7 Firmware Images for InfiniHost IM Ex PCI Express HCA Cards PCI DevID Decimal amp Firmware Image Name Type of HCA Card Examples PCI DevID 22218 fw 2518 5_1_400 MHEA28 XSC bin zip is the firmware binary of firmware fw 25218 MERE version 5 1 400 for the mem free HCA card MHEA28 XSC Firmware fw 25218 PCI DevID 25208 fw 25208 4_7_600 MHGA28 1TC bin zip is the firmware binary of firmware fw With on board memory 25208 version 4 7 600 for the HCA card MHEA28 XSC with 128MB on board mem Firmware fw ory 25208
38. lanox Technologies Rev 1 20 24 Table 11 MHEA28 XSC VPD Layout Offset Decimal Item Value Format Description 75 Length 0x10 76 Data PCIe x8 92 VPD Keyword RV 94 Length 0x1 95 Data Checksum 96 Large Resource Type VPD W Tag 0x11 0x91 97 Length Ox9F 99 VPD Keyword VI EFI Driver version 101 Length 0x6 102 Data N A Number 108 VPD Keyword YA Asset Tag 110 Length 0x20 111 Data N A Alphanumeric N A 143 VPD Keyword RW Remaining read write area 145 Length 0x6D 146 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 352 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHEA28 XTC Note A1 was used as the HCA card PCB revision Later revisions of the HCA card will have the same format Table 12 MHEA28 XTC VPD Layout Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 0x9 3 Data Lion mini Alphanumeric 12 Large Resource Type VPD R Tag 0x10 0x90 13 Length 0x4F 15 VPD Keyword PN Numbers Add in Card Part Number Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 12 MHEA28 XTC VPD Layout
39. n 6 4cm x 16 8cm Voltage 12V 3 3V Air Flow 200LFM 55 C Maximum Power 12 7W 4X 20Gb s Connector InfiniBand Copper current rating 0 5A Temperature 0 C to 55 C max with active media adapter support On board Memory Size 256MB Protocol Support Regulatory InfiniBand IBTA v1 2 Auto Negotiation 20Gb s CTUVUS UL60950 1 2003R7 06 5Gb s or 10Gb s 2 5Gb s CAN CSA C22 2 No 60950 1 03 QoS 8 InfiniBand Virtual Lanes for each port a The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architecture Specification Release 1 2 Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Appendix B Interface Connectors Pinout B 1 PC compatible Connector Pinout Figure 7 2C compatible Connector 1 4 5 2 3 Table 34 12C compatible Connector Pinout Connector Pin Number HCA Signal Name 1 SPSDA 2 SPSCL 3 GND 4 NC 5 NC B 2 InfiniBand Connector Pinout Figure 8 InfiniBand 4X Port Connector S10 S9 S12 S11 S14 S13 S16 S15 J2 Conn 4X S7 Table 35 InfiniBand 4X Connector Pinout Sheet 1 of 2 IBtxOp 3 IBtxlp 3 IBtxOn 3 IBtxin 3 S8 Connector Pin Connector Pin IB Port A Signal IB Port B Signal Number Name Name Name IBtxOp 2 IBtxlp 2 S5 SI IBtxIp 0 Rx_Al Rx BI IBt
40. nel form et qualifi 9 Elimination du mat riel L limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur 10 Codes lectriques locaux et nationaux Ce mat riel doit tre install dans le respect des codes lectriques locaux et nationaux Mellanox Technologies Rev 1 20
41. o Card LED Holes Step 2 Attach short bracket to card Insert a screw along with a washer into each of the two holes on the card intended for holding the bracket Use a torque screwdriver to apply up to 2 Ibs in torque on each screw Figure 17 Attach Bracket onto Card using Screws Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Step 3 Install Connector Clips Gently push one clip onto the connector Make sure to slide both clip hooks sides around the connector evenly as shown in Figure 18 Figure 18 Sliding Connector Clip Evenly Use a small flat head screwdriver to gently slide the clip s hook towards the connector s base side as shown in Figure 19 Figure 19 Fix Clip Hooks into Place Using Screwdriver Repeat this step for the second clip See Figure 20 Assembled Short Bracket View Figure 20 Assembled Short Bracket View Mellanox Technologies Rev 1 20 62 Appendix D Avertissements de s curit d installation 1 Instructions d installation Lisez toutes les instructions d installation avant de brancher le mat riel la source d alimentation lectrique 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambiante d passant le maximum recommand de 55 C 131 F En outre pour garantir un bon coulement de lair laissez au moins 8 cm 3 pouces d espace lib
42. one T R RoHS lt blank gt non RoHS C RoHS w Exemption R RoHS Lead C Finding the GUID and Serial Number on the Adapter Cards All mellanox HCA adapter cards have a label on the printed side of the adapter card that has the card serial number and the card GUID Rev 1 20 Figure 3 Card Product Label S N MT0710X01085 LAN A N REV X1 P N MHGH28 XTC IMI DELLA LL EL ORSAK GUID 0002C90300000424 e A Made In IL Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual HCA Card Installation Hardware and Software Requirements Before installing the HCA Adapter card please make sure that the system meets the hardware and software require ments listed in Table 6 Hardware and Software Requirements Table 6 Hardware and Software Requirements Requirement Description Hardware PCI Express x8 slot or x16 slot Software e o For Windows see WinIB ReadMe at https docs mellanox com dm WinIB ReadMe html Operating e For Linux see Mellanox OpenFabrics Enterprise Distribution OFED software package available via the Systems Distributions Mellanox OpenFabrics Web site http www mellanox com products ofed php Installation Instructions Read all installation instructions before connecting the equipment to the power source Please consult the host machine documentation for instructions on how to install a PCI Express card 1 0 1 Installation Instructions
43. ough the DDR SDRAM Flash and C compatible inter faces 1 0 6 DDR SDRAM Not Applicable to Mem free Cards The board is compliant with the JEDEC standard JESD79 Double Data Rate DDR SDRAM Specification and is populated with an unbuffered ECC protected 333 MHz memory 1 0 7 FLASH ROM The board supports 4MB of Flash ROM space via the CPU interface of the MT25208 InfiniHost III Ex device The details of the Flash supported are e 8 bit data e 22 bit address e Programming via the CPU bus Intel s TE28F320J3C 110 TE28F320J3D 110 Flash device used on the board has the following characteristics e 32 Mb Uniform 4MB e 110 ns access time 1 Not applicable to Mem free HCA cards Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual 19 There is a jumper on each HCA card that indicates to the HCA IC whether an on board Flash device exists or is to be used Table 10 provides information on this jumper per HCA card type mem free or with on board memory Table 10 Jumper Configuration Referen Default Commen Card Type ce on Name Description Option Configurati E Board on Mem free 4 No Shorting Block FLASH Present CLOSED FLASH NOT PRESENT FLASH is Pres CE No Shorting Header 3 FLASH With on ent Not Present With Shorting nper in place Block 1x2 board mem J3 Block ory FLASH Not Present For the Flash jum
44. per location on mem free HCA cards see Figure 4 on page 20 For the Flash jumper location on the HCA cards with on board memory see Figure 5 on page 21 1 0 8 EEPROM The board incorporates an EEPROM that is accessible through an PC compatible interface The EEPROM is used for storing the Vital Product Data VPD VPD format adheres to the PCI Local Bus Specification rev 2 3 VPD definition see Vital Product Data VPD Format on page 23 EEPROM capacity is IKByte Mellanox Technologies Rev 1 20 20 Mechanical Information Air Flow Requirement Per the PCI Express specification all the HCA cards covered in this User s Manual require an airflow of 200 LFM at 55 C ambient temperature Board Mechanical Drawing and Dimensions 1 0 9 Mem free HCA Cards All the mem free HCA cards covered in this User s Manual have the same mechanical drawing and share the same dimensions as depicted in Figure 4 Figure 4 Mem free HCA Cards Mechanical Drawing and Dimensions mm 40 64 J3 I2C Connector J4 Flash Jumper ALL DIMENSION ARE IN MM Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual 21 1 0 10 HCA Cards with On board Memory All the HCA cards with on board memory covered in this User s Manual have the same mechanical drawing and share the same dimensions as depicted in Figure 5 Figure 5 HCA Cards with On board Memor
45. raffic 4X IB connectors e PCI Express expansion board with an x8 edge connector compatible to the PCI Express 1 0a specification e Media detect circuit supporting external InfiniBand fiber solutions e EU Restriction of Hazardous Substances RoHS compliant The boards differ in e 4X IB port speed support 10Gb s SDR or 20Gb s DDR e On board memory size Mem free OMB 128MB 256MB or 512MB e Bracket height short or tall Mem free HCA Cards Table 3 lists the Mem free HCA cards described in this manual Table 3 Mem free HCA Cards On board Ordering Part IBSDR Memory eae Pie HCA IC Part amp Number OPN DDR Size p Number Mem free HCA Card Photo Bracket ce Mem free MHEA28 XSC SDR Mem Short RoHS R5 MT25208A0 FCC free MHEA28 XTC Tall Figure 1 MHEA28 XTC MHGA28 XSC DDR Short RoHS R5 MT25208A0 FCC D MHGA28 XTC Tall Short Tall Bracket Bracket XSC XTC a The Mem free HCA cards have a similar form and fit The main visible difference is in the bracket height Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual HCA Cards with On board Memory Table 4 lists the HCA cards with on board memory described in Part TI Table 4 HCA Cards with 128MB 256MB On board Memory On board snort RoHS Ordering Part IB SDR Memory Tall Compli
46. re Update as Part of a Cluster Firmware Update 3 3 Customized HCA Card Firmware Update OEM Only Adapter Card Interfaces 4 1 VO Interfaces 4 1 1 InfiniBand Interface 4 1 2 PCI Express Interface 4 1 3 LED Assignment 4 1 4 I2C Compatible Interface 42 Power 4 3 Memory 4 3 1 DDR SDRAM Not Applicable to Mem free Cards 4 3 2 FLASH ROM 4 3 3 EEPROM Mechanical Information 5 1 Air Flow Requirement 5 2 Board Mechanical Drawing and Dimensions 5 2 1 Mem free HCA Cards 5 2 2 HCA Cards with On board Memory 5 2 3 I O Panel with Dual Ports and LEDs Vital Product Data VPD Format 6 1 PCI VPD Layout for MHEA28 XSC 6 2 PCI VPD Layout for MHEA28 XTC 6 3 PCI VPD Layout for MHGA28 XSC 6 4 PCI VPD Layout for MHGA28 XTC 6 55 PCI VPD Layout for MHEA28 1SC 6 6 PCI VPD Layout for MHEA28 1TC 6 7 PCI VPD Layout for MHGA28 1SC 6 8 PCI VPD Layout for MHGA28 1TC 6 9 PCI VPD Layout for MHGA28D 1TC Mellanox Technologies LU W 10 11 12 12 13 13 13 13 14 15 15 15 16 17 17 17 17 17 18 18 18 18 18 19 20 20 20 20 21 22 23 23 24 26 27 28 29 31 32 33 Rev 1 20 4 6 10 6 11 6 12 6 13 PCI VPD Layout for MHEA28 2SC PCI VPD Layout for MHEA28 2TC PCI VPD Layout for MHGA28 2SC PCI VPD Layout for MHGA28 2TC Appendix A Specifications Appendix B A l A 2 A 3 A4 A S A 6 A 7 A 8 A 9 EMC Certification Statements A 1 1 FCC Statements USA 41 A 1 2 EN Statements
47. re autour des ouver tures de ventilation 3 Empilage du ch ssis Le ch ssis ne doit pas tre empil sur un autre mat riel Si le ch ssis tombe il peut pro voquer des blessures corporelles et des d gradations de biens 4 Connection d Alimentation electrique excedentaire dangers lectriques Ce produit comporte un couvercle qui recouvre l emplacement de l alimentation electrique excedentaire Ne pas faire fonctionner le produit si le couvercle n est pas securise ou si il a ete retire 5 Orages dangers lectriques Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d brancher les cables 6 Branchement d branchement des cables InfiniBand en cuivre Les cables InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire tr s attention en les branchant et en les d branchant des connecteurs Consultez le fab ricant des cables pour connaitre les mises en garde et les instructions sp ciales 7 Montage et entretien sur baie Lorsque ce produit est mont ou entretenu sur baie il faut prendre des pr cautions sp ciales pour s assurer que le syst me reste stable En g n ral il faut remplir la baie avec du mat riel de bas en haut Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual 8 Installation du mat riel Ce mat riel ne doit tre install remplac ou entretenu que par du person
48. t MHGA28D 1TC VPD Layout MHEA28 2SC VPD Layout MHEA28 2TC VPD Layout MHGA28 2SC VPD Layout MHGA28 2TC VPD Layout HCA Cards Certification Status Specifications for Mem free HCA Cards IB SDR Specifications for Mem free HCA Cards IB DDR Specifications for HCA Cards with 128MB On board Memory IB SDR Specifications for MHGA28 1SC 128MB Short Bracket IB DDR Specifications for MHGA28 1TC 128MB Tall Bracket IB DDR Specifications for MHGA28D 1TC 128MB Tall Bracket IB DDR Specifications for MHEA28 2SC 256MB Short Bracket IB SDR Specifications for MHEA28 2TC 256MB Tall Bracket IB SDR Specifications for HCA Cards with 256MB On board Memory IB DDR I2C compatible Connector Pinout Mellanox Technologies 10 11 12 13 15 17 18 19 23 24 26 27 28 29 31 32 33 35 36 37 38 41 44 45 46 47 48 49 50 51 52 53 InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Table 39 InfiniBand 4X Connector Pinout Table 40 PCI Express x8 Connector Pinout Mellanox Technologies 53 54 Rev 1 20 8l Revision History Table 1 Revision History Table Date Rev Comments Changes August 2008 1 20 Removed Watermark and Confidential in the Footer March 2008 1 13 Added MIC Statement Added MIC BCC and C Tick Certs for relevant cards in Appendix A Cert Table Feb 2008 1 12 Added P N MHGA28D ITC and its specifications Added M
49. tions for the MHGA28 1SC Short Bracket HCA card with 128MB on board memory and IB running at DDR Table 28 Specifications for MHGA28 1SC 128MB Short Bracket IB DDR Physical Power and Environmental Size Air Flow 4X 20Gb s Connector On board Memory Size 2 5in x 6 6in 6 4cm x 16 8cm 200LFM 55 C InfiniBand Copper current rating 0 5A max with active media adapter support 128MB Voltage Maximum Power Temperature 12V 3 3V 12 7W O C to 55 C Protocol Support Regulatory InfiniBand Qos RDMA Support IBTA v1 2 Auto Negotiation 20Gb s 5Gb s or 10Gb s 2 5Gb s 8 InfiniBand Virtual Lanes for each port Yes All Ports EMC CTUVUS Safety Environmental RoHS FCC 47 CFR part 15 2005 subpart B class A ICES 003 2004 Issue 4 class A VCCI V 3 2005 04 class A MIC class A EN 55022 1998 A 1 2000 A2 2003 class A EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Direc tive 89 336 EEC UL60950 1 2003R7 06 CAN CSA C22 2 No 60950 1 03 TEC EN 60950 1 2001 ETSI EN 300 019 2 2 IEC 60068 2 64 29 32 RoHS R5 a The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architecture Specification Release 1 2 Mellanox Technologies Rev 1 20 48 A 6 MHGA28 1TC Specifications Table 28 lists the spec
50. v 1 20 46 A 4 MHEA28 1SC and MHEA28 1TC Specifications Table 27 lists the specifications for the HCA cards with 128MB on board memory listed in Table 4 on page 11 and IB running at SDR Table 27 Specifications for HCA Cards with 128MB On board Memory IB SDR Physical Power and Environmental Size Air Flow 4X 10Gb s Connector On board Memory Size 2 5in x 6 6in 6 4cm x 16 8cm 200LFM 55 C InfiniBand Copper current rating 0 5A max with active media adapter support 128MB Voltage Maximum Power Temperature 12V 3 3V 10 5W 0 C to 55 C Protocol Support Regulatory InfiniBand Qos RDMA Support Rev 1 20 IBTA v1 2 Auto Negotiation 10Gb s 2 5Gb s 8 InfiniBand Virtual Lanes for each port Yes All Ports EMC CTUVUS Safety Environmental RoHS Mellanox Technologies FCC 47 CFR part 15 2005 subpart B class B ICES 003 2004 Issue 4 class B VCCI V 3 2005 04 class B MIC Class A EN 55022 1998 A 1 2000 A2 2003 class B EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Direc tive 89 336 EEC UL60950 1 2003R7 06 CAN CSA C22 2 No 60950 1 03 TEC EN 60950 1 2001 ETSI EN 300 019 2 2 IEC 60068 2 64 29 32 RoHS R5 InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual A 5 MHGA28 1SC Specifications Table 28 lists the specifica
51. xOn 2 IBtxin 2 6 S2 IBtxIn 0 Rx_AO Rx BO IBtxOp 1 IBixlp 1 S3 S3 IBtxIp 1 Rx_A3 Rx_B3 IBtxOn 1 IBtxin t S s4 IBtxIn 1 Rx_A2 Rx_B2 S1 IBtxOp 0 IBtxlp 0 ET S5 IBtxIp 2 Rx_A5 Rx_B5 S2 IBtxOn 0 BRN S6 IBtxIn 2 Rx_A4 Rx_B4 Seaggesesese S7 TBtxIp 3 Rx A7 Rx B7 LOFT TON F OGG s8 IBtxIn 3 Rx_A6 Rx_B6 s9 IBtxOn 3 Tx_A6 Tx_B6 10 IBtxOp 3 Tx A7 Tx B7 S11 IBtxOn 2 Tx_A4 Tx_B4 S12 IBtxOp 2 Tx_A5 Tx_B5 S13 IBtxOn 1 Tx_A2 Tx_B2 Mellanox Technologies Rev 1 20 544 B 3 PCI Express x8 Connector Pinout Table 35 InfiniBand 4X Connector Pinout Sheet 2 of 2 Connector Pin Connector Pin IB Port A Signal IB Port B Signal Number Name Name Name 14 IBtxOp 1 Tx_A3 Tx_B3 S15 IBtxOn 0 Tx A0 Tx BO S16 IBtxOp 0 Tx_Al Tx BI G1 G6 G9 H1 H2 Signal Ground GND GND G7 Sense 3 3V SENSE Pl SENSE P2 G8 Vec MC_POWER_P1 MC_POWER_P2 a The Sense 3 3V signal is used to enable the Vcc power supply pin G8 used to provide power to the active media adapter Figure 9 PCI Express x8 Connector Rev 1 20 Table 36 PCI Express x8 Connector Pinout Sheet 1 of 3 Side B Connector Side A Connector Pin Connector PCI Ex Port Signal Connector Pin PCI Ex Port Signal Number Pin Name Name Name Name 1 12V 12V PRSNT Hot plug presence detect 2 12V 12V 12V 12V 3 RSVD NC 12V
52. y Mechanical Drawing and Dimensions mm e AU 02 Are gt o 64 40 ALL DIMENSION ARE IN MM J1 12C Connector J3 Flash Jumper Mellanox Technologies Rev 1 20 22 1 0 11 I O Panel with Dual Ports and LEDs Figure 6 shows the common I O panel of all the tall bracket HCA cards covered in this User s Manual Both IB ports ar shown along with the physical and activity link LEDs Note Short brackets have the same port and LED footprints as tall brackets See Appendix C Instructions for Replacing a Tall Bracket with a Short Bracket on HCA Cards on page 57 Figure 6 I O Panel with Dual Ports and LEDs Tall Bracket Port 1 Physical Link Physical Link Data Activity Link Yellow LED Data Activity Link Port 2 Rev 1 20 Mellanox Technologies InfiniHost III Ex PCI Express x8 HCA Adapter Cards User s Manual Vital Product Data VPD Format The PCI VPD Vital Product Data layout for each of the described Mellanox Technologies HCA cards complies with the format defined in the PCI 2 3 Specification Appendix I All HCA cards share the same PCI VPD layout i e have the same items however the Offset of each item and or its Value may be different from one card s VPD to another The PCI VPD layout for each HCA card is provided in the following sections e Section PCI VPD Layout for MHEA28 XSC on page 23 e Section

InfiniHost III Ex User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents