Reference Guide
Contents
1. M 7 Solution ComponheniS5 a dn 7 Bargware dnedgllitefrierilsss 7 21 22 Sotware Component 2 a a 7 PACS DeploynienuComponeillS5u eu me 7 INE Dad GN CN YC er 8 2 tw dw a Na 9 Zi JNODWOEKS PANO CATO MA crescendo edo s ditus YF FA NR a 9 2 2 Gonfiguring 1Gbps WAN Public aue en be Usate Pe Dn pee GO DDA 9 2 3 Configuring 40Gbps Switching Fabric MLAG 9 3 Host Installation and Configuration 2 42222 0 11 4 vShield Manager Appliance Installation 1 1 1 1 1 3 19 5 VXLAN m 22 6 Virtual Tunnel Endpoint IP Configuration 24 7 Cloud Director Deploymen Cd GWN euo ae depu Eras 26 _ d S Mellanox Technologies Rev 1 0 Table of Contents List of Tables 1 Related TD oeoumelils zs ere ce o A Yd 5 Table 2 Network Allocatlon Examlple e tete GYG 9 NN Mellanox Technologies2. heit ampin host Seteci network adag naen ia hice On Tom Ge Swiirn All MAN ASS Py Rel mly iu tg 10 142 200 31 tamp adas nm 0 1 adapters erable pode C i 10 342 nid 4 Manage VM eine nebork adapters moda 10 747 200 33 o 6 a i og finale mal og 10 142 200 34 Dig 8 ot 10 342 200 3 of COR 10 342 200 04 ma an og 10142 200 05 1 8 any 10 142 200 88 0 8 ony Ready 10 tompiajs iivices 10 1482 200 4 Faust Tnlarancn bogging Msnagermant Raplicaan ame BN trafic Cancel Click Next d Choose the first 3 options Select network adapter tasks Selec ine natwnrk tasks te perform lw Manage physical adapters template Feleti metwork adapter Add physical nebweork ihe distribulsd swsteh assign fem bo up niks remove ELE existing anas Manage physical network Mannage VMknrnal network Add vMkame ngbwork adapters 10 this distributed switch migrate tham from other switches adapters template mode assign tham te disinbuted part graums cenfigure Mair settings nr remove aising ones Analyze impact Migrate virtual machine networking Migrabe netaork xdaslera by assigning femi to distribuled pert gaupas an the dislribubed grate VM mabynrking 3 Fancy complete Manage advanced host settin
3. CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 About this Manual Mellanox Cloud XM is a group of reference architectures that allows companies to build the most efficient high performance and scalable clouds based on Mellanox s superior interconnect and off the shelf building blocks servers storage interconnect and software This document covers Cloud X M reference architecture for the most efficient cloud infrastructure based on VMware vCloud solutions while running on Mellanox interconnect technology Audience This document is intended for cloud virtualization and network architects who are interested in deploying VMware based cloud solutions using Mellanox up to 56GbE NIC and switch products Document Conventions The following lists conventions used in this document NOTE Identifies important information that contains helpful suggestions A CAUTION Alerts you to the risk of personal injury system damage or loss of data WARNING Warns you that failure to take or avoid a specific action might result in A personal injury or a malfunction of the hardware or software Be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents before you work on any equipment Related Documents For additional information see the following documents Table 1 Related Documents Document Location VMware amp VXLAN Deployment ht
4. Click Next d Enable vMotion traffic and click Next rc g 10 142 200 31 Add Networking wv 1 Select connection type Port properties Specify VMkernel port settings w 2 Select target device 3 Connection settings 3a Port properties 3b 4 settings TURCO IP settings IPv4 VMkernel port settings Network label TCPIIP stack Default Available services Enable services vMotion traffic C Fault Tolerance logging Management traffic C Virtual SAN traffic e Specify VMkernel IPv4 settings 10 142 200 31 Add Networking gt w 1 Select connection type IPv4 settings Specify VMkermel IPv4 seltings w 2 Selecttarget device 3 Connection setimgs _ Obtain IPv4 settings automatically 2 Use static 4 settings 3b IPw4 settings 4 Ready to complete Subnet mask Detault gateway for IPv4 10 142 2001 ONS server addresses 10 142 200 201 Back Next Cancel Click Next and Finish Mellanox Technologies Rev 1 0 Host Installation and Configuration 10 Migrate management interface from the standard vSwitch to MGMT_DVS vSphere distributed switch and set up VMkernel interface for vMotion Port Group in the Management cluster Repeat steps 6 a 6 f with the following changes e In Step e choose two Mellanox interfaces e In Step choose DPortGroup MGMT port group Repeat
5. Local Security Authentication Server Active Directory Servic Stopped Redirector Active Directory Service Stopped Service Details Running Status Running Stop Restart Note Action will take place immediately Startup Policy Start and stop with host v Start and stop with host Cancel Click OK c Copy the driver to each host in the tmp folder using a secure shell copy application For example WinSCP d Install the driver Run from each host s console the following command esxcli software vib install d tmp MEL mlnx en 1 9 9 4 LOEM 550 0 0 15531520 ofLlmne bundle 2349569 21p amp reboot 6 Create the distributed switches NSX_DVSwitch A single uplink with two port groups NSX MGMT vMotion e WAN DVSwitch A single uplink with port group WAN_DPG e MGMT DVS Two active uplinks Load balancing Route based on IP hash with two port groups DPortGroup MGMT DPortGroup_vMotion Note Networks CloudX LAN and LAB Network used by the Misc management server and without specific settings _ gt _ 7 Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 7 Migrate management interface from the standard vSwitch to NSX_DVSwitch vSphere distributed switch DVS ng adu gt Dist Select Networking gt Distributed Switch gt Manage Tab gt Settings Tab gt Topology gt Add and Manage Hosts 20 2 a Choose Add host and manage h
6. 40Gbps Switching Fabric MLAG VLANs e Left and Right spine switches e Set the MTU to at least 1600 for all ports In our setup we set to 9000 Disable the STP protocol e Create an MLAG between the spine switches Setup an mlag port channel interface for each uplink from the TOR switch e Set all mlag port channel interfaces to trunk mode with pass through all VLANs e Save the running configuration e Bronze and Gold cluster switches e Set the MTU to at least 1600 for all ports In our setup we set to 9000 Disable the STP protocol e Create a LAG interface between the uplinks and the spine switches e Save the running configuration 1 tt Mellanox Technologies Rev1 0 Network Installation Management cluster switches e Set the MTU to at least 1600 for all ports In our setup we set to 9000 e Disable the STP protocol e Create an MLAG between the management switches e Set up an mlag port channel interface for each uplink from the TOR switch to the spine switch e Set all mlag port channel interfaces to trunk mode with pass through all VLANs e Create an mlag port channel interface for each management server connection port and set it to hybrid mode with default VLAN 101 and tagged VLAN 102 e Save the running configuration NOTE For further information of switch configuration please refer to the MLNX OS User Manual See Table 1 Related Documents 5 222 Mellanox Technologies Confide
7. ANN Mellanox TECHNOLOGIES Connect Accelerate Outperform CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 www mellanox com Mellanox Technologies NOTE THIS HARDWARE SOFTW ARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST OUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OFLIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENT ATION EVEN IF ADVISED OF THE P
8. O RC Storage Policies Notes Update Manager Compliance Tags 2 After installing vCloud Director open up a web browser and navigate to https vcloud 01 cloudx vmw mlnx and complete the remaining steps in the wizard 26 Mellanox Technologies Confidential
9. OSSIBILIT Y OF SUCH DAMAGE Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 Hakidma 26 Sunnyvale CA 94085 Ofer Industrial Park U S A Yokneam 2069200 www mellanox com Israel Tel 408 970 3400 www mellanox com Fax 408 970 3403 Tel 4972 0 74 723 7200 Fax 4972 0 4 959 3245 Copyright 2015 Mellanox Technologies All Rights Reserved Mellanox Mellanox logo Bridge X amp ConnectX Connect IB amp CoolBox CORE Direct GPUDirect InfiniBridge Infini Host InfiniScale amp Kotura Kotura logo MetroX amp MLNX OS PhyX Scalable HPC SwitchX TestX UFM Virtual Protocol Interconnect Voltaire and Voltaire logo are registered trademarks of Mellanox Technologies Ltd ExtendX FabricIT FPGA Direct M HPC X Mellanox Care Mellanox CloudX TM Mellanox Open Ethernet Mellanox PeerDirect Mellanox Virtual Modular Switch MetroDX NVMeDirect Switch IB Unbreakable Link are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners 2 Document Number MLNX 1 5 4882 Mellanox Technologies Table of Contents Rev 1 0 Table of Contents About this Manuals tona ttai uico GUY Ri sea NND NW 5 OVervlIeW
10. ady vmkz 10 142 202 53 10 142 200 we Ready vmk2 10 142 202 64 2 lU 142 200 af Ready wmkz 10 142 202 6 5 v Ready NEX 103 Slate 1609 10 142 200 Ready vmk2 10 142 202 33 10 142200 Ready vmk2 10 142 202 32 10 152 200 Raddy wmk2 10 142 202 31 ia 10 142 200 af Ready wmk2 10 142_202 34 3 Set up the Segment ID Pool and Multicast Group Address Range configuration 24 Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 Click the Segment ID button and then press Edit Ann Firewall Er card Hebwork Scopes eworks Edges Provide a pool and multicast range unique to this wShiekd manager Mubicnet addretinn 239 0 0 1 229 0 5 254 Ok Cancel Click OK 25 Mellanox Technologies Rev 1 0 vCloud Director Deployment 7 vCloud Director Deployment 1 Deploy vCloud Director For information on how to do so please refer to http pubs vmware com vcd 55 topic com vmware ICbase PDF vcd 55 install pdf http pubs vmware com vcd 55 topic com vmware ICbase PDF vcd 55 admin guide pdf The screenshot below displays the complete VM with the deployed vCloud director In this setup vCloud Director Hostname is vcloud 01 cloudx vmw mlnx 4 MGMT 01 Actons v Networ co 3 Datastores t RC
11. atacenter in the left pane 3 Navigate to the Network Virtualization tab on the right pane B https vsm 01 cloudx vmw mlnx aci vShield Manager O General App Firewall Endpoint SpoofGuard Network Virtualization Preparation Network Scopes Networks Edges ag Settings amp Reports E Data Security i i li Service Insertion Network Connectivity for VXLAN Traffic B Normal f Object Library All hosts in a cluster must be connected to a distributed switch to enable VXLAN networking aw Datacenters CloudX Hosts amp Clust Status Vmknic IP Ad Distributed S VLAN Teaming Policy VX Bronze Gh VX Gold MGMT 4 Press the Preparation link and add the Clusters you want to participate in VXLAN networking and then press Edit a Choose a distributed switch and set the VLAN ID Cloud X General Apa Firewall 5poofGuard Network Virtualization Preparation Network Scopes Networks Edges Select participating Select participati nag clusters clusters Select one ar mare clusters ta participate in VXLAM networking For each cluster designate a distributed switch to transport VXLAN traffic Chae Saitoh 1 14 DVSwlth NSX_DVSwitch 0 Click Next 22 Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 b Set the desired teaming
12. atastone 5 adapters iP patastore Physical adapiers em TOR configuration em Advanced Naira witchc Sach NSX MGMT Dm Y HSK DvSwilch DvUp nks 107 VLAN IC Gy Uplink 1 1 Adapter 1 Machines 2 wldotion WLAN 102 Pars 1 00 EL 5 107 9 VLAN ID 103 0 5 Virtual Machines 0 2 After setting up VTEP VMkernel interfaces on all hosts refresh the Preparation page to see that all Clusters are VXLAN ready 3 2 eleudx vrrmiominx aci 2 di C ELITS mew Hos B App Endpoint 5 Network Virtualization Melwurk Scope Edges E Seliings amp Reports a C v hield App _Cannmectivity Segment ID EE Data Security Service insertion Network Connectivity for VXILAM Traffic An Object Library clusier must be connected bo a disbribuled gwich be amable VALAN networking EJ Datacenters Hasta amp Clist Vmiknic TP Addres Distributed 5 14 VLAN Tearing Policy MTU w Ready DHCP DuEwibch 103 state ElhwerZhanm 1600 HC DE wv Branze vx cnld MGMT 10 142 200 sr Ready 2 10 142 202 65 p 10 142 200 Re
13. ch i On Mher swichesindaimed Wa wonicd nici wmnic1000402 Back Cancel Click Next f Assign an NSX_MGMT port group and press Apply to all w 1 Select task Manage VMkernei network adapters Template mode Manage ard 255507 Network adapters the distributed swch 2 Select hosts w 3 Select template host Contgure oc rewew the setings of the Vllikemel network adapters of the template host on this switch Ya tasks network azaptecs wil De warming 5303 might lose network connediety unless they are migrated to the distribuled switch Seted a deslinalion port group to mug ate ern vs Manage physical network PX por group New acapter Ed adapter wm Reset changes View semings Mort berms wr Ao i Uw by wt Sour Pon Croup Deet an cn Mort Cacus 7 Analyze impact lt 10 142 200 31 template 8 Migrate VM networking On swch 9 Ready to complete 5 On other swtches o ADG fe ser gs of he Verne network edapters of he template Nast on fiis switch to af nosts oy teal am Reset Kost here tewon 14 bey Seth Source Port Group Oesticaton Port Geoop 9 10 142 200 32 Ontes switch Mc38e1 Reassignec ySwtlch0 Management Network NSX_MCMT Or oer swt chas 10142200 33 Back Next Finis Cancel Click Next until Finish Ready complete Review your selections defor
14. d Networking and Security Manager One Virtual Distributed Switch 1 2 Setup Diagram Figure 1 presents the cloud topology Figure 1 Cloud Topology TOR Bronze NIG TOR Gold LAG MGMT Left MIAG MGMT Right ML AG WAN LARS MGMT Cluster network GU I HU TH Te con leeu o UUN MISC MGMT L fat sai Remote MGMT VM WAN External _ 7 Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 2 Network Installation 2 1 Networks Allocation The example in this document is based on the network allocation defined in this table Table 2 Network Allocation Example Network Switching Subnet Mask Gateway VLAN ID Fabric Management Mellanox 10 142 200 0 24 10 142 200 101 and Storage 40Gbps vMotion Mellanox 10 142 201 0 24 N A 102 40Gbps VXLAN Mellanox 10 142 202 0 24 N A 103 40Gbps WAN Public 1Gbps 10 144 255 41 53 16 10 144 0 1 Public network used to connect switch Cloud nodes to an external network Note In the examples used in this document Lab network is used as W AN Public 2 2 Configuring 1Gbps WAN Public Switch e No specific configuration is required e Each server in Bronze and Gold clusters should be connected to the network e The range of IP addresses within the WAN Public network to be used by the cloud should be allocated by the Network administrator 2 3 Configuring
15. e An available PCI Express v3 0 x8 e Mellanox ConnectX 3Pro EN VPI dual port adapter e Mellanox SwitchX products with 40Gbps Ethernet support 1 1 2 Software Components The following components installation and configuration are covered in this document VMware ESXi 5 5 U2 e VMware vCloud Networking and Security 5 5 4 2504419 e VMware vCloud Director 5 5 3 2578696 Prerequisites We assume the components below are already installed and configured on your system We will run there components as VMs on dedicated standalone ESXi server MISC MGMT server e Active Directory domain controller with DHCP and DNS server based on Windows Server 2012R2 e SQL server 2014 for vCenter and vCloud DB e VMware vCenter 5 5 U2 1 1 3 Deployment Components e Switch Fabric Six MSX6710 switches for cloud internal networks e 1Gbps switch for WAN External network connectivity e Two compute clusters Gold and Bronze in the same vCenter datacenter For Bronze and Gold clusters a single port adapter can be used too Mellanox SwitchX VPI switches can be used too r J Mellanox Technologies Rev 1 0 Overview Four hosts per cluster e One Top of the Rack switch per cluster e One 40 56GbE ConnectX 3 Pro VPI Dual Port Adapter network interface cards per host e Two Virtual Distributed Switches External VXLAN e Management cluster 3 hosts in the cluster e 2 Top of the Rack switches VCloud Director vClou
16. e finishing me ward Number of managed hosts Hosts to add 8 Number of network adapters tor update Physical network adapters Updated vMkemel network 7 adapters Resssigned VMkeme network 8 adapters 5 5 ww 9 Ready to complete Mellanox Technologies Rev 1 0 Host Installation and Configuration 8 Set up the WAN DSwitch vSphere distributed switch Repeat steps 6 a 6 f with the following changes e In Step e choose Gbps interface connected to WAN Public network e In Step f choose PG port group Once completing these steps the window below will display your results 4 D5w ch v a a Getting Started Summary Monitor Manage Related Objects Cl wcenber D1 ery a Cours Sans Alarm Definitions Tags Fenmissions Network Protocol Prof es Forts Resource Allocation 3 VM FNebwork Se Progen Eir ra WAN ao WAN 225 ril ER d chowax Lan VLAN ID 1 NIC Adapters E3 LAB Hetwork Private virtual Machines 0 Vide 2 ees a wmnic 10 14 GRMGHT WS Neti lew wmnicB 10 142 200 84 o e DFOITGIOUD MmT cr DDOD Port wmnieD 10 142 200 63 see Health chock wmnict 10 142 200 21 1 DS DVUp nis 4 10 142 200 65 o i vmniet 10 142 200 88 vmnic 10 142 200 34 oO 9 Configure VMkernel inte
17. es Compatibility ESX ESXi 4 0 and later VM version 7 Update Manager Compliance r1 Edit Settings Status Advanced Configuration Scan Detailed Status Click Open with VMRC Log in using admin credentials Type enable in the Command Line prompt and re enter admin password uw 2 Type setup to configure the vShield Manager VM networking settings in Management and Storage network In this document vShield Manager VM is referred as vsm 01 cloudx vmw mlnx E Mellanox Technologies Rev 1 0 vShield Manager Appliance Installation VSM 01 VMware Remote Console VMRC ff cb EH login login login login login login login login login login login login login login login login admin anager setup se CTRL D to abort configuration dialog at any prompt Default settings are in square brackets Ll IP Address A B C D _ 9 Open a web browser and navigate to https vsm 01 cloudx vmw mlInx 10 Log in using admin credentials 11 Link the vShield Manager to your vCenter server a Navigate to Settings amp Reports on the left pane Under the Configuration tab on the right pane b Edit the information listed under vCenter Server to match your vCenter Server s network configuration 20 Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 View Host amp Clusters D Settings amp Reports Co
18. f hosts When you add cluster the host s resources become part of Bl VX Gold 10 142 200 63 10 142 200 64 10 142 200 65 10 142 200 66 E MGMT El ih Management 10 142 200 11 10 142 200 12 10 142 200 13 Temp RH6 5 E vcd 01 ij VSM 01 10 142 200 14 resources The cluster manages the resourc within it Clusters enable the vSphere High Availabilit vSphere Distributed Resource Scheduler D Basic Tasks f Add a host Gt Create new virtual machine Create a resource pool 11 Mellanox Technologies Rev 1 0 Host Installation and Configuration 5 Manually upgrade the MLNX EN ESX Driver for VMware ESX 5 5 a Download the latest Mellanox driver from VMware site In our example we use MEL mlnx en 1 9 9 4 0EM 550 0 0 1331820 offline_bundle 2349568 zip b Enable SSH and 5 Shell on each host in Security Profile services via vSphere Web Client Hosts and Select Hosts and Clusters 249 gt Select the desired server gt Manage Tab gt Settings Tab gt Security Profile gt Scroll down to the Services section and press Edit In edit window start ESXi Shell and SSH services 10 142 200 12 Edit Security Profile To provide access to a service or client check the corresponding box By default daemons will start automatically when any of their ports are opened and stop when all of their ports are closed Direct Console Ul Running Running Running Running
19. gs Sel 18 number of per legacy hasi pry switch simpe distributed switch Manage Vvidkernal Manage poysecal adaplers TN VMkerne peris Uplina TR I Eu SE Migrate virtual machines networking Uai wm Click Next 14 Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide e Assign the Mellanox interface as the uplink on the template host and press Apply to all Add and Manage Hosts 7 w 1 Selecttask Manage physical network adapters template mode Add or remove physical network adapters to this distribuled switch w 2 Selecthosts 3 Select template host Configure or review physical network adapter assignments for Ihe lemptate hast in this switch w a Select network adapter 4 tasks Assign uplink u Reset changes o View settings Manage physscal network neid Network Astapters 1 Uw by Dia Jpline Uplire Mort adapters lemp ate templa Manage VMkernel network 10 142 200 31 te adapters template moge On this switch 4 Analyze impact OO E 4 e Migrate VM networking On other awitchesuactaimed Ready to compsete vmmic 1 o Apply e physical network adapter assignments on this swilch for the template host lo all hosts met Hervan Asta ien i in Uwm by Ste Uplire Port 12014220032 On fnis awll
20. ing Started sy Actions Management slated Objects 5 vcenter 01 12 Add Host CloudX E Move Hosts into Cluster z New Virtual Machine amp vx Bronze E New vApp 10 142 200 31 New Resource Pool 10 142 200 32 New Datastore E 10 142 200 33 10 142 200 34 fay Attach Host Profile vl God 4 Settings 10 142 200 63 Cluster Resol O vSphere DRS o B 10 142 200 64 Hino 1 Move To E ADEM 10 142 200 65 Rename E 10 142 200 66 Total Processors 2 Assign Tag ns Y O v g MGMT Total CPU Resol lt j Remove Tag I DW Management gt maaan 4 Migration automation level Fully Automated gt B 10 142 200 14 Migration threshold Apply priority 1 Total Virtual Flast All vCenter Actions gt priority 2 and EVC Mode Manage 4 Cluster Consumers 3 Power management automation level Off Resource Pools 0 DRS recommendations 0 DRS faults 0 vApps 0 3 Complete the remaining steps in the wizard to install the vShield Manager Appliance to a location of your choosing After finishing the setup wizard a new vShield Manager VM should appear in your Hosts and Clusters inventory window 4 Power on the Virtual Machine 4 vCenter X CD VSM 01 Actions y 8 E amp Getting Started Summary Monitor Manage Related Objects vcenter 01 VSM 01 v i CloudX Guest OS Other Linux 64 bit Compatibility ESX ESXi 4 0 and
21. later VM version 7 y gt E X Gold VMw are Tools Running version 2147483647 Guest Managed VX Gol DNS Name manager v Ba MGMT IPAddresses 10 142 200 209 amp Management View all2 IP addresses m an 10 142 200 12 B 10 142 200 11 Launch Console Host 10 142 200 12 10 142 200 13 Open with VMRC Temp RH6 5 Download VMRC a VSM 01 2 VM Hardware VM Storage Policies LH Notes Oo gt 10 142 200 14 CPU 2 CPU s 21 MHz used VM Storage Policies vShield Manager is the centralized network management component of vShield and is installed as a virtual appliance on any ESX host in your vCenter Server environment Hard disk 1 60 00 GB Last Checked Date Install vShield Manager on an ESX host separate from your vShield components Using the vShield Manager user Memory a 8192 MB 81 MB used VM Storage Policy Compliance Network adapter 1 DPortGroup_MGMT connected Refresh interface or vSphere Client plug in administrators install CD DVD drive 1 Disconnected 8 configure and maintain vShield components The vShield Tags Manager user interface leverages the VMware Infrastructure Floppy drive 1 Disconnected alr z SDK to display a copy of the vSphere Client inventory panel Assigned Tag Category Description st and includes the Hosts Clusters and Networks views Video card 4 00 MB This listis empty Other Additional Hardware i
22. nfiguration Updates System Events Audit Logs General Support Backups SSL Certificate Networking E7 Settings amp Reports DA vShield App Fod i Edit E Data Security Lookup Service i Service Insertion For vCenter versions 5 1 and above you may configure Lookup Service and provide the SSO administrator credentials to register i E Object Library vShield Manager as a solution user It is also recommended to set the NTP server for SSO configuration to work correctly e Datacenters vCenter Server Edit Connecting to a vCenter server enables vShield Manager to display the VMware Infrastructure inventory HTTPS port 443 needs to be open for communication between vShield Manager ESX and VC For a full list of ports reguired see section Client and User Access of Chapter Preparing for Installation in the vShield Installation and Upgrade Guide Last successful inventory update was on 4 28 2015 2 19 PM UTC DNS Servers Edit To resolve all objects referenced using a hostname you must provide one or more DNS servers common to vCenter ESX hosts and other vSphere components Primary Server 10 142 200 201 Secondary Server Not Configured Tertiary Server Not Configured NTP Server Edit Specify NTP server below For SSO configuration to work correctly it is reguired that the time on vSM server and NTP server should be in sync It is recommended to use the same NTP server used by the SSO server NTP Server 062200207 Sy
23. ntial CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 Host Installation and Configuration In order to deploy the host please follow these steps 1 Install ESXi 5 5 U2 on all the servers 2 Configure vCenter server to connect to each ESXi host for GU WEB management 3 Log into your vCenter Server via the vSphere Client or vSphere Web Client and create two datacenters MGMT CloudX with three clusters Management VX Bronze VX Gold File Edit View Inventory Administration Plug ins Help EJ a Home p gt Inventory p sg Hosts and Clusters m s egt 98s E CloudX Getting Started Nis s D cg ih VXeBronze What is a Cluster MGMT Management 10 142 200 14 A cluster is a group of hosts When you add a host to a cluster the host s resources become part of the cluster s resources The cluster manages the resources of all hosts within it Clusters enable the vSphere High Availability HA and vSphere Distributed Resource Scheduler DRS solutions Basic Tasks f Add a host t Create new virtual machine Create a resource pool 4 Drag your hosts to the corresponding cluster Home Inventory b reg Hosts and Clusters EK s eux sius Ej Cloudx db VxcBronze 10 142 200 31 10 142 200 32 10 142 200 33 10 142 200 34 VX Bronze Hosts Summary Virtual Machines What is a Cluster A cluster is a group o
24. ost networking advanced gt Add and Manage Hosts 1 Select task Select task Select a task to perform on this distributed switch E 29 2 Select hosts 3 network adapter Add hosts Add new hosts to this distributed switch Manage physical network adapters _ Manage host networking Manage VMkernel network Manage networking of hosts attached to this distributed switch adapters A Remove hosts 6 Analyze impact Remove hosts from this distributed switch 7 Ready to complete Add host and manage host networking advanced Add new hosts and manage networking of hosts already attached to this distributed switch Use this option to unify the network configuration of new and existing hosts Next F Cancel Click Next b Press New hosts and select hosts Q Filte ost Stat Cluster 8 1014220031 Connected E vx Bronze v 8 1014220032 Connected B 1014220033 Connected E vx Bronze y 10 142 200 34 Connected vx Bronze 0 10 142 200 63 Connected vX Gold 8 10142200 64 Connected vx Gold 8 1014220065 Connected vx Gold E 10 142 200 66 Connected Gp vX Gold 8 items Cancel Click OK and Next ww wo s J Mellanox Technologies Rev 1 0 Host Installation and Configuration c Select any host as your Template host 5alact template host Selecta templale hast ln apply iis network configuration switch lo Ihe olher hosis
25. policy and MTU to 1600 In this setup there is no teaming and servers connected through single 40Gbps link dendr 2 O sraa mraze Network Virtualization Specify transport attributes The following switches were ted for transporting VXLAN traffic genga 1 Pleate cpecily a VLAN preferred MTU setting for each emiteh Specify transport altriba tes Catrin aed Smid Tear Pu gt cy Static EtherChannel 100 Previous Next Finish Cancel 5 Click Finish to begin preparing your hosts for VXLAN networking 23 Mellanox Technologies Rev 1 0 Virtual Tunnel Endpoint IP Configuration 6 Virtual Tunnel Endpoint IP Configuration 1 The IP configuration is required for Virtual Tunnel Endpoint VTEP VMkernel interface on each host in CloudX datacenter The configuration may be either provided by the DHCP server or configured manually In this setup there is no DHCP infrastructure available so VTEP VMkernel interfaces were configured manually The figure below shows the final configuration for one VTEP VMkernel interface ViTTWare vSphere Web Client 4 Vx Bronze Stated Summary Mono Manage Related Objects Tap Level Ohjacte Senngs Sinrage Alarm DaefiniBans Taga Permissions CE Machines 1 Virtual swilches M Ten 111 E3 D
26. rface for vMotion Port Group on each server in both Bronze and Gold cluster Hosts and Click the Home button h on vSphere Web Client and select Hosts and Clusters cu gt CloudX datacenter gt Related Objects gt Hosts Tab a Select the desired host b Select the Manage Tab gt Networking gt VMkernel adapters and add the VMkernel Network Adapter 2 e g 10 142 200 31 Add Networking 1 Select connection type Select connection type Select a connection type to create 2 Select target device VMkernel Network Adapter The VMkernel TCP IP stack handles traffic for ESXi services such as vSphere vMotion iSCSI NFS FCoE Fault Tolerance Virtual SAN and host management Physical Network Adapter A physical network adapter handles the network traffic to other hosts on the network _ Virtual Machine Port Group for a Standard Switch A port group handles the virtual machine traffic on standard switch Cancel Click Next c Select target port group g 10 142 200 31 Add Networking Select target device Select a target device for the new connection w 1 Select connection type 2 Select target device 3 Connection settings Select an existing distributed port group 3a Port properties Browse _ Select an existing standard switch _ New standard switch b Cancel Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0
27. slog Server Edit You can specify the IP address or name of the syslog server that can be resolved using the above mentioned DNS Server s Syslog Server Not Configured Port Not Configured 12 Add an SSL Certificate to identify the vShield Manager Web Service to disable the Certificate error warning a Click on the SSL Certificate under the Configuration tab on the right pane b Generate a Certificate Signing Request download it sign in a local CA and import the signed certificate 13 Reboot the vShield Manager Appliance 14 Re open a web browser and navigate to https vsm 01 cloudx vmw mlnx 15 Verify the vShield Manager Web Service certificate is valid vsm 01 cloudx vmw mlnx co amp C e Login x General Details Certification Path Certificate Information This certificate is intended for the following purpose s Ensures the identity of a remote computer eld Manager Issued to vsm 01 doudx vmw minx id Valid from 06 04 2015 to 04 04 2020 Install Certificate Issuer Statement Learn more about certificates yright 1998 2015 VMware Inc All rights reserved lx NOTE For more information please refer to http Www vmware com pdf vshield_55_install pdf 11 1L Mellanox Technologies Rev 1 0 VXLAN Configuration VXLAN Configuration 1 Log into the vShield Manager VSM via a web browser 2 Select your CloudX d
28. steps 8 8 for each the servers in the cluster Once completing these steps the window below will display your results B rs 1411 ERO 5 5 0 2456174 VB EnEE dl Vice Mew Snitch wiphere Smich ge Mel wrorha fh Management 1 3 563385 11 242 100 17 2 MGMT 965 J 1 42 200 15 E n DH HGHT Ds 2 heats rdd d t 6 IMaHMTLDE DVupirizdt inn LAN ID 1 Uplink L LN3C Adapter ch Mere Poets 11 CH much 42 21 1019220018 ea dtd roual Machines 2 CH mic i PE aed At viet Sor Tyr Puram 1 TE Mahra tan raki ANOLE o dn toatl Hade oc gr Wirbual Machines 4 arity Pra fi sal Cache Dani Pensar Alles ca Ben VAR Aaron rt Drwyn Si AN 7 Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 4 vShield Manager Appliance Installation 1 Download the vShield Manager Appliance from the VMware website 2 Install the vShield Manager Appliance on the Management cluster from the vShield Web Client Actions 2 Deploy OVF Template x lj Management Actions 724 vCenter E Gett
29. tp Www vmware con files pdf techpaper V M ware Guide VXLAN Deployment Guide pdf VMware Network Virtualization http Www vmware com files pdf techpaper Virtual Network Design Guide Design Guide pdf A Mellanox Technologies Rev 1 0 Overview Document Location How To Configure MLAG on https community mellanox com docs DOC 1434 Mellanox Switches http support mellanox com MLNX OS User Manual NOTE Active support account required to access manual C Mellanox Technologies Confidential CloudX VMware vCloud 5 5 Reference Guide Rev 1 0 1 Overview CloudX for VMware vCloud is a private implementation of cloud reference design based on VMware vCloud Suite and Mellanox advance interconnect NIC and switch products This CloudX takes advantage of Virtual eXtensible Local Area Network VXLAN offload capabilities of Mellanox ConnectX 3 Pro NIC device to provide both the scalability and efficiency of VXLAN without the associated penalties significant drop of network throughput and increase of CPU utilization In addition this reference design takes advantage of Mellanox 40Gbps end to end interconnect to provide ample IO services for the VMs running on each Hyper V hypervisor increasing the VM density and the overall performance of the cloud 1 1 Solution Components 1 1 1 Hardware Reguirements server platform shall be compatible with the VMware ESXi 5 5 U2 reguirements
Download Pdf Manuals
Related Search