2 rdma over converged ethernet, 1 roce configuration – Dell Mellanox Family of Adapters User Manual

Page 61

Advertising
background image

User Manual for Mellanox ConnectX®-3 10/40 Gigabit Ethernet Adapters for Dell PowerEdge Servers

Rev 1.1

Mellanox Technologies

61

Step 9.

Enable QoS on the relevant interface.

Step 10.

Enable PFC on priority 3.

To add the script to the local machine startup scripts:

Step 1.

From the PowerShell invoke.

Step 2.

In the pop-up window, under the 'Computer Configuration' section, perform the following:

1.

Select Windows Settings

2.

Select Scripts (Startup/Shutdown)

3.

Double click Startup to open the Startup Properties

4.

Click Add

5.

Browse for the script's location.

6.

Click OK

4.5.2

RDMA over Converged Ethernet

4.5.2.1 RoCE Configuration

In order to function reliably, RoCE requires a form of flow control. While it is possible to use
global flow control, this is normally undesirable, for performance reasons.

The normal and optimal way to use RoCE is to use Priority Flow Control (PFC). To use PFC, it
must be enabled on all endpoints and switches in the flow path.

In the following section instructions are presented to configure PFC on Mellanox ConnectX™
cards. There are multiple configuration steps required, all of which may be performed via Power-
Shell. Therefore, although each step is presented individually, you may ultimately choose to
write a PowerShell script to do them all in one step. Note that administrator privileges are
required for these steps.

Prerequisites

The following are the driver’s prerequisites in order to set or configure RoCE:

All InfiniBand verbs applications which run over InfiniBand verbs should work on
RoCE links if they use GRH headers.

Configuring Windows Host

To configure Priority flow control (PFC) on the host, perform the steps below:

Step 1.

Remove all the previous QoS configuration.

Step 2.

Enable PowerShell to configure DCB.

Step 3.

Enable the Data Center Bridging (DCB) feature which is mandatory for PFC.

PS $ Enable-NetAdapterQos -InterfaceAlias "Ethernet 4"

PS $ Enable-NetQosFlowControl -Priority 3

gpedit.msc

PS $ Remove-NetQosTrafficClass

PS $ Remove-NetQosPolicy -Confirm:$False

PS $ Set-ExecutionPolicy Unrestricted

PS $ Install-WindowsFeature Data-Center-Bridging

Advertising