Dell Mellanox Family of Adapters User Manual
Page 43
User Manual for Mellanox ConnectX®-3 10/40 Gigabit Ethernet Adapters for Dell PowerEdge Servers
Rev 1.1
Mellanox Technologies
43
The example above loads the driver with 5 VFs (num_vfs). The standard use of a VF is a single VF
per a single VM. However, the number of VFs varies upon the working mode requirements.
The protocol types are:
Step 10.
Reboot the server.
Step 11.
Load the driver and verify the SR-IOV is supported. Run:
Where:
•
“03:00" represents the Physical Function
•
“03:00.X" represents the Virtual Function connected to the Physical Function
port_type_array
Specifies the protocol type of the ports. It is either one array
of 2 port types
't1,t2'
for all devices or list of BDF to
port_type_array 'bb:dd.f-t1;t2,...'
. (string)
Valid port types: 1-ib, 2-eth, 3-auto, 4-N/A
If only a single port is available, use the N/A port type for
port2 (e.g '1,4').
Note: For dual port Ethernet only devices set
port_type_array=2,2.
probe_vf
•
If absent or zero: no VF interfaces will be loaded in the Hyper-
visor/host
•
If num0_vfs is a number in the range of 1-63, the driver run-
ning on the Hypervisor will itself activate that number of VFs.
All these VFs will run on the Hypervisor. This number will
apply to all ConnectX® HCAs on that host.
•
If its format is a string: the string specifies the
probe_vf
parameter separately per installed HCA.
•
The string format is: "bb:dd.f-v,bb:dd.f-v,…
•
bb:dd.f = bus:device.function of the PF of the HCA
•
v = number of VFs to use in the PF driver for that HCA
For example:
•
probe_vfs=5
- The PF driver will activate 5 VFs on the HCA
and this will be applied to all ConnectX® HCAs on the host
•
probe_vfs=00:04.0-5,00:07.0-8
- The PF driver will
activate 5 VFs on the HCA positioned in BDF 00:04.0 and 8
for the one in 00:07.0)
Note: PFs not included in the above list will not activate any
of their VFs in the PF driver.
If the Mellanox card is not available after rebooting when SR-IOV is enabled (and
many virtual functions were configured), the following steps can be taken:
1. Disable SR-IOV in the System BIOS
2. Reboot the server
3. Verify the adapter becomes available
4. Configure less SR-IOV virtual functions for the Mellanox adapters. Recommenda-
tion is less than 126 total functions (virtual and physical) for Mellanox devices.
5. Enable SR-IOV in the System BIOS
lspci | grep Mellanox
Parameter
Recommended Value