SR-IOV
Contents
SR-IOV
before you can use the SR-IOV feature for your LDOM configuration, you will have to update the Emulex HBA firmware, according the OVM documentation Sun Storage 16 Gb Fibre Channel Universal HBA, Emulex must be at least revision 1.1.60.1 to enable the Fibre Channel SR-IOV feature. (and it says: only upgrade if you are using SR-IOV)
Update HBA Firmware to use the sr-iov Feature on Oracle VM
Download Firmware: http://www.emulex.com/downloads/oem-qualified/oracle/7101684/firmware-and-boot-code/
# unzip A11601.zip
Download Emulex "OneCommand Manager application kit", including FCA utilities, for 64-bit SPARC and 64-bit x86: http://www.emulex.com/downloads/emulex/drivers/solaris/solaris-11/management/
untar and install "OneCommand Manager application kit":
# tar xvf elxocmcore-solaris-10.2.370.16-1.tar # cd elxocmcore-solaris-10.2.370.16-1 # ./install
PKGs will be installed to /opt/ELXocm and /opt/EMLXemlxu
# hbacmd listhba m=7101684 | grep "Port WWN" Port WWN : 10:00:00:90:fa:74:eb:96 Port WWN : 10:00:00:90:fa:74:eb:97 Port WWN : 10:00:00:90:fa:74:eb:ed Port WWN : 10:00:00:90:fa:74:eb:ee
Update Firmware on the HBAs with model number 7101684:
# hbacmd listhba m=7101684 | nawk '/Port WWN/ {print $4}' | while read PWWN; do
> echo "hbacmd download $PWWN /root/sr-iov/A11601.grp"
> hbacmd download $PWWN /root/sr-iov/A11601.grp
> done
hbacmd download 10:00:00:90:fa:74:eb:96 /root/sr-iov/A11601.grp
Downloading /root/sr-iov/A11601.grp to hba 10:00:00:90:fa:74:eb:96
Download Complete. Please reboot system to activate new firmware.
hbacmd download 10:00:00:90:fa:74:eb:97 /root/sr-iov/A11601.grp
Downloading /root/sr-iov/A11601.grp to hba 10:00:00:90:fa:74:eb:97
Download Complete. Please reboot system to activate new firmware.
hbacmd download 10:00:00:90:fa:74:eb:ed /root/sr-iov/A11601.grp
Downloading /root/sr-iov/A11601.grp to hba 10:00:00:90:fa:74:eb:ed
Download Complete. Please reboot system to activate new firmware.
hbacmd download 10:00:00:90:fa:74:eb:ee /root/sr-iov/A11601.grp
Downloading /root/sr-iov/A11601.grp to hba 10:00:00:90:fa:74:eb:ee
Download Complete. Please reboot system to activate new firmware.
# init 6
Setup
pci 5/7 --> primary pci_11/13 --> io-domain # ldm start-reconf primary # ldm set-io iov=on pci_5 # ldm set-io iov=on pci_7 # ldm create-vf -n max /SYS/RCSA/PCIE4/IOVFC.PF0 # ldm create-vf -n max /SYS/RCSA/PCIE12/IOVFC.PF0 # ldm remove-io pci_11 primary # ldm remove-io pci_13 primary # init 6 # ldm add-io pci_11 io-domain # ldm add-io pci_13 io-domain # ldm bind io-domain # ldm start io-domain # ldm start-reconf io-domain # ldm set-io iov=on pci_11 # ldm set-io iov=on pci_13 # ldm create-vf -n max /SYS/RCSA/PCIE15/IOVFC.PF0 # ldm create-vf -n max /SYS/RCSA/PCIE8/IOVFC.PF0 # init 6
Guest LDOM
# ldm add-domain akhlsap02 # ldm set-core 2 akhlsap02 # ldm set-memory 16g akhlsap02 # ldm add-vds iodom-vds io-domain # ldm list-services # ldm add-vswitch net-dev=aggr0 primary-switch primary # ldm add-vswitch net-dev=aggr0 iodom-switch io-domain # ldm add-vnet net0 primary-switch akhlsap02 # ldm add-vnet net1 iodom-switch akhlsap02 # ldm list-bindings akhlsap02 # ldm list-io # ldm add-io /SYS/RCSA/PCIE4/IOVFC.PF0.VF0 akhlsap02 # ldm add-io /SYS/RCSA/PCIE15/IOVFC.PF0.VF0 akhlsap02