From:
xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
[mailto:xen-devel-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Byrne, John
(HP Labs)
Sent: Monday, July 19, 2010 2:22 PM
To: kishore kumar
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx; wangalalei;
xen-users@xxxxxxxxxxxxxxxxxxx
Subject: RE: [Xen-devel] Re: [Xen-users] wiki page on 10G SRIOV
I’m a bit confused with your device IDs. The 10fb device is the
PCI id for the physical NIC; the 10d8 device is the SRIOV Virtual Function
device created by the driver. With the latest xen-unstable, I have
successfully used this NIC to create and assign the VF devices to HVM guests.
The ixgbevf driver, which binds to the VF devices, expects device id 0x10ed. I
simply assumed that the driver was not quite up to date and tweaked things to
work. So, if you are just a bit confused, the following might help.
I added the following in my modprobe.d directory to create four
VF devices (ixgbe.conf, attached):
options ixgbe max_vfs=4
So, on my machine, I can see the physical NIC and the 4 VFs
created.
lspci –n | grep 0a:
0a:00.0 0200: 8086:10fb (rev 01)
0a:10.0 0200: 8086:10d8 (rev 01)
0a:10.2 0200: 8086:10d8 (rev 01)
0a:10.4 0200: 8086:10d8 (rev 01)
0a:10.6 0200: 8086:10d8 (rev 01)
I added the ixgbevf driver to both my dom0 and domUs. While it
is a simple tweak to add the device id to the driver, I decided to play with
modprobe instead and added the following to my modprobe.d directory in both
dom0 and domU (ixgbvevf.conf, attached):
install ixgbevf /sbin/modprobe --ignore-install ixgbevf; echo
"0x8086 0x10d8" >/
sys/bus/pci/drivers/ixgbevf/new_id
If you are working with HVM guests, there has to be a patch to
qemu as well. (Attached) You also have to add
“(pci-passthrough-strict-check no)” to your xend-config.sxp. (I don’t think you
need the xend-config change for PV guests.)
Then it is simply a matter of adding the VF PCI devices to your
domU configurations and configuring the ixgbevf devices in the guests.
Both the ixgbe and ixgbevf drivers will generate random MAC
addresses for the devices. What I wanted to do was to set the MAC
addresses for the VF devices in dom0 and then my guests’ networking
configuration was much easier. The physical NIC must be up. It doesn’t have to
have an IP address, but if it isn’t up the MAC address set in dom0 will be
lost. I’ve attached my dom0 rc.local where I set the MAC addresses and assign
the devices to pciback.
I can’t swear that this is the best way to do this, but this did
work.
John Byrne
From:
xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
[mailto:xen-devel-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of kishore
kumar
Sent: Monday, July 19, 2010 10:16 AM
To: Pasi Kärkkäinen; xen-devel@xxxxxxxxxxxxxxxxxxx
Cc: wangalalei; xen-users@xxxxxxxxxxxxxxxxxxx
Subject: [Xen-devel] Re: [Xen-users] wiki page on 10G SRIOV
I am facing a strange issue with my 10G 82599 PCIe device.
The Device Id has to be 0x10FB for SRIOV to function
properly, But all of sudden the Device ID started showing me as 0x10D8,
and because of this the SRIOV feature is not working and I cannot assign the
Virtual Function to my guest.
When I did lspci command it is showing me as Intel
Corporation Unknown device 10d8 (rev 01). Previously it was showing me
Intel Corporation 82599EB Gigabit Networking with 10FB, and I was able to
assign the Virtual Function to my guest.
I googled and found out that the device ID 0x10D8 is a 82599
Unprogrammed device.
Can any one please let me know what is happening here and
how to recover back from this?
I am totally blocked for 2 days because of this issue.
On Fri, Jul 16, 2010 at 1:05 AM, Pasi Kärkkäinen <pasik@xxxxxx> wrote:
On Fri, Jul 16, 2010 at
02:17:30AM +0000, wangalalei wrote:
> hi all:
>
> i read intel 82576 card datasheet,and finding it
saying that the 82576
> can set the vf's bandwidth,
> but when i test this card,i can not find any parameter to it
> any one else notice this problem? or anyone knows
whether the 82576
> card can control its vf's bandwidth?
>
I think bandwidth management is a work-in-progress by
Intel..
-- Pasi
> alaleiwang
>
>
--------------------------------------------------------------------------
>
> Date: Thu, 15 Jul 2010 18:35:57 -0700
> Subject: Re: [Xen-users] wiki page on 10G SRIOV
> From: bodkekumar@xxxxxxxxx
> To: pasik@xxxxxx
> CC: xen-users@xxxxxxxxxxxxxxxxxxx
>
> Yeah, I configured 64 Virtual Functions in DOM-0 and
passthru 1 VF to
> assign it to the guest. It worked for me.
>
> I assign static IP to my guest and tried to ping the remote
machine. It
> worked for me.
>
> But I am wondering that ping to DOM-0 from guest makes any
sense here?
> Can you let me know on this? ping worked though from
guest to DOM-0 as
> well.
>
> On Thu, Jul 15, 2010 at 1:11 PM, Pasi
KÀrkkÀinen <[1]pasik@xxxxxx>
> wrote:
>
> On Thu, Jun 24, 2010 at 10:56:28AM -0700, kishore
kumar wrote:
> > Hi All,
> >
> > Can any one please let me know if
there is a WIKI page which talks
> about
> > how to configure SRIOV in Xen and
use Physical Functions and
> Virtual
> > Functions ?
> >
> > I searched xen wiki, but could not
find.
> >
>
> Each virtual function should be a separate PCI device,
so you can
> passthru
> them like any other normal PCI device.
>
> Did you get it to work?
> -- Pasi
>
>
--------------------------------------------------------------------------
>
> è**倩+æ**玢+é*®ç®± æ*³èŠ*蜻æ*Ÿå*ºæžž,æ**æ*ºMSNåž®äœ
æ**å®*!
> [2]ç«*å*»äž*蜜ïŒ*
> 2. http://3g.msn.cn/
Home