Hi,
I happen to have done a huge amount of research into this as our
infrastructure is all based on converged Infiniband.
Xen-IB and SmartIO were two seperate attempts at building a
paravirtualised Infinband driver for Xen that allowed guests to use
native Infinband protocols at close to native speeds. Being
paravirtualised they were live-migration cappable and many domU could
share a single Infiniband adapter.
As far as I am aware both of the projects are dead, however SR-IOV
isn't long off for Infiniband, Mellanox is on target to push theirs
upstream into OFED 1.6 due in November, Qlogic and Oracle/Sun will be
quick to follow I would imagine.
SR-IOV will allow pretty similar functionality but less portable in
terms of live-migrate etc.
It is worth noting here that you can't bridge IPoIB, IPoIB is not a
layer 2 device and doesn't understand Ethernet. You can use EoIB
(Ethernet over IB) or routing to provide network access to domUs.
Feel free to email me if you need any help with Infiniband and Xen.
Joseph.
On 27 May 2011 04:50, Pasi Kärkkäinen <pasik@xxxxxx> wrote:
> On Thu, May 26, 2011 at 03:10:40PM +0100, Ian Campbell wrote:
>> On Thu, 2011-05-26 at 15:04 +0100, maus wrote:
>> > Hi,
>> >
>> > I know use IP-over-IB can let KVM or Xen use IB, but what I have to do
>> > is like Xen-IB. Not just use IB.
>>
>> What is Xen-IB exactly?
>>
>
> Could "Xen-IB" mean live migration over Infiniband RDMA (Remote DMA) ?
> I can't really think of other uses..
>
> -- Pasi
>
>
>> > So, there is no toturial for Xen-IB,right?
>>
>> That's right, there is no documentation and anyone who would have been
>> involved with this stuff is long gone.
>>
>> Ian.
>>
>> >
>> >
>> > Yi-Man
>> >
>> >
>> >
>> > 2011/5/26 Ian Campbell <Ian.Campbell@xxxxxxxxxxxxx>
>> > On Wed, 2011-05-25 at 14:40 +0100, maus wrote:
>> > > Hi,
>> > >
>> > > I have a project which is make KVM use InfiniBand.
>> > > However, since Xen can use InfiniBand through Xen-IB, I want
>> > to try to
>> > > make Xen use InfiniBand first.
>> > > Through that way, I think it may give me some idea about how
>> > to make
>> > > KVM use InfiniBand.
>> > > So, as you said, I just use "Updated defconfig to include
>> > infiniband
>> > > driver as modules for dom0/domU" to do?
>> > > And since I don't know how to I do first for Xen-IB, is
>> > there any
>> > > tutorial for Xen-IB?
>> > > Or does Xen build-in support IB currently?
>> >
>> >
>> > I'm not sure what IB support you expect Xen to have over and
>> > above the
>> > driver and utils support, which are functions of the dom0
>> > kernel and
>> > distro and not the hypervisor.
>> >
>> > Have you got IB working on a native system? I expect that if
>> > you do that
>> > then Xen or KVM will be able to make use of it basically for
>> > free, i.e.
>> > configure a VIF on an IP-over-IB bridge or use a local
>> > IP-over-IB
>> > address in dom0 for migration etc etc.
>> >
>> > Ian.
>> >
>> >
>> > >
>> > > Yi-Man
>> > >
>> > >
>> > >
>> > > 2011/5/24 Ian Campbell <Ian.Campbell@xxxxxxxxxxxxx>
>> > > Please do not top post.
>> > >
>> > > On Tue, 2011-05-24 at 11:07 +0100, maus wrote:
>> > > > Hi,
>> > > >
>> > > > There many file in
>> > > http://xenbits.xensource.com/ext/xen-smartio/ ,
>> > > > which should I use for Xen-IB?
>> > > > Use the following three?
>> > > > Updated defconfig to include infiniband driver as
>> > modules
>> > > for
>> > > > dom0/domU
>> > > > Updating drivers/infiniband to latest. Should
>> > shrink size of
>> > > > xen_ib.patch in
>> > > > Add support for Infiniband into Xen
>> > >
>> > >
>> > > Again, these changesets are >5 years old and have
>> > not been
>> > > looked at or
>> > > maintained since -- I am very sceptical that you
>> > will find
>> > > anything of
>> > > use on a modern Xen system in there.
>> > >
>> > > I expect that IB support in the kernels we currently
>> > use for
>> > > dom0 is
>> > > vastly improved over what was available in the
>> > 2.6.16 tree
>> > > referenced in
>> > > the above repository. Perhaps you don't even need
>> > anything
>> > > special
>> > > outside of what is available in the upstream dom0
>> > kernel.
>> > >
>> > > Perhaps if you explain what you are actually trying
>> > to achieve
>> > > then
>> > > people will be able to better advise you?
>> > >
>> > > Ian.
>> > >
>> > >
>> > >
>> >
>> >
>> >
>> >
>>
>>
>>
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@xxxxxxxxxxxxxxxxxxx
>> http://lists.xensource.com/xen-devel
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel
>
--
Kind regards,
Joseph.
Founder | Director
Orion Virtualisation Solutions | www.orionvm.com.au | Phone: 1300 56
99 52 | Mobile: 0428 754 846
--
Kind regards,
Joseph.
Founder | Director
Orion Virtualisation Solutions | www.orionvm.com.au | Phone: 1300 56
99 52 | Mobile: 0428 754 846
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
|
Home