WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Are there source codes for Xen-IB?

To: Joseph Glanville <joseph.glanville@xxxxxxxxxxxxxx>
Subject: Re: [Xen-devel] Are there source codes for Xen-IB?
From: Ian Campbell <Ian.Campbell@xxxxxxxxxxxxx>
Date: Tue, 31 May 2011 10:04:59 +0100
Cc: maus <maustudent@xxxxxxxxx>, "xen-devel@xxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxx>, "Fajar A. Nugraha" <list@xxxxxxxxx>
Delivery-date: Tue, 31 May 2011 06:42:54 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <BANLkTiniDtQaz=W1_daSDSaLzqHx5fqi9Q@xxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Organization: Citrix Systems, Inc.
References: <BANLkTi=eg4T77cjfjKKyWhDZTTTYMO13Wg@xxxxxxxxxxxxxx> <BANLkTikSVUa2d6ccZWDBCyAODJ-6fvWnvg@xxxxxxxxxxxxxx> <1306147218.20576.79.camel@xxxxxxxxxxxxxxxxxxxxxx> <BANLkTikybX1pE0wYMwx9LLSLnVLWecU2uA@xxxxxxxxxxxxxx> <1306232138.20576.147.camel@xxxxxxxxxxxxxxxxxxxxxx> <BANLkTinrLrNs3t3GzV2NH4cPm-uuOk63OA@xxxxxxxxxxxxxx> <1306395870.775.8.camel@xxxxxxxxxxxxxxxxxxxxxx> <BANLkTintPGMs9aLsku4OsGp5b_G6bAwt3g@xxxxxxxxxxxxxx> <1306419040.775.34.camel@xxxxxxxxxxxxxxxxxxxxxx> <20110526185006.GJ32595@xxxxxxxxxxx> <BANLkTiniDtQaz=W1_daSDSaLzqHx5fqi9Q@xxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
On Sat, 2011-05-28 at 19:15 +0100, Joseph Glanville wrote:
> Hi,
> 
> I happen to have done a huge amount of research into this as our
> infrastructure is all based on converged Infiniband.
> 
> Xen-IB and SmartIO were two seperate attempts at building a
> paravirtualised Infinband driver for Xen that allowed guests to use
> native Infinband protocols at close to native speeds. Being
> paravirtualised they were live-migration cappable and many domU could
> share a single Infiniband adapter.
>
> As far as I am aware both of the projects are dead,

Ah, thanks for the info, sounds like there was some interesting ideas
here once upon a time. I'm not 100% sure that Xen-IB and SmartIO were
actually different projects,
http://nowlab.cse.ohio-state.edu/projects/xen/index.html seems to
suggest they are actually the same.

So I guess I stand corrected: the xen-smartio repo does contain some PV
IB drivers but since they are for 2.6.16 and for the Xen PV architecture
(not KVM) I don't know how much use they will be to the OP.

FWIW I also found http://wiki.xensource.com/xenwiki/XenSmartIO and
http://www.openfabrics.org/archives/nov2006sc/xen-ib-presentation.pdf
while further researching.

Ian.

>  however SR-IOV
> isn't long off for Infiniband, Mellanox is on target to push theirs
> upstream into OFED 1.6 due in November, Qlogic and Oracle/Sun will be
> quick to follow I would imagine.
> 
> SR-IOV will allow pretty similar functionality but less portable in
> terms of live-migrate etc.
> 
> It is worth noting here that you can't bridge IPoIB, IPoIB is not a
> layer 2 device and doesn't understand Ethernet. You can use EoIB
> (Ethernet over IB) or routing to provide network access to domUs.
> 
> Feel free to email me if you need any help with Infiniband and Xen.
> 
> Joseph.
> 
> On 27 May 2011 04:50, Pasi Kärkkäinen <pasik@xxxxxx> wrote:
> > On Thu, May 26, 2011 at 03:10:40PM +0100, Ian Campbell wrote:
> >> On Thu, 2011-05-26 at 15:04 +0100, maus wrote:
> >> > Hi,
> >> >
> >> > I know use IP-over-IB can let KVM or Xen use IB, but what I have to do
> >> > is like Xen-IB. Not just use IB.
> >>
> >> What is Xen-IB exactly?
> >>
> >
> > Could "Xen-IB" mean live migration over Infiniband RDMA (Remote DMA) ?
> > I can't really think of other uses..
> >
> > -- Pasi
> >
> >
> >> > So, there is no toturial for Xen-IB,right?
> >>
> >> That's right, there is no documentation and anyone who would have been
> >> involved with this stuff is long gone.
> >>
> >> Ian.
> >>
> >> >
> >> >
> >> > Yi-Man
> >> >
> >> >
> >> >
> >> > 2011/5/26 Ian Campbell <Ian.Campbell@xxxxxxxxxxxxx>
> >> >         On Wed, 2011-05-25 at 14:40 +0100, maus wrote:
> >> >         > Hi,
> >> >         >
> >> >         > I have a project which is make KVM use InfiniBand.
> >> >         > However, since Xen can use InfiniBand through Xen-IB, I want
> >> >         to try to
> >> >         > make Xen use InfiniBand first.
> >> >         > Through that way, I think it may give me some idea about how
> >> >         to make
> >> >         > KVM use InfiniBand.
> >> >         > So, as you said, I just use "Updated defconfig to include
> >> >         infiniband
> >> >         > driver as modules for dom0/domU" to do?
> >> >         > And since I don't know how to I do first for Xen-IB, is
> >> >         there any
> >> >         > tutorial for Xen-IB?
> >> >         > Or does Xen build-in support IB currently?
> >> >
> >> >
> >> >         I'm not sure what IB support you expect Xen to have over and
> >> >         above the
> >> >         driver and utils support, which are functions of the dom0
> >> >         kernel and
> >> >         distro and not the hypervisor.
> >> >
> >> >         Have you got IB working on a native system? I expect that if
> >> >         you do that
> >> >         then Xen or KVM will be able to make use of it basically for
> >> >         free, i.e.
> >> >         configure a VIF on an IP-over-IB bridge or use a local
> >> >         IP-over-IB
> >> >         address in dom0 for migration etc etc.
> >> >
> >> >         Ian.
> >> >
> >> >
> >> >         >
> >> >         > Yi-Man
> >> >         >
> >> >         >
> >> >         >
> >> >         > 2011/5/24 Ian Campbell <Ian.Campbell@xxxxxxxxxxxxx>
> >> >         >         Please do not top post.
> >> >         >
> >> >         >         On Tue, 2011-05-24 at 11:07 +0100, maus wrote:
> >> >         >         > Hi,
> >> >         >         >
> >> >         >         > There many file in
> >> >         >          http://xenbits.xensource.com/ext/xen-smartio/ ,
> >> >         >         > which should I use for Xen-IB?
> >> >         >         > Use the following three?
> >> >         >         > Updated defconfig to include infiniband driver as
> >> >         modules
> >> >         >         for
> >> >         >         > dom0/domU
> >> >         >         > Updating drivers/infiniband to latest. Should
> >> >         shrink size of
> >> >         >         > xen_ib.patch in
> >> >         >         > Add support for Infiniband into Xen
> >> >         >
> >> >         >
> >> >         >         Again, these changesets are >5 years old and have
> >> >         not been
> >> >         >         looked at or
> >> >         >         maintained since -- I am very sceptical that you
> >> >         will find
> >> >         >         anything of
> >> >         >         use on a modern Xen system in there.
> >> >         >
> >> >         >         I expect that IB support in the kernels we currently
> >> >         use for
> >> >         >         dom0 is
> >> >         >         vastly improved over what was available in the
> >> >         2.6.16 tree
> >> >         >         referenced in
> >> >         >         the above repository. Perhaps you don't even need
> >> >         anything
> >> >         >         special
> >> >         >         outside of what is available in the upstream dom0
> >> >         kernel.
> >> >         >
> >> >         >         Perhaps if you explain what you are actually trying
> >> >         to achieve
> >> >         >         then
> >> >         >         people will be able to better advise you?
> >> >         >
> >> >         >         Ian.
> >> >         >
> >> >         >
> >> >         >
> >> >
> >> >
> >> >
> >> >
> >>
> >>
> >>
> >> _______________________________________________
> >> Xen-devel mailing list
> >> Xen-devel@xxxxxxxxxxxxxxxxxxx
> >> http://lists.xensource.com/xen-devel
> >
> > _______________________________________________
> > Xen-devel mailing list
> > Xen-devel@xxxxxxxxxxxxxxxxxxx
> > http://lists.xensource.com/xen-devel
> >
> 
> 
> 



_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel