[Xen-devel] Problem with Xen-SmartIO IB setup for multiple VMs

To:	xen-smartio@xxxxxxxxxxxxxxxxxxx, xen-devel@xxxxxxxxxxxxxxxxxxx
Subject:	[Xen-devel] Problem with Xen-SmartIO IB setup for multiple VMs
From:	"Mukil Kesavan" <mukilk@xxxxxxxxx>
Date:	Tue, 23 Oct 2007 18:11:20 -0400
Delivery-date:	Tue, 23 Oct 2007 15:12:01 -0700
Dkim-signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type; bh=3ORVu+dV3OkO6R21zbFTpWoVLSK4h9EHcKZK77XWkus=; b=aGOhGGO11qaX6cAe44zpWu8DtXSv9WH9uNUxnmKtyZ99bu+SeheY4WXsQMLg+CIYOUqOeawuAlyTkaAGouKDGUOY2g4NDug6khL51qM6AE1Ly1gjlncgICcgGBs95o5Xa0wFwewA8BrNyGPhx8hyAjvnFRkOsgIM1RtwSRwG11k=
Domainkey-signature:	a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:mime-version:content-type; b=rDMeKg9jcOl4iVvC8dDXt8ukZx761dFlE/CYHg8gci4wK0JBszbN87po9cQfy+kw8jMxWJSvEn/P+cZuYWKkULrD6fKs4PufGUw6z6mMD+zfgy68eedjoEqfG9ogC2dixtN0n99xz8M/eO41CiRYZGa07AFJ86Cd/6OM/D+wl0o=
Envelope-to:	www-data@xxxxxxxxxxxxxxxxxx
List-help:	<mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id:	Xen developer discussion <xen-devel.lists.xensource.com>
List-post:	<mailto:xen-devel@lists.xensource.com>
List-subscribe:	<http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe:	<http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Sender:	xen-devel-bounces@xxxxxxxxxxxxxxxxxxx

Hi,

I tweaked the xen-smartio (http://wiki.xensource.com/xenwiki/XenSmartIO) code to enable support for setting up IB in multiple VMs. I can load the ib_gmthca module in two VMs but not more than that! It is kind of strange why this would be observed as in general if the code works for two, it should work for 3 or more as well subject to the limit specified in the program.

Is there anything inherent in the way the socket communication is used to setup communication between dom0 and domu that prevents more than 2 VMs from using IB simultaneously on the same physical machine (I've set the number of threads and devices to 16)? I can't get any debug traces as well after the second VM's IB module has been setup. The dom0 module just seems to freeze and be non-responsive thereafter.

Any help would be appreciated.

Thanks,

Mukil

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

WARNING - OLD ARCHIVES

xen-devel

[Xen-devel] Problem with Xen-SmartIO IB setup for multiple VMs