WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] 10Gbit ethernet NIC gives slow throughput

To: Pasi Kärkkäinen <pasik@xxxxxx>
Subject: Re: [Xen-users] 10Gbit ethernet NIC gives slow throughput
From: fabi.a169@xxxxxxxxx
Date: Mon, 22 Dec 2008 18:48:21 +0100
Cc: xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Mon, 22 Dec 2008 09:50:36 -0800
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:cc:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=u+vYGzoOVXIf0P6WkXqJUtj+l3lLdFjDZdWZofq/W30=; b=t1wjOBVtoRnC4LtokAxIELpNftH1LFD1AO7sX2ZVRuaVP05rERM0C053OH+7TXwSO6 QxM7Ca7ecnmLvFxi6GLhkQ20ch+rhJalxalhtSfuyi7jbLReDJkqEppho24y5PO4RK7V 3o+Dykllzu1Az9tevJYirolf4fsz70T7cBlcU=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; b=n2AhfbOJwjyES2kk0eCynlVW1lnv+Lx+DTGpa8fbNLDIygid7NEBNl5TLoecEWQLsv BpF+4qyeXGR/JCIAwpotaadXACZDHfgBcDDfCm/n859XhpqFOvybMXzvnFX3+ZF778EK VsyH298/I/SMRgXl507m7AxUR0+lDDE//1E9s=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <20081222171409.GK15052@xxxxxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <b42ab6100812220836x17f461ebj1f5802c9bb92f60b@xxxxxxxxxxxxxx> <20081222171409.GK15052@xxxxxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Thunderbird 2.0.0.17 (X11/20080925)
Pasi Kärkkäinen wrote:
On Mon, Dec 22, 2008 at 05:36:40PM +0100, fabi.a169@xxxxxxxxx wrote:
Hello,

I would like to use a server having myricom 10gbit ethernet interfaces
(driver myri10ge) for Xen. But between dom0s (no domU running), I get only a
throughput of about 2.3Gbit/s (I use Xen 3.2 with the 2.6.18 kernel and
debian in dom0), whether xend is running or not.  However, on linux kernel
with the same version but without xen patch, I get more than 6Gbit/s.
Clearly, with Xen, the CPU is not the bottleneck, beeing used at much less
than 100%.

Does anybody have experiences with Xen and 10Gbit ethernet ?


With Xen, are you using bridged networking?
The default network configuration in Xen creates virtual ethernet interface 
called
'eth0', which is bridged to the real NIC (which is renamed to peth0).

So, when making comparisons, make sure you're using the actual physical interface.
Dunno if there's something to optimize in the bridge-setup.. have you done
all the normal optimizations? txqueuelen for all interfaces (including vif
interfaces), tcp window sizes etc.

-- Pasi

I don't even use the brigdes, for example without starting xend. Also, when I measure throughput on the loopback interface, I get the same throughput bounded to 2.29 Gbps. There should be something bounding everything to this value, maybe related to the vcpus. If I send for example 2 flows in parallel, I get the double of this throughput.

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

<Prev in Thread] Current Thread [Next in Thread>