WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] Linux DomU vs Bare Metal performance issues

To: xen-users@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Xen-users] Linux DomU vs Bare Metal performance issues
From: Mark Watts <m.watts@xxxxxxxxxxxxxxxxx>
Date: Sun, 05 Dec 2010 23:25:36 +0000
Delivery-date: Sun, 05 Dec 2010 15:27:59 -0800
Dkim-signature: v=1; a=rsa-sha256; c=simple/simple; d=linux-corner.info; s=default; t=1291591537; bh=Etalle+UMIofuUTOZPe5sj4eQHkF15QpLmfe8pN3Jd8=; h=Message-ID:Date:From:MIME-Version:To:Subject:References: In-Reply-To:Content-Type:Content-Transfer-Encoding; b=OFO5oEqN/DOBNd/k8hss139GdoyTTsbA9c6VrZ+V8R3yNJ6Ta+y4VTtTEQzEudfFV XYSGD5DKVjvYxga/h8C8Hy3oBGoqMODDlK3K8u2Z1FbgH6g6I/9N5+X54YNNa8WoI3 56/lyAbC2MP1FzGR7ej3MegREEwE/T8+cvSAGUqs=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <4CF9F76E.8090909@xxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <4CF947A7.4040103@xxxxxxxxxxxxxxxxx> <64D0546C5EBBD147B75DE133D798665F06A1285C@xxxxxxxxxxxxxxxxx> <4CF9F76E.8090909@xxxxxxxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 04/12/2010 08:10, Mark Watts wrote:
> On 03/12/2010 22:18, Jeff Sturm wrote:
>>> -----Original Message-----
>>> From: xen-users-bounces@xxxxxxxxxxxxxxxxxxx [mailto:xen-users-
>>> bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Mark Watts
>>> Sent: Friday, December 03, 2010 2:40 PM
>>> To: xen-users@xxxxxxxxxxxxxxxxxxx
>>> Subject: [Xen-users] Linux DomU vs Bare Metal performance issues
>>>
>>> Can anyone shed any light on why I see such a drop in performance
>> between these
>>> two servers? I could understand, to an extent, seeing the DomU getting
>> 3/4 of the
>>> performance of the bare metal server given it has one CPU less, but
>> this is less than
>>> 1/2 the performance.
> 
>> Understand what you're really testing here is the performance of the
>> virtual network driver, since Apache does almost no work to serve a
>> simple static page.  You're exercising the TCP stack and network drivers
>> more than anything else.
> 
> Sure, but iperf shows near-enough line speed in both directions.
> Shouldn't this 'prove' the virtual network driver is up to scratch for
> this system?
> 
>> Out of curiosity, can you easily run the same test against dom0?  The
>> dom0 runs a Xen kernel, on top of the hypervisor, but with a physical
>> network interface (rather than virtual).
> 
> I can, certainly.
> 
>> One thing you can try is to pin the dom0 and/or domU to a physical core,
>> using "xm vcpu-pin".  That gave me better throughput on some of my
>> tests.
> 
> Dom-0 is already pinned to one CPU with the Dom-U given the remaining three.
> 
>> (I have doubts that hyperthreading scales as well as multicore
>> processors, however I don't have any hyperthreaded systems of my own to
>> test.)
> 
> I can certainly try this again with HT switched off on both boxes,
> although that'll have to wait 'till monday.

Some updates:

Running the same ab test against the Dom-0 gets me around 4,400 req/sec
- - a modest increase over the Dom-U (~3,800).
Rebooting my Dom-0 system into the standard CentOS 5.5 kernel sees the
same 10,200 req/sec, so its clearly something related to this kernel
which causes the slow down.

Any ideas?

Mark.

- -- 
Mark Watts, BSc RHCE
http://www.linux-corner.info/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJM/B9wAAoJEA67+nBFe32maJ4IAKMbxFXA2Lr/tVUW0LjPrJIC
R8WPVMzKeajtrgixWtaLL/8ABinqfZGEu2/UE3FXSYKQF9frlXIaXuFsPafRztb2
W/Li3XPDWSTUeSaMfHo8SDhft9GMmNjXY2XYRd91hnM4RtKRCiM26/nXfbaqb8M6
2Hz4UEpRyIoPHHD/XgfKpjIXWgEzWEylVgMO1JuTpxj8MqWUuQBIm4ISlq16KcOd
m14CBltZa0iup07UHRiFc9lm5zxVqwKN6KUMPXCjqgF8YyYh3/OFymkZ5JnxkUuC
Yfft1Rhi6nUfS6L0Eb5GzRhIQzxoJ4ckOkPNECbXSPIRaI4rUabJwNG6PAQ8d1I=
=xhLd
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users