WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] More network tests with xenoprofile this time

To: "Ian Pratt" <m+Ian.Pratt@xxxxxxxxxxxx>, <xen-devel@xxxxxxxxxxxxxxxxxxx>
Subject: Re: [Xen-devel] More network tests with xenoprofile this time
From: Andrew Theurer <habanero@xxxxxxxxxx>
Date: Tue, 31 May 2005 17:38:33 -0500
Delivery-date: Tue, 31 May 2005 22:39:13 +0000
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <A95E2296287EAD4EB592B5DEEFCE0E9D281FC6@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <A95E2296287EAD4EB592B5DEEFCE0E9D281FC6@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: KMail/1.5
On Tuesday 31 May 2005 17:16, Ian Pratt wrote:
> > I had a chance to run a couple of the netperf tests with
> > xenoprofile.  I am still having some trouble with
> > multi-domain profiles (probably user error), but I have been
> > able to profile dom0 while running 2 types of tests.  I was
> > surprised to see as much as 50% cpu in hypervisor on these tests:
> >
> > netperf tcp_stream 16k msg size, dom1 -> dom2 dom0 is on
> > cpu0, HT thread 0, dom1 is on cpu1, HT thread 0,
> > dom2 is on cpu1, HT thread 1.
>
> Let's ignore the domU <-> domU results for the moment as we know
> about the problem with lack of batching in this scenario. Let's dig
> into the dom1 -> external.
>
> First off, are these figures just for CPU 0 HT 0? i.e. just dom0 so
> we don't see where time goes in the domU? How is idle time on the CPU
> reported?

Yes, this is just for CPU 0 HT 0.  DomU is pinned to its own cpu, which 
is CPU 1 HT 0.  

I have cpu util from polling xc_domain_get_cpu_usage() for both domains, 
which is (an exerpt from the whole run, in 3 second intervals):

 cpu0:  [100.4] d0-0[100.4]
 cpu2:  [045.1] d1-0[045.1]

 cpu0:  [100.0] d0-0[100.0]
 cpu2:  [045.1] d1-0[045.1]

 cpu0:  [099.6] d0-0[099.6]
 cpu2:  [045.1] d1-0[045.1]

 cpu0:  [101.3] d0-0[101.3]
 cpu2:  [045.3] d1-0[045.3]

 cpu0:  [099.7] d0-0[099.7]
 cpu2:  [045.1] d1-0[045.1]

 cpu0:  [099.7] d0-0[099.7]
 cpu2:  [045.0] d1-0[045.0]

This is fairly consistent for the whole test.

> Spending 18% of the time handling interrupts in Xen is surprisingy
> (at least to me).
>
> What interrupt rate are you observing? What are the default tg3
> interrupt coallescing settings? What interrupt rate do you get on
> native? Also, what hypercall rate are you seeing?
>
> (It would be good to put this in context of the rx/tx packet rates).

I don't have that data from this test, but I am queuing up another with 
sar, so I should have it soon.

I will also queue up a test with just baremetal linux so we can compare 
int rates, etc.

> Is the Ethernet NIC sharing an interrupt with the USB controller per
> chance?

Not as far as I can tell:

           CPU0
  1:          8        Phys-irq  i8042
  3:          0        Phys-irq  acpi
  4:       3031        Phys-irq  serial
 11:    6764395        Phys-irq  ohci_hcd
 12:         93        Phys-irq  i8042
 15:      38687        Phys-irq  ide1
 18:      39398        Phys-irq  qla2300
 22:      47905        Phys-irq  ioc0
 24:    6037311        Phys-irq  eth0
256:          7     Dynamic-irq  ctrl-if
257:     182396     Dynamic-irq  timer0
258:          0     Dynamic-irq  net-be-dbg
259:      83437     Dynamic-irq  blkif-backend
260:    1688517     Dynamic-irq  vif1.0

>
> Seeing find_domain_by_id and copy_from_user so high up the list is
> pretty surprising.

Yes.

-Andrew

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

<Prev in Thread] Current Thread [Next in Thread>