|
xen-devel
Re: [Xen-devel] slow live magration / xc_restore on xen4 pvops
|
To: |
Keir Fraser <keir.fraser@xxxxxxxxxxxxx> |
|
Subject: |
Re: [Xen-devel] slow live magration / xc_restore on xen4 pvops |
|
From: |
Brendan Cully <Brendan@xxxxxxxxx> |
|
Date: |
Wed, 2 Jun 2010 23:45:50 -0700 |
|
Cc: |
Ian Jackson <Ian.Jackson@xxxxxxxxxxxxx>, Jeremy Fitzhardinge <jeremy@xxxxxxxx>, "xen-devel@xxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxx>, Andreas Olsowski <andreas.olsowski@xxxxxxxxxxxxxxx>, "Zhai, Edwin" <edwin.zhai@xxxxxxxxx> |
|
Delivery-date: |
Wed, 02 Jun 2010 23:47:03 -0700 |
|
Dkim-signature: |
v=1; a=rsa-sha1; c=relaxed; d=quuxuum.com; h=date:to:cc :subject:message-id:references:mime-version:content-type :in-reply-to:from; s=dk; bh=b/vtiioCRWDeafW+DhuYWuWl6AE=; b=QXug 7OCzsn51L4Dd630AQya0soYjEB3xwb9Dq7G0gJOuj11BRROL+3e9GqKj1mC+8NdY 51Bq43/pcL0ZOEqx4p2WV00dDfAHtoMNPFt3kLdWGtO0uhEwE80UWCGw2JKQTCEY ngu/gKIhK5vt/7JnDvKiPsSXCxzJ5u1+Ked0jQ4= |
|
Envelope-to: |
www-data@xxxxxxxxxxxxxxxxxxx |
|
In-reply-to: |
<C82D0098.168F5%keir.fraser@xxxxxxxxxxxxx> |
|
List-help: |
<mailto:xen-devel-request@lists.xensource.com?subject=help> |
|
List-id: |
Xen developer discussion <xen-devel.lists.xensource.com> |
|
List-post: |
<mailto:xen-devel@lists.xensource.com> |
|
List-subscribe: |
<http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe> |
|
List-unsubscribe: |
<http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe> |
|
Mail-followup-to: |
keir.fraser@xxxxxxxxxxxxx, andreas.olsowski@xxxxxxxxxxxxxxx, xen-devel@xxxxxxxxxxxxxxxxxxx, Ian.Jackson@xxxxxxxxxxxxx, edwin.zhai@xxxxxxxxx, jeremy@xxxxxxxx |
|
References: |
<20100603010418.GB2028@xxxxxxxxxxxxxxxxx> <C82D0098.168F5%keir.fraser@xxxxxxxxxxxxx> |
|
Sender: |
xen-devel-bounces@xxxxxxxxxxxxxxxxxxx |
|
User-agent: |
Mutt/1.5.20 (2010-04-22) |
On Thursday, 03 June 2010 at 06:47, Keir Fraser wrote:
> On 03/06/2010 02:04, "Brendan Cully" <Brendan@xxxxxxxxx> wrote:
>
> > I've done a bit of profiling of the restore code and observed the
> > slowness here too. It looks to me like it's probably related to
> > superpage changes. The big hit appears to be at the front of the
> > restore process during calls to allocate_mfn_list, under the
> > normal_page case. It looks like we're calling
> > xc_domain_memory_populate_physmap once per page here, instead of
> > batching the allocation? I haven't had time to investigate further
> > today, but I think this is the culprit.
>
> Ccing Edwin Zhai. He wrote the superpage logic for domain restore.
Here's some data on the slowdown going from 2.6.18 to pvops dom0:
I wrapped the call to allocate_mfn_list in uncanonicalize_pagetable
to measure the time to do the allocation.
kernel, min call time, max call time
2.6.18, 4 us, 72 us
pvops, 202 us, 10696 us (!)
It looks like pvops is dramatically slower to perform the
xc_domain_memory_populate_physmap call!
I'll attach the patch and raw data below.
alloc-profile.diff
Description: Text document
2.6.18-alloc
Description: Text document
pvops-alloc
Description: Text document
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
|
|
|
Home