WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

RE: [Xen-devel] [PATCH] (resent) NUMA node migration

To: "John Levon" <levon@xxxxxxxxxxxxxxxxx>, "Andre Przywara" <andre.przywara@xxxxxxx>
Subject: RE: [Xen-devel] [PATCH] (resent) NUMA node migration
From: "Ian Pratt" <Ian.Pratt@xxxxxxxxxxxxx>
Date: Sat, 22 Dec 2007 01:15:43 -0000
Cc: Ian Pratt <Ian.Pratt@xxxxxxxxxxxxx>, xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Fri, 21 Dec 2007 17:16:09 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <20071222005315.GA11052@xxxxxxxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <476C40BE.1030907@xxxxxxx> <20071222005315.GA11052@xxxxxxxxxxxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
Thread-index: AchENRhuo9Yb9EmaQyaoF3rVrZnjJwAALR5A
Thread-topic: [Xen-devel] [PATCH] (resent) NUMA node migration
> > I am aware that using live migration isn't the best approach (takes
> > twice the memory and quite some time), but it's less intrusive and
> works
> > fine (given localhost migration stability...)
> 
> Is this really using localhost live migration to move a domain from
one
> NUMA node to another on the same host? 

Yep, it really is.

> Why isn't there a simpler way?

Well, you can't beat using live migration for code simplicity :)

Doing page migration for HVM guests is easy as you can just stop the
guest, copy a bunch of pages and update the p2m table, flush the shadow
page table cache and all VCPU's TLBs, then resume. Doing it live is a
little tricky as you have to go from MFN's to PTE's which currently
requires a full shadow page table scan. [Though some of the experimental
page sharing patches maintain linked lists of backpointers, and we could
switch to a shadow mode that supports this while doing page migration] 

PV guests are a little more challenging as all references in the
direct-mode page tables need to be updated. We also need to make sure
that the guest isn't holding MFNs outside of pagetables, so we need to
get all the VCPUs into a known state. The best way of handling this is
to use the PV fast checkpoint support to freeze the guest, copy the
badly located pages, scan and update all pagetables, resume from
checkpoint. This would make a nice little project for someone...

Ian

 

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel