This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-devel] Xen 3.4.1 NUMA support

To: George Dunlap <george.dunlap@xxxxxxxxxxxxx>
Subject: Re: [Xen-devel] Xen 3.4.1 NUMA support
From: Juergen Gross <juergen.gross@xxxxxxxxxxxxxx>
Date: Mon, 09 Nov 2009 12:44:45 +0100
Cc: Dan Magenheimer <dan.magenheimer@xxxxxxxxxx>, "xen-devel@xxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxx>, Keir Fraser <Keir.Fraser@xxxxxxxxxxxxx>, Papagiannis Anastasios <apapag@xxxxxxxxxxxx>
Delivery-date: Mon, 09 Nov 2009 03:45:11 -0800
Dkim-signature: v=1; a=rsa-sha256; c=simple/simple; d=ts.fujitsu.com; i=juergen.gross@xxxxxxxxxxxxxx; q=dns/txt; s=s1536b; t=1257767202; x=1289303202; h=from:sender:reply-to:subject:date:message-id:to:cc: mime-version:content-transfer-encoding:content-id: content-description:resent-date:resent-from:resent-sender: resent-to:resent-cc:resent-message-id:in-reply-to: references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:list-owner:list-archive; z=From:=20Juergen=20Gross=20<juergen.gross@xxxxxxxxxxxxxx> |Subject:=20Re:=20[Xen-devel]=20Xen=203.4.1=20NUMA=20supp ort|Date:=20Mon,=2009=20Nov=202009=2012:44:45=20+0100 |Message-ID:=20<4AF800AD.3070407@xxxxxxxxxxxxxx>|To:=20Ge orge=20Dunlap=20<george.dunlap@xxxxxxxxxxxxx>|CC:=20Dan =20Magenheimer=20<dan.magenheimer@xxxxxxxxxx>,=20=0D=0A =20"xen-devel@xxxxxxxxxxxxxxxxxxx"=20<xen-devel@xxxxxxxxx source.com>,=0D=0A=20Keir=20Fraser=20<Keir.Fraser@xxxxxxx ix.com>,=20=0D=0A=20Papagiannis=20Anastasios=20<apapag@ic s.forth.gr>|MIME-Version:=201.0 |Content-Transfer-Encoding:=207bit|In-Reply-To:=20<4AF7FE 15.6070503@xxxxxxxxxxxxx>|References:=20<bd4f4a54-5269-42 d8-b16d-cbdfaeeba361@default>=20<4AF7FE15.6070503@xxxxxxx ix.com>; bh=6PD1//2NE6tX9xyIbijUiSxdfTI3J/8V6J2YdGTNusc=; b=Czt9LwsaZ7dOFjVdVa6u2MaSyiLpmI1rPoKSUif1I49Lb+gV/2deElxj 9r7A1UQ3W7BezwiqY3nPZUQovWtDYmwG9HWJ5uR/f91WTI62/Yq5JcS2Z 1T9ytIRkjMqEbkUmsGKVfwsFdqsHWKQKbKVH2J8Ren6CCZjCUGtz/BiRM YCY5DMFASi3uGqGiASjviY6WJuvcFD4DiwyJVG/+MIjhDy9sJHpTg7pY+ 0Q1ixNSL3IYHwCuNgButPrtwA2rpl;
Domainkey-signature: s=s1536a; d=ts.fujitsu.com; c=nofws; q=dns; h=X-SBRSScore:X-IronPort-AV:Received:X-IronPort-AV: Received:Received:Message-ID:Date:From:Organization: User-Agent:MIME-Version:To:CC:Subject:References: In-Reply-To:X-Enigmail-Version:Content-Type: Content-Transfer-Encoding; b=VA6y7k3xPztmzuehccyUyuWyOKifrKaSC9IxVUwDTlN9RlHGSPNKg3Ab MZjj2OCrBPr4yq47rXDSOdiSpLhK/R65Oj+Jjkz34AC9mm9P9sgJjYahA HkHnQJ5rchcCVScTFVBOOcG3YfDiDs10UpKV6sraokY5KCbbxe4G8dqGX m7LMG384hPD5ZxvzQwxyJetvSZxRJqUlC/XzpBKPd86VN/AE7RgBhgXuC N0twPY1ySSCR88iPNzcKjzfuOBBhS;
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <4AF7FE15.6070503@xxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Organization: Fujitsu Technology Solutions
References: <bd4f4a54-5269-42d8-b16d-cbdfaeeba361@default> <4AF7FE15.6070503@xxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla-Thunderbird (X11/20090707)
Cpupools? :-)

NUMA was a topic I wanted to look at as soon as cpupools are officially
accepted. Keir wanted to propose a way to get rid of the function
continue_hypercall_on_cpu() which was causing most of the stuff leading
to the objection of cpupools.
I guess Keir had some higher priority jobs. :-)
So I will try a new patch for cpupools without continue_hypercall_on_cpu()
and perhaps with NUMA support.
George, would this be okay for you? I think your scheduler still will have
problems with domain weights as long as domains are restricted to some
processors, right?


George Dunlap wrote:
> I haven't had time to look at NUMA stuff at all.  I probably will look
> at it eventually, if no one else does, but I'd be happy if someone else
> could pursue it.
> -George
> Dan Magenheimer wrote:
>> VMware has the notion of a "cell" where VMs can be
>> scheduled only within a cell, not across cells.
>> Cell boundaries are determined by VMware by
>> default, though certains settings can override them.
>> An interesting project might be to implement
>> "numa=cell" for Xen.... or maybe something similar
>> is already in George Dunlap's scheduler plans?
>>> -----Original Message-----
>>> From: Keir Fraser [mailto:keir.fraser@xxxxxxxxxxxxx]
>>> Sent: Wednesday, November 04, 2009 5:33 AM
>>> To: Papagiannis Anastasios; xen-devel@xxxxxxxxxxxxxxxxxxx
>>> Subject: Re: [Xen-devel] Xen 3.4.1 NUMA support
>>> Add Xen boot parameter 'numa=on' to enable NUMA detection. Then it's
>>> up to
>>> you to, for example, pin domains to specific nodes, using the 'cpus=...'
>>> option in the domain config file. See /etc/xen/xmexample1 for an
>>> example of
>>> its usage.
>>>  -- Keir
>>> On 04/11/2009 12:02, "Papagiannis Anastasios" <apapag@xxxxxxxxxxxx>
>>> wrote:
>>>> Hello,
>>>> does the last version of Xen(3.4.1) support NUMA machines?       
>>> Is there a .pdf
>>>> or a link that can give me some more details about that? I work on a
>>>> project for xen performace in numa machines. And in xen 3.3.0 this
>>>> performance isn't good. Have something changed in last version?
>>>> Thanks in advance,
>>>> Papagiannis Anastasios
>>>> _______________________________________________
>>>> Xen-devel mailing list
>>>> Xen-devel@xxxxxxxxxxxxxxxxxxx
>>>> http://lists.xensource.com/xen-devel
>>> _______________________________________________
>>> Xen-devel mailing list
>>> Xen-devel@xxxxxxxxxxxxxxxxxxx
>>> http://lists.xensource.com/xen-devel
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel

Juergen Gross                 Principal Developer Operating Systems
TSP ES&S SWE OS6                       Telephone: +49 (0) 89 636 47950
Fujitsu Technolgy Solutions               e-mail: juergen.gross@xxxxxxxxxxxxxx
Otto-Hahn-Ring 6                        Internet: ts.fujitsu.com
D-81739 Muenchen                 Company details: ts.fujitsu.com/imprint.html

Xen-devel mailing list