WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

[Xen-devel] NUMA guest PV enlightenment (was Re:[PATCH 00/11] PV NUMA Gu

To: "Cui, Dexuan" <dexuan.cui@xxxxxxxxx>, Dulloor <dulloor@xxxxxxxxx>
Subject: [Xen-devel] NUMA guest PV enlightenment (was Re:[PATCH 00/11] PV NUMA Guests)
From: Andre Przywara <andre.przywara@xxxxxxx>
Date: Fri, 23 Apr 2010 14:45:38 +0200
Cc: "xen-devel@xxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxx>, "Nakajima, Jun" <jun.nakajima@xxxxxxxxx>
Delivery-date: Fri, 23 Apr 2010 05:47:28 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Thunderbird 2.0.0.23 (X11/20090820)
Hi,

(sorry for the late reply, the mail was already scrolled out of the
window ;-). I will split the thread up to allow quicker and more focused responses).

Cui, Dexuan wrote:
> Dulloor wrote:
> ...
> Hi Dulloor,
> In your patches, the toolstack tries to figure out the "best fit
> nodes" for a PV guest and invokes a hypercall set_domain_numa_layout
> to tell the hypervisor to remember the info, and later the PV guest
> invokes a hypercall get_domain_numa_layout to retrieve the info from
> the hypervisor.
> Can this be changed to: the toolstack writes the guest numa info
> directly into a new field in the start_info(or the share_info) (maybe
> in the starndard format of the SRAT/SLIT) and later PV guest reads the
> info and uses acpi_numa_init() to parse the info?  I think in this way
> the new hypercalls can be avoided and the pv numa enlightenment code
> in guest kernel can be minimized.
> I'm asking  this because this is the way how HVM numa patches of
> Andure do(the toolstack passes the info to hvmloader and the latter
> builds SRAT/SLIT for guest)
I think that is a fundamental difference between PV and HVM, where in HVM you naturally have to inject all infos, but PV is mostly querying the info it needs. AFAICS the design of PV Linux is to remove everything that is not absolutely necessary. I once also tried PV NUMA support, but gave up when I discovered that both NUMA and ACPI were turned off in the then-recent PV kernels (read: kudos to Dulloor ;-). I like the ELF hint trick, it solves a big problem we have with HVM guests: Are they NUMA aware or not? If not, the striping is maybe a better option than persisting on the NUMA layout. Only for HVM guests it is almost impossible to know beforehand.
So as far as this goes, I am OK with PV guests using hypercalls to query
the NUMA information, the only thing I would hint is to leverage the
already existing guest NUMA code and actually provide the info in ACPI SRAT/SLIT format. But one has to consider possible runtime changes to the topology, as this is something that ACPI currently does not provide.

Regards,
Andre.

--
Andre Przywara
AMD-Operating System Research Center (OSRC), Dresden, Germany
Tel: +49 351 448-3567-12


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

<Prev in Thread] Current Thread [Next in Thread>
  • [Xen-devel] NUMA guest PV enlightenment (was Re:[PATCH 00/11] PV NUMA Guests), Andre Przywara <=