WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-ia64-devel

Re: [Xen-ia64-devel] [patch] increase xen-heap-size basedon nodes-shift

To: Tristan Gingold <tgingold@xxxxxxx>
Subject: Re: [Xen-ia64-devel] [patch] increase xen-heap-size basedon nodes-shift
From: Isaku Yamahata <yamahata@xxxxxxxxxxxxx>
Date: Mon, 18 Jun 2007 10:41:04 +0900
Cc: xen-ia64-devel <xen-ia64-devel@xxxxxxxxxxxxxxxxxxx>, Jes Sorensen <jes@xxxxxxx>, Alex Williamson <alex.williamson@xxxxxx>
Delivery-date: Sun, 17 Jun 2007 18:38:54 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <20070616085743.GB2516@saphi>
List-help: <mailto:xen-ia64-devel-request@lists.xensource.com?subject=help>
List-id: Discussion of the ia64 port of Xen <xen-ia64-devel.lists.xensource.com>
List-post: <mailto:xen-ia64-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-ia64-devel>, <mailto:xen-ia64-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-ia64-devel>, <mailto:xen-ia64-devel-request@lists.xensource.com?subject=unsubscribe>
References: <4672220B.8080001@xxxxxxx> <823A93EED437D048963A3697DB0E35DE5EA13D@xxxxxxxxxxxxxxxxxxxxxxxxxxxx> <20070616085743.GB2516@saphi>
Sender: xen-ia64-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mutt/1.4.2.1i
On Sat, Jun 16, 2007 at 10:57:43AM +0200, Tristan Gingold wrote:
> On Sat, Jun 16, 2007 at 02:23:21PM +0800, Zhang, Xing Z wrote:
> > >>
> > >>    Unfortunately it breaks VTi domains somehow.  My system hangs when
> > I
> > >> try to xm create one.  Thanks,
> > >
> > >Thats bizarre given it's a simple heap increase. However I cannot help
> > >debug this right now as I don't have a box with VT to play with right
> > >now.
> > >
> > [Zhang, Xing Z] 
> > Hi Sorensen, I have some comments on this patch. I noticed you increase
> > xen heap to 256M. But current xen heap is 64M TR mapped ( use
> > KERNEL_TR_PAGE_SHIFT macro in xen/arch/linux-xen/head.S). So Xen has
> > 256M heap but 64M TR mapping area with your patch, this should be reason
> > why VTI hang. Not only VTI, I think XenU has same issue because struct
> > vcpu located in xen heap and it must be TR mapped.
> > Maybe boot more XenU guests will show the issue. 
> This is certainly the reason of the crash!

So it's the reason why xenheap_megabytes boot option is disabled
intentionally.

Given that xen/ia64 supports virtual frame table and altix has
very sparsely allocated RAM layout, I'm suspencting that allocation
bitmap in page allocater of common code is the culprit.
It is single big bitmap.
So I suppose that the bitmap should made NUMA node aware, then
the pressure on xenheap will be greatly decreased.

Off course, there remains scalability limits caused by xenheap size.
But at first we should estimate memory usage on xenheap and necessary
scalability to determine what is a dominant issue.
-- 
yamahata

_______________________________________________
Xen-ia64-devel mailing list
Xen-ia64-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-ia64-devel