This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-devel] 3GB memory restriction for pv domU with PCI

To: Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx>
Subject: Re: [Xen-devel] 3GB memory restriction for pv domU with PCI
From: Bruce Edge <bruce.edge@xxxxxxxxx>
Date: Thu, 14 Oct 2010 07:39:37 -0700
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Thu, 14 Oct 2010 07:40:23 -0700
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=WbavX4b3YF+LSuZfMoNBMXXn3lmYEtyRU5BWGTKqbp8=; b=TlM8egE6n/wagGWLJ7eYOjsXHslLFEFANc6AIoh6YMqNPurAUTSyvUmiz4S2DHUGC7 2SN5iI/BYNv/lUsuX4dbAP1qyvesAReTw8y0LMv/diw3pLpTgahrpQamfXxssiNMheup X3XUCCOQWl+kNaHN+01KH1qfH1wd+SjwQzhEg=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=UZStMbnI+qdPNV9G23+uRBo9Pd+cELAtGwbXkeVdrK4YXFrCWsq4OTE8J9+t1BIMiQ FS1a/cPFnUuHh06zIPBIghMQynEAJ49l7wQ0ddJuzKBJok/k1SNM8UiwtrByKR78fi6F 6tVay6gSRMlQ4Lx7L5yMj2G4hRbNEJ5WLJGuY=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <20101014142337.GB2727@xxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <AANLkTik72ZxxL35PY1l5dOMaqbFwTlbA4axO4Ai-XntL@xxxxxxxxxxxxxx> <20100611164255.GA19481@xxxxxxxxxxxxxxxxxxx> <AANLkTik9-x5BbhsPy-o41p0UfCMYX8+CqxR+c0m4+fqz@xxxxxxxxxxxxxx> <20101014142337.GB2727@xxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
On Thu, Oct 14, 2010 at 7:23 AM, Konrad Rzeszutek Wilk
<konrad.wilk@xxxxxxxxxx> wrote:
> On Wed, Oct 13, 2010 at 05:10:32PM -0700, Bruce Edge wrote:
>> On Fri, Jun 11, 2010 at 9:42 AM, Konrad Rzeszutek Wilk
>> <konrad.wilk@xxxxxxxxxx> wrote:
>> > On Fri, Jun 11, 2010 at 08:54:05AM -0700, Bruce Edge wrote:
>> >> On Fri, Jun 11, 2010 at 6:38 AM, Konrad Rzeszutek Wilk
>> >> <konrad.wilk@xxxxxxxxxx> wrote:
>> >> > On Fri, Jun 11, 2010 at 09:09:36AM +0300, Pasi Kärkkäinen wrote:
>> >> >> On Thu, Jun 10, 2010 at 04:25:54PM -0700, Bruce Edge wrote:
>> >>
>> >> >> > Here's the domU boot log:
>> >>
>> >> >> >         memory       = 4096
>> >> >
>> >> > And also there is a bug where we can't do PCI in PV guests when guest
>> >> > has more than 3GB.
>> >> >
>> >>
>> >> Is there any expectation that this 3GB restriction will be resolved in
>> >> the short term ?
>> >
>> > What is "short-term" ? This week = no. This month = likely.
>> It looks like this is still a restriction. Is there any plan to allow
>> pvops domU's to use more than 4GB ?
> Jeremy wrote up some new shinny code where the memory can be fragmented
> (so that we can now stick in a big PCI hole). His patches are in
> xen/balloon. But I haven't taken those and fiddled with them and changed
> the toolstack (xm or xl) to actually take advantage of this.
>> How much and who do we have to pay to get it in sooner?
>> If this ends up being our only show stopper for pvops, I'll start
>> selling lab equipment out the back door to pay for it. :-)
> Sheeshh. you are missing the mark. Instead of selling the lab equipment
> you _send_ the equipment - that is like a X-mas present for geeks: shiny
> new toy! :-)
> But jokes aside, I haven't touched this since this last email. And I am
> not going to get to it this week nor the next. Then there is one week
> where (25th->29th) where I can play with this. After that, Linux Kernel
> Summit and the Linux Plumbers Conference is in - so it will be quiet.

It's not the last nail in the coffin right now, but it will be if it's
not in there by the end of the year at the latest.
We'll have to fallback to hvm which no one wants to do because we'll
lose all the new goodies that come along with pvops.

We are in a pv-ops vs. hvm showdown mode right now. The remaining
sticking points are this and the 2MB contig alloc for the tachyon 2 MB
block for the FC SEST. I feel like if we don't get pvops in now, it'll
be a hard sell later on.

Anyway, thanks for the info and I'll keep my fingers crossed that 5
days is all it takes.

> If this is a show-stopper right now, you could come with a hack where
> the resource check is just ignored.
I assume one could do this only if not using PCI passthrough?


Xen-devel mailing list

<Prev in Thread] Current Thread [Next in Thread>