WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Assigning contiguous memory to a driver domain

To: Dan Magenheimer <dan.magenheimer@xxxxxxxxxx>
Subject: Re: [Xen-devel] Assigning contiguous memory to a driver domain
From: Jeremy Fitzhardinge <jeremy@xxxxxxxx>
Date: Mon, 20 Sep 2010 17:45:49 -0700
Cc: Rafal Wojtczuk <rafal@xxxxxxxxxxxxxxxxxxxxxx>, xen-devel@xxxxxxxxxxxxxxxxxxx, Joanna Rutkowska <joanna@xxxxxxxxxxxxxxxxxxxxxx>, Jan Beulich <JBeulich@xxxxxxxxxx>, Konrad Wilk <konrad.wilk@xxxxxxxxxx>
Delivery-date: Mon, 20 Sep 2010 17:46:50 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <5bdf8acc-99ad-47a9-abe4-467b9a3fd9ca@default>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <4C90C3200200007800016442@xxxxxxxxxxxxxxxxxx> <4C90A8E4.9090004@xxxxxxxxxxxxxxxxxxxxxx> <4C90CF39020000780001647E@xxxxxxxxxxxxxxxxxx> <87pqwfgqvt.fsf@xxxxxxxxxxxxxxxxxxxx> <20100915120626.GA2024@email> <4C90EB1102000078000164C6@xxxxxxxxxxxxxxxxxx> <20100915144413.GB2098@email> <4C91027802000078000165E8@xxxxxxxxxxxxxxxxxx> <20100920194836.GA25803@xxxxxxxxxxxx> <4C97C3AC.90207@xxxxxxxx> <20100920214126.GH26201@xxxxxxxxxxxx 4C97D848.20608@xxxxxxxx> <5bdf8acc-99ad-47a9-abe4-467b9a3fd9ca@default>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.9) Gecko/20100907 Fedora/3.1.3-1.fc13 Lightning/1.0b3pre Thunderbird/3.1.3
 On 09/20/2010 04:42 PM, Dan Magenheimer wrote:
>>  On 09/20/2010 02:41 PM, Konrad Rzeszutek Wilk wrote:
>>> On Mon, Sep 20, 2010 at 01:27:24PM -0700, Jeremy Fitzhardinge wrote:
>>>>  On 09/20/2010 12:48 PM, Konrad Rzeszutek Wilk wrote:
>>>>> Let me expand this. During bootup Xen-SWIOTLB  (which for DomU you
>> have
>>>>> to enable via the 'iommu=soft'), allocated 32 2MB chunks of
>> contingous
>>>>> memory under the 4GB limit. Those chunks stay in DomU and are used
>>>>> during the the runtime of the DomU. They don't go back to Xen
>> unless the
>>>>> domain has been terminated. Any of the DMA operations that any
>> driver
>>>>> does go through the SWIOTLB bufer if the physical (mfn) for the DMA
>> is
>>>>> outside the driver capabilities (say, your ping buffer is allocated
>> above
>>>>> the 4GB, and your r8169 can only do 32-bit, then SWIOTLB would be
>> utilized
>>>>> to "bounce" the memory).
>>>> BTW, are there any hooks to make sure these pages are still
>> contiguous
>>>> after migration/restore?
>>> <shudders>I don't really know. We do save the P2M map, so those
>> mappings
>>> are saved in the guest. But for the MFNs that have been exchanged - I
>> don't
>>> believe the hypervior is notified about which MFNs have been
>> transfered
>>> to another domain? Or these MFNs extracted during save/resume
>> On save the toolstack will rewrite all the mfns in the pagetables and
>> the p2m map to canonical pfn form, then rewrite them back to mfns on
>> resume when it has allocated pages for them all.  I don't believe
>> there's any mechanism to remember what regions were mfn-contiguous and
>> restore that on resume.
> I may be too far behind on this thread, but aren't we only talking about
> driver domains with passthrough?   Is it even possible to migrate
> driver domains yet?

Not with devices attached.  But there should be no problem in principle
with detaching all the devices, migrating, the reattaching everything.

    J

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel