WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Testing nested virtualization on Intel CPUs

To: Pasi Kärkkäinen <pasik@xxxxxx>
Subject: Re: [Xen-devel] Testing nested virtualization on Intel CPUs
From: AP <apxeng@xxxxxxxxx>
Date: Mon, 19 Sep 2011 17:35:51 -0700
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Mon, 19 Sep 2011 17:37:00 -0700
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=Xp+7rzXFP3TWx3V3Q3tEKjjfMdIPXStN3zjavAQaZr4=; b=uj6qFovETtTMrulzmL2eg2+AF0f8Jaz4Mts9xt5pq6SvzqNBI5CSPG9rN6LX7BfgiP 0DYFVfdXU/isWrbr1Myqjl9p3qAic9btF0qGas1sAO2axfPLjSr7/2rBs81Lovfc8Unk fmzAwv3YkUSgfet/oMTbLr8deAkVUVkhOWcOs=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <20110917134221.GZ12984@xxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <CAGU+autjPnjevraC5vhX4RAMC2XrqkfKUN_ZuJz1r0r3078=0Q@xxxxxxxxxxxxxx> <20110917134221.GZ12984@xxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
On Sat, Sep 17, 2011 at 6:42 AM, Pasi Kärkkäinen <pasik@xxxxxx> wrote:
> On Fri, Sep 16, 2011 at 06:16:20PM -0700, AP wrote:
>> I am testing out nested virtualization on a Lenovo x220 (Intel
>> i7-2620M). I am running xen-unstable (23842:483c5f8319ad) and Linux
>> 3.0 (Ubuntu 10.10).
>> I brought up a Centos 5.6 VM and installed Xen that is packaged with
>> it. I think it is a variant of 3.0.
>>
>
> Xen hypervisor in RHEL5 / CentOS5 is heavily patched Xen 3.1.2+.
> (the userland tools are 3.0.3-based though).
>
>
>> The CentOS Xen VM boots very
>> slowly but it does finally come up in to the nested Dom0. Now when I
>> do an "xm create" of an HVM domain I just get a blank sdl screen. I
>> don't even see the bios screen. Are there any more patches that I need
>> to be adding to get this to work?
>>
>
> Hmm.. I remember AMD guys mentioning nested virt Xen-on-Xen and KVM-on-Xen 
> works OK in xen-unstable.
> Not sure about the status of Intel nested virt currently.
>
> You could also try using Xen 4.x in the CentOS VM, just to see if that makes 
> a difference.
> rpms in http://gitco.de/repo/

With Xen-4.1.0 from gitco the inner Dom0 kernel doesn't come up fully.
So I changed tracks and tried running KVM within the guest and
installing an inner guest with KVM as the hypervisor. That seemingly
worked! I passed -enable-kvm to qemu-kvm. Is there anyway of
confirming this from the outer host Xen?

AP

> -- Pasi
>
>
>> I have also included some log output. Please let me know if you need
>> any other info.
>>
>> Thanks,
>> AP
>>
>> Config of nested hypervisor VM
>> =======================
>> kernel = "hvmloader"
>> builder='hvm'
>> memory = 1024
>> name = 'centos'
>> vcpus = 1
>> pae = 1
>> acpi = 1
>> apic = 1
>> vif = [ 'bridge=br0' ]
>> disk = ['phy:/dev/vollumvg/centos,hda,w', 'phy:/dev/vollumvg/centosfi,hdb,w']
>> device_model = 'qemu-dm'
>> vnc = 0
>> sdl = 1
>> stdvga = 1
>> serial = 'pty'
>> monitor=1
>> usb=1
>> videoram = 16
>> nestedhvm = 1
>>
>> Host Xen messages during nested hypervisor Xen VM boot
>> ---------------------------------------------------------------------------------------
>> (XEN) HVM2: HVM Loader
>> (XEN) HVM2: Detected Xen v4.2-unstable
>> (XEN) HVM2: Xenbus rings @0xfeffc000, event channel 2
>> (XEN) HVM2: System requested ROMBIOS
>> (XEN) HVM2: CPU speed is 2691 MHz
>> (XEN) irq.c:269: Dom2 PCI link 0 changed 0 -> 5
>> (XEN) HVM2: PCI-ISA link 0 routed to IRQ5
>> (XEN) irq.c:269: Dom2 PCI link 1 changed 0 -> 10
>> (XEN) HVM2: PCI-ISA link 1 routed to IRQ10
>> (XEN) irq.c:269: Dom2 PCI link 2 changed 0 -> 11
>> (XEN) HVM2: PCI-ISA link 2 routed to IRQ11
>> (XEN) irq.c:269: Dom2 PCI link 3 changed 0 -> 5
>> (XEN) HVM2: PCI-ISA link 3 routed to IRQ5
>> (XEN) HVM2: pci dev 01:2 INTD->IRQ5
>> (XEN) HVM2: pci dev 01:3 INTA->IRQ10
>> (XEN) HVM2: pci dev 03:0 INTA->IRQ5
>> (XEN) HVM2: pci dev 04:0 INTA->IRQ5
>> (XEN) HVM2: pci dev 02:0 bar 10 size 01000000: f0000008
>> (XEN) HVM2: pci dev 03:0 bar 14 size 01000000: f1000008
>> (XEN) HVM2: pci dev 03:0 bar 10 size 00000100: 0000c001
>> (XEN) HVM2: pci dev 04:0 bar 10 size 00000100: 0000c101
>> (XEN) HVM2: pci dev 04:0 bar 14 size 00000100: f2000000
>> (XEN) HVM2: pci dev 01:2 bar 20 size 00000020: 0000c201
>> (XEN) HVM2: pci dev 01:1 bar 20 size 00000010: 0000c221
>> (XEN) HVM2: Multiprocessor initialisation:
>> (XEN) HVM2:  - CPU0 ... 36-bit phys ... fixed MTRRs ... var MTRRs
>> [2/8] ... done.
>> (XEN) HVM2: Testing HVM environment:
>> (XEN) HVM2:  - REP INSB across page boundaries ... passed
>> (XEN) HVM2:  - GS base MSRs and SWAPGS ... passed
>> (XEN) HVM2: Passed 2 of 2 tests
>> (XEN) HVM2: Writing SMBIOS tables ...
>> (XEN) HVM2: Loading ROMBIOS ...
>> (XEN) HVM2: 9724 bytes of ROMBIOS high-memory extensions:
>> (XEN) HVM2:   Relocating to 0xfc000000-0xfc0025fc ... done
>> (XEN) HVM2: Creating MP tables ...
>> (XEN) HVM2: Loading Standard VGABIOS ...
>> (XEN) HVM2: Loading PCI Option ROM ...
>> (XEN) HVM2:  - Manufacturer: http://etherboot.org
>> (XEN) HVM2:  - Product name: gPXE
>> (XEN) HVM2: Loading ACPI ...
>> (XEN) HVM2: vm86 TSS at fc012800
>> (XEN) HVM2: BIOS map:
>> (XEN) HVM2:  c0000-c9fff: VGA BIOS
>> (XEN) HVM2:  ca000-d7fff: Etherboot ROM
>> (XEN) HVM2:  f0000-fffff: Main BIOS
>> (XEN) HVM2: E820 table:
>> (XEN) HVM2:  [00]: 00000000:00000000 - 00000000:0009e000: RAM
>> (XEN) HVM2:  [01]: 00000000:0009e000 - 00000000:000a0000: RESERVED
>> (XEN) HVM2:  HOLE: 00000000:000a0000 - 00000000:000e0000
>> (XEN) HVM2:  [02]: 00000000:000e0000 - 00000000:00100000: RESERVED
>> (XEN) HVM2:  [03]: 00000000:00100000 - 00000000:3f000000: RAM
>> (XEN) HVM2:  HOLE: 00000000:3f000000 - 00000000:fc000000
>> (XEN) HVM2:  [04]: 00000000:fc000000 - 00000001:00000000: RESERVED
>> (XEN) HVM2: Invoking ROMBIOS ...
>> (XEN) HVM2: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
>> (XEN) stdvga.c:147:d2 entering stdvga and caching modes
>> (XEN) HVM2: VGABios $Id: vgabios.c,v 1.67 2008/01/27 09:44:12 vruppert Exp $
>> (XEN) HVM2: VBE Bios $Id: vbe.c,v 1.60 2008/03/02 07:47:21 vruppert Exp $
>> (XEN) HVM2: Bochs BIOS - build: 06/23/99
>> (XEN) HVM2: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
>> (XEN) HVM2: Options: apmbios pcibios eltorito PMM
>> (XEN) HVM2:
>> (XEN) HVM2: ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63
>> (XEN) HVM2: ata0 master: QEMU HARDDISK ATA-7 Hard-Disk (10240 MBytes)
>> (XEN) HVM2: ata0-1: PCHS=10402/16/63 translation=lba LCHS=652/255/63
>> (XEN) HVM2: ata0  slave: QEMU HARDDISK ATA-7 Hard-Disk (5120 MBytes)
>> (XEN) HVM2:
>> (XEN) HVM2:
>> (XEN) HVM2:
>> (XEN) HVM2: Press F12 for boot menu.
>> (XEN) HVM2:
>> (XEN) HVM2: Booting from Hard Disk...
>> (XEN) HVM2: Booting from 0000:7c00
>> (XEN) HVM2: int13_harddisk: function 41, unmapped device for ELDL=82
>> (XEN) HVM2: int13_harddisk: function 08, unmapped device for ELDL=82
>> (XEN) HVM2: *** int 15h function AX=00c0, BX=0000 not yet supported!
>> (XEN) HVM2: int13_harddisk: function 02, unmapped device for ELDL=82
>> (XEN) HVM2: int13_harddisk: function 41, unmapped device for ELDL=82
>> (XEN) irq.c:269: Dom2 PCI link 0 changed 5 -> 0
>> (XEN) irq.c:269: Dom2 PCI link 1 changed 10 -> 0
>> (XEN) irq.c:269: Dom2 PCI link 2 changed 11 -> 0
>> (XEN) irq.c:269: Dom2 PCI link 3 changed 5 -> 0
>>
>>
>> Nested Xen Messages during nested VM boot
>> -------------------------------------------------------------------
>> (XEN) sysctl.c:51: Allowing physinfo call with newer ABI version
>> (XEN) sysctl.c:51: Allowing physinfo call with newer ABI version
>> (XEN) sysctl.c:51: Allowing physinfo call with newer ABI version
>> (XEN) sysctl.c:51: Allowing physinfo call with newer ABI version
>> (XEN) sysctl.c:51: Allowing physinfo call with newer ABI version
>> (XEN) sysctl.c:51: Allowing physinfo call with newer ABI version
>> (XEN) memory.c:124:d0 Could not allocate order=9 extent: id=1
>> memflags=0 (0 of 1)
>> (XEN) memory.c:124:d0 Could not allocate order=9 extent: id=1
>> memflags=0 (0 of 1)
>> (XEN) memory.c:124:d0 Could not allocate order=9 extent: id=1
>> memflags=0 (0 of 1)
>> (XEN) memory.c:124:d0 Could not allocate order=9 extent: id=1
>> memflags=0 (0 of 1)
>>
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@xxxxxxxxxxxxxxxxxxx
>> http://lists.xensource.com/xen-devel
>

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel