Seems like new kernel brought up back some old issues with ubuntu 8.10 devices. It never happened before patching 2.6.29-rc7 kernel on C2D boxes with the same ubuntu 8.10 server release and 2.6.29-rc5. In particular, CentOS 5.2 PV DomU's xen-hotplug.log looks like:-
xenstore-read: couldn't read path /local/domain/2/vm xenstore-read: couldn't read path /local/domain/9/vm xenstore-read: couldn't read path /local/domain/3/vm xenstore-read: couldn't read path /local/domain/4/vm Either xen-tools (or whatever else in xen unstable) requires correlation with patched kernel.
--- On Mon, 3/9/09, Boris Derzhavets <bderzhavets@xxxxxxxxx> wrote:
From: Boris Derzhavets
<bderzhavets@xxxxxxxxx> Subject: [Xen-devel] Re: [PATCH] xen: mask XSAVE in cpuid since we don't allow guests to use it To: "Keir Fraser" <keir.fraser@xxxxxxxxxxxxx> Cc: "Xen-devel" <xen-devel@xxxxxxxxxxxxxxxxxxx> Date: Monday, March 9, 2009, 10:31 AM
Just cloned,built and installed the most recent xen-unstable. Seems like "make tools" reports some errors , but still finishes with no error message. CentOS 5.2 PV DomU may be loaded OK only the very first time. The next attempt after DomU shutdown brings it to paused state. After "xm unpause DomainName":-
i8042.c: No controller
found. in 1 seconds Red Hat nash version 5.1.19.6 starting Reading all physical volumes. This may take a while... No volume groups found Volume group "VolGroup00" not found mount: could not find filesystem '/dev/root' setuproot: moving /dev failed: No such file or directory setuproot: error mounting /proc: No such file or directory setuproot: error mounting /sys: No such file or directory switchroot: mount failed: No such file or
directory Kernel panic - not syncing: Attempted to kill init! root@ServerUbuntu810:/home/boris/vm# Error: Device 51712 (vbd) could not be connected. Hotplug scripts not working.
/var/log/xen/xend.log:-
[2009-03-09 10:18:33 6335] DEBUG (XendDomainInfo:2131) No device model [2009-03-09 10:18:33 6335] DEBUG (XendDomainInfo:2133) Releasing devices [2009-03-09 10:19:29 6335] DEBUG (DevController:629) hotplugStatusCallback /local/domain/0/backend/vbd/2/51712/hotplug-status. [2009-03-09 10:19:29 6335] DEBUG (DevController:643) hotplugStatusCallback 1. [2009-03-09 10:19:42 6335] ERROR (XendDomainInfo:1983) Failed to restart domain 2. Traceback (most recent call last): File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 1969, in _restart new_dom.waitForDevices() File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 1020, in waitForDevices
self.getDeviceController(devclass).waitForDevices() File "//usr/lib64/python/xen/xend/server/DevController.py", line 140, in waitForDevices return map(self.waitForDevice, self.deviceIDs()) File "//usr/lib64/python/xen/xend/server/DevController.py", line 152, in waitForDevice self.destroyDevice(devid, False) File "//usr/lib64/python/xen/xend/server/blkif.py", line 200, in destroyDevice DevController.destroyDevice(self, devid, force) File "//usr/lib64/python/xen/xend/server/DevController.py", line 228, in destroyDevice self.writeBackend(dev, 'online', "0") File "//usr/lib64/python/xen/xend/server/DevController.py", line 474, in writeBackend raise VmError("Device %s not connected" % devid) VmError: Device 51712 not connected [2009-03-09 10:21:06 6335] DEBUG (DevController:629)
hotplugStatusCallback /local/domain/0/backend/vbd/3/51712/hotplug-status. [2009-03-09 10:21:06 6335] DEBUG (DevController:643) hotplugStatusCallback 2.
Start F10 PV DomU:-
root@ServerUbuntu810:/home/boris/vm# xm create -c f10.pyrun Using config file "./f10.pyrun". PCI: Fatal: No config space access function found IO APIC resources could be not be allocated. Loading /lib/kbd/keymaps/i386/qwerty/us.map BUG: unable to handle kernel NULL pointer dereference at 0000000000000000 IP: [<ffffffffa00010e5>] backend_changed+0x2d5/0x3af [xen_blkfront] PGD 7d1f6067 PUD 7d143067 PMD 7d116067 PTE 0 Oops: 0000 [1] SMP CPU 1 Modules linked in: xen_blkfront Pid: 19, comm: xenwatch Not tainted 2.6.27.5-117.fc10.x86_64 #1 RIP: e030:[<ffffffffa00010e5>] [<ffffffffa00010e5>] backend_changed+0x2d5/0x3af [xen_blkfront] RSP: e02b:ffff88007f40fdf0 EFLAGS: 00010246 RAX: 0000000000000000
RBX: ffff88007d02d840 RCX: 0000000000000000 RDX: ffff88007f40fe28 RSI: 0000000000000005 RDI: ffff88007ff5f400 RBP: ffff88007f40fe80 R08: ffff88007f40fdd0 R09: ffff88007f40fcc0 R10: 0000000000000001 R11: ffff880000000018 R12: ffff88007ff5f400 R13: ffff88007d042000 R14: 000000000000000a R15: ffffffff817e2f44 FS: 00007fb68f67e6f0(0000) GS:ffff88007fc04880(0000) knlGS:0000000000000000 CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000000000000 CR3: 000000007d105000 CR4: 0000000000002660 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process xenwatch (pid: 19, threadinfo ffff88007f40e000, task ffff88007ffd5c40) Stack: ffff88007f40fe00 ffff88007f40fe40 ffffffff816de500 ffffffff816de500 ffffffff81455f53 ffffffff81462b99 ffff88007f40fe7c 0000000000000000 000000000000000a ffff88007d02d840
ffff88007ff5f400 ffffffffa0002ac0 Call Trace: [<ffffffff811c91e6>] otherend_changed+0x81/0x8a [<ffffffff811c7e14>] xenwatch_thread+0x101/0x134 [<ffffffff81055199>] ? autoremove_wake_function+0x0/0x38 [<ffffffff811c7d13>] ? xenwatch_thread+0x0/0x134 [<ffffffff81054e53>] kthread+0x49/0x76 [<ffffffff810116e9>] child_rip+0xa/0x11 [<ffffffff81010a07>] ? restore_args+0x0/0x30 [<ffffffff810116df>] ? child_rip+0x0/0x11
Code: 58 08 e9 97 00 00 00 49 8b 7d 00 48 c7 c2 b9 15 00 a0 be ed ff ff ff 48 8b 4f 10 31 c0 e8 da 5f 1c e1 e9 cf 00 00 00 49 8b 45 08 <8b> 38 c1 e7 14 0b 78 04 e8 26 55 0e e1 48 85 c0 48 89 c3 75 16 RIP [<ffffffffa00010e5>] backend_changed+0x2d5/0x3af [xen_blkfront] RSP <ffff88007f40fdf0> CR2: 0000000000000000 ---[ end trace bf88f6e1c7a703d2
]--- root@ServerUbuntu810:/home/boris/vm# Error: Device 51712 (vbd) could not be connected. Hotplug scripts not working.
--- On Mon, 3/9/09, Keir Fraser <keir.fraser@xxxxxxxxxxxxx> wrote:
From: Keir Fraser <keir.fraser@xxxxxxxxxxxxx> Subject: Re: [PATCH] xen: mask XSAVE in cpuid since we don't allow guests to use it To: "bderzhavets@xxxxxxxxx" <bderzhavets@xxxxxxxxx> Cc: "Xen-devel" <xen-devel@xxxxxxxxxxxxxxxxxxx> Date: Monday, March 9, 2009, 7:26 AM
If you¹re using a recent xen-unstable then you might try again with the current tip. A couple of changes went in recently (including one fix today).
-- Keir
On 09/03/2009 11:18, "Boris Derzhavets" <bderzhavets@xxxxxxxxx> wrote:
> I was able to go through creating PV DomUs images
via corresponding pygrub's > profiles for F10,CentOS 5.2,SNV_106 (64-bit all). > However, only Solaris Nevada PV DomU gets loaded via standard > pygrub profile. > > Attempt to load F10 PV:- > > [2009-03-09 05:33:38 6351] DEBUG (XendDomainInfo:92) > XendDomainInfo.create(['vm', ['name', 'F10PV'], ['memory', 2048], > ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 1], > ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'], ['bootloader', > '/usr/bin/pygrub'], ['bootloader_args', '-q'], ['image', ['linux', > ['videoram', 4]]], ['device', ['vbd', ['uname', 'phy:/dev/sdb5'], ['dev', > 'xvda'], ['mode', 'w']]], ['device', ['vif', ['bridge', 'eth0']]], ['device', > ['vkbd']], ['device', ['vfb', ['vncunused', '1'], ['type', 'vnc'], > ['xauthority', '/root/.Xauthority']]]]) > [2009-03-09 05:33:38 6351] DEBUG
(XendDomainInfo:2183) > XendDomainInfo.constructDomain > [2009-03-09 05:33:38 6351] DEBUG (balloon:166) Balloon: 7239368 KiB free; need > 2048; done. > [2009-03-09 05:33:38 6351] DEBUG (XendDomain:452) Adding Domain: 8 > [2009-03-09 05:33:38 6351] DEBUG (XendDomainInfo:2362) > XendDomainInfo.initDomain: 8 256 > [2009-03-09 05:33:38 12975] DEBUG (XendBootloader:113) Launching bootloader as > ['/usr/bin/pygrub', '--output=/var/run/xend/boot/xenbl.29001', '-q', > '/dev/sdb5']. > [2009-03-09 05:33:39 6351] ERROR (XendBootloader:213) Boot loader didn't > return any data! > [2009-03-09 05:33:39 6351] ERROR (XendDomainInfo:472) VM start failed > Traceback (most recent call last): > File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 452, in start > XendTask.log_progress(31, 60, self._initDomain) > File
"//usr/lib64/python/xen/xend/XendTask.py", line 209, in log_progress > retval = func(*args, **kwds) > File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 2364, in > _initDomain > self._configureBootloader() > File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 2765, in > _configureBootloader > bootloader_args, kernel, ramdisk, args) > File "//usr/lib64/python/xen/xend/XendBootloader.py", line 214, in > bootloader > raise VmError, msg > > Attempt to load CentOS 5.2 PV:- > > [2009-03-09 06:45:39 6351] DEBUG (XendDomainInfo:92) > XendDomainInfo.create(['vm', ['name', 'RHEL52PV'], ['memory', 2048], ['vcpus', > 1], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'], ['image', > ['linux', ['videoram', 4]]], ['device', ['vbd', ['uname', 'phy:/dev/sdb5'], > ['dev', 'xvda'], ['mode',
'w']]], ['device', ['vif', ['bridge', 'eth0']]]]) > [2009-03-09 06:45:39 6351] DEBUG (XendDomainInfo:2183) > XendDomainInfo.constructDomain > [2009-03-09 06:45:39 6351] DEBUG (balloon:166) Balloon: 7239368 KiB free; need > 2048; done. > [2009-03-09 06:45:39 6351] DEBUG (XendDomain:452) Adding Domain: 12 > [2009-03-09 06:45:39 6351] DEBUG (XendDomainInfo:2362) > XendDomainInfo.initDomain: 12 256 > [2009-03-09 06:45:39 16739] DEBUG (XendBootloader:113) Launching bootloader as > ['/usr/bin/pygrub', '--output=/var/run/xend/boot/xenbl.15023', '/dev/sdb5']. > [2009-03-09 06:45:44 6351] ERROR (XendBootloader:213) Boot loader didn't > return any data! > [2009-03-09 06:45:44 6351] ERROR (XendDomainInfo:472) VM start failed > Traceback (most recent call last): > File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 452, in start >
XendTask.log_progress(31, 60, self._initDomain) > File "//usr/lib64/python/xen/xend/XendTask.py", line 209, in log_progress > retval = func(*args, **kwds) > File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 2364, in > _initDomain > self._configureBootloader() > File "//usr/lib64/python/xen/xend/XendDomainInfo.py", line 2765, in > _configureBootloader > bootloader_args, kernel, ramdisk, args) > File "//usr/lib64/python/xen/xend/XendBootloader.py", line 214, in > bootloader > raise VmError, msg > VmError: Boot loader didn't return any data! > > > > > > > > > > --- On Sun, 3/8/09, Jeremy Fitzhardinge <jeremy@xxxxxxxx> wrote: >> From: Jeremy Fitzhardinge <jeremy@xxxxxxxx> >> Subject: [PATCH] xen: mask XSAVE in cpuid since we don't
allow guests to use >> it >> To: "Keir Fraser" <keir.fraser@xxxxxxxxxxxxx> >> Cc: "Xen-devel" <xen-devel@xxxxxxxxxxxxxxxxxxx>, "Marc - A. Dahlhaus [ >> Administration | Westermann GmbH ]" <mad@xxxxxx>, "Boris Derzhavets" >> <bderzhavets@xxxxxxxxx> >> Date: Sunday, March 8, 2009, 12:31 AM >> >> Mask X86_FEATURE_XSAVE in cpuid leaf 1, ecx, as we don't allow guests to >> use it (by setting cr4.OSXSAVE). >> >> This prevents crashes in pvops dom0 kernels, as new versions of Linux try >> to use this feature. >> >> (This patch deals with dom0 cpuid; I'm not sure where the right place to >> set up the default mask for domU is.) >> >> Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@xxxxxxxxxx> >> >> diff -r 7f573cb76db4
xen/arch/x86/traps.c >> --- a/xen/arch/x86/traps.c Tue Mar 03 13:22:28 2009 +0000 >> +++ b/xen/arch/x86/traps.c Sat Mar 07 17:02:03 2009 -0800 >> @@ -757,6 +757,7 @@ >> __clear_bit(X86_FEATURE_XTPR % 32, &c); >> __clear_bit(X86_FEATURE_PDCM % 32, &c); >> __clear_bit(X86_FEATURE_DCA % 32, &c); >> + __clear_bit(X86_FEATURE_XSAVE % 32, &c); >> if ( !cpu_has_apic ) >> >> __clear_bit(X86_FEATURE_X2APIC % 32, &c); >> __set_bit(X86_FEATURE_HYPERVISOR % 32, &c); >> diff -r 7f573cb76db4 xen/include/asm-x86/cpufeature.h >> --- a/xen/include/asm-x86/cpufeature.h Tue Mar 03 13:22:28 2009 +0000 >> +++ b/xen/include/asm-x86/cpufeature.h Sat Mar 07 17:02:03 2009 -0800 >> @@ -95,6 +95,7 @@ >> #define X86_FEATURE_SSE4_2 (4*32+20) /* Streaming
SIMD Extensions 4.2 */ >> #define X86_FEATURE_X2APIC (4*32+21) /* Extended xAPIC */ >> #define X86_FEATURE_POPCNT (4*32+23) /* POPCNT instruction */ >> +#define X86_FEATURE_XSAVE (4*32+26) /* XSAVE/XRSTOR/XSETBV/XGETBV */ >> #define X86_FEATURE_HYPERVISOR (4*32+31) /* Running under some hypervisor */ >> >> /* VIA/Cyrix/Centaur-defined CPU features, CPUID level 0xC0000001, word 5 */ >> >> > >
|
_______________________________________________ Xen-devel mailing list Xen-devel@xxxxxxxxxxxxxxxxxxx http://lists.xensource.com/xen-devel
|
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
|