I can boot non NFS images of the same target with no problem.
Are there any grub tricks I need to know?
I suspect the problem is in my domU config file (below).
Has anyone managed to get an HVM NFS boot working? If so, please,
can I have the details of the configuration?
I know have the tftp server and dhcp setup right as I can boot non-xen
images fine.
Here's the console output:
#> xm create -c /import/bedge/static-nfs.cfg
Using config file "/import/bedge/static-nfs.cfg".
Started domain dpm (id=20)
Probing pci nic...
[PXE]Hunting for pixies...found !PXE at 0009ce60...ok
configfile: (nd)/import/tonic/pxe/kaan-14-dpm/menu.lst
bootp called in PXE TFTP mode
dhcp called in PXE TFTP mode
...then nothing.
I know the grub menu.lst was transferred because the tftp server logs:
Oct 20 12:13:31 tonic in.tftpd[20901]: RRQ from 135.149.76.94 filename
/import/tonic/pxe/lib/pxegrub
Oct 20 12:13:31 tonic in.tftpd[20902]: RRQ from 135.149.76.94 filename
import/tonic/pxe/kaan-14-dpm/menu.lst
Oct 20 12:13:32 tonic in.tftpd[20903]: RRQ from 135.149.76.94 filename
import/tonic/pxe/kaan-14-dpm/menu.lst
This is the config:
#bootloader = '/usr/bin/pygrub'
kernel = '/usr/lib64/xen/boot/hvmloader'
builder='hvm'
memory = 4096
memory_dynamic_max = 2048
name = "dpm"
hap=0
vcpus=1
#vif = [ 'type=ioemu, bridge=xenbr0, mac=00:16:3e:00:14:01' ]
#vif = [ 'type=ioemu, bridge=eth0, mac=00:16:3e:00:14:01' ]
vif = [ 'type=ioemu, mac=00:16:3e:00:14:01' ]
disk = [ 'phy:system/dpm_root_0,xvda:sda1,w',
'phy:system/dpm_swap,xvdb:sda2,w' ]
boot="n"
device_model = '/usr/lib64/xen/bin/qemu-dm'
#pci = ['17:00.0', '17:00.1']
vnc=0
vncunused=1
nographic=0
apic=1
acpi=1
vnclisten="0.0.0.0"
vncpasswd=''
stdvga=0
serial='pty'
usbdevice='tablet'
>
on_reboot = 'restart'
on_crash = 'restart'
Here's the Xen console output:
(XEN) HVM20: HVM Loader
(XEN) HVM20: Detected Xen v3.5-unstable
(XEN) HVM20: CPU speed is 1000 MHz
(XEN) irq.c:243: Dom20 PCI link 0 changed 0 -> 5
(XEN) HVM20: PCI-ISA link 0 routed to IRQ5
(XEN) irq.c:243: Dom20 PCI link 1 changed 0 -> 10
(XEN) HVM20: PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:243: Dom20 PCI link 2 changed 0 -> 11
(XEN) HVM20: PCI-ISA link 2 routed to IRQ11
(XEN) irq.c:243: Dom20 PCI link 3 changed 0 -> 5
(XEN) HVM20: PCI-ISA link 3 routed to IRQ5
(XEN) HVM20: pci dev 01:2 INTD->IRQ5
(XEN) HVM20: pci dev 01:3 INTA->IRQ10
(XEN) HVM20: pci dev 03:0 INTA->IRQ5
(XEN) HVM20: pci dev 04:0 INTA->IRQ5
(XEN) HVM20: pci dev 02:0 bar 10 size 02000000: f0000008
(XEN) HVM20: pci dev 03:0 bar 14 size 01000000: f2000008
(XEN) HVM20: pci dev 02:0 bar 14 size 00001000: f3000000
(XEN) HVM20: pci dev 03:0 bar 10 size 00000100: 0000c001
(XEN) HVM20: pci dev 04:0 bar 10 size 00000100: 0000c101
(XEN) HVM20: pci dev 04:0 bar 14 size 00000100: f3001000
(XEN) HVM20: pci dev 01:2 bar 20 size 00000020: 0000c201
(XEN) HVM20: pci dev 01:1 bar 20 size 00000010: 0000c221
(XEN) HVM20: Multiprocessor initialisation:
(XEN) HVM20: - CPU0 ... 40-bit phys ... fixed MTRRs ... var MTRRs
[2/8] ... done.
(XEN) HVM20: Testing HVM environment:
(XEN) HVM20: - REP INSB across page boundaries ... passed
(XEN) HVM20: - GS base MSRs and SWAPGS ... passed
(XEN) HVM20: Passed 2 of 2 tests
(XEN) HVM20: Writing SMBIOS tables ...
(XEN) HVM20: Loading ROMBIOS ...
(XEN) HVM20: 9788 bytes of ROMBIOS high-memory extensions:
(XEN) HVM20: Relocating to 0xfc000000-0xfc00263c ... done
(XEN) HVM20: Creating MP tables ...
(XEN) HVM20: Loading Cirrus VGABIOS ...
(XEN) HVM20: Loading PCI Option ROM ...
(XEN) HVM20: - Manufacturer:
http://etherboot.org
(XEN) HVM20: - Product name: gPXE
(XEN) HVM20: Loading ACPI ...
(XEN) HVM20: - Lo data: 000ea020-000ea04f
(XEN) HVM20: - Hi data: fc002800-fc011dcf
(XEN) HVM20: vm86 TSS at fc012000
(XEN) HVM20: BIOS map:
(XEN) HVM20: c0000-c8fff: VGA BIOS
(XEN) HVM20: c9000-d57ff: Etherboot ROM
(XEN) HVM20: eb000-eb14e: SMBIOS tables
(XEN) HVM20: f0000-fffff: Main BIOS
(XEN) HVM20: Invoking ROMBIOS ...
(XEN) HVM20: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
(XEN) stdvga.c:147:d20 entering stdvga and caching modes
(XEN) HVM20: VGABios $Id: vgabios.c,v 1.67 2008/01/27 09:44:12 vruppert Exp $
(XEN) HVM20: Bochs BIOS - build: 06/23/99
(XEN) HVM20: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
(XEN) HVM20: Options: apmbios pcibios eltorito PMM
(XEN) HVM20:
(XEN) HVM20: ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63
(XEN) HVM20: ata0 master: QEMU HARDDISK ATA-7 Hard-Disk (8192 MBytes)
(XEN) HVM20: ata0-1: PCHS=4161/16/63 translation=lba LCHS=520/128/63
(XEN) HVM20: ata0 slave: QEMU HARDDISK ATA-7 Hard-Disk (2048 MBytes)
(XEN) HVM20:
(XEN) HVM20:
(XEN) HVM20:
(XEN) HVM20: Press F12 for boot menu.
(XEN) HVM20:
(XEN) HVM20: Booting from Network...
(XEN) HVM20: Booting from c900:0281
(XEN) HVM20: int13_harddisk: function 41, unmapped device for ELDL=82
(XEN) HVM20: int13_harddisk: function 08, unmapped device for ELDL=82
(XEN) HVM20: *** int 15h function AX=00c0, BX=0000 not yet supported!
...and here's the xen logs:
==> xend.log <==
[2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:99)
XendDomainInfo.create(['vm', ['name', 'dpm'], ['memory', 4096],
['on_poweroff', 'destroy'], ['on_reboot', 'restart'], ['on_crash',
'restart'], ['vcpus', 1], ['on_xend_start', 'ignore'],
['on_xend_stop', 'ignore'], ['image', ['hvm', ['kernel',
'/usr/lib64/xen/boot/hvmloader'], ['videoram', 4], ['device_model',
'/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 1], ['boot',
'n'], ['fda', ''], ['fdb', ''], ['timer_mode', 1], ['localtime', 0],
['serial', 'pty'], ['stdvga', 0], ['isa', 0], ['nographic', 0],
['soundhw', ''], ['vnc', 0], ['vncunused', 1], ['vnclisten',
'0.0.0.0'], ['xauthority', '/root/.Xauthority'], ['rtc_timeoffset',
0], ['monitor', 0], ['acpi', 1], ['apic', 1], ['usb', 0],
['usbdevice', 'tablet'], ['keymap', ''], ['pci', []], ['hpet', 0],
['guest_os_type', 'default'], ['hap', 0], ['cpuid', []],
['cpuid_check', []], ['viridian', 0], ['pci_msitranslate', 1],
['vpt_align', 1], ['pci_power_mgmt', 0], ['xen_platform_pci', 1],
['vncpasswd', 'XXXXXXXX'], ['tsc_native', 0]]], ['s3_integrity', 1],
['device', ['vbd', ['uname', 'phy:system/dpm_root_0'], ['dev',
'xvda:sda1'], ['mode', 'w']]], ['device', ['vbd', ['uname',
'phy:system/dpm_swap'], ['dev', 'xvdb:sda2'], ['mode', 'w']]],
['device', ['vif', ['mac', '00:16:3e:00:14:01'], ['type', 'ioemu']]]])
[2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:2389)
XendDomainInfo.constructDomain
[2009-10-20 12:13:24 11382] DEBUG (balloon:181) Balloon: 4250864 KiB
free; need 4096; done.
[2009-10-20 12:13:24 11382] DEBUG (XendDomain:464) Adding Domain: 20
[2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:2634)
XendDomainInfo.initDomain: 20 256
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: boot, val: n
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: fda, val: None
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: fdb, val: None
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: soundhw, val: None
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: localtime, val: 0
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: serial, val: ['pty']
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: std-vga, val: 0
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: isa, val: 0
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: acpi, val: 1
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: usb, val: 0
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: usbdevice, val: tablet
[2009-10-20 12:13:24 11382] DEBUG (image:847) args: gfx_passthru, val: None
[2009-10-20 12:13:24 11382] INFO (image:783) Need to create platform
device.[domid:20]
[2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:2661)
_initDomain:shadow_memory=0x0, memory_static_max=0x100000000,
memory_static_min=0x0.
[2009-10-20 12:13:24 11382] DEBUG (balloon:181) Balloon: 4249412 KiB
free; need 4248576; done.
[2009-10-20 12:13:24 11382] INFO (image:181) buildDomain os=hvm dom=20 vcpus=1
[2009-10-20 12:13:24 11382] DEBUG (image:900) domid = 20
[2009-10-20 12:13:24 11382] DEBUG (image:901) image =
/usr/lib64/xen/boot/hvmloader
[2009-10-20 12:13:24 11382] DEBUG (image:902) store_evtchn = 2
[2009-10-20 12:13:24 11382] DEBUG (image:903) memsize = 4096
[2009-10-20 12:13:24 11382] DEBUG (image:904) target = 4096
[2009-10-20 12:13:24 11382] DEBUG (image:905) vcpus = 1
[2009-10-20 12:13:24 11382] DEBUG (image:906) acpi = 1
[2009-10-20 12:13:24 11382] DEBUG (image:907) apic = 1
[2009-10-20 12:13:25 11382] INFO (XendDomainInfo:2253) createDevice:
vbd : {'uuid': '92d71e42-49d2-f977-5fbe-2a5d73b7d169', 'bootable': 1,
'driver': 'paravirtualised', 'dev': 'xvda:sda1', 'uname':
'phy:system/dpm_root_0', 'mode': 'w'}
[2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController:
writing {'backend-id': '0', 'virtual-device': '51712', 'device-type':
'sda1', 'state': '1', 'backend':
'/local/domain/0/backend/vbd/20/51712'} to
/local/domain/20/device/vbd/51712.
[2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController:
writing {'domain': 'dpm', 'frontend':
'/local/domain/20/device/vbd/51712', 'uuid':
'92d71e42-49d2-f977-5fbe-2a5d73b7d169', 'bootable': '1', 'dev':
'xvda', 'state': '1', 'params': 'system/dpm_root_0', 'mode': 'w',
'online': '1', 'frontend-id': '20', 'type': 'phy'} to
/local/domain/0/backend/vbd/20/51712.
[2009-10-20 12:13:25 11382] INFO (XendDomainInfo:2253) createDevice:
vbd : {'uuid': 'eddb896f-8ca7-ce22-4cff-a97895fc95ba', 'bootable': 0,
'driver': 'paravirtualised', 'dev': 'xvdb:sda2', 'uname':
'phy:system/dpm_swap', 'mode': 'w'}
[2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController:
writing {'backend-id': '0', 'virtual-device': '51728', 'device-type':
'sda2', 'state': '1', 'backend':
'/local/domain/0/backend/vbd/20/51728'} to
/local/domain/20/device/vbd/51728.
[2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController:
writing {'domain': 'dpm', 'frontend':
'/local/domain/20/device/vbd/51728', 'uuid':
'eddb896f-8ca7-ce22-4cff-a97895fc95ba', 'bootable': '0', 'dev':
'xvdb', 'state': '1', 'params': 'system/dpm_swap', 'mode': 'w',
'online': '1', 'frontend-id': '20', 'type': 'phy'} to
/local/domain/0/backend/vbd/20/51728.
[2009-10-20 12:13:25 11382] INFO (XendDomainInfo:2253) createDevice:
vif : {'mac': '00:16:3e:00:14:01', 'type': 'ioemu', 'uuid':
'fc2d0127-1e56-ff53-0918-aee9358e5ca5'}
[2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController:
writing {'state': '1', 'backend-id': '0', 'backend':
'/local/domain/0/backend/vif/20/0'} to /local/domain/20/device/vif/0.
[2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController:
writing {'domain': 'dpm', 'frontend': '/local/domain/20/device/vif/0',
'uuid': 'fc2d0127-1e56-ff53-0918-aee9358e5ca5', 'script':
'/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:00:14:01',
'frontend-id': '20', 'state': '1', 'online': '1', 'handle': '0',
'type': 'ioemu'} to /local/domain/0/backend/vif/20/0.
[2009-10-20 12:13:25 11382] INFO (image:410) spawning device models:
/usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '20',
'-domain-name', 'dpm', '-videoram', '4', '-nographic', '-vcpus', '1',
'-boot', 'n', '-serial', 'pty', '-acpi', '-usbdevice', 'tablet',
'-net', 'nic,vlan=1,macaddr=00:16:3e:00:14:01,model=rtl8139', '-net',
'tap,vlan=1,ifname=tap20.0,bridge=xenbr0', '-M', 'xenfv']
[2009-10-20 12:13:25 11382] INFO (image:459) device model pid: 14877
[2009-10-20 12:13:25 11382] INFO (image:561) waiting for sentinel_fifo
[2009-10-20 12:13:25 11382] DEBUG (XendDomainInfo:3205) Storing VM
details: {'on_xend_stop': 'ignore', 'shadow_memory': '33', 'uuid':
'ef62ef66-caca-6fdc-166d-ce3e08d231b9', 'on_reboot': 'restart',
'start_time': '1256066005.3', 'on_poweroff': 'destroy',
'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash':
'restart', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1',
'bootloader': '', 'image': '(hvm (kernel ) (superpages 0) (videoram 4)
(hpet 0) (stdvga 0) (vnclisten 0.0.0.0) (loader
/usr/lib64/xen/boot/hvmloader) (monitor 0) (rtc_timeoffset 0) (pci ())
(hap 0) (localtime 0) (timer_mode 1) (pci_msitranslate 1) (apic 1)
(usbdevice tablet) (vpt_align 1) (serial pty) (vncunused 1) (boot n)
(xen_platform_pci 1) (pae 1) (viridian 0) (acpi 1) (vnc 0) (nographic
0) (tsc_native 0) (usb 0) (guest_os_type default) (device_model
/usr/lib64/xen/bin/qemu-dm) (pci_power_mgmt 0) (xauthority
/root/.Xauthority) (isa 0) (notes (SUSPEND_CANCEL 1)))', 'name':
'dpm'}
[2009-10-20 12:13:25 11382] DEBUG (XendDomainInfo:1693) Storing domain
details: {'console/port': '3', 'name': 'dpm', 'console/limit':
'1048576', 'store/port': '2', 'vm':
'/vm/ef62ef66-caca-6fdc-166d-ce3e08d231b9', 'domid': '20',
'image/suspend-cancel': '1', 'cpu/0/availability': 'online',
'memory/target': '4194304',
'control/platform-feature-multiprocessor-suspend': '1',
'store/ring-ref': '1044476', 'console/type': 'ioemu'}
[2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController:
writing {'state': '1', 'backend-id': '0', 'backend':
'/local/domain/0/backend/console/20/0'} to
/local/domain/20/device/console/0.
[2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController:
writing {'domain': 'dpm', 'frontend':
'/local/domain/20/device/console/0', 'uuid':
'18e9fb5c-7c8d-5682-c15b-929914f1a1b9', 'frontend-id': '20', 'state':
'1', 'location': '3', 'online': '1', 'protocol': 'vt100'} to
/local/domain/0/backend/console/20/0.
[2009-10-20 12:13:25 11382] DEBUG (XendDomainInfo:1780)
XendDomainInfo.handleShutdownWatch
[2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices tap2.
[2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices vif.
[2009-10-20 12:13:25 11382] DEBUG (DevController:144) Waiting for 0.
[2009-10-20 12:13:25 11382] DEBUG (DevController:628)
hotplugStatusCallback /local/domain/0/backend/vif/20/0/hotplug-status.
[2009-10-20 12:13:25 11382] DEBUG (DevController:642) hotplugStatusCallback 1.
[2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices vkbd.
[2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for
devices ioports.
[2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices tap.
[2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices vif2.
[2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for
devices console.
[2009-10-20 12:13:26 11382] DEBUG (DevController:144) Waiting for 0.
[2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vscsi.
[2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vbd.
[2009-10-20 12:13:26 11382] DEBUG (DevController:144) Waiting for 51712.
[2009-10-20 12:13:26 11382] DEBUG (DevController:628)
hotplugStatusCallback
/local/domain/0/backend/vbd/20/51712/hotplug-status.
==> xen-hotplug.log <==
Nothing to flush.
==> ../kern.log <==
Oct 20 12:13:25 kaan-14 kernel: [358675.614339] device tap20.0 entered
promiscuous mode
Oct 20 12:13:25 kaan-14 kernel: [358675.614360] eth0: port 2(tap20.0)
entering forwarding state
Oct 20 12:13:25 kaan-14 kernel: [358675.695537] device vif20.0 entered
promiscuous mode
Oct 20 12:13:25 kaan-14 kernel: [358675.720156] eth0: port 3(vif20.0)
entering forwarding state
Oct 20 12:13:25 kaan-14 kernel: [358675.778216] physdev match: using
--physdev-out in the OUTPUT, FORWARD and POSTROUTING chains for
non-bridged traffic is not supported anymore.
Oct 20 12:13:25 kaan-14 kernel: [358675.943472]
(cdrom_add_media_watch() file=drivers/xen/blkback/cdrom.c, line=108)
nodename:backend/vbd/20/51728
Oct 20 12:13:25 kaan-14 kernel: [358675.943476] (cdrom_is_type()
file=drivers/xen/blkback/cdrom.c, line=95) type:0
==> xend.log <==
[2009-10-20 12:13:26 11382] DEBUG (DevController:628)
hotplugStatusCallback
/local/domain/0/backend/vbd/20/51712/hotplug-status.
[2009-10-20 12:13:26 11382] DEBUG (DevController:642) hotplugStatusCallback 1.
[2009-10-20 12:13:26 11382] DEBUG (DevController:144) Waiting for 51728.
[2009-10-20 12:13:26 11382] DEBUG (DevController:628)
hotplugStatusCallback
/local/domain/0/backend/vbd/20/51728/hotplug-status.
[2009-10-20 12:13:26 11382] DEBUG (DevController:642) hotplugStatusCallback 1.
[2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices irq.
[2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vfb.
[2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices pci.
[2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vtpm.
[2009-10-20 12:13:26 11382] INFO (XendDomain:1206) Domain dpm (20) unpaused.
==> ../kern.log <==
Oct 20 12:13:26 kaan-14 kernel: [358676.959824]
(cdrom_add_media_watch() file=drivers/xen/blkback/cdrom.c, line=108)
nodename:backend/vbd/20/51712
Oct 20 12:13:26 kaan-14 kernel: [358676.959829] (cdrom_is_type()
file=drivers/xen/blkback/cdrom.c, line=95) type:0
Oct 20 12:13:35 kaan-14 kernel: [358685.462114] tap20.0: no IPv6 routers present
Oct 20 12:13:36 kaan-14 kernel: [358686.431951] vif20.0: no IPv6 routers present
Thanks in advance
-Bruce