WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 		  
Home Products Support Community News
 
   
 

xen-users

[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

Re: [Xen-users] Do systems have to be IDENTICAL for live migration?

from [James Pifer] [Permanent Link][Original]
To: xen-users@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Xen-users] Do systems have to be IDENTICAL for live migration?
From: James Pifer <jep@xxxxxxxxxxxxxxxx>
Date: Wed, 07 Jul 2010 11:25:28 -0400
Cc: Nick Couchman <Nick.Couchman@xxxxxxxxx>
Delivery-date: Wed, 07 Jul 2010 08:32:14 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <4C34409B02000099000684C1@xxxxxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <4C34409B02000099000684C1@xxxxxxxxxxxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx 
> Could you more clearly define "not working" - error messages, log
> entries, etc.?  Sometimes CPU differences can prevent live migration
> from working properly, but there are other factors, too.  It would be
> useful to know what Xen says about why live migration is failing.  Also,
> could you specify exactly what CPUs are in those boxes?  I don't use HP,
> but I know with Dell servers the model/generation of server you're using
> can have a wide range of processors in it, so just specifying the server
> model/brand does not really tell anything useful.
> 
> -Nick

Hi Nick. I actually had all of this in the original post, but cut it in
replies. See below.

Thanks,
James

The first system is a ProLiant DL360 G6:
Proc 1:2533 MHz
Execution technology:4/4 cores; 8 maximum threads
Memory technology:64-bit capable
Processor 1 Internal L1 Cache:128 KB
Processor 1 Internal L2 Cache:1024 KB
Processor 1 Internal L3 Cache:8192 KB

Proc 2:2533 MHz
Execution technology:4/4 cores; 8 maximum threads
Memory technology:64-bit capable
Processor 2 Internal L1 Cache:128 KB
Processor 2 Internal L2 Cache:1024 KB
Processor 2 Internal L3 Cache:8192 KB


The second system is a ProLiant DL360 G5:
Proc 1:2500 MHz
Execution technology:4/4 cores; 4 threads
Memory technology:64-bit capable
Processor 1 Internal L1 Cache:128 KB
Processor 1 Internal L2 Cache:12288 KB

Proc 2:2500 MHz
Execution technology:4/4 cores; 4 threads
Memory technology:64-bit capable
Processor 2 Internal L1 Cache:128 KB
Processor 2 Internal L2 Cache:12288 KB



When I tried to Live Migrate a VM from system one to system two I got:
[2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:237) 
XendDomainInfo.restore(['domain', ['domid', '3'], ['cpu_weight', '256'], 
['cpu_cap', '0'], ['pool_name', 'Pool-0'], ['bootloader'], ['vcpus', '2'], 
['node', '8002'], ['cpus', [[], []]], ['on_poweroff', 'destroy'], 
['description'], ['on_crash', 'destroy'], ['uuid', 
'92b1b8f4-94aa-d393-92a4-3d78262bf092'], ['bootloader_args'], ['name', 
'chsimp2'], ['on_reboot', 'restart'], ['maxmem', '2048'], ['memory', '2048'], 
['shadow_memory', '18'], ['vcpu_avail', '3'], ['features'], ['on_xend_start', 
'ignore'], ['on_xend_stop', 'ignore'], ['start_time', '1277985922.2'], 
['cpu_time', '2433.09449026'], ['online_vcpus', '2'], ['image', ['hvm', 
['kernel'], ['superpages', '0'], ['videoram', '4'], ['hpet', '0'], ['stdvga', 
'0'], ['loader', '/usr/lib/xen/boot/hvmloader'], ['xen_platform_pci', '1'], 
['rtc_timeoffset', '0'], ['pci', []], ['hap', '1'], ['localtime', '0'], 
['timer_mode', '1'], ['pci_msitranslate', '1'], ['oos', '1'], ['apic', '0'], 
['sdl', '0'], ['usbdevice', 'tablet'], ['vpt_align', '1'], ['extid', '0'], 
['vncunused', '1'], ['boot', 'c'], ['pae', '1'], ['viridian', '0'], ['acpi', 
'1'], ['vnc', '1'], ['nographic', '0'], ['nomigrate', '0'], ['usb', '1'], 
['tsc_mode', '0'], ['guest_os_type', 'default'], ['device_model', 
'/usr/lib64/xen/bin/qemu-dm'], ['pci_power_mgmt', '0'], ['xauthority', 
'/root/.Xauthority'], ['isa', '0'], ['notes', ['SUSPEND_CANCEL', '1']]]], 
['status', '2'], ['state', '-b----'], ['store_mfn', '1044476'], ['device', 
['vif', ['bridge', 'br0'], ['mac', '00:16:3e:1f:ea:77'], ['script', 
'/etc/xen/scripts/vif-bridge'], ['uuid', 
'53301d91-5283-d69d-4b7d-5beb3deee963'], ['backend', '0']]], ['device', 
['console', ['protocol', 'vt100'], ['location', '4'], ['uuid', 
'b02891b0-855e-fc59-9744-5685e1950c19']]], ['device', ['vbd', ['protocol', 
'x86_32-abi'], ['uuid', '31c2d623-a977-4e81-5ecc-2ab09907f76e'], ['bootable', 
'1'], ['dev', 'hda:disk'], ['uname', 
'phy:/dev/disk/by-id/scsi-200d0b29d2d002200'], ['mode', 'w'], ['backend', '0'], 
['VDI']]], ['device', ['vfb', ['vncunused', '1'], ['vnc', '1'], ['uuid', 
'e40219c2-a740-c910-2840-be3a2aaa9548'], ['location', '127.0.0.1:5902']]], 
['change_home_server', 'False']])
[2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:2543) 
XendDomainInfo.constructDomain
[2010-07-01 12:06:49 5660] DEBUG (balloon:239) Balloon: 31107320 KiB free; need 
16384; done.
[2010-07-01 12:06:49 5660] DEBUG (XendDomain:465) Adding Domain: 1
[2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:3470) Storing VM details: 
{'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '18', 
'uuid': '92b1b8f4-94aa-d393-92a4-3d78262bf092', 'on_reboot': 'restart', 
'start_time': '1277985922.2', 'on_poweroff': 'destroy', 'bootloader_args': '', 
'on_xend_start': 'ignore', 'on_crash': 'destroy', 'xend/restart_count': '0', 
'vcpus': '2', 'vcpu_avail': '3', 'bootloader': '', 'image': '(hvm (kernel ) 
(superpages 0) (videoram 4) (hpet 0) (stdvga 0) (loader 
/usr/lib/xen/boot/hvmloader) (xen_platform_pci 1) (rtc_timeoffset 0) (pci ()) 
(hap 1) (localtime 0) (timer_mode 1) (pci_msitranslate 1) (oos 1) (apic 0) (sdl 
0) (usbdevice tablet) (vpt_align 1) (extid 0) (vncunused 1) (boot c) (pae 1) 
(viridian 0) (acpi 1) (vnc 1) (nographic 0) (nomigrate 0) (usb 1) (tsc_mode 0) 
(guest_os_type default) (device_model /usr/lib64/xen/bin/qemu-dm) 
(pci_power_mgmt 0) (xauthority /root/.Xauthority) (isa 0) (notes 
(SUSPEND_CANCEL 1)))', 'name': 'chsimp2'}
[2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: console : 
{'protocol': 'vt100', 'location': '4', 'uuid': 
'b02891b0-855e-fc59-9744-5685e1950c19'}
[2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing 
{'state': '1', 'backend-id': '0', 'backend': 
'/local/domain/0/backend/console/1/0'} to /local/domain/1/device/console/0.
[2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing 
{'domain': 'chsimp2', 'frontend': '/local/domain/1/device/console/0', 'uuid': 
'b02891b0-855e-fc59-9744-5685e1950c19', 'frontend-id': '1', 'state': '1', 
'location': '4', 'online': '1', 'protocol': 'vt100'} to 
/local/domain/0/backend/console/1/0.
[2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: vfb : 
{'vncunused': '1', 'other_config': {'vncunused': '1', 'vnc': '1'}, 'vnc': '1', 
'uuid': 'e40219c2-a740-c910-2840-be3a2aaa9548', 'location': '127.0.0.1:5902'}
[2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing 
{'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/1/0'} 
to /local/domain/1/device/vfb/0.
[2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing 
{'vncunused': '1', 'domain': 'chsimp2', 'frontend': 
'/local/domain/1/device/vfb/0', 'uuid': 'e40219c2-a740-c910-2840-be3a2aaa9548', 
'frontend-id': '1', 'state': '1', 'location': '127.0.0.1:5902', 'online': '1', 
'vnc': '1'} to /local/domain/0/backend/vfb/1/0.
[2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: vbd : 
{'protocol': 'x86_32-abi', 'uuid': '31c2d623-a977-4e81-5ecc-2ab09907f76e', 
'bootable': 1, 'driver': 'paravirtualised', 'dev': 'hda:disk', 'uname': 
'phy:/dev/disk/by-id/scsi-200d0b29d2d002200', 'mode': 'w', 'backend': '0'}
[2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing 
{'virtual-device': '768', 'protocol': 'x86_32-abi', 'device-type': 'disk', 
'backend-id': '0', 'state': '1', 'backend': 
'/local/domain/0/backend/vbd/1/768'} to /local/domain/1/device/vbd/768.
[2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing 
{'domain': 'chsimp2', 'frontend': '/local/domain/1/device/vbd/768', 'uuid': 
'31c2d623-a977-4e81-5ecc-2ab09907f76e', 'bootable': '1', 'dev': 'hda', 'state': 
'1', 'params': '/dev/disk/by-id/scsi-200d0b29d2d002200', 'mode': 'w', 'online': 
'1', 'frontend-id': '1', 'type': 'phy'} to /local/domain/0/backend/vbd/1/768.
[2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: vif : 
{'bridge': 'br0', 'mac': '00:16:3e:1f:ea:77', 'script': 
'/etc/xen/scripts/vif-bridge', 'uuid': '53301d91-5283-d69d-4b7d-5beb3deee963', 
'backend': '0'}
[2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing 
{'backend-id': '0', 'mac': '00:16:3e:1f:ea:77', 'handle': '0', 'state': '1', 
'backend': '/local/domain/0/backend/vif/1/0'} to /local/domain/1/device/vif/0.
[2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing 
{'bridge': 'br0', 'domain': 'chsimp2', 'handle': '0', 'uuid': 
'53301d91-5283-d69d-4b7d-5beb3deee963', 'script': 
'/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:1f:ea:77', 'frontend-id': '1', 
'state': '1', 'online': '1', 'frontend': '/local/domain/1/device/vif/0'} to 
/local/domain/0/backend/vif/1/0.
[2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:1835) Storing domain details: 
{'console/port': '4', 'description': '', 'console/limit': '1048576', 
'image/suspend-cancel': '1', 'domid': '1', 'vm': 
'/vm/92b1b8f4-94aa-d393-92a4-3d78262bf092', 'cpu/0/availability': 'online', 
'memory/target': '2097152', 'control/platform-feature-multiprocessor-suspend': 
'1', 'console/type': 'ioemu', 'cpu/1/availability': 'online', 'store/port': 
'3', 'name': 'chsimp2'}
[2010-07-01 12:06:49 5660] INFO (XendCheckpoint:343) restore hvm domain 1, 
apic=0, pae=1
[2010-07-01 12:06:49 5660] DEBUG (image:339) No VNC passwd configured for vfb 
access
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: boot, val: c
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: fda, val: None
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: fdb, val: None
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: soundhw, val: None
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: localtime, val: 0
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: serial, val: None
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: std-vga, val: 0
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: isa, val: 0
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: acpi, val: 1
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: usb, val: 1
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: usbdevice, val: tablet
[2010-07-01 12:06:49 5660] DEBUG (image:901) args: gfx_passthru, val: None
[2010-07-01 12:06:49 5660] INFO (image:833) Need to create platform 
device.[domid:1]
[2010-07-01 12:06:49 5660] DEBUG (XendCheckpoint:361) restore:shadow=0x12, 
_static_max=0x80000000, _static_min=0x0, 
[2010-07-01 12:06:49 5660] DEBUG (XendCheckpoint:380) [xc_restore]: 
/usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0
[2010-07-01 12:06:49 5660] INFO (XendCheckpoint:482) xc_domain_restore start: 
p2m_size = 100000
[2010-07-01 12:06:49 5660] INFO (XendCheckpoint:482) Reloading memory pages:   
0%
[2010-07-01 12:08:12 5660] INFO (XendCheckpoint:482) Read 1448 bytes of QEMU 
data
[2010-07-01 12:08:12 5660] INFO (XendCheckpoint:482) Read 5544 bytes of QEMU 
data
[2010-07-01 12:08:12 5660] INFO (XendCheckpoint:482) Read 9 bytes of QEMU data
[2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) ERROR Internal error: 
Error when reading batch size
[2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) ERROR Internal error: 
error when buffering batch, finishing
[2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) 
[2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) Writing 7001 bytes of QEMU 
data
[2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) ERROR Internal error: 
error setting the HVM context
[2010-07-01 12:08:14 5660] INFO (XendCheckpoint:482) Restore exit with rc=1
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:3111) XendDomainInfo.destroy: 
domid=1
[2010-07-01 12:08:14 5660] ERROR (XendDomainInfo:3125) XendDomainInfo.destroy: 
domain destruction failed.
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 
3118, in destroy
    xc.domain_pause(self.domid)
Error: (3, 'No such process')
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2451) No device model
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2453) Releasing devices
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing vif/0
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) 
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing console/0
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) 
XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing vbd/768
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) 
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing vfb/0
[2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) 
XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2010-07-01 12:08:14 5660] INFO (XendDomain:1108) Domain chsimp2 
(92b1b8f4-94aa-d393-92a4-3d78262bf092) deleted.
[2010-07-01 12:08:14 5660] ERROR (XendCheckpoint:416) 
/usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0 failed
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendCheckpoint.py", line 
384, in restore
    forkHelper(cmd, fd, handler.handler, True)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendCheckpoint.py", line 
470, in forkHelper
    raise XendError("%s failed" % string.join(cmd))
XendError: /usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0 failed
[2010-07-01 12:08:14 5660] ERROR (XendDomain:1176) Restore failed
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomain.py", line 1160, 
in domain_restore_fd
    dominfo = XendCheckpoint.restore(self, fd, paused=paused, 
relocating=relocating)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendCheckpoint.py", line 
417, in restore
    raise exn
XendError: /usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0 failed


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  Re: [Xen-users] Problem pinging the xen guest after live migration, Srija G
Next by Date:  Re: [Xen-users] Problem pinging the xen guest after live migration, Bart Coninckx
Previous by Thread:  Re: [Xen-users] Do systems have to be IDENTICAL for live migration?, Nick Couchman
Next by Thread:  Re: [Xen-users] Do systems have to be IDENTICAL for live migration?, Nick Couchman
Indexes:  [Date] [Thread] [Top] [All Lists]
 
   

Copyright , Citrix Systems Inc. All rights reserved. Legal and Privacy