Hi,
I am trying to live migrate blkif devices backed by drbd devices and I
am struggling with a problem for a few days now. The problem is that
after migration, the domU machine cannot load any new programs into
memory. The ssh connection survives migration and I can run programs
that are already in the memory but not something that needs to be loaded
from the disk.
I am currently testing with an almost idle machine and I am triggering
the drive migration after the domain is suspended, in step 2, from:
XendCheckpoint.py: dominfo.migrateDevices(network, dst,
DEV_MIGRATE_STEP2, domain_name).
However, I also tried before the domain is suspended from step 1
(dominfo.migrateDevices(network, dst, DEV_MIGRATE_STEP1, domain_name))
and everything works fine, except that there is the obvious possibility
of loosing some writes to the disk because the domain is not suspended yet.
After migration, when I reattach a console I get this message:
"vbd vbd-769: 16 Device in use; refusing to close"
This is from the blkfront.c backend_changed() function but I cannot
figure out why this error occurs.
From the xend.logs and dmesg on the source and destination attached
bellow I cannot spot any errors. I am using xen 3.0.3.
Any kind of ideas will be greatly appreciated as I am a beginner with
developing and debugging xen.
Thank you very much.
#dmesg on the destination
[97198.550035] DEV: registering device: ID = 'vif-10-0'
[97198.550304] PM: Adding info for xen-backend:vif-10-0
[97198.550312] bus xen-backend: add device vif-10-0
[97198.550318] xen-backend: Matched Device vif-10-0 with Driver vif
[97198.553322] CLASS: registering class device: ID = 'vif10.0'
[97198.553350] class_uevent - name = vif10.0
[97198.555781] bound device 'vif-10-0' to driver 'vif'
[97198.555792] xen-backend: Bound Device vif-10-0 to Driver vif
[97198.564861] DEV: registering device: ID = 'vbd-10-769'
[97198.565066] PM: Adding info for xen-backend:vbd-10-769
[97198.565073] bus xen-backend: add device vbd-10-769
[97198.565077] xen-backend: Matched Device vbd-10-769 with Driver vbd
[97198.566590] bound device 'vbd-10-769' to driver 'vbd'
[97198.566600] xen-backend: Bound Device vbd-10-769 to Driver vbd
[97198.890187] device vif10.0 entered promiscuous mode
[97199.101015] vbd vbd-10-769: 2 creating vbd structure
[97219.554243] drbd1: Secondary/Primary --> Secondary/Secondary
[97219.565465] drbd1: Secondary/Secondary --> Primary/Secondary
[97220.340039] xenbr0: port 3(vif10.0) entering learning state
[97220.350034] xenbr0: topology change detected, propagating
[97220.350057] xenbr0: port 3(vif10.0) entering forwarding state
#dmesg on the source
[97567.392392] drbd1: Primary/Secondary --> Secondary/Secondary
[97567.464148] drbd1: Secondary/Secondary --> Secondary/Primary
[97567.634964] DEV: Unregistering device. ID = 'vif-15-0'
[97567.634986] bus xen-backend: remove device vif-15-0
[97567.658033] xenbr0: port 3(vif15.0) entering disabled state
[97567.698110] device vif15.0 left promiscuous mode
[97567.698152] xenbr0: port 3(vif15.0) entering disabled state
[97567.719202] class_uevent - name = vif15.0
[97567.719440] device class 'vif15.0': release.
[97567.758982] PM: Removing info for xen-backend:vif-15-0
[97567.760113] DEV: Unregistering device. ID = 'vbd-15-769'
[97567.760133] bus xen-backend: remove device vbd-15-769
[97567.760465] PM: Removing info for xen-backend:vbd-15-769
#xend.log for the destination
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:265)
XendDomainInfo.restore(['domain', ['domid', '15'], ['uuid',
'e5aed08a-0834-0f98-5d82-5a64fde20c4d'], ['vcpus', '1'], ['vcpu_avail', '1'],
['cpu_weight', '1.0'], ['memory', '232'], ['shadow_memory', '0'], ['maxmem',
'232'], ['features'], ['name', 'vm01'], ['on_poweroff', 'destroy'],
['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux',
['kernel', '/boot/vmlinuz-2.6-xenU'], ['ip',
'130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'],
['root', '/dev/hda1']]], ['device', ['vif', ['backend', '0'], ['script',
'vif-bridge'], ['mac', '00:16:3E:F6:BB:01']]], ['device', ['vbd', ['backend',
'0'], ['dev', 'hda1:disk'], ['uname', 'phy:drbd1'], ['mode', 'w']]], ['state',
'--p---'], ['shutdown_reason', 'poweroff'], ['cpu_time', '0.0'],
['online_vcpus', '1'], ['up_time', '109.739135981'], ['start_time',
'1165505462.6'], ['store_mfn', '238994'], ['console_mfn', '241198']])
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:296)
parseConfig: config is ['domain', ['domid', '15'], ['uuid',
'e5aed08a-0834-0f98-5d82-5a64fde20c4d'], ['vcpus', '1'], ['vcpu_avail', '1'],
['cpu_weight', '1.0'], ['memory', '232'], ['shadow_memory', '0'], ['maxmem',
'232'], ['features'], ['name', 'vm01'], ['on_poweroff', 'destroy'],
['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux',
['kernel', '/boot/vmlinuz-2.6-xenU'], ['ip',
'130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'],
['root', '/dev/hda1']]], ['device', ['vif', ['backend', '0'], ['script',
'vif-bridge'], ['mac', '00:16:3E:F6:BB:01']]], ['device', ['vbd', ['backend',
'0'], ['dev', 'hda1:disk'], ['uname', 'phy:drbd1'], ['mode', 'w']]], ['state',
'--p---'], ['shutdown_reason', 'poweroff'], ['cpu_time', '0.0'],
['online_vcpus', '1'], ['up_time', '109.739135981'], ['start_time',
'1165505462.6'], ['store_mfn', '238994'], ['console_mfn', '241198']]
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:395)
parseConfig: result is {'shadow_memory': 0, 'uuid':
'e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'on_crash': 'restart', 'on_reboot':
'restart', 'localtime': None, 'image': ['linux', ['kernel',
'/boot/vmlinuz-2.6-xenU'], ['ip',
'130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'],
['root', '/dev/hda1']], 'on_poweroff': 'destroy', 'bootloader_args': None,
'cpus': None, 'name': 'vm01', 'backend': [], 'vcpus': 1, 'cpu_weight': 1.0,
'features': None, 'vcpu_avail': 1, 'memory': 232, 'device': [('vif', ['vif',
['backend', '0'], ['script', 'vif-bridge'], ['mac', '00:16:3E:F6:BB:01']]),
('vbd', ['vbd', ['backend', '0'], ['dev', 'hda1:disk'], ['uname', 'phy:drbd1'],
['mode', 'w']])], 'bootloader': None, 'cpu': None, 'maxmem': 232}
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:1253)
XendDomainInfo.construct: None
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:712)
Storing VM details: {'shadow_memory': '0', 'uuid':
'e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'on_reboot': 'restart', 'image':
'(linux (kernel /boot/vmlinuz-2.6-xenU) (ip
130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off)
(root /dev/hda1))', 'on_poweroff': 'destroy', 'name': 'vm01',
'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '232',
'on_crash': 'restart', 'maxmem': '232'}
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:110) DevController:
writing {'backend-id': '0', 'mac': '00:16:3E:F6:BB:01', 'handle': '0', 'state':
'1', 'backend': '/local/domain/0/backend/vif/10/0'} to
/local/domain/10/device/vif/0.
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:112) DevController:
writing {'domain': 'vm01', 'handle': '0', 'script':
'/etc/xen/scripts/vif-bridge', 'state': '1', 'frontend':
'/local/domain/10/device/vif/0', 'mac': '00:16:3E:F6:BB:01', 'online': '1',
'frontend-id': '10'} to /local/domain/0/backend/vif/10/0.
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:110) DevController:
writing {'backend-id': '0', 'virtual-device': '769', 'device-type': 'disk',
'state': '1', 'backend': '/local/domain/0/backend/vbd/10/769'} to
/local/domain/10/device/vbd/769.
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:112) DevController:
writing {'domain': 'vm01', 'frontend': '/local/domain/10/device/vbd/769',
'dev': 'hda1', 'state': '1', 'params': 'drbd1', 'mode': 'w', 'online': '1',
'frontend-id': '10', 'type': 'phy'} to /local/domain/0/backend/vbd/10/769.
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:747)
Storing domain details: {'console/port': '2', 'name': 'vm01', 'console/limit':
'1048576', 'vm': '/vm/e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'domid': '10',
'cpu/0/availability': 'online', 'memory/target': '237568', 'store/port': '1'}
[2006-12-07 15:32:15 xend 7200] DEBUG (balloon:127) Balloon: 770548 KiB free;
need 245760; done.
[2006-12-07 15:32:15 xend 7200] DEBUG (XendCheckpoint:169) [xc_restore]:
/usr/lib/xen/bin/xc_restore 4 10 61440 1 2
[2006-12-07 15:32:15 xend 7209] ERROR (XendCheckpoint:250) xc_linux_restore
start: max_pfn = f000
[2006-12-07 15:32:15 xend 7209] ERROR (XendCheckpoint:250) Increased domain
reservation by 3c000 KB
[2006-12-07 15:32:15 xend 7209] ERROR (XendCheckpoint:250) Reloading memory
pages: 0%
[2006-12-07 15:32:36 xend 7200] DEBUG (XendCheckpoint:223) store-mfn 45516
[2006-12-07 15:32:36 xend 7200] DEBUG (XendCheckpoint:223) console-mfn 45335
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Received all pages
(0 races)
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) 100%
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Memory reloaded.
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Decreased
reservation by 2096 pages
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Domain ready to be
built.
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Restore exit with
rc=0
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
vif.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:149) Waiting for 0.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:464) hotplugStatusCallback
/local/domain/0/backend/vif/10/0/hotplug-status.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:479) hotplugStatusCallback
1.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
usb.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
vbd.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:149) Waiting for 769.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:464) hotplugStatusCallback
/local/domain/0/backend/vbd/10/769/hotplug-status.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:479) hotplugStatusCallback
1.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
irq.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
pci.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
ioports.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
tap.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices
vtpm.
[2006-12-07 15:32:37 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:672)
XendDomainInfo.completeRestore
[2006-12-07 15:32:37 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:747)
Storing domain details: {'console/ring-ref': '45335', 'console/port': '2',
'name': 'vm01', 'console/limit': '1048576', 'vm':
'/vm/e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'domid': '10',
'cpu/0/availability': 'online', 'memory/target': '237568', 'store/ring-ref':
'45516', 'store/port': '1'}
[2006-12-07 15:32:37 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:682)
XendDomainInfo.completeRestore done
[2006-12-07 15:32:37 xend.XendDomainInfo 3013] DEBUG (XendDomainInfo:933)
XendDomainInfo.handleShutdownWatch
#xend.log for the source
[2006-12-07 15:32:52 xend 9776] INFO (blkif:168) Request to network-migrate
device to rangatira. step=0.
[2006-12-07 15:32:52 xend 9776] DEBUG (balloon:127) Balloon: 533304 KiB free;
need 2048; done.
[2006-12-07 15:32:52 xend 9776] INFO (blkif:168) Request to network-migrate
device to rangatira. step=1.
[2006-12-07 15:32:52 xend 9776] DEBUG (XendCheckpoint:83) [xc_save]:
/usr/lib/xen/bin/xc_save 19 15 0 0 1
[2006-12-07 15:32:52 xend 9785] ERROR (XendCheckpoint:242) Had 0 unexplained
entries in p2m table
[2006-12-07 15:32:53 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages:
iter 1 0% 5%PT Race: [10000000,909] pte=bed063, mfn=00000bed
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242) 10% 15%
20% 25% 31%PT Race: [10000000,0] pte=1d8063, mfn=000001d8
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242) PT Race:
[10000000,1] pte=1d9063, mfn=000001d9
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242) PT Race:
[10000000,2] pte=1da063, mfn=000001da
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242) PT Race:
[10000000,3] pte=1db063, mfn=000001db
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) 36% 41%
46% 51% 57% 62% 67% 72% 77% 83% 88% 93%
98%
1: sent 59188, skipped 203, delta 20756ms, dom0 10%, target 0%, sent 93Mb/s,
dirtied 0Mb/s 238 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages:
iter 2 0%netbuf race: iter 2, pfn e422. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e42c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e064. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e079. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 7e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e498. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e4c0. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e0d6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e4e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e510. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e514. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 7c6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 59d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e5be. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e5bf. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn ddc4. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn dde6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 5f1. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn de0c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn de10. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 612. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e235. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e638. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e63a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 63c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e63e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e646. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e647. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 648. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e661. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e662. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e664. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 666. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 66f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 670. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn de7c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn de7d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e691. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e694. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 696. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 69c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 69e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 6bc. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 7fb. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e6e4. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 6e6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 6ec. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 6ed. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn deee. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn deef. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e711. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 713. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn e726. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 132c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 73e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 743. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 76b. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 76d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 79f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2,
pfn 7a0. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) 2: sent 176, skipped
0, delta 64ms, dom0 34%, target 0%, sent 90Mb/s, dirtied 29Mb/s 58 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages:
iter 3 0%
3: sent 58, skipped 0, delta 16ms, dom0 18%, target 0%, sent 118Mb/s, dirtied
83Mb/s 41 pages
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:215) suspend
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:86) In saveInputHandler
suspend
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:88) Suspending 15 ...
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages:
iter 4 0%
4: sent 41, skipped 0, Start last iteration
[2006-12-07 15:33:13 xend.XendDomainInfo 9225] DEBUG (XendDomainInfo:933)
XendDomainInfo.handleShutdownWatch
[2006-12-07 15:33:13 xend.XendDomainInfo 9225] DEBUG (XendDomainInfo:933)
XendDomainInfo.handleShutdownWatch
[2006-12-07 15:33:13 xend.XendDomainInfo 9225] INFO (XendDomainInfo:892) Domain
has shutdown: name=migrating-vm01 id=15 reason=suspend.
[2006-12-07 15:33:13 xend 9776] INFO (blkif:168) Request to network-migrate
device to rangatira. step=2.
[2006-12-07 15:33:13 xend 9776] INFO (XendCheckpoint:94) Domain 15 suspended.
[2006-12-07 15:33:13 xend 9776] INFO (blkif:168) Request to network-migrate
device to rangatira. step=3.
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) SUSPEND shinfo
00000bed eip c01013a7 edx 000054b5
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) delta 277ms, dom0
71%, target 0%, sent 4Mb/s, dirtied 17Mb/s 145 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages:
iter 5 0%netbuf race: iter 5, pfn e422. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e42c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e064. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 7e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e0d6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e4e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e510. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 59d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e5be. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e5bf. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn dde6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 5f1. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn de0c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn de10. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e235. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e63a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 63c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e63e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e646. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 648. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e661. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e662. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e664. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 666. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 66f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 670. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn de7d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e691. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 696. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 69c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 69e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 6bc. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 7fb. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 6e6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn deee. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn deef. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e711. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 713. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn e726. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 132c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 73e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 743. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 76b. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 76d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 79f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5,
pfn 7a0. mfn ffffffff
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:99) Written done
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) 5: sent 145, skipped
0, delta 42ms, dom0 42%, target 0%, sent 113Mb/s, dirtied 113Mb/s 145 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Total pages sent=
59608 (0.97x)
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) (of which 0 were
fixups)
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) All memory is saved
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Save exit rc=0
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] DEBUG (XendDomainInfo:1457)
XendDomainInfo.destroyDomain(15)
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev
769 still active, looping...
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev
769 still active, looping...
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev
769 still active, looping...
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev
769 still active, looping...
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
|