WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

[Xen-devel] blkif migration problem

To: xen-devel@xxxxxxxxxxxxxxxxxxx
Subject: [Xen-devel] blkif migration problem
From: Cristian Zamfir <zamf@xxxxxxxxxxxxx>
Date: Thu, 07 Dec 2006 15:47:39 +0000
Delivery-date: Thu, 07 Dec 2006 07:47:33 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Thunderbird 1.5.0.8 (X11/20061117)

Hi,

I am trying to live migrate blkif devices backed by drbd devices and I am struggling with a problem for a few days now. The problem is that after migration, the domU machine cannot load any new programs into memory. The ssh connection survives migration and I can run programs that are already in the memory but not something that needs to be loaded from the disk.

I am currently testing with an almost idle machine and I am triggering the drive migration after the domain is suspended, in step 2, from: XendCheckpoint.py: dominfo.migrateDevices(network, dst, DEV_MIGRATE_STEP2, domain_name).

However, I also tried before the domain is suspended from step 1 (dominfo.migrateDevices(network, dst, DEV_MIGRATE_STEP1, domain_name)) and everything works fine, except that there is the obvious possibility of loosing some writes to the disk because the domain is not suspended yet.

After migration, when I reattach a console I get this message:
"vbd vbd-769: 16 Device in use; refusing to close"
This is from the blkfront.c backend_changed() function but I cannot figure out why this error occurs.

From the xend.logs and dmesg on the source and destination attached bellow I cannot spot any errors. I am using xen 3.0.3.

Any kind of ideas will be greatly appreciated as I am a beginner with developing and debugging xen.
Thank you very much.













#dmesg on the destination

[97198.550035] DEV: registering device: ID = 'vif-10-0'
[97198.550304] PM: Adding info for xen-backend:vif-10-0
[97198.550312] bus xen-backend: add device vif-10-0
[97198.550318] xen-backend: Matched Device vif-10-0 with Driver vif
[97198.553322] CLASS: registering class device: ID = 'vif10.0'
[97198.553350] class_uevent - name = vif10.0
[97198.555781] bound device 'vif-10-0' to driver 'vif'
[97198.555792] xen-backend: Bound Device vif-10-0 to Driver vif
[97198.564861] DEV: registering device: ID = 'vbd-10-769'
[97198.565066] PM: Adding info for xen-backend:vbd-10-769
[97198.565073] bus xen-backend: add device vbd-10-769
[97198.565077] xen-backend: Matched Device vbd-10-769 with Driver vbd
[97198.566590] bound device 'vbd-10-769' to driver 'vbd'
[97198.566600] xen-backend: Bound Device vbd-10-769 to Driver vbd
[97198.890187] device vif10.0 entered promiscuous mode
[97199.101015] vbd vbd-10-769: 2 creating vbd structure
[97219.554243] drbd1: Secondary/Primary --> Secondary/Secondary
[97219.565465] drbd1: Secondary/Secondary --> Primary/Secondary
[97220.340039] xenbr0: port 3(vif10.0) entering learning state
[97220.350034] xenbr0: topology change detected, propagating
[97220.350057] xenbr0: port 3(vif10.0) entering forwarding state
#dmesg on the source

[97567.392392] drbd1: Primary/Secondary --> Secondary/Secondary
[97567.464148] drbd1: Secondary/Secondary --> Secondary/Primary
[97567.634964] DEV: Unregistering device. ID = 'vif-15-0'
[97567.634986] bus xen-backend: remove device vif-15-0
[97567.658033] xenbr0: port 3(vif15.0) entering disabled state
[97567.698110] device vif15.0 left promiscuous mode
[97567.698152] xenbr0: port 3(vif15.0) entering disabled state
[97567.719202] class_uevent - name = vif15.0
[97567.719440] device class 'vif15.0': release.
[97567.758982] PM: Removing info for xen-backend:vif-15-0
[97567.760113] DEV: Unregistering device. ID = 'vbd-15-769'
[97567.760133] bus xen-backend: remove device vbd-15-769
[97567.760465] PM: Removing info for xen-backend:vbd-15-769
#xend.log for the destination

[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:265) 
XendDomainInfo.restore(['domain', ['domid', '15'], ['uuid', 
'e5aed08a-0834-0f98-5d82-5a64fde20c4d'], ['vcpus', '1'], ['vcpu_avail', '1'], 
['cpu_weight', '1.0'], ['memory', '232'], ['shadow_memory', '0'], ['maxmem', 
'232'], ['features'], ['name', 'vm01'], ['on_poweroff', 'destroy'], 
['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', 
['kernel', '/boot/vmlinuz-2.6-xenU'], ['ip', 
'130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'],
 ['root', '/dev/hda1']]], ['device', ['vif', ['backend', '0'], ['script', 
'vif-bridge'], ['mac', '00:16:3E:F6:BB:01']]], ['device', ['vbd', ['backend', 
'0'], ['dev', 'hda1:disk'], ['uname', 'phy:drbd1'], ['mode', 'w']]], ['state', 
'--p---'], ['shutdown_reason', 'poweroff'], ['cpu_time', '0.0'], 
['online_vcpus', '1'], ['up_time', '109.739135981'], ['start_time', 
'1165505462.6'], ['store_mfn', '238994'], ['console_mfn', '241198']])
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:296) 
parseConfig: config is ['domain', ['domid', '15'], ['uuid', 
'e5aed08a-0834-0f98-5d82-5a64fde20c4d'], ['vcpus', '1'], ['vcpu_avail', '1'], 
['cpu_weight', '1.0'], ['memory', '232'], ['shadow_memory', '0'], ['maxmem', 
'232'], ['features'], ['name', 'vm01'], ['on_poweroff', 'destroy'], 
['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', 
['kernel', '/boot/vmlinuz-2.6-xenU'], ['ip', 
'130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'],
 ['root', '/dev/hda1']]], ['device', ['vif', ['backend', '0'], ['script', 
'vif-bridge'], ['mac', '00:16:3E:F6:BB:01']]], ['device', ['vbd', ['backend', 
'0'], ['dev', 'hda1:disk'], ['uname', 'phy:drbd1'], ['mode', 'w']]], ['state', 
'--p---'], ['shutdown_reason', 'poweroff'], ['cpu_time', '0.0'], 
['online_vcpus', '1'], ['up_time', '109.739135981'], ['start_time', 
'1165505462.6'], ['store_mfn', '238994'], ['console_mfn', '241198']]
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:395) 
parseConfig: result is {'shadow_memory': 0, 'uuid': 
'e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'on_crash': 'restart', 'on_reboot': 
'restart', 'localtime': None, 'image': ['linux', ['kernel', 
'/boot/vmlinuz-2.6-xenU'], ['ip', 
'130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'],
 ['root', '/dev/hda1']], 'on_poweroff': 'destroy', 'bootloader_args': None, 
'cpus': None, 'name': 'vm01', 'backend': [], 'vcpus': 1, 'cpu_weight': 1.0, 
'features': None, 'vcpu_avail': 1, 'memory': 232, 'device': [('vif', ['vif', 
['backend', '0'], ['script', 'vif-bridge'], ['mac', '00:16:3E:F6:BB:01']]), 
('vbd', ['vbd', ['backend', '0'], ['dev', 'hda1:disk'], ['uname', 'phy:drbd1'], 
['mode', 'w']])], 'bootloader': None, 'cpu': None, 'maxmem': 232}
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:1253) 
XendDomainInfo.construct: None
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:712) 
Storing VM details: {'shadow_memory': '0', 'uuid': 
'e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'on_reboot': 'restart', 'image': 
'(linux (kernel /boot/vmlinuz-2.6-xenU) (ip 
130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off)
 (root /dev/hda1))', 'on_poweroff': 'destroy', 'name': 'vm01', 
'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '232', 
'on_crash': 'restart', 'maxmem': '232'}
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:110) DevController: 
writing {'backend-id': '0', 'mac': '00:16:3E:F6:BB:01', 'handle': '0', 'state': 
'1', 'backend': '/local/domain/0/backend/vif/10/0'} to 
/local/domain/10/device/vif/0.
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:112) DevController: 
writing {'domain': 'vm01', 'handle': '0', 'script': 
'/etc/xen/scripts/vif-bridge', 'state': '1', 'frontend': 
'/local/domain/10/device/vif/0', 'mac': '00:16:3E:F6:BB:01', 'online': '1', 
'frontend-id': '10'} to /local/domain/0/backend/vif/10/0.
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:110) DevController: 
writing {'backend-id': '0', 'virtual-device': '769', 'device-type': 'disk', 
'state': '1', 'backend': '/local/domain/0/backend/vbd/10/769'} to 
/local/domain/10/device/vbd/769.
[2006-12-07 15:32:15 xend 7200] DEBUG (DevController:112) DevController: 
writing {'domain': 'vm01', 'frontend': '/local/domain/10/device/vbd/769', 
'dev': 'hda1', 'state': '1', 'params': 'drbd1', 'mode': 'w', 'online': '1', 
'frontend-id': '10', 'type': 'phy'} to /local/domain/0/backend/vbd/10/769.
[2006-12-07 15:32:15 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:747) 
Storing domain details: {'console/port': '2', 'name': 'vm01', 'console/limit': 
'1048576', 'vm': '/vm/e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'domid': '10', 
'cpu/0/availability': 'online', 'memory/target': '237568', 'store/port': '1'}
[2006-12-07 15:32:15 xend 7200] DEBUG (balloon:127) Balloon: 770548 KiB free; 
need 245760; done.
[2006-12-07 15:32:15 xend 7200] DEBUG (XendCheckpoint:169) [xc_restore]: 
/usr/lib/xen/bin/xc_restore 4 10 61440 1 2
[2006-12-07 15:32:15 xend 7209] ERROR (XendCheckpoint:250) xc_linux_restore 
start: max_pfn = f000
[2006-12-07 15:32:15 xend 7209] ERROR (XendCheckpoint:250) Increased domain 
reservation by 3c000 KB
[2006-12-07 15:32:15 xend 7209] ERROR (XendCheckpoint:250) Reloading memory 
pages:   0%
[2006-12-07 15:32:36 xend 7200] DEBUG (XendCheckpoint:223) store-mfn 45516
[2006-12-07 15:32:36 xend 7200] DEBUG (XendCheckpoint:223) console-mfn 45335
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Received all pages 
(0 races)
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) 100%
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Memory reloaded.
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Decreased 
reservation by 2096 pages
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Domain ready to be 
built.
[2006-12-07 15:32:36 xend 7209] ERROR (XendCheckpoint:250) Restore exit with 
rc=0
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
vif.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:149) Waiting for 0.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:464) hotplugStatusCallback 
/local/domain/0/backend/vif/10/0/hotplug-status.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:479) hotplugStatusCallback 
1.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
usb.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
vbd.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:149) Waiting for 769.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:464) hotplugStatusCallback 
/local/domain/0/backend/vbd/10/769/hotplug-status.
[2006-12-07 15:32:37 xend 3013] DEBUG (DevController:479) hotplugStatusCallback 
1.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
irq.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
pci.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
ioports.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
tap.
[2006-12-07 15:32:37 xend 7200] DEBUG (DevController:143) Waiting for devices 
vtpm.
[2006-12-07 15:32:37 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:672) 
XendDomainInfo.completeRestore
[2006-12-07 15:32:37 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:747) 
Storing domain details: {'console/ring-ref': '45335', 'console/port': '2', 
'name': 'vm01', 'console/limit': '1048576', 'vm': 
'/vm/e5aed08a-0834-0f98-5d82-5a64fde20c4d', 'domid': '10', 
'cpu/0/availability': 'online', 'memory/target': '237568', 'store/ring-ref': 
'45516', 'store/port': '1'}
[2006-12-07 15:32:37 xend.XendDomainInfo 7200] DEBUG (XendDomainInfo:682) 
XendDomainInfo.completeRestore done
[2006-12-07 15:32:37 xend.XendDomainInfo 3013] DEBUG (XendDomainInfo:933) 
XendDomainInfo.handleShutdownWatch
#xend.log for the source


[2006-12-07 15:32:52 xend 9776] INFO (blkif:168) Request to network-migrate 
device to rangatira. step=0.
[2006-12-07 15:32:52 xend 9776] DEBUG (balloon:127) Balloon: 533304 KiB free; 
need 2048; done.
[2006-12-07 15:32:52 xend 9776] INFO (blkif:168) Request to network-migrate 
device to rangatira. step=1.

[2006-12-07 15:32:52 xend 9776] DEBUG (XendCheckpoint:83) [xc_save]: 
/usr/lib/xen/bin/xc_save 19 15 0 0 1
[2006-12-07 15:32:52 xend 9785] ERROR (XendCheckpoint:242) Had 0 unexplained 
entries in p2m table
[2006-12-07 15:32:53 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages: 
iter 1   0%  5%PT Race: [10000000,909] pte=bed063, mfn=00000bed
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242)  10% 15% 
20% 25% 31%PT Race: [10000000,0] pte=1d8063, mfn=000001d8
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242) PT Race: 
[10000000,1] pte=1d9063, mfn=000001d9
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242) PT Race: 
[10000000,2] pte=1da063, mfn=000001da
[2006-12-07 15:32:59 xend 9785] ERROR (XendCheckpoint:242) PT Race: 
[10000000,3] pte=1db063, mfn=000001db
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242)  36% 41% 
46% 51% 57% 62% 67% 72% 77% 83% 88% 93% 
98%
 1: sent 59188, skipped 203, delta 20756ms, dom0 10%, target 0%, sent 93Mb/s, 
dirtied 0Mb/s 238 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages: 
iter 2   0%netbuf race: iter 2, pfn e422. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e42c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e064. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e079. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 7e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e498. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e4c0. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e0d6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e4e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e510. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e514. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 7c6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 59d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e5be. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e5bf. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn ddc4. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn dde6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 5f1. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn de0c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn de10. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 612. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e235. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e638. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e63a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 63c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e63e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e646. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e647. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 648. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e661. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e662. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e664. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 666. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 66f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 670. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn de7c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn de7d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e691. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e694. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 696. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 69c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 69e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 6bc. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 7fb. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e6e4. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 6e6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 6ec. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 6ed. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn deee. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn deef. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e711. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 713. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn e726. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 132c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 73e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 743. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 76b. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 76d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 79f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 2, 
pfn 7a0. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) 2: sent 176, skipped 
0, delta 64ms, dom0 34%, target 0%, sent 90Mb/s, dirtied 29Mb/s 58 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages: 
iter 3   0%
 3: sent 58, skipped 0, delta 16ms, dom0 18%, target 0%, sent 118Mb/s, dirtied 
83Mb/s 41 pages
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:215) suspend
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:86) In saveInputHandler 
suspend
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:88) Suspending 15 ...
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages: 
iter 4   0%
 4: sent 41, skipped 0, Start last iteration
[2006-12-07 15:33:13 xend.XendDomainInfo 9225] DEBUG (XendDomainInfo:933) 
XendDomainInfo.handleShutdownWatch
[2006-12-07 15:33:13 xend.XendDomainInfo 9225] DEBUG (XendDomainInfo:933) 
XendDomainInfo.handleShutdownWatch
[2006-12-07 15:33:13 xend.XendDomainInfo 9225] INFO (XendDomainInfo:892) Domain 
has shutdown: name=migrating-vm01 id=15 reason=suspend.
[2006-12-07 15:33:13 xend 9776] INFO (blkif:168) Request to network-migrate 
device to rangatira. step=2.




[2006-12-07 15:33:13 xend 9776] INFO (XendCheckpoint:94) Domain 15 suspended.
[2006-12-07 15:33:13 xend 9776] INFO (blkif:168) Request to network-migrate 
device to rangatira. step=3.

[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) SUSPEND shinfo 
00000bed eip c01013a7 edx 000054b5
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) delta 277ms, dom0 
71%, target 0%, sent 4Mb/s, dirtied 17Mb/s 145 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Saving memory pages: 
iter 5   0%netbuf race: iter 5, pfn e422. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e42c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e064. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 7e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e0d6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e4e2. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e510. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 59d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e5be. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e5bf. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn dde6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 5f1. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn de0c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn de10. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e235. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e63a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 63c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e63e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e646. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 648. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e661. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e662. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e664. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 666. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 66f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 670. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn de7d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e691. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 696. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e69a. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 69c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 69e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 6bc. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 7fb. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 6e6. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn deee. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn deef. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e711. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 713. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn e726. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 132c. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 73e. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 743. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 76b. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 76d. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 79f. mfn ffffffff
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) netbuf race: iter 5, 
pfn 7a0. mfn ffffffff
[2006-12-07 15:33:13 xend 9776] DEBUG (XendCheckpoint:99) Written done
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) 5: sent 145, skipped 
0, delta 42ms, dom0 42%, target 0%, sent 113Mb/s, dirtied 113Mb/s 145 pages
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Total pages sent= 
59608 (0.97x)
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) (of which 0 were 
fixups)
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) All memory is saved
[2006-12-07 15:33:13 xend 9785] ERROR (XendCheckpoint:242) Save exit rc=0
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] DEBUG (XendDomainInfo:1457) 
XendDomainInfo.destroyDomain(15)
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev 
769 still active, looping...
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev 
769 still active, looping...
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev 
769 still active, looping...
[2006-12-07 15:33:13 xend.XendDomainInfo 9776] INFO (XendDomainInfo:1555) Dev 
769 still active, looping...
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
<Prev in Thread] Current Thread [Next in Thread>