WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

[Xen-devel] Live Migration Error

To: xen-devel@xxxxxxxxxxxxxxxxxxx
Subject: [Xen-devel] Live Migration Error
From: Andres Lagar Cavilla <andreslc@xxxxxxxxxxxxxx>
Date: Fri, 13 May 2005 12:07:33 -0500
Delivery-date: Fri, 13 May 2005 16:02:09 +0000
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla Thunderbird 1.0.2 (X11/20050322)
Hi,
I've been scanning the list and seen reports on problems with live migration. Thought I might add a bit more entropy. I try to do a live migration in the same physical host, i.e. xm migrate --live 'whatever' localhost
It fails with 'Error: errors: suspend, failed, Callbak timed out'.
It seems like transfer of memory pages works until the point when the domain needs to be suspended to do the final transfer. Funny thing is it used to work before, gloriously, and I haven't made any software/hardware changes. At some point a xm save command failed with timeout, and from there on live migration fails with this message. Non-live migration works perfectly, also between different physical hosts. save/restore also works flawlessly.
For the record, I use nfsroot.
I attached xfrd.log. I can post some other stuff, just ask

Thanks a lot
Andres

xfrd.log:

(xfr.migrate 6 "(domain (id 6) (name AndresNfsDomain) (memory 511) (maxmem 524288) (state -b---) (cpu 1) (cpu_time 0.10838393) (up_time 27.1105668545) (start_time 1115999325.85) (console (status listening) (id 12) (domain 6) (local_port 12) (remote_port 1) (console_port 9606)) (devices (vif (idx 0) (vif 0) (mac 00:80:84:00:00:11) (vifname vif6.0) (evtchn 13 3) (index 0))) (config (vm (name AndresNfsDomain) (memory 512) (image (linux (kernel /boot/vmlinuz-2.6.11-xenU) (ip 192.168.70.45:192.168.70.106:192.168.70.254:255.255.255.0:virtuality:eth0:off) (root /dev/nfs) (args 'nfsroot=192.168.70.106:/mnt/nfs2,rsize=32768,wsize=32768 4'))) (device (vif (mac 00:80:84:00:00:11))))))" localhost 8002 1 0)[DEBUG]
Conn_sxpr< err=0
[DEBUG] Conn_connect> addr=127.0.0.1:8002
[DEBUG] Conn_init> flags=1
[DEBUG] Conn_init> write stream...
[DEBUG] stream_init>mode=w flags=1 compress=0
[DEBUG] stream_init> unbuffer...
[DEBUG] stream_init< err=0
[DEBUG] Conn_init> read stream...
[DEBUG] stream_init>mode=r flags=1 compress=0
[DEBUG] stream_init> unbuffer...
[DEBUG] stream_init< err=0
[DEBUG] Conn_sxpr>
(xfr.err 0)[DEBUG] Conn_sxpr< err=0

[1115999352.965314] xc_linux_save start 6

xc_linux_save start 6
[1115999352.966265] Saving memory pages: iter 1   0%
Saving memory pages: iter 1 0%4344 [INF] XFRD> Xfr service for 127.0.0.1:54931
[DEBUG] Conn_init> flags=1
[DEBUG] Conn_init> write stream...
[DEBUG] stream_init>mode=w flags=1 compress=0
[DEBUG] stream_init> unbuffer...
[DEBUG] stream_init< err=0
[DEBUG] Conn_init> read stream...
[DEBUG] stream_init>mode=r flags=1 compress=0
[DEBUG] stream_init> unbuffer...
[DEBUG] stream_init< err=0
[DEBUG] Conn_sxpr>
(xfr.hello 1 0)[DEBUG] Conn_sxpr< err=0
[DEBUG] Conn_sxpr>
(xfr.xfr 6)[DEBUG] Conn_sxpr< err=0
[1115999352.971066] xc_linux_restore start

xc_linux_restore start
[1115999352.991648] Created domain 7

Created domain 7
[1115999353.003196] Reloading memory pages:   0%
Reloading memory pages:   5%
 5%
10%
10%
10%FNI 765 : [1000007e,1020] pte=00bec063, mfn=00000bec, pfn=ffffffff [mfn]=deadbeef
15%
15%
20%
20%
25%
25%
30%
30%
35%
35%
40%
40%
45%
45%
50%
50%
55%
55%
60%
60%
65%
65%
70%
70%
75%
75%
80%
80%
85%
85%
90%
90%
95%
95%
1: sent 130824, skipped 243,
1: sent 130824, skipped 243, delta 2629ms, dom0 100%, target 71%, sent 1630Mb/s, dirtied 4Mb/s 321 pages
[1115999355.596112] Saving memory pages: iter 2   0%
2: sent 320, skipped 0,  2   0%
2: sent 320, skipped 0, delta 11ms, dom0 0%, target 100%, sent 953Mb/s, dirtied 35Mb/s 12 pages
[1115999355.607606] Saving memory pages: iter 3   0%
3: sent 12, skipped 0, r 3   0%
3: sent 12, skipped100%
100%[DEBUG] Conn_sxpr>
(xfr.err 22)[DEBUG] Conn_sxpr< err=0
Retry suspend domain (120)
#... This repeats 198 times in total ...#
Retry suspend domain (120)
Unable to suspend domain. (120)
Unable to suspend domain. (120)
Domain appears not to have suspended: 120
Domain appears not to have suspended: 120
4343 [WRN] XFRD> Transfer errors:
4343 [WRN] XFRD> state=XFR_STATE    err=1
4343 [INF] XFRD> Xfr service err=1
Error when reading from state file
Error when reading from state file
4344 [INF] XFRD> Xfr service err=1

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

<Prev in Thread] Current Thread [Next in Thread>