WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 		  
Home Products Support Community News
 
   
 

xen-devel

[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

Re: [Xen-devel] Hypervisor crash(!) on xl cpupool-numa-split

from [Andre Przywara] [Permanent Link][Original]
To: George Dunlap <George.Dunlap@xxxxxxxxxxxxx>
Subject: Re: [Xen-devel] Hypervisor crash(!) on xl cpupool-numa-split
From: Andre Przywara <andre.przywara@xxxxxxx>
Date: Wed, 9 Feb 2011 14:51:21 +0100
Cc: Juergen Gross <juergen.gross@xxxxxxxxxxxxxx>, "xen-devel@xxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxx>, "Diestelhorst, Stephan" <Stephan.Diestelhorst@xxxxxxx>
Delivery-date: Wed, 09 Feb 2011 05:55:19 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <AANLkTikgGNz=imS1xRVVjntY5P=+MuT_Qsb=-h3QHajY@xxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <4D41FD3A.5090506@xxxxxxx> <201102021539.06664.stephan.diestelhorst@xxxxxxx> <4D4974D1.1080503@xxxxxxxxxxxxxx> <201102021701.05665.stephan.diestelhorst@xxxxxxx> <4D4A43B7.5040707@xxxxxxxxxxxxxx> <4D4A72D8.3020502@xxxxxxxxxxxxxx> <4D4C08B6.30600@xxxxxxx> <4D4FE7E2.9070605@xxxxxxx> <4D4FF452.6060508@xxxxxxxxxxxxxx> <AANLkTinoRUQC_suVYFM9-x3D00KvYofq3R=XkCQUj6RP@xxxxxxxxxxxxxx> <4D50D80F.9000007@xxxxxxxxxxxxxx> <AANLkTinKJUAXhiXpKui_XX8XCD6T5fmzNARwHE6Fjafv@xxxxxxxxxxxxxx> <AANLkTinP0z9GynF1RFd8RwzWuqvxYdb+UBE+7xKpX6D4@xxxxxxxxxxxxxx> <4D517051.10402@xxxxxxx> <AANLkTi=MiELBnPFvb6-jzVth+T7aKxP5JMFhVh3Crdmo@xxxxxxxxxxxxxx> <AANLkTikgGNz=imS1xRVVjntY5P=+MuT_Qsb=-h3QHajY@xxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Thunderbird 2.0.0.23 (X11/20090820) 
George Dunlap wrote:

<George.Dunlap@xxxxxxxxxxxxx> wrote:

On Tue, Feb 8, 2011 at 4:33 PM, Andre Przywara <andre.przywara@xxxxxxx> wrote:

(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 24
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 24
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 24
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v32 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v32 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v32 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 29

Interesting -- what seems to happen here is that as cpus are disabled,
vcpus are "shovelled" in an accumulative fashion from one cpu to the
next:
* v18,34,42 start on cpu 24.
* When 24 is brought down, they're all migrated to 25; then when 25 is
brougth down, to 26, then to 27
* v24 is running on cpu 27, so when 27 is brought down, v24 is added to the mix
* v3 is running on cpu 28, so all of them plus v3 are shoveled onto cpu 29.

While that behavior may not be ideal, it should certainly be bug-free.

Another interesting thing to note is that the bug happened on pcpu 32,
but there were no advertised migrations from that cpu.

Andre, can you fold the attached patch into your testing?
Sorry, but that bug (and its output) didn't trigger on two tries. Instead I now saw two occasions of the "migration failed, must retry later" message. Interestingly enough is does not seem to be fatal. The first time it triggers, the numa-split even completes, then after I roll it back and repeat it it shows again, but crashes later on that old BUG_ON(). 

See the attached log for more details.

Thanks for the try, anyway.

Regards,
Andre.




Thanks for all your work on this.
I am glad for all your help. I only start to really understand the scheduler, so your support is much appreciated. 



 -George




--
Andre Przywara
AMD-Operating System Research Center (OSRC), Dresden, Germany

root@dosorca:/data/images# sh numasplit.sh create
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 6
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 7
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 7
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 8
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 8
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 9
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 10
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 11
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node1
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 12
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 12
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 13
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 13
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 14
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 14
(XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 15
(XEN)   Migration failed, must retry later.
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 15
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 15
(XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 17
(XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 17
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 17
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 17
(XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 17
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node2
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 18
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 19
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 19
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 20
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 20
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 20
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 21
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 21
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 21
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 22
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 22
(XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 22
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 23
(XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 23
(XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 23
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node3
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v12 from cpu 24
(XEN) cpu_disable_scheduler: Migrating d0v30 from cpu 24
(XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v30 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 29
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 29
(XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 29
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 29
(XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 29
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node4
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 30
(XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 30
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 31
(XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 31
(XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 31
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 32
(XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 32
(XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 32
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 33
(XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 33
(XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 33
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 34
(XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 34
(XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 34
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 35
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 35
(XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 35
(XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 35
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node5
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 36
(XEN) cpu_disable_scheduler: Migrating d0v45 from cpu 36
(XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v45 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 41
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node6
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 42
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 42
(XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 42
(XEN) cpu_disable_scheduler: Migrating d0v46 from cpu 42
(XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 43
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 43
(XEN) cpu_disable_scheduler: Migrating d0v12 from cpu 43
(XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 43
(XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 43
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 43
(XEN) cpu_disable_scheduler: Migrating d0v43 from cpu 43
(XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 44
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 44
(XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 44
(XEN) cpu_disable_scheduler: Migrating d0v23 from cpu 44
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 44
(XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 44
(XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 45
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 45
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 45
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 45
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 45
(XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 45
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 45
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 46
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 46
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 46
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 46
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 46
(XEN) cpu_disable_scheduler: Migrating d0v12 from cpu 47
(XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 47
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 47
(XEN) cpu_disable_scheduler: Migrating d0v33 from cpu 47
(XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 47
(XEN) cpu_disable_scheduler: Migrating d0v43 from cpu 47
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node7
scheduler:      credit
number of cpus: 1
Populating new pool
root@dosorca:/data/images# sh numasplit.sh create revert
Destroying Pool 1
adding freed CPUs to pool 0
Destroying Pool 2
adding freed CPUs to pool 0
Destroying Pool 3
adding freed CPUs to pool 0
Destroying Pool 4
adding freed CPUs to pool 0
Destroying Pool 5
adding freed CPUs to pool 0
Destroying Pool 6
adding freed CPUs to pool 0
Destroying Pool 7
adding freed CPUs to pool 0
root@dosorca:/data/images# sh numasplit.sh create
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 6
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 6
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 7
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 7
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 7
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 8
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 8
(XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 8
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 8
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 9
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 9
(XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 9
(XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 9
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 10
(XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 10
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 10
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 11
(XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 11
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 11
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node1
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 12
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 12
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 13
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 13
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 13
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 14
(XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 14
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 14
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 14
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 15
(XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 15
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 15
(XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 15
(XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 15
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 16
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 17
(XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 17
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 17
(XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 17
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node2
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 18
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 18
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 19
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 19
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 20
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 20
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 20
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 21
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 21
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 21
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 22
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 22
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 22
(XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 23
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 23
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 23
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node3
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 24
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 25
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v43 from cpu 26
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 27
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 28
(XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 29
(XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 29
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 29
(XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 29
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node4
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 31
(XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 32
(XEN) cpu_disable_scheduler: Migrating d0v46 from cpu 32
(XEN)   Migration failed, must retry later.
(XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 33
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 34
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 34
(XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 34
(XEN) cpu_disable_scheduler: Migrating d0v4 from cpu 35
(XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 35
(XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 35
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node5
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 36
(XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 36
(XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 36
(XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 36
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 37
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 38
(XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 39
(XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v47 from cpu 40
(XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 41
(XEN) cpu_disable_scheduler: Migrating d0v45 from cpu 41
Rewriting config file
Creating new pool
Using config file "cpupool.test"
cpupool name:   Pool-node6
scheduler:      credit
number of cpus: 1
Populating new pool
Removing CPUs from Pool 0
(XEN) Xen BUG at sched_credit.c:998
(XEN) ----[ Xen-4.1.0-rc3-pre  x86_64  debug=y  Not tainted ]----
(XEN) CPU:    0
(XEN) RIP:    e008:[<ffff82c48011814d>] csched_acct+0x11f/0x41c
(XEN) RFLAGS: 0000000000010006   CONTEXT: hypervisor
(XEN) rax: 0000000000000010   rbx: 0000000000000f00   rcx: 0000000000000100
(XEN) rdx: 0000000000001000   rsi: ffff830437ffa600   rdi: 0000000000000010
(XEN) rbp: ffff82c480297e38   rsp: ffff82c480297da8   r8:  0000000000000100
(XEN) r9:  0000000000000007   r10: ffff82c4802cbfe0   r11: 0000009d467684b5
(XEN) r12: ffff830437ffa5e0   r13: ffff82c48011802e   r14: ffff830433af2018
(XEN) r15: ffff830434321ec0   cr0: 000000008005003b   cr4: 00000000000006f0
(XEN) cr3: 00000008067e3000   cr2: 00007f5a56dce590
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff82c480297da8:
(XEN)    ffff82c480297dc8 fffffed480153c5e ffff830400000eff ffff830437ffa5e0
(XEN)    ffff830437ffa5e8 ffff82c480153ced ffff830437ffa5e0 0000000000000292
(XEN)    ffff830437ffa5e8 00000e1034322000 00000f0000000f00 0000000000000000
(XEN)    ffff82c400000000 ffff82c4802d3f80 ffff830437ffa5e0 ffff82c48011802e
(XEN)    ffff830433af2018 ffff830433af2010 ffff82c480297e68 ffff82c480125fc4
(XEN)    0000000000000002 ffff830437ffa600 ffff82c4802d3f80 0000009d44e55c65
(XEN)    ffff82c480297eb8 ffff82c4801262e9 0000000000000001 ffff82c4802d3f80
(XEN)    ffff830433af2010 0000000000000000 0000000000000000 ffff82c4802b0880
(XEN)    ffff82c480297f18 ffffffffffffffff ffff82c480297ef8 ffff82c4801233b7
(XEN)    ffff82c480297ed8 ffff8300c7e0a000 ffff88007ce88f40 ffff8817a7c47000
(XEN)    0000000000000001 000000000000002c ffff82c480297f08 ffff82c480123432
(XEN)    00007d3b7fd680c7 ffff82c480207d16 000000000000002c 0000000000000001
(XEN)    ffff8817a7c47000 ffff88007ce88f40 ffff88179f9ffce8 ffff8817a84df000
(XEN)    0000000000000286 000000000000000f ffff88179f9ffcf8 ffff88007ce898c0
(XEN)    0000000000000000 ffffffff8100940a ffff88007ce75000 00000000deadbeef
(XEN)    00000000deadbeef 0000010000000000 ffffffff8100940a 000000000000e033
(XEN)    0000000000000286 ffff88179f9ffca0 000000000000e02b 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    ffff8300c7e0a000 0000000000000000 0000000000000000
(XEN) Xen call trace:
(XEN)    [<ffff82c48011814d>] csched_acct+0x11f/0x41c
(XEN)    [<ffff82c480125fc4>] execute_timer+0x4e/0x6c
(XEN)    [<ffff82c4801262e9>] timer_softirq_action+0xf2/0x245
(XEN)    [<ffff82c4801233b7>] __do_softirq+0x88/0x99
(XEN)    [<ffff82c480123432>] do_softirq+0x6a/0x7a
(XEN)    
(XEN) 
(XEN) ****************************************
(XEN) Panic on CPU 0:
(XEN) Xen BUG at sched_credit.c:998
(XEN) ****************************************
(XEN) 
(XEN) Reboot in five seconds...
(XEN) Resetting with ACPI MEMORY or I/O RESET_REG.

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  [Xen-devel] Re: [PATCH v2] xen network backend driver, Ian Campbell
Next by Date:  Re: [Xen-devel] Re: [PATCH 08/23] xen: statically initialize cpu_evtchn_mask_p, Ian Campbell
Previous by Thread:  Re: [Xen-devel] Hypervisor crash(!) on xl cpupool-numa-split, Andre Przywara
Next by Thread:  Re: [Xen-devel] Hypervisor crash(!) on xl cpupool-numa-split, Juergen Gross
Indexes:  [Date] [Thread] [Top] [All Lists]
 
   

Copyright , Citrix Systems Inc. All rights reserved. Legal and Privacy