Re: [Xen-users] BUG: soft lockup - CPU#1 stuck for XXs!

[Peter Booth <peter_booth@xxxxxx>]

Can you attach sar -A output for the DomU?

Sent from my iPhone

On Jul 17, 2009, at 11:21 AM, Michele Castigliego <subcomandante@xxxxxxxxxxx 
> wrote:
> Hi all,
> I'm having an issue on a fully virtualized DomU (Lenny with
> 2.6.26-2-686) saying "BUG: soft lockup" on several daemons (apache2,
> etc..) several times a day. Most of the time the guest does not freeze
> but sometimes yes.
> DomU is a bit loaded due to a website with a lot of users.
>
> Dom0 is Lenny 2.6.26-1-xen-686, xen-hypervisor-3.2-1-i386.
>
> Is this a well known problem? I cannot find any useful info on
> Internet...
>
> Regards,
> Michele Castigliego
>
>
>
> This is the DomU config:
> kernel = '/usr/lib/xen-3.2-1/boot/hvmloader'
> builder = 'hvm'
> memory = '1024'
> device_model='/usr/lib/xen-3.2-1/bin/qemu-dm'
> # Disks
> disk = [ 'file:/dfs/virtual/images/domu.img,ioemu:hda,w']
> # Hostname
> name = 'casshern'
> vcpus=2
>
> # Networking
> vif = ['type=ioemu, mac=xx:xx:xx:xx:xx:xx, model=rtl8139, bridge=br0']
>
> usbdevice="tablet"
>
> # Behaviour
> # boot on floppy (a), hard disk (c) or CD-ROM (d)
> # default: hard disk, cd-rom, floppy
> boot='c'
> vnc=1
> vncviewer=1
> vncunused=0
> vnclisten="0.0.0.0"
> vncdisplay=11
> sdl=0
> stdvga=0
> serial='pty'
>
>
>
> I post below dmesg output example:
> [218595.260615] BUG: soft lockup - CPU#1 stuck for 79s!  
> [apache2:29210]
> [218595.260615] Modules linked in: ipv6 loop joydev usbhid hid
> ff_memless parport_pc parport serio_raw psmouse snd_pcsp snd_pcm
> snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core evdev ext3  
> jbd
> mbcache ide_disk ata_generic libata scsi_mod dock 8139cp  
> ide_pci_generic
> floppy uhci_hcd 8139too mii usbcore piix ide_core thermal processor  
> fan
> thermal_sys
> [218595.260615]
> [218595.260615] Pid: 29210, comm: apache2 Tainted: G        W
> (2.6.26-2-686 #1)
> [218595.260615] EIP: 0060:[<c02b979b>] EFLAGS: 00000246 CPU: 1
> [218595.260615] EIP is at _spin_unlock_irqrestore+0x7/0x10
> [218595.260615] EAX: 00000246 EBX: 0001c218 ECX: 00080262 EDX:  
> 00000246
> [218595.260615] ESI: f7986be0 EDI: 00000246 EBP: f7986800 ESP:  
> d3129df0
> [218595.260615]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
> [218595.260615] CR0: 8005003b CR2: b699fcc0 CR3: 37ac9000 CR4:  
> 000006d0
> [218595.260615] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3:  
> 00000000
> [218595.260615] DR6: ffff0ff0 DR7: 00000400
> [218595.260615]  [<f883456b>] ? rtl8139_start_xmit+0xe7/0x10d  
> [8139too]
> [218595.260615]  [<c0258bb4>] ? dev_hard_start_xmit+0x1eb/0x24f
> [218595.260615]  [<c0266c2a>] ? __qdisc_run+0xa8/0x17c
> [218595.260615]  [<c025ad33>] ? dev_queue_xmit+0x19f/0x2bc
> [218595.260615]  [<c0276525>] ? ip_finish_output+0x1c5/0x1fc
> [218595.260615]  [<c02760b3>] ? ip_local_out+0x15/0x17
> [218595.260615]  [<c0276ad5>] ? ip_queue_xmit+0x25b/0x29d
> [218595.260615]  [<c01190c9>] ? hrtick_start_fair+0x82/0x12c
> [218595.260615]  [<c0285010>] ? tcp_transmit_skb+0x6a2/0x6d5
> [218595.260615]  [<c0285b39>] ? tcp_retransmit_skb+0x41f/0x515
> [218595.260615]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> [218595.260615]  [<c0287ca4>] ? tcp_write_timer+0x489/0x629
> [218595.260615]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> [218595.260615]  [<c01296bf>] ? run_timer_softirq+0x11a/0x17c
> [218595.260615]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> [218595.260615]  [<c01265d9>] ? __do_softirq+0x66/0xd3
> [218595.260615]  [<c012668b>] ? do_softirq+0x45/0x53
> [218595.260615]  [<c0126942>] ? irq_exit+0x35/0x67
> [218595.260615]  [<c01101c9>] ? smp_apic_timer_interrupt+0x6b/0x76
> [218595.260615]  [<c0104364>] ? apic_timer_interrupt+0x28/0x30
> [218595.260615]  [<c02b0000>] ? aer_probe+0x7d/0xff
> [218595.260615]  =======================
> [220760.234273] BUG: soft lockup - CPU#1 stuck for 83s! [swapper:0]
> [220760.234273] Modules linked in: ipv6 loop joydev usbhid hid
> ff_memless parport_pc parport serio_raw psmouse snd_pcsp snd_pcm
> snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core evdev ext3  
> jbd
> mbcache ide_disk ata_generic libata scsi_mod dock 8139cp  
> ide_pci_generic
> floppy uhci_hcd 8139too mii usbcore piix ide_core thermal processor  
> fan
> thermal_sys
> [220760.234273]
> [220760.234273] Pid: 0, comm: swapper Tainted: G        W  
> (2.6.26-2-686
> #1)
> [220760.234273] EIP: 0060:[<f8841928>] EFLAGS: 00000282 CPU: 1
> [220760.234273] EIP is at ide_do_request+0x2d3/0x81b [ide_core]
> [220760.234273] EAX: 0000000e EBX: f8853acc ECX: f8853a80 EDX:  
> f7809e40
> [220760.234273] ESI: f8853acc EDI: f7809e40 EBP: f78b199c ESP:  
> f7475cbc
> [220760.234273]  DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
> [220760.234273] CR0: 8005003b CR2: b6dad000 CR3: 03223000 CR4:  
> 000006d0
> [220760.234273] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3:  
> 00000000
> [220760.234273] DR6: ffff0ff0 DR7: 00000400
> [220760.234273]  [<f8841310>] ? ide_end_request+0x56/0x5f [ide_core]
> [220760.234273]  [<f8845927>] ? task_end_request+0x40/0x51 [ide_core]
> [220760.234273]  [<f88420d6>] ? ide_intr+0x174/0x19b [ide_core]
> [220760.234273]  [<c015209e>] ? handle_IRQ_event+0x23/0x51
> [220760.234273]  [<c015328f>] ? handle_edge_irq+0xbf/0xfa
> [220760.234273]  [<c0105f3a>] ? do_IRQ+0x4d/0x63
> [220760.234273]  [<c01042a7>] ? common_interrupt+0x23/0x28
> [220760.234273]  [<c02b979b>] ? _spin_unlock_irqrestore+0x7/0x10
> [220760.234273]  [<f883456b>] ? rtl8139_start_xmit+0xe7/0x10d  
> [8139too]
> [220760.234273]  [<c0258bb4>] ? dev_hard_start_xmit+0x1eb/0x24f
> [220760.234273]  [<c0266c2a>] ? __qdisc_run+0xa8/0x17c
> [220760.234273]  [<c025ad33>] ? dev_queue_xmit+0x19f/0x2bc
> [220760.234273]  [<c0276525>] ? ip_finish_output+0x1c5/0x1fc
> [220760.234273]  [<c02760b3>] ? ip_local_out+0x15/0x17
> [220760.234273]  [<c0276ad5>] ? ip_queue_xmit+0x25b/0x29d
> [220760.234273]  [<c0134566>] ? ktime_get+0xd/0x21
> [220760.234273]  [<c0119132>] ? hrtick_start_fair+0xeb/0x12c
> [220760.234273]  [<c0285010>] ? tcp_transmit_skb+0x6a2/0x6d5
> [220760.234273]  [<c01360bc>] ? getnstimeofday+0x37/0xbc
> [220760.234273]  [<c0285b39>] ? tcp_retransmit_skb+0x41f/0x515
> [220760.234273]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> [220760.234273]  [<c0287ca4>] ? tcp_write_timer+0x489/0x629
> [220760.234273]  [<c011b6c5>] ? try_to_wake_up+0xe8/0xf1
> [220760.234273]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> [220760.234273]  [<c01296bf>] ? run_timer_softirq+0x11a/0x17c
> [220760.234273]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> [220760.234273]  [<c01265d9>] ? __do_softirq+0x66/0xd3
> [220760.234273]  [<c012668b>] ? do_softirq+0x45/0x53
> [220760.234273]  [<c0126942>] ? irq_exit+0x35/0x67
> [220760.234273]  [<c0105f3f>] ? do_IRQ+0x52/0x63
> [220760.234273]  [<c0102656>] ? default_idle+0x0/0x53
> [220760.234273]  [<c01042a7>] ? common_interrupt+0x23/0x28
> [220760.234273]  [<c0102656>] ? default_idle+0x0/0x53
> [220760.234273]  [<c0114d68>] ? native_safe_halt+0x2/0x3
> [220760.234273]  [<c0102683>] ? default_idle+0x2d/0x53
> [220760.234273]  [<c01025ce>] ? cpu_idle+0xab/0xcb
> [220760.234273]  =======================
>
>
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-users
_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users