WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

RE: [Xen-devel] No VT-d with Xen 3.3/3.4rc3 on Intel-Board DQ45CB

To: Tim Kaufmann <tk@xxxxxxxxxx>
Subject: RE: [Xen-devel] No VT-d with Xen 3.3/3.4rc3 on Intel-Board DQ45CB
From: Ross Philipson <Ross.Philipson@xxxxxxxxxx>
Date: Mon, 27 Apr 2009 09:39:32 -0400
Accept-language: en-US
Acceptlanguage: en-US
Cc: xen-devel <xen-devel@xxxxxxxxxxxxxxxxxxx>
Delivery-date: Mon, 27 Apr 2009 06:40:11 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <28109258-1B1E-48F9-936B-9AFC04866C11@xxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <0F8EA8B5-298F-4ED0-AC0F-B1D0F47F34BF@xxxxxxxxxx> <84CE0F9C-5E0C-4070-97BA-029D47A19E12@xxxxxxxxxx> <831D55AF5A11D64C9B4B43F59EEBF72035FCB5409A@xxxxxxxxxxxxxxxxxxxxxxxxx> <28109258-1B1E-48F9-936B-9AFC04866C11@xxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
Thread-index: AcnGx8VeSNhu+jniTMaGjymgIDM12wAdXPAw
Thread-topic: [Xen-devel] No VT-d with Xen 3.3/3.4rc3 on Intel-Board DQ45CB
Tim,

Could you send along a few things that might be helpful?

1. The rest of the xen output from your debug build leading up to the hang.
2. A listing of your PCI devices using lspci.
3. A dump of the ACPI DMAR using pmtools/acpidump - using something like this
    $ acpidump -t DMAR -b > dmar.bin

Thanks
Ross

-----Original Message-----
From: Tim Kaufmann [mailto:tk@xxxxxxxxxx]
Sent: Sunday, April 26, 2009 7:36 PM
To: Ross Philipson
Cc: xen-devel
Subject: Re: [Xen-devel] No VT-d with Xen 3.3/3.4rc3 on Intel-Board DQ45CB

> You said it is an Intel system; is the over all system an OEM system
> or a custom assembly?

It's a custom assembly and the BIOS ver 0079 belongs to the mainboard.
To be precise, here it is:

http://downloadcenter.intel.com/Detail_Desc.aspx?agr=Y&Inst=Yes&ProductID=2933&DwnldID=17562&strOSs=All&OSFullName=Alle%20Betriebssysteme&lang=deu

> Can you try using "iommu_inclusive_mapping=1" on the xen boot
> command line? This works around a VT-d related BIOS issue.

That didn't help. Now that I compiled Xen with debug options, the last
lines before the boot process hangs look like this:

(XEN) [VT-D]iommu.c:1252:d32767 domain_context_mapping:PCI: bdf = 1:1.0

This output is the same, no matter if I boot with iommu=1 only or with
both iommu and iommu_inclusive_mapping enabled.

Attached, there's a full xm dmesg of the machine after booting it with
IOMMU disabled.

Tim


  __  __            _____ _  _    ___              _____
  \ \/ /___ _ __   |___ /| || |  / _ \    _ __ ___|___ /    _ __  _ __
___
   \  // _ \ \047_ \    |_ \| || |_| | | |__| \047__/ __| |_ \ __|
\047_ \| \047__/ _ \
   /  \  __/ | | |  ___) |__   _| |_| |__| | | (__ ___) |__| |_) | |
|  __/
  /_/\_\___|_| |_| |____(_) |_|(_)___/   |_|  \___|____/   | .__/|_|
\___|
                                                           |_|
(XEN) Xen version 3.4.0-rc3-pre (root@xxxxxxxxxxxx) (gcc version 4.3.2
(Debian 4.3.2-1.1) ) Sun Apr 26 16:00:39 CEST 2009
(XEN) Latest ChangeSet: Fri Apr 24 13:46:17 2009 +0100
19575:dc5bd14a4675
(XEN) Command line: iommu_inclusive_mapping=1
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 0 MBR signatures
(XEN)  Found 5 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009e800 (usable)
(XEN)  000000000009e800 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000bd3c1000 (usable)
(XEN)  00000000bd3c1000 - 00000000bd403000 (ACPI NVS)
(XEN)  00000000bd403000 - 00000000bd526000 (reserved)
(XEN)  00000000bd526000 - 00000000bd53a000 (ACPI NVS)
(XEN)  00000000bd53a000 - 00000000bd63c000 (reserved)
(XEN)  00000000bd63c000 - 00000000bd63d000 (ACPI NVS)
(XEN)  00000000bd63d000 - 00000000bd642000 (reserved)
(XEN)  00000000bd642000 - 00000000bd64c000 (ACPI data)
(XEN)  00000000bd64c000 - 00000000bd667000 (ACPI NVS)
(XEN)  00000000bd667000 - 00000000bd686000 (reserved)
(XEN)  00000000bd686000 - 00000000bd68c000 (ACPI NVS)
(XEN)  00000000bd68c000 - 00000000bd800000 (usable)
(XEN)  00000000bd800000 - 00000000bdb00000 (reserved)
(XEN)  00000000bdc00000 - 00000000c0000000 (reserved)
(XEN)  00000000fed1c000 - 00000000fed20000 (reserved)
(XEN)  00000000ff000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 000000023c000000 (usable)
(XEN) System RAM: 8084MB (8278860kB)
(XEN) ACPI: RSDP 000F03C0, 0024 (r2  INTEL)
(XEN) ACPI: XSDT BD64AE18, 0064 (r1 INTEL  DQ45CB         4F MSFT
10013)
(XEN) ACPI: FACP BD649D98, 00F4 (r4  INTEL    A M I  6222004 MSFT
10013)
(XEN) ACPI: DSDT BD642018, 6818 (r1 INTEL  DQ45CB         4F INTL
20051117)
(XEN) ACPI: FACS BD652F40, 0040
(XEN) ACPI: APIC BD649F18, 006C (r2 INTEL  DQ45CB         4F MSFT
10013)
(XEN) ACPI: MCFG BD654E18, 003C (r1 INTEL  DQ45CB         4F
MSFT       97)
(XEN) ACPI: ASF! BD653D18, 00A0 (r32 INTEL  DQ45CB         4F TFSM
F4240)
(XEN) ACPI: HPET BD654D98, 0038 (r1 INTEL  DQ45CB         4F
AMI.        3)
(XEN) ACPI: SPCR BD654C98, 0050 (r1 INTEL  DQ45CB         4F
AMI.        3)
(XEN) ACPI: TCPA BD654C18, 0032 (r2 INTEL  DQ45CB         4F MSFT
1000013)
(XEN) ACPI: DMAR BD63CC18, 0120 (r1 INTEL  DQ45CB         4F
INTL        1)
(XEN) NUMA turned off
(XEN) Faking a node at 0000000000000000-000000023c000000
(XEN) Domain heap initialised
(XEN) DMI 2.4 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x408
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[404,0], pm1x_evt[400,0]
(XEN) ACPI:                  wakeup_vec[bd652f4c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 7:7 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
(XEN) Processor #1 7:7 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
(XEN) Processor #2 7:7 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
(XEN) Processor #3 7:7 APIC version 20
(XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Initializing CPU#0
(XEN) Detected 2833.098 MHz processor.
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 6144K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 0
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN) HVM: VMX enabled
(XEN) Intel machine check reporting enabled on CPU#0.
(XEN) CPU0: Thermal monitoring enabled (TM2)
(XEN) CMCI: CPU0 has no CMCI support
(XEN) CPU0: Intel(R) Core(TM)2 Quad CPU    Q9550  @ 2.83GHz stepping 0a
(XEN) Booting processor 1/1 eip 8c000
(XEN) Initializing CPU#1
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 6144K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 1
(XEN) Intel machine check reporting enabled on CPU#1.
(XEN) CPU1: Thermal monitoring enabled (TM2)
(XEN) CMCI: CPU1 has no CMCI support
(XEN) CPU1: Intel(R) Core(TM)2 Quad CPU    Q9550  @ 2.83GHz stepping 0a
(XEN) Booting processor 2/2 eip 8c000
(XEN) Initializing CPU#2
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 6144K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 2
(XEN) Intel machine check reporting enabled on CPU#2.
(XEN) CPU2: Thermal monitoring enabled (TM2)
(XEN) CMCI: CPU2 has no CMCI support
(XEN) CPU2: Intel(R) Core(TM)2 Quad CPU    Q9550  @ 2.83GHz stepping 0a
(XEN) Booting processor 3/3 eip 8c000
(XEN) Initializing CPU#3
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 6144K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 3
(XEN) Intel machine check reporting enabled on CPU#3.
(XEN) CPU3: Thermal monitoring enabled (TM2)
(XEN) CMCI: CPU3 has no CMCI support
(XEN) CPU3: Intel(R) Core(TM)2 Quad CPU    Q9550  @ 2.83GHz stepping 0a
(XEN) Total of 4 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) checking TSC synchronization across 4 CPUs: passed.
(XEN) Platform timer is 14.318MHz HPET
(XEN) microcode.c:73:d32767 microcode: CPU1 resumed
(XEN) microcode.c:73:d32767 microcode: CPU2 resumed
(XEN) microcode.c:73:d32767 microcode: CPU3 resumed
(XEN) Brought up 4 CPUs
(XEN) I/O virtualisation disabled
(XEN) HPET: 8 timers in total, 4 timers will be used for broadcast
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80200000 memsz=0x287a00
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80488000 memsz=0x8a8e8
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80513000 memsz=0xc08
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80514000 memsz=0xcd81c
(XEN) elf_parse_binary: memory: 0xffffffff80200000 -> 0xffffffff805e181c
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff80200000
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff80206000
(XEN) elf_xen_parse_note: unknown xen elf note (0xd)
(XEN) elf_xen_parse_note: FEATURES = "writable_page_tables|
writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|
supervisor_mode_kernel"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)     virt_base        = 0xffffffff80000000
(XEN)     elf_paddr_offset = 0xffffffff80000000
(XEN)     virt_offset      = 0x0
(XEN)     virt_kstart      = 0xffffffff80200000
(XEN)     virt_kend        = 0xffffffff805e181c
(XEN)     virt_entry       = 0xffffffff80200000
(XEN)     p2m_base         = 0xffffffffffffffff
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, lsb, paddr 0xffffffff80200000 ->
0xffffffff805e181c
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000230000000->0000000234000000 (1994281
pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff80200000->ffffffff805e181c
(XEN)  Init. ramdisk: ffffffff805e2000->ffffffff817a4800
(XEN)  Phys-Mach map: ffffffff817a5000->ffffffff826fc148
(XEN)  Start info:    ffffffff826fd000->ffffffff826fd4b4
(XEN)  Page tables:   ffffffff826fe000->ffffffff82715000
(XEN)  Boot stack:    ffffffff82715000->ffffffff82716000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82800000
(XEN)  ENTRY ADDRESS: ffffffff80200000
(XEN) Dom0 has maximum 4 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xffffffff80200000 ->
0xffffffff80487a00
(XEN) elf_load_binary: phdr 1 at 0xffffffff80488000 ->
0xffffffff805128e8
(XEN) elf_load_binary: phdr 2 at 0xffffffff80513000 ->
0xffffffff80513c08
(XEN) elf_load_binary: phdr 3 at 0xffffffff80514000 ->
0xffffffff8054eff8
(XEN) Scrubbing Free RAM: .done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to
switch input to Xen)
(XEN) Freed 128kB init memory.
(XEN) PCI add device 00:19.0
(XEN) PCI add device 00:03.2
(XEN) PCI add device 00:1f.5
(XEN) Set CPU acpi_id(1) cpuid(0) Px State info:
(XEN)   _PPC: 0
(XEN) Set CPU acpi_id(1) cpuid(0) Px State info:
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=64,
bit_offset=0, reserved=0, address=409
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=16,
bit_offset=0, reserved=0, address=408
(XEN)   _PSS: state_count=2
(XEN)   State0: 2830MHz 27000mW 10us 10us 0x4822 0x4822
(XEN)   State1: 1998MHz 13800mW 10us 10us 0x616 0x616
(XEN)   _PSD: num_entries=5 rev=0 domain=1 coord_type=252
num_processors=1
(XEN)   _PPC: 0
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 0 initialization completed
(XEN) Set CPU acpi_id(2) cpuid(1) Px State info:
(XEN)   _PPC: 0
(XEN) Set CPU acpi_id(2) cpuid(1) Px State info:
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=64,
bit_offset=0, reserved=0, address=409
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=16,
bit_offset=0, reserved=0, address=408
(XEN)   _PSS: state_count=2
(XEN)   State0: 2830MHz 27000mW 10us 10us 0x4822 0x4822
(XEN)   State1: 1998MHz 13800mW 10us 10us 0x616 0x616
(XEN)   _PSD: num_entries=5 rev=0 domain=2 coord_type=252
num_processors=1
(XEN)   _PPC: 0
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 1 initialization completed
(XEN) Set CPU acpi_id(3) cpuid(2) Px State info:
(XEN)   _PPC: 0
(XEN) Set CPU acpi_id(3) cpuid(2) Px State info:
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=64,
bit_offset=0, reserved=0, address=409
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=16,
bit_offset=0, reserved=0, address=408
(XEN)   _PSS: state_count=2
(XEN)   State0: 2830MHz 27000mW 10us 10us 0x4822 0x4822
(XEN)   State1: 1998MHz 13800mW 10us 10us 0x616 0x616
(XEN)   _PSD: num_entries=5 rev=0 domain=3 coord_type=252
num_processors=1
(XEN)   _PPC: 0
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 2 initialization completed
(XEN) Set CPU acpi_id(4) cpuid(3) Px State info:
(XEN)   _PPC: 0
(XEN) Set CPU acpi_id(4) cpuid(3) Px State info:
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=64,
bit_offset=0, reserved=0, address=409
(XEN)   _PCT: descriptor=130, length=12, space_id=127, bit_width=16,
bit_offset=0, reserved=0, address=408
(XEN)   _PSS: state_count=2
(XEN)   State0: 2830MHz 27000mW 10us 10us 0x4822 0x4822
(XEN)   State1: 1998MHz 13800mW 10us 10us 0x616 0x616
(XEN)   _PSD: num_entries=5 rev=0 domain=4 coord_type=252
num_processors=1
(XEN)   _PPC: 0
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 3 initialization completed
(XEN) no cpu_id for acpi_id 5
(XEN) no cpu_id for acpi_id 6
(XEN) no cpu_id for acpi_id 7
(XEN) no cpu_id for acpi_id 8
(XEN) PCI add device 00:1a.0
(XEN) PCI add device 00:1a.1
(XEN) PCI add device 00:1a.2
(XEN) PCI add device 00:1d.0
(XEN) PCI add device 00:1d.1
(XEN) PCI add device 00:1d.2
(XEN) PCI add device 01:01.0
(XEN) PCI add device 01:00.0
(XEN) PCI add device 00:1f.2
(XEN) PCI add device 00:1a.7
(XEN) PCI add device 00:1d.7
(XEN) PCI add device 00:1f.5
(XEN) PCI add device 00:1f.3
(XEN) PCI add device 00:1b.0
(XEN) irq.c:640:d0 Cannot bind IRQ 2 to guest. In use by \047cascade
\047.
(XEN) irq.c:640:d0 Cannot bind IRQ 2 to guest. In use by \047cascade
\047.
(XEN) mtrr: type mismatch for c1fe0000,10000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c1fc0000,20000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c1f80000,40000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c1f00000,80000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c1e00000,100000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c1c00000,200000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c1800000,400000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c1000000,800000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for c0000000,1000000 old: write-back new:
write-combining


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel