WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] Xen 3.0.3, AMD and PCI passthrough

To: Pasi Kärkkäinen <pasik@xxxxxx>
Subject: Re: [Xen-users] Xen 3.0.3, AMD and PCI passthrough
From: Kalle Happonen <kalle.happonen@xxxxxxx>
Date: Tue, 09 Mar 2010 14:53:49 +0100
Cc: xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Tue, 09 Mar 2010 05:55:20 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <20100308165623.GX2580@xxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <4B950DC7.3020801@xxxxxxx> <20100308165623.GX2580@xxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Thunderbird 2.0.0.23 (X11/20090817)
Pasi Kärkkäinen wrote:
On Mon, Mar 08, 2010 at 03:46:31PM +0100, Kalle Happonen wrote:
Hello all,

I'm running Xen on a HP DL385G6 machine. I use Centos 5.4 on the dom0, which comes with the seemingly old 3.0.3 (accoring to rpm) version of xen.(Although another thread just said: RHEL5 has Xen hypervisor version 3.1.2 + tools version 3.0.3.)

The machine runs a pair of AMD Istanbuls (Six-Core AMD Opteron(tm) Processor 2431). I have an Ininiband card on the machine which I would like to pass on to a domU. When I try to attach the pci device to the domu, I get the following output though..

xm pci-attach jade 0000:48:00.0
Error: failed to assign device: maybe the platform doesn't support VT-d, or VT-d isn't enabled properly?
Usage: xm pci-attach <Domain> <domain:bus:slot.func> [virtual slot]

Insert a new pass-through pci device.

If I have understood correctly, this new AMDs should support it though. The virtualization option has been enabled in the BIOS.

Looking at xm dmesg, however, I get the following

...
(XEN) HVM: SVM enabled
(XEN) HVM: Hardware Assisted Paging detected and enabled.
(XEN) I/O virtualisation disabled
...

I have tried adding "amd_enable_iommu=1" to grub, but it doesn't seem to help. Is the version of xen too old to support this? If so, how big of a task is it to upgrade xen, and which version would be required? Sticking with the stock version would be nice from the security update point of view.


Please paste the full "xm dmesg" log. Are you sure your hardware has IOMMU, that is required for IO virtualization?
Well, I have tried to look into this, but the information is a bit scarce. As far as I can tell, this hardware should have IOMMU support. Unless HP has problems with the firmware...
Also I think only the very latest Xen versions (aka upcoming Xen 4.0.0) has
support for AMD IOMMUs..
Yeah, I assumed this might be the case. Well it's not completely critical, but it would be nice.
Dunno if Redhat has backported AMD IOMMU support to their Xen version.

The xm dmesg output is below,

Cheers,
Kalle Happonen

Xen version 3.1.2-164.11.1.el5 (mockbuild@xxxxxxxxxx) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) Wed Jan 20 07:24:59 EST 2010
Latest ChangeSet: unavailable

(XEN) Command line: dom0_mem=2048MB dom0_max_vcpus=2 amd_enable_iommu=1
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 2 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009f400 (usable)
(XEN)  000000000009f400 - 00000000000a0000 (reserved)
(XEN)  00000000000f0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000cfe3e000 (usable)
(XEN)  00000000cfe3e000 - 00000000cfe46000 (ACPI data)
(XEN)  00000000cfe46000 - 00000000cfe47000 (usable)
(XEN)  00000000cfe47000 - 00000000e0000000 (reserved)
(XEN)  00000000fec00000 - 00000000fee10000 (reserved)
(XEN)  00000000ffc00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 000000082ffff000 (usable)
(XEN) System RAM: 32765MB (33552244kB)
(XEN) Xen heap: 13MB (13980kB)
(XEN) Domain heap initialised: DMA width 32 bits
(XEN) Processor #0 0:8 APIC version 16
(XEN) Processor #8 0:8 APIC version 16
(XEN) Processor #1 0:8 APIC version 16
(XEN) Processor #9 0:8 APIC version 16
(XEN) Processor #2 0:8 APIC version 16
(XEN) Processor #10 0:8 APIC version 16
(XEN) Processor #3 0:8 APIC version 16
(XEN) Processor #11 0:8 APIC version 16
(XEN) Processor #4 0:8 APIC version 16
(XEN) Processor #12 0:8 APIC version 16
(XEN) Processor #5 0:8 APIC version 16
(XEN) Processor #13 0:8 APIC version 16
(XEN) IOAPIC[0]: apic_id 8, version 17, address 0xfec00000, GSI 0-15
(XEN) IOAPIC[1]: apic_id 9, version 17, address 0xfec01000, GSI 16-31
(XEN) IOAPIC[2]: apic_id 10, version 17, address 0xfec02000, GSI 32-47
(XEN) Enabling APIC mode:  Phys.  Using 3 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2400.192 MHz processor.
(XEN) AMD SVM: ASIDs enabled.
(XEN) HVM: SVM enabled
(XEN) HVM: Hardware Assisted Paging detected and enabled.
(XEN) I/O virtualisation disabled
(XEN) CPU0: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 1/8 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU1: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 2/1 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU2: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 3/9 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU3: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 4/2 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU4: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 5/10 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU5: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 6/3 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU6: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 7/11 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU7: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 8/4 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU8: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 9/12 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU9: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 10/5 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU10: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 11/13 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU11: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Total of 12 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) Platform timer overflows in 14998 jiffies.
(XEN) Platform timer is 14.318MHz HPET
(XEN) Brought up 12 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80200000 memsz=0x2edd48
(XEN) elf_parse_binary: phdr: paddr=0xffffffff804edd80 memsz=0x14a4f0
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80639000 memsz=0xc08
(XEN) elf_parse_binary: phdr: paddr=0xffffffff8063a000 memsz=0x11c50c
(XEN) elf_parse_binary: memory: 0xffffffff80200000 -> 0xffffffff8075650c
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff80200000
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff80206000
(XEN) elf_xen_parse_note: FEATURES = "writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)     virt_base        = 0xffffffff80000000
(XEN)     elf_paddr_offset = 0xffffffff80000000
(XEN)     virt_offset      = 0x0
(XEN)     virt_kstart      = 0xffffffff80200000
(XEN)     virt_kend        = 0xffffffff8075650c
(XEN)     virt_entry       = 0xffffffff80200000
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN) Dom0 kernel: 64-bit, lsb, paddr 0xffffffff80200000 -> 0xffffffff8075650c
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 0000000806000000->0000000808000000 (516096 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff80200000->ffffffff8075650c
(XEN)  Init. ramdisk: ffffffff80757000->ffffffff80e18e00
(XEN)  Phys-Mach map: ffffffff80e19000->ffffffff81219000
(XEN)  Start info:    ffffffff81219000->ffffffff8121949c
(XEN)  Page tables:   ffffffff8121a000->ffffffff81227000
(XEN)  Boot stack:    ffffffff81227000->ffffffff81228000
(XEN)  TOTAL:         ffffffff80000000->ffffffff81400000
(XEN)  ENTRY ADDRESS: ffffffff80200000
(XEN) Dom0 has maximum 2 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xffffffff80200000 -> 0xffffffff804edd48
(XEN) elf_load_binary: phdr 1 at 0xffffffff804edd80 -> 0xffffffff80638270
(XEN) elf_load_binary: phdr 2 at 0xffffffff80639000 -> 0xffffffff80639c08
(XEN) elf_load_binary: phdr 3 at 0xffffffff8063a000 -> 0xffffffff80677028
(XEN) Initrd len 0x6c1e00, start at 0xffffffff80757000
(XEN) Scrubbing Free RAM: .............................................................................................................................................................................................................................................................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to switch input to Xen).
(XEN) Freed 112kB init memory.


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

<Prev in Thread] Current Thread [Next in Thread>