[Xen-devel] Re:good progress on pci vga passthrough in xen-3.4-rc1

[wei zhou <weizhou.sir@xxxxxxxxx>]

Platform : Nehalem, official Intel x58 with Core i7 920 (dx58so)
Main (Console): Nvidia 9500 GT PCI Express
Secondary: Nvidia 8800 GTS PCI Express
 
Yes, I binned the ASUS P6T due to bad VT-d support in the BIOS.
 
With the latest BIOS from Intel, the dx58so has enable/disable for VT-d, ICH FLR and Interrupt Mapping! Helped a lot with getting this working ...
 
Dom0: 2.6.18-xen0 (built from xen-3.4-rc1)
DomU: 2.6.26-1-xen-amd64 (deb lenny shipped)
 
SUCCESS! - Linux DomU with the official drivers from Nvidia (180.44) .. boot DomU into console, patch and install Nvidia driver, then started X using defaults. gdm chooser appeared on Secondary screen!!
 
So far, i`m using VNC or Synergy to control the DomU (from Dom0 also running X/gdm) and it is good and stable.
 
ISSUES:
This is only possible after a clean restart of the physical machine. Dom0 kernel seems to have problems with the IRQ. BUG trap: "irq has gone away" after attempting to start DomU a second time, Dom0 kernel displays: Disabling IRQ#. (the IRQ IS being shared on Dom0 with a usb controller, but im assuming this is already patched from reading xen history)
 
Also confirmed that this is NOT possible under a HVM or running Windows in a DomU, this could be due to the IRQ corruption but i`m not really sure, in both cases the PCI device is visible but the driver will not load :(
 
As these vga cards dont support FLR, would the FLR code when attempting d3r or sbr cause the interrupt corruption ?
 
Some steer and some assistance would help here, i`m trying to get this working for HVM too !?
 
BTW: I`m eagerly awaiting Jeremy Fitzhardinge to bring pciback.ko to the modern kernels ! Support for this chipset in 2.6.18 is not very good and i would like to try pvops and PCI passthrough. (although, got a hang with x2apic and IRQ mapping enabled)
 
I`m willing to help move the development of xen forwards with any testing or assistance you guys need!

Hi Tim :

   I heard the good news you published from Xen Maillist.That really inspired me. Recently i was working on vt-d graphic passthrough  experiment. That was a real tough job for me. I faced some problems that you may also met before. So i hope you can give me any advises or informaitons.
   Any reply  appreciated!

HardWare:  Q35 matherboard + PCIE NVIDIA 9400 + PCI ATI R128 + IGD Intel
                   Two Monitors connected with respective cards
OS           :  Domain0 (Gentoo X86_64 2.6.28)
                   DomainU (Ubuntu i386 / windows xp / RedHat Ent4.5)
                   Xen3.3.1

At first ,I assumed the Matherboard integrated graphic card for Domain0 then passthrough the PCIE NVIDIA graphic card for DomainU.
But My Matherboard cann't support those two cards work together.
 And Everytime i use the PCIE card render for Domain0, the VT-D can't be Enable Because of the RMMR incorrect.
Considered that reason , the PCIE card was aborted in my experiment.
Now I use the integrated card as the primary card ,the ATI PCI graphic card as the secondly.
Now i face the problem is that the DomainU asigned the ATI card can't displaied on the Monitor connected with the ATI card.

From you information on Xen maillist,
you passthrough the PCIE NVIDIA card to DomainU --> boot from console  --> setup the proper driver for that card --> startx --> then the DomainU display on the second Monitor
Any other works ?
Is that right?  You didn't change any source codes. The whole process are works about configurations.
I tried install a R128 driver in DomainU for the ATI card and Modified the xorg.conf(/etc/X11/xorg.conf) to tell the DomainU use the ATI card do render work.
whatever i do the DomainU always stay on the same screen.

Now i have none idea for the next step .
Hope you can give me some help.

Thanks so much !

--
Best regards ！
周魏
E-mail: weizhou.sir@xxxxxxxxx

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel