cancel
Showing results for 
Search instead for 
Did you mean: 

AMD-Vi/IOMMU/VFIO PCI passthrough broken on PRIME X470-PRO

calebwill
Level 7
Motherboard model: PRIME X470-PRO

UEFI Version: 5204

CPU: Ryzen 2700X

Memory kit part number (s) and amount in GB: G-Skill F4-3200C16-8GVGB x 4 = 32 GB

GPU: EVGA GTX 980

SSD/HDDs/Optical drives: Samsung 970 EVO plus 1TB

PSU: EVGA Supernova G2 850W

USB Devices (model/version number):

Monitor: AOC G2460P


CPU Cooler: AMD Wraith Prism

PC CASE:

Operating system: Debian 10


Drivers Installed (include version): Linux 4.19.37-5+deb10u1

Any third Party temp/voltage software installed:

System Overclocked (provide details)? Using DOCP to run RAM at 3200 MHz


Issue

Hello first time poster here. I just upgraded from an ASUS Z97-AR with Core i5 4590 to the above mentioned hardware. After upgrading I can no longer use IOMMU/AMD-Vi to pass my GPU through to virtual machines with vfio.

When I start a VM that has the GPU assigned to it the display attached to the GPU does not power on as before. When this happens I get this error in my logs (more log messages below):

Aug 03 23:37:42 hill kernel: vfio-pci 0000:0a:00.1: Refused to change power state, currently in D3


I'm posting to the forum because from what I've read elsewhere it seems that others using my motherboard (and indeed other X470 users) are having the same problem, and it started after an AGESA update. I would like to know if there are any plans to fix the issue.

Needless to say I'm disappointed with my upgrade so far.

Relevant log entries:

Aug 03 21:01:03 hill kernel: AMD-Vi: IOMMU performance counters supported

Aug 03 21:01:03 hill kernel: iommu: Adding device 0000:0a:00.0 to group 17

Aug 03 21:01:03 hill kernel: AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
Aug 03 21:01:03 hill kernel: AMD-Vi: Extended features (0xf77ef22294ada):
Aug 03 21:01:03 hill kernel: PPR NX GT IA GA PC GA_vAPIC
Aug 03 21:01:03 hill kernel: AMD-Vi: Interrupt remapping enabled
Aug 03 21:01:03 hill kernel: AMD-Vi: virtual APIC enabled
Aug 03 21:01:03 hill kernel: AMD-Vi: Lazy IO/TLB flushing enabled

Aug 03 23:40:13 hill kernel: vfio-pci 0000:0a:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
Aug 03 23:40:13 hill kernel: vfio_pci: add [10de:13c0[ffff:ffff]] class 0x000000/00000000
Aug 03 23:40:13 hill kernel: vfio_pci: add [10de:0fbb[ffff:ffff]] class 0x000000/00000000

Aug 03 23:36:24 hill kernel: vfio-pci 0000:0a:00.0: enabling device (0000 -> 0003)
Aug 03 23:36:24 hill kernel: vfio_ecap_init: 0000:0a:00.0 hiding ecap 0x1e@0x258
Aug 03 23:36:24 hill kernel: vfio_ecap_init: 0000:0a:00.0 hiding ecap 0x19@0x900
Aug 03 23:36:24 hill kernel: vfio-pci 0000:0a:00.1: enabling device (0000 -> 0002)
Aug 03 23:36:26 hill kernel: vfio_bar_restore: 0000:0a:00.1 reset recovery - restoring bars
Aug 03 23:36:26 hill kernel: vfio_bar_restore: 0000:0a:00.0 reset recovery - restoring bars
Aug 03 23:36:27 hill kernel: vfio_bar_restore: 0000:0a:00.0 reset recovery - restoring bars
Aug 03 23:36:27 hill kernel: vfio_bar_restore: 0000:0a:00.1 reset recovery - restoring bars

Aug 03 23:37:42 hill kernel: vfio-pci 0000:0a:00.1: Refused to change power state, currently in D3

Aug 03 23:37:43 hill libvirtd[945]: internal error: Unknown PCI header type '127'
Aug 03 23:37:43 hill libvirtd[945]: Failed to reset PCI device: internal error: Unknown PCI header type '127'
Aug 03 23:37:43 hill libvirtd[945]: internal error: Unknown PCI header type '127'
Aug 03 23:37:43 hill libvirtd[945]: Failed to reset PCI device: internal error: Unknown PCI header type '127'
3,174 Views
0 REPLIES 0