gpu pass-trough not working due to "wrong" immou group

[Idar Lund]

Hi,

I'm trying to start a virtual machine with a passthrough of a pcie GPU. Unfortunately my GPU is in an IMMOU group with a lot of other peripherals that I obviously need on the host OS. I've tried to search online and the motherboard manual to get the GPU out of this IMMOU group, with no luck. Moving the GPU to another pcie-slot is also not an option in my setup. Any suggestions?

$ cat /proc/cpuinfo |grep "model name"|uniq
model name : AMD Ryzen 9 7950X 16-Core Processor

$ sudo dmidecode -t 2|grep -v "Serial Number"
# dmidecode 3.4
Getting SMBIOS data from sysfs.
SMBIOS 3.5.0 present.

Handle 0x0002, DMI type 2, 15 bytes
Base Board Information
Manufacturer: ASUSTeK COMPUTER INC.
Product Name: PRIME X670E-PRO WIFI
Version: Rev 1.xx
Asset Tag: Default string
Features:
Board is a hosting board
Board is replaceable
Location In Chassis: Default string
Chassis Handle: 0x0003
Type: Motherboard
Contained Object Handles: 0

$ lspci|grep -i vga
03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 [Radeon RX 7900 XT/7900 XTX] (rev c8)
0b:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev a1)

QEMU 7.2.1 monitor - type 'help' for more information
(qemu) qemu-system-x86_64: -device vfio-pci,host=0b:00.0,multifunction=on: vfio 0000:0b:00.0: group 20 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

# find /sys/kernel/iommu_groups/ -type l|grep "/20/"
/sys/kernel/iommu_groups/20/devices/0000:0c:00.0
/sys/kernel/iommu_groups/20/devices/0000:09:00.0
/sys/kernel/iommu_groups/20/devices/0000:06:08.0
/sys/kernel/iommu_groups/20/devices/0000:0a:04.0
/sys/kernel/iommu_groups/20/devices/0000:0b:00.0
/sys/kernel/iommu_groups/20/devices/0000:0a:0c.0
/sys/kernel/iommu_groups/20/devices/0000:0a:00.0
/sys/kernel/iommu_groups/20/devices/0000:0f:00.0
/sys/kernel/iommu_groups/20/devices/0000:0b:00.1
/sys/kernel/iommu_groups/20/devices/0000:0e:00.0
/sys/kernel/iommu_groups/20/devices/0000:0a:08.0
/sys/kernel/iommu_groups/20/devices/0000:0a:0d.0

# for i in `find /sys/kernel/iommu_groups/ -type l|grep "/20/"|sort|cut -d":" -f2-`; do lspci -s  $i; done
06:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43f5 (rev 01)
09:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43f4 (rev 01)
0a:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43f5 (rev 01)
0a:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43f5 (rev 01)
0a:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43f5 (rev 01)
0a:0c.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43f5 (rev 01)
0a:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43f5 (rev 01)
0b:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev a1)
0b:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
0c:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 05)
0e:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43f7 (rev 01)
0f:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43f6 (rev 01)

-Idar