[oi-dev] system configuration for a working bhyve GPU passthrough

[Stephan Althaus]

Hello!


I've created a script to get the relevant system parameters around 
bhyve, to get the corresponding config for each of my tests.

Please let me know if i miss something relevant here!

i call it check_bhyve_config.sh


echo "######### grep -v '#' /etc/ppt_aliases"
grep -v "#" /etc/ppt_aliases | awk NF
echo "######### grep -v '#' /etc/ppt_matches "
grep -v "#" /etc/ppt_matches | awk NF
echo "######### grep -v '#' /etc/mach"
grep -v "#" /etc/mach | awk NF
echo "######### grep -v '#' /platform/i86pc/kernel/drv/rootnex.conf"
grep -v "#" /platform/i86pc/kernel/drv/rootnex.conf | awk NF
echo "######### apic_mode::print | mdb -k"
echo apic_mode::print | mdb -k
echo "######### pptadm list -ao all"
pptadm list -ao all
echo "######### /opt/bhyve-tests/tests/vmm/check_iommu (Openindiana 
package pkg://openindiana.org/system/bhyve/tests 
<http://openindiana.org/system/bhyve/tests>)"
/opt/bhyve-tests/tests/vmm/check_iommu
echo "######### dmesg | grep -iE '(vmm|ppt|APIC|DMAR|IOMMU|mapp)'"
grep -iE '(vmm|ppt|APIC|DMAR|IOMMU|mapp)' /var/adm/messages | tail -n 100



Would you be so kind, and run above script on your machines with a 
working GPU passthrough configuration, i have no clue why i get "error 
43" within my win10 vm. The GPUs are visible as PCI device within 
Windows, but are not usable.  (with FreeBSD 14.2 host-OS this is working 
well on my hardware/BIOS combination with both GPUs AMD RX6400 and MSI 
NVidia GT1030).

Thank you!
Stephan

-------------------------
output on my machine fpr my first test today:

# ./check_bhyve_config.sh
######### grep -v '#' /etc/ppt_aliases
ppt "pci1002,743f"
ppt "pci1002,ab28"
ppt "pci10de,1d01"
ppt "pci10de,fb8"
######### grep -v '#' /etc/ppt_matches
pciex1da2,e458
pciex1002,ab28
pciex10de,1d01
pciex10de,fb8
######### grep -v '#' /etc/mach
pcplusmp
apix
xpv_psm
######### grep -v '#' /platform/i86pc/kernel/drv/rootnex.conf
immu-enable="false";
immu-intrmap-enable="false";
######### apic_mode::print | mdb -k
3 (LOCAL_X2APIC)
######### pptadm list -ao all
DEV        VENDOR DEVICE SUBVENDOR SUBDEVICE REV PATH                   
                     LABEL
/dev/ppt2  10de   1d01   1462      8c98      a1 
/pci at 0,0/pci8086,6f04 at 2/display at 0                 NVIDIA Corporation 
GP108 [GeForce GT 1030]
/dev/ppt3  10de   fb8    1462      8c98      a1 
/pci at 0,0/pci8086,6f04 at 2/pci1462,8c98 at 0,1          NVIDIA Corporation 
GP108 High Definition Audio Controller
/dev/ppt0  1002   743f   1da2      e458      c7 
/pci at ff,0/pci8086,6f08 at 3/pci1002,1478 at 0/pci1002,1479 at 0/display at 0 
Advanced Micro Devices, Inc. [AMD/ATI] Navi 24 [Radeon RX 6400/6500 
XT/6500M]
/dev/ppt1  1002   ab28   1002      ab28      0 
  /pci at ff,0/pci8086,6f08 at 3/pci1002,1478 at 0/pci1002,1479 at 0/pci1002,ab28 at 0,1 
Advanced Micro Devices, Inc. [AMD/ATI] Navi 21/23 HDMI/DP Audio Controller
######### /opt/bhyve-tests/tests/vmm/check_iommu (Openindiana package 
pkg://openindiana.org/system/bhyve/tests)
check_iommu     PASS
######### dmesg | grep -iE '(vmm|ppt|APIC|DMAR|IOMMU|mapp)'
Jun 11 10:10:20 smhost genunix: [ID 936769 kern.info] vmm0 is /pseudo/vmm at 0
Jun 11 10:19:19 smhost pseudo: [ID 129642 kern.info] pseudo-device: 
vmm_drv_test0
Jun 11 10:19:19 smhost genunix: [ID 936769 kern.info] vmm_drv_test0 is 
/pseudo/vmm_drv_test at 0

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://openindiana.org/pipermail/oi-dev/attachments/20250611/3a6140bc/attachment.html>