hogofwar@lemmy.world to Selfhosted@lemmy.worldEnglish · 1 year agoIf you had to redo your self hosting setup, what would you do differently this time around?message-squaremessage-square101fedilinkarrow-up1145arrow-down13
arrow-up1142arrow-down1message-squareIf you had to redo your self hosting setup, what would you do differently this time around?hogofwar@lemmy.world to Selfhosted@lemmy.worldEnglish · 1 year agomessage-square101fedilink
minus-squarenotfromhere@lemmy.onelinkfedilinkEnglisharrow-up1·1 year agoDoes that setup allow access to PCIe GPUs for CUDA inference from containers or VMs?
minus-squareoken735@yukistorm.comlinkfedilinkEnglisharrow-up2·1 year agoYes, you can pass through any GPU to containers pretty easily, and if you are starting with a new VM you can also pass through easily there, but if you are trying to use an existing VM you can run into problems.
Does that setup allow access to PCIe GPUs for CUDA inference from containers or VMs?
Yes, you can pass through any GPU to containers pretty easily, and if you are starting with a new VM you can also pass through easily there, but if you are trying to use an existing VM you can run into problems.