… Related Nvidia stopped supporting my GPU, so I started self-hosting LLMs with it I self-support my gpu now because Nvidia won't Passing a GPU to LXCs is fairly straightforward Especially compared to PCI passthrough on VMs Compared to configuring GPU passthrough on VMs manually, LXCs have a simple p… …
… However, GPU passthrough single-handedly made my virtualized Windows instance as capable as my daily driver. …
… On top of that, drivers can compensate for a lot. GPU drivers handle far more than just rendering. …
… AMD's reluctance to support older-generation GPUs and the lack of game support right now are major blockers to the broad adoption of its FSR suite. …
… Related Nvidia stopped supporting my GPU, so I started self-hosting LLMs with it I self-support my gpu now because Nvidia won't I went with the Vulkan variant of llama.cpp for this project Getting GPU passthrough working was the easy part Let me make this clear: Ollama is a fantastic local LLM prov… …
… After all, just this year, we've seen a huge release like Crimson Desert completely forgo support for Intel Arc GPUs initially, and even Resident Evil Requiem and Pragmata don't support path tracing on any of the latest AMD cards. …
… It was almost required since our existing playback device of choice didn't support all the formats stored on Plex. I ended up using a GPU, starting with an Nvidia GeForce RTX 1060 and ending up with a T1000 GPU to handle the workload. …
… One quick note, it doesn't support the Game Ready drivers that the RTX 5090 does, but that just means per-game tweaks might not be available for newer games. …
… NVIDIA's proprietary Linux drivers are more predictable, but they're not immune to version-compatibility issues, and passthrough with both cards can be fickle. If your motherboard and CPU don't support IOMMU, you're basically out of luck, and even then, it's not straightforward. …
… On my aged system, I simply ran the ls -l /dev/nvidia command to get the device IDs 195, 235, and 237 for my GPU , pasted the following syntax into the LXC’s config file, and installed the graphics card drivers inside the LXC to configure GPU passthrough, before compiling llama.cpp’s Vulkan variant… …
