Mixture-of-experts models quietly changed what hardware you need for local AI
…VRAM-heavy; the GPU needs to hold the entire model in memory for every input and output. Any worthwhile model on your local machine requires a high-end, expensive graphics card, which…