I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built
…For something as simple as “Tell me something cool,” the cluster would struggle to hit 2.20 tokens/second. So, I restarted my Raspberry Pi, and ran the llama-server command once…