Sipeed's new K3 RISC-V SBCs can run 30B-parameter LLMs at 10 tokens per second
…While not as fast as GPU cores, the K3 architecture supports zero-copy, allowing CPU and AI cores to share the same memory space. The dual 32-bit controllers support LPDDR4x-4200…
