Sipeed's new K3 RISC-V SBCs can run 30B-parameter LLMs at 10 tokens per second
… SpacemiT, a fabless Chinese semiconductor designer, is the silicon architect, while Sipeed serves as the hardware integrator. The K3 SoC is packaged with 32GB of LPDDR5-6400 memory and 10GbE networking, offering an alternative to proprietary AI hardware for enthusiasts and researchers. …