Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
… Of course, that's not the only model used, and much smaller models offer somewhat better performance. Qwen 3 30B apparently runs at just under 10 tokens per second, while Qwen Coder 30B delivers a bit closer to 9 tokens per second. …
… It leveraged the super-chip's large pool of unified memory to run a heavy 35-billion-parameter Qwen 3.635B model that was running locally on 60-70GB of memory. …
… Performance doesn't drop off too badly on C1 which a local AI model would utilize most often as the context window grows. …