Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
… The website relies on Qwen 3.5 models for benchmarking: Qwen3.5-9B – Required Small device baseline Qwen3.5-27B – Required Mid-range device baseline Qwen3.5-35B-A3B MoE – Optional MoE performance reference Qwen3.5-122B-A10B MoE – Optional Large memory device reference Qwen3.5-397B-A17B MoE – Option… …
… The LLM handles dynamic decisions, and local Lua scripts execute deterministically, even when offline. Quick response time – Devices react to real-time events instead of polling. A local event bus drives Lua rules for sensors and triggers, enabling millisecond-latency response on or offline. …
… Qwen3-VL-2B benchmark and efficient data were also provided. The MaxCAM2 can’t quite match the performance of an AMD 8845HS, but it’s much more efficient. …
… In terms of performance, the developers say decoding speed is mainly limited by memory bandwidth. …
… Both are designed for local AI workloads, and AMD shared a few advantageous benchmark results where they pitted the two platforms against each other for a range of AI models: GLM 7.4 Flash-30B-A3B, GPT-OSS-120B, Qwen 3.5-122B-A10B, and Qwen 3.6-35B-A3B. …
… Results on the ROCK 4D SBC: Llama-3.2-1B at about 13 tok/s, Qwen2.5-1.5B at about 9 tok/s, and MobileNet at about 169 fps. …
… So I restarted to give access to compute on the LAN instead, using 0.0.0.0 for the host: 1 jaufranc @ CNXSOFT - spacemitk3picoitx : ~ / LLM $ llama - server - m Qwen3 - 8B - Q4 K M . gguf - t 8 -- host 0.0.0.0 -- port 8080 Performance is about the same at 4.7 tokens per second; it just consumes few… …
… 5 - 7B - Instruct - int4 - ov -- local - dir ~ / llmmodels / qwen25 - 7b - np ov - npu aey @ IT13 - Max - CNX : ~ $ python - c ' import openvino genai as ov genai pipe = ov genai.LLMPipeline "/home/aey/llmmodels/qwen25-7b-npu", "NPU" result = pipe.generate "What is the capital of Thailand?" , max n… …