Tracked topic
Large language models are machine learning models trained to predict and generate text and other language-based outputs.
…Embedded LLM Embedded LLM and AMD collaborate through the TokenVisor monetization platform, specifically designed for AMD Instinct™ GPUs within the neocloud ecosystem. Launched at AMD's Advancing AI 2025 conference, TokenVisor enables…
…Evolving from public chat to governed AI systems Most Maincode customers begin with simple chat experiments using public LLM APIs. The trouble comes when they try to plug those into the governed…
…Lamini Using Supermicro GPU Servers with the AMD Instinct™ MI300X, Lamini is able to offer LLM tuning at high speed. Absolute Hosting Read the case study about how Supermicro’s 2U systems…
…Enabling 20B LLMs on AMD Ryzen AI GPT-OSS-20B [1] is a 20B-parameter open-weight language model built for strong instruction following, coding, and general reasoning while remaining practical for…
…Asymmetric 4-bit WOQ allows more aggressive model compression while preserving accuracy, enabling production deployment of quantized LLMs on CPU infrastructure. Dynamic Quantization at Serving Time : The new INT8 dynamic quantization path…
…Engineer and Zachary Streeter, Senior Member of Technical Staff Near-Lossless MXFP4 Compression for Accelerated LLM Serving , by Felix Marty, Senior Software Engineer Demos and Developer Engagement Beyond technical presentations, AMD hosted…
…We achieved up to 10× faster LLM initialization (from ~10s to ~1s) — as measured on Qwen3-4B running on AMD Ryzen™ AI — with zero impact on inference correctness. May 21, 2026 Agent…
…Enhanced Distributed Inference AMD ROCm 7 introduces a robust approach to distributed inference, leveraging the open-source ecosystem, including frameworks like SGLang, vLLM, and llm-d. By embracing an open strategy, ROCm…
…Raspberry Pi systems Flipper Zero devices AI-powered gaming peripherals Game development tools Local LLM setups AMD GPU and hardware prizes AMD technologies have powered generations of gamers, creators, and developers. Through…
…Accelerated AI Outcomes Sustained AI Success Trusted AI Partner The Latest in AI from AMD View All Accelerating LLM Startup on AMD Ryzen AI with Two-Phase Custom Op Initialization In this…