Tracked topic
Large language models are machine learning models trained to predict and generate text and other language-based outputs.
…This includes many popular large language models (LLMs) and other generative AI applications. AMD EPYC server CPUs are a great fit for many inference use cases. These include classic machine learning, computer…
…And for good reason - GPUs aren’t going anywhere . Their massive parallel processing power remains the gold standard for heavy-lift workloads like high-throughput LLM inferencing. However, the CPU is no…
…The explosion in generative AI and large language models (LLMs) coupled with the rapid pace of AI application innovation is driving enormous demand for compute resources and requiring solutions that are performant…
…May 27, 2026 LLM-D Serving for AMD Instinct GPUs on OCI LLM-D serving using AMD Instinct™ MI300X GPUs on OCI explores PD disaggregation, Pareto tuning, and SLO-driven LLM inference…
…32GB VRAM for Larger AI Models Optimal VRAM Buffer for Advanced Local AI Meet the memory demands of modern LLMs and text-to-image models on your desktop with AMD Radeon™ AI…
…Check "Developer Mode" and "Start LLM service on login" 4. Click on the "Model Search" Icon represented by a Robot and a Magnifying glass 5. Select "Qwen3.6 35B A3B" on the…
…How AMD Instinct™ MI355X GPUs Achieve Cost-Competitive Distributed Inference Through SGLang with MoRI May 27, 2026 As large-scale LLM inference increasingly relies on multi-node disaggregated serving with wide Expert…
…Article By AMD Silo AI Related Blogs View All Blogs Adapting AIM LLMs For Specific Use Cases Through Fine-Tuning in AMD AI Workbench — ROCm Blogs Learn how to adapt and fine…
…Tok/Sec per $ No NPU AMD Ryzen AI Halo Supports Windows and Linux OS Leadership LLM Tok/Sec per $ 50 TOPS NPU Build, Run, and Deploy Your Way Real Workflows, Ready to…
…Article By Ramine Roane Andy Luo Related Blogs View All Blogs ATOMesh Unlocking AMD Hardware for Scalable LLM Serving ATOMesh is a serving-layer orchestration system that turns AMD GPU clusters into…