Tracked topic
By Authors Jiong Gong, Weiwen Xia Introduction INT8 quantization is one of the key features in PyTorch* for speeding up deep learning inference. By reducing the precision of weights and activations in…
…CPU Dynamic Shapes Inference Path for torch.compile Dynamic shapes is one of the key features in PyTorch 2.0. PyTorch 2.0 assumes everything is static by default. If we recompile…
By Overview This document provides an overview of the prerequisites, release notes, and known issues associated with building PyTorch v2.5 from source with support for Intel® GPUs. All the required software…
…Intel’s PyTorch Contributions at a Glance Intel, actively involved in the PyTorch community, ranks among the top contributors and provides numerous optimizations that enhance performance on Intel architecture. Intel started contributing…
The smile-deep module provides idiomatic Java API for deep learning on the JVM while still reaching CPU, CUDA, and MPS backends by wrapping the PyTorch / LibTorch C++ runtime. It also provides tiktoken BPE tokenizer, LLa…
Show HN: We built an LLM inference engine in pure Python – no PyTorch, no Triton
…Intel Compiler & PyTorch Teams Introduction The performance of PyTorch-based AI applications and scalability across different platforms can greatly benefit from native C++ kernels that they use, taking full advantage of the…
…Building an End-to-End AI Solution using PyTorch* Optimize PyTorch Models using Intel® Extension for PyTorch (IPEX) Quantization PyTorch Training Optimizations with Advanced Matrix Extensions Bfloat16 See all code samples 1
By Benjamin Consolvo AI Engineering Manager, Intel Corporation LinkedIn PyTorch* delivers great CPU performance, and it can be further accelerated with Intel® Extension for PyTorch. I trained an AI image segmentation model…
By 6/11/2024 Previously, we shared how to boost large language models (LLM) with PyTorch* on Intel® Xeon® processors, which provides the best practices for general inference scenarios with publicly available…
Data Science Scale Biology Transformer Models with PyTorch and NVIDIA BioNeMo Recipes Nov 05, 2025 By Kyle Tretina , Youssef Nashed , Neha Tadimeti , Jonathan Mitchell and Peter St John Discuss (0) Discuss (0…
…A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning Published on Jul 22 Submitted by taesiri on Jul 27 #3 Paper of the day NVIDIA Authors: , , , , , , , , , , Abstract A g e n…
