AWS Neuron 2.30.0 now available with NKI 0.4.0 and 22 new NKI Library kernels - AWS
… The NKI Library adds 3 new core kernels for segmented attention, KV-parallel prefill, and FP8 quantization, as well as 19 experimental kernels covering context parallelism, MXFP8 training, state-space models, and fused optimizers. PyTorch reference implementations are now available for 29 kernels. …