The Token-Efficient Path for Long-Context Inference: KV Cache Offload to Flash
…On price, enterprise flash has long sold at a fraction of DRAM’s cost per terabyte, a structural gap that follows from NAND’s multilevel, 3D-stacked cells versus DRAM’s one…