Paper page - MinT: Managed Infrastructure for Training and Serving Millions of LLMs
…Scale Out separates durable policy addressability from CPU/GPU working sets: a tensor-parallel deployment supports 10^6-scale addressable catalogs (measured single-engine sweeps through 100K) and thousand-adapter active waves…