… To preserve gradient unbiasedness despite using trajectory-conditioned features , we introduce a cross-rollout construction that predicts each rollout's value from an independent rollout's internal states. …
… FA2 vs FA3+sink, with/without rollout correction would make the relative impact clear. Rollout engine: The article mentions both vLLM and SGLang; Figure 4 references SGLang with Triton kernels for the sink forward. …
… StraTA samples a compact strategy from the initial task state, conditions subsequent actions on that strategy, and trains strategy generation and action execution jointly with a hierarchical GRPO-style rollout design, further enhanced by diverse strategy rollout and critical self-judgment . …
… Instead of materializing each policy as a merged full checkpoint , MinT keeps the base model resident and moves exported LoRA adapter revisions through rollout, update, export, evaluation, serving , and rollback, hiding distributed training , serving , scheduling , and data movement behind a servic… …
… Guided and unguided rollouts are then jointly optimized via mixed-policy training , internalizing the exploration gains back into the unguided policy. …