pythonvllmllminferenceafter-work
vLLM 0.29 after work: Model Runner V2 default
vLLM 0.29.0 (~9 Sep 2026): Model Runner V2 default for all models—CUDA graph memory profiling, batch-sharded sampling (logits mem ~1/TP). MRV1 remains for some ROCm/unsupported features. Deprecated architectures removed; prefer vllm serve. Not transformers-5-17 Hub. Not investment advice.