#vllm

1 post

An hourglass counting down on a desk, sand falling through the narrow neck

Your vLLM Thinking Budget Was Doing Nothing With MTP On

vLLM 0.21.0 shipped Friday with a quiet fix: thinking_token_budget was being silently ignored when MTP speculative decoding was enabled. If you serve reasoning models with spec decode, you have been paying for it.