Skip to content

fix(vllm): handle removed EngineCoreOutput.num_cached_tokens on vLLM >= 0.20 - #20821

Open
uhmin99 wants to merge 3 commits into
mainfrom
hyunmin.yoo/MLOS-950-vllm-num-cached-tokens
Open

uhmin99 wants to merge 3 commits into
mainfrom
hyunmin.yoo/MLOS-950-vllm-num-cached-tokens

Commits

  1. Commits on Oct 2, 2026

  2. Commits on Oct 6, 2026