Skip to content

fix(vllm): handle removed EngineCoreOutput.num_cached_tokens on vLLM >= 0.20 - #20821

Open
uhmin99 wants to merge 3 commits into
mainfrom
hyunmin.yoo/MLOS-950-vllm-num-cached-tokens
Open

fix(vllm): handle removed EngineCoreOutput.num_cached_tokens on vLLM >= 0.20#20821
uhmin99 wants to merge 3 commits into
mainfrom
hyunmin.yoo/MLOS-950-vllm-num-cached-tokens

Merge branch 'main' into hyunmin.yoo/MLOS-950-vllm-num-cached-tokens

c36bfcc
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar