Skip to content

Speed up M=4 packed GEMV and multi-row lm_head for NEXTN - #1

Merged
krisclarkdev merged 1 commit into
gptq-page-sizefrom
gptq-decode-speed
Oct 29, 2026
Merged

krisclarkdev merged 1 commit into
gptq-page-sizefrom
gptq-decode-speed

Speed up M=4 packed GEMV and multi-row lm_head for NEXTN decode.

17d0385
Select commit
Loading
Failed to load commit list.

There are no checks for this commit