Skip to content

Change release scope of local-rank Rail bypass for dispatch#654

Open
huakainomore wants to merge 1 commit into
deepseek-ai:mainfrom
huakainomore:main
Open

Change release scope of local-rank Rail bypass for dispatch#654
huakainomore wants to merge 1 commit into
deepseek-ai:mainfrom
huakainomore:main

Conversation

@huakainomore

@huakainomore huakainomore commented Jun 1, 2026

Copy link
Copy Markdown
  1. ~30% improvement when ep16 with 12 SMs
  2. 5% improvement when ep16 with 16 SMs

when use less sms or small EP size(like EP 16), this will improve performance.
releated to issue 647

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant