Skip to content

Latest commit

 

History

History
13 lines (10 loc) · 255 Bytes

shard.md

File metadata and controls

13 lines (10 loc) · 255 Bytes
title llm-helper shard
description Split one model across machines (Ray or vLLM multiprocessing)

Usage

llm-helper shard