Skip to content

Latest commit

 

History

History
13 lines (10 loc) · 248 Bytes

pool.md

File metadata and controls

13 lines (10 loc) · 248 Bytes
title llm-helper pool
description Run a router in front of replicas serving the same model

Usage

llm-helper pool