| title | llm-helper up |
|---|---|
| description | Start serving a profile alongside anything already running |
llm-helper up <profile> [flags]| Type | string |
fixed KV cache size in bytes, e.g. 20G
| Type | string |
fraction of GPU memory this model may use, e.g. 0.4
| Type | bool |
return as soon as the server is started instead of watching the boot
| Type | string |
port to serve on (default: the next free one from PORT)
| Type | duration |
give up waiting after this long (default: wait forever)
| Type | bool |
block until the endpoint is healthy, without streaming logs