Skip to content

Latest commit

 

History

History
35 lines (25 loc) · 908 Bytes

serve.md

File metadata and controls

35 lines (25 loc) · 908 Bytes
title llm-helper serve
description Run a web panel for this machine

Serve a control panel: which models are running, whether they are healthy, and what else could be run.

It listens on localhost unless told otherwise. The panel can start, stop and restart models, so every request needs the token printed below -- open the URL it gives you.

The panel drives the native service (systemd or launchd) only. For a recipe container cluster it shows status and logs but leaves run, restart and stop to the command line.

Usage

llm-helper serve [flags]

Options

--listen

Type string
Default 127.0.0.1:8080

address to listen on (use 0.0.0.0:8080 to reach it from another machine)