Beautiful Local Inference Interface Service
- Go 57.2%
- Shell 38%
- Dockerfile 4.8%
| Filename | Latest commit message | Latest commit date |
|---|---|---|
| .forgejo/workflows | ||
| cmd/bliis | ||
| hack | ||
| internal | ||
| .gitignore | ||
| CHANGELOG.md | ||
| Dockerfile | ||
| go.mod | ||
| go.sum | ||
| LICENSE | ||
| README.md | ||
| VERSION | ||
BLIIS
Beautiful Local Inference Interface Service — the human-facing inference interface for the brooktrails cluster.
BLIIS is the interactive front end for inference. It serves the UI and calls
the upstream SLP (Simple LLM
Proxy) for OpenAI-compatible inference under the hood. Behind Caddy at
inference.brooktrails.org, SLP owns the /v1/* OpenAI API surface and BLIIS
owns the rest of the path space.
Status: scaffold. BLIIS stands up its HTTP server, health, and metrics endpoints and serves a placeholder landing page. It cannot yet be experienced — the real UI is still to be built.
Endpoints
| Path | Purpose |
|---|---|
/ |
Placeholder landing page (identifies BLIIS + version) |
/healthz |
Liveness/readiness check (200 OK) |
/metrics |
Prometheus metrics |
Running
go run ./cmd/bliis # defaults: listen :8080, SLP upstream http://slp
go run ./cmd/bliis --listen :9000 # override the listen address
go run ./cmd/bliis --config bliis.yaml
Configuration is optional; built-in defaults are used when no --config is
given. The config file is YAML:
listen: ":8080"
slp_url: "http://slp"
Layout
cmd/bliis— entry point (flags, config load, graceful shutdown)internal/config— configuration loading with defaultsinternal/server— HTTP server, routes, metrics, and the placeholder page
License
MIT — see LICENSE.