Beautiful Local Inference Interface Service
  • Go 57.2%
  • Shell 38%
  • Dockerfile 4.8%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2026-07-16 02:07:08 +00:00
.forgejo/workflows feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
cmd/bliis feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
hack feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
internal feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
.gitignore feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
CHANGELOG.md docs(changelog): update for v0.1.0 [skip ci] 2026-07-16 02:07:08 +00:00
Dockerfile feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
go.mod feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
go.sum feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
LICENSE feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
README.md feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00
VERSION feat: scaffold BLIIS 2026-07-15 17:54:05 -07:00

BLIIS

Beautiful Local Inference Interface Service — the human-facing inference interface for the brooktrails cluster.

BLIIS is the interactive front end for inference. It serves the UI and calls the upstream SLP (Simple LLM Proxy) for OpenAI-compatible inference under the hood. Behind Caddy at inference.brooktrails.org, SLP owns the /v1/* OpenAI API surface and BLIIS owns the rest of the path space.

Status: scaffold. BLIIS stands up its HTTP server, health, and metrics endpoints and serves a placeholder landing page. It cannot yet be experienced — the real UI is still to be built.

Endpoints

Path Purpose
/ Placeholder landing page (identifies BLIIS + version)
/healthz Liveness/readiness check (200 OK)
/metrics Prometheus metrics

Running

go run ./cmd/bliis                 # defaults: listen :8080, SLP upstream http://slp
go run ./cmd/bliis --listen :9000  # override the listen address
go run ./cmd/bliis --config bliis.yaml

Configuration is optional; built-in defaults are used when no --config is given. The config file is YAML:

listen: ":8080"
slp_url: "http://slp"

Layout

  • cmd/bliis — entry point (flags, config load, graceful shutdown)
  • internal/config — configuration loading with defaults
  • internal/server — HTTP server, routes, metrics, and the placeholder page

License

MIT — see LICENSE.