docs: energy metering at inference time #120
Loading…
Reference in a new issue
No description provided.
Delete branch "docs/energy-metering"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Adds
docs/energy-metering.md, a self-contained design document for how gllm measures and bills energy at inference time.It covers:
energy.Meterinterface, the 25 ms sampler and interpolatingTimeline, per-step billing over themodel.Forwardwindow, the single extrapolation estimate, and the batch vs. proportional per-request split.gllm_*_energy_joules_totalvs...._attributed_joules_total, what the gap between them means, and the perfstats energy fields.dlopen, an optional energy call, and device binding by UUID.Options.CPUEnergyslot and the planned privileged RAPL helper.Documentation only; no code changes.
🤖 Generated with Claude Code
Automated review by pr-reviewer v0.54.0 | Safety Check | Nemotron 3 Nano | tracking id
r-c97fc9-55ebacThis is an AI-generated review and may contain mistakes.
Status: ❌ Failed
Review failed. Tracking id
r-c97fc9-55ebac— see logs for details.Comment
@pr-reviewer-bot retryto try again.