docs(perf): use idle-card numbers for the GQA attention result #130
Loading…
Reference in a new issue
No description provided.
Delete branch "docs/attn-gqa-clean-numbers"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
#129merged with the original profile, taken while a livegllm serveshared the Blackwell. That server has now exited, so re-measure on the idle card and correct the section:The Granite number also records why the win shrinks with the group factor: at group 4 L2 already served part of the duplicated traffic.
No code changes in this PR. The #129 description was updated with the same clean numbers.
Automated review by pr-reviewer v0.54.0 | Safety Check | Nemotron 3 Nano | tracking id
r-e99cdb-4c779dThis is an AI-generated review and may contain mistakes.
Status: ❌ Failed
Review failed. Tracking id
r-e99cdb-4c779d— see logs for details.Comment
@pr-reviewer-bot retryto try again.