brooktrails/pr-reviewer
2
0
Fork 0
Code Issues 1 Pull requests Projects Releases Packages Wiki Activity Actions

fix: stop flagging valid software versions as non-existent #3

Merged
rcsheets merged 1 commit from fix/version-hallucination into main 2026-03-20 16:34:00 +00:00
Conversation 1 Commits 1 Files changed 1 +10
rcsheets commented 2026-03-20 16:33:18 +00:00
Owner
Copy link

LLMs confidently assert that version numbers postdating their training
cutoff don't exist. Added guidance to both prompts: only flag versions
that look like genuine typos or are wildly outside expected ranges.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

LLMs confidently assert that version numbers postdating their training cutoff don't exist. Added guidance to both prompts: only flag versions that look like genuine typos or are wildly outside expected ranges. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
LLMs confidently assert that version numbers postdating their training
cutoff don't exist. Added guidance to both prompts: only flag versions
that look like genuine typos or are wildly outside expected ranges.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
pr-reviewer-bot commented 2026-03-20 16:33:24 +00:00
Collaborator
Copy link

Automated review by pr-reviewer v0.8.0 | Safety Check | anthropic | tracking id r-bd76cf-1b0b7e

Status: ✅ Completed

This change adds helpful guidance to prevent the AI reviewer from incorrectly flagging legitimate software versions that may have been released after its training cutoff. The added text is consistent across both prompts and provides clear examples of what should actually be flagged (genuine typos or wildly incorrect versions).

Verdict: LGTM

*Automated review by [pr-reviewer](https://git.brooktrails.org/brooktrails/pr-reviewer) v0.8.0 | Safety Check | anthropic | tracking id `r-bd76cf-1b0b7e`* **Status:** ✅ Completed --- This change adds helpful guidance to prevent the AI reviewer from incorrectly flagging legitimate software versions that may have been released after its training cutoff. The added text is consistent across both prompts and provides clear examples of what should actually be flagged (genuine typos or wildly incorrect versions). **Verdict: LGTM**
rcsheets deleted branch fix/version-hallucination 2026-03-20 16:34:06 +00:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
brooktrails/pr-reviewer!3
No description provided.