feat(coordinator): a clearer PR comment, answer first, and an AI summary when a farm run ends #117
No reviewers
Labels
No labels
kind
bug
kind
chore
kind
docs
kind
feature
kind
performance
kind
question
priority
critical
priority
high
priority
low
risk
high
risk
low
risk
medium
status
blocked
status
confirmed
status
duplicate
status
invalid
status
needs-info
status
wontfix
ci: approved
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set
Reference
MagicBeanDev/Beanstalk!117
Loading…
Reference in a new issue
No description provided.
Delete branch "HumanBean/Beanstalk:feat/clearer-comment-summary"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
The farm's PR comment was one long block. On #1574, for example:
RX_VK_ACQUI);This PR puts the answer first and folds the rest, and adds an AI summary once a run has finished.
The comment
folded_bodydrops the whole new title line.The AI summary (
results_summary.py)When: once a round, when every target has finished (pass, fail, couldn't be judged or cancelled, with at least one report). It's claimed in the database before the model is asked (
result_summary_round), so it's asked only once. A new round (@Beanstalkagain) gets a new summary.Which model: the planner's, through a new
farm.summary_llm. It's set only when the app builds that model itself, so tests that pass a fake planner model don't get summaries by accident. If AI planning isn't set up, there's no summary.What it reads: only the farm's own judgement, made small (at most 24 KB):
It never reads a log, a picture or the PR's description, so nothing made from the game leaves.
Safety: the prompt says the JSON is data and never instructions, and the answer must fit a JSON schema. What's shown is cleaned: one paragraph, no @mention, link or HTML, at most 700 characters.
Where it shows:
Storage: migration
0022_result_summaries.sqladdsresult_summary,result_summary_roundandresult_summary_modeltocommitsandruns.Tests
log_tail, shown before the table, cleaned (no link, HTML or live @mention) and on the PR page. Updating the PR again doesn't ask again.finished;clean;writewith good, broken and empty answers.Not done here
ast.parseonly. CI runs pytest.🤖 Generated with Claude Code
WIP: feat(coordinator): a clearer PR comment, answer first, and an AI summary when a farm run endsto feat(coordinator): a clearer PR comment, answer first, and an AI summary when a farm run ends