feat(coordinator): an A/B/C plan shows each level side by side on the PR's comment #121
No reviewers
Labels
No labels
kind
bug
kind
chore
kind
docs
kind
feature
kind
performance
kind
question
priority
critical
priority
high
priority
low
risk
high
risk
low
risk
medium
status
blocked
status
confirmed
status
duplicate
status
invalid
status
needs-info
status
wontfix
ci: approved
No milestone
No project
No assignees
2 participants
Notifications
Due date
No due date set.
Dependencies
No dependencies set
Reference
MagicBeanDev/Beanstalk!121
Loading…
Reference in a new issue
No description provided.
Delete branch "HumanBean/Beanstalk:feat/abc-tables"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Summary
Longshot #1681 compares a switch's levels 0, 1 and 2 (
RX_VK_TARGET_REUSE_MEMORY, PR side only), but the farm's comment showed one "main → PR" frame-time column (one cell's numbers, whichever came first) and an 18-row table of every cell and target. For a plan that compares one matrix axis's levels (reporter.compared_axis: itspass.comparerules' axis and reference value, else the matrix's one axis with two or more values and its first value):Plans without levels to compare, and plans with several multi-valued axes, are unchanged.
What #1681's comment will show once reports come:
Testing
Tested: the coordinator suite in a python:3.13-alpine container with Postgres 17 on the farm's server: 594 passed, 3 failed (
test_regression.py, failing the same way on main), 1 skipped. Newtest_an_abc_plan_shows_each_level_side_by_side: a 3-level PR-only plan with compare rules gives the per-level table (main once, the reference plain, the others with their change, a target with no report as dashes) and a results table without the frame-time column; the default plan gives none.Still to test: #1681's comment once its reports come.
🤖 Generated with Claude Code
Possibly related, for context:
9e497ddb7823d4905f3eWIP: feat(coordinator): an A/B/C plan shows each level side by side on the PR's commentto feat(coordinator): an A/B/C plan shows each level side by side on the PR's comment