troubleshooting
Roll back refinement regressions
If /refine introduces worse behavior, identify the refinement ID in the ledger and roll it back to restore the prior harness state. Verify with a focused task, review future diffs before applying them, and remember that refinement can optimize the wrong objective as shown in the Factorio reward-hacking case.
First-party announcement, documentation, release, or installer.
Symptom
Symptom
A recent /refine made the agent worse or introduced a bad habit.
Diagnosis
A small harness edit improved the wrong objective or broke an implicit assumption.
Safe fix
Roll back the refinement ID, inspect the diff, and apply a narrower correction if necessary.
Verification
Verify the fix with a task that previously failed and confirm the old behavior is back.
Rollback
If the bad state reached an external system, undo that side effect separately.
Diagnosis
Symptom
A recent /refine made the agent worse or introduced a bad habit.
Diagnosis
A small harness edit improved the wrong objective or broke an implicit assumption.
Safe fix
Roll back the refinement ID, inspect the diff, and apply a narrower correction if necessary.
Verification
Verify the fix with a task that previously failed and confirm the old behavior is back.
Rollback
If the bad state reached an external system, undo that side effect separately.
Safe fix
Symptom
A recent /refine made the agent worse or introduced a bad habit.
Diagnosis
A small harness edit improved the wrong objective or broke an implicit assumption.
Safe fix
Roll back the refinement ID, inspect the diff, and apply a narrower correction if necessary.
Verification
Verify the fix with a task that previously failed and confirm the old behavior is back.
Rollback
If the bad state reached an external system, undo that side effect separately.
Verification
Symptom
A recent /refine made the agent worse or introduced a bad habit.
Diagnosis
A small harness edit improved the wrong objective or broke an implicit assumption.
Safe fix
Roll back the refinement ID, inspect the diff, and apply a narrower correction if necessary.
Verification
Verify the fix with a task that previously failed and confirm the old behavior is back.
Rollback
If the bad state reached an external system, undo that side effect separately.
Rollback
Symptom
A recent /refine made the agent worse or introduced a bad habit.
Diagnosis
A small harness edit improved the wrong objective or broke an implicit assumption.
Safe fix
Roll back the refinement ID, inspect the diff, and apply a narrower correction if necessary.
Verification
Verify the fix with a task that previously failed and confirm the old behavior is back.
Rollback
If the bad state reached an external system, undo that side effect separately.