Hwayn-pixel/dsh-touchstone
A touchstone for agent changes: run golden cases against the current config and a candidate, then keep the change only if it measurably helped.
Provides the evaluation half of DSH's self-evolution loop. Where the ecosystem has undo and rollback for a bad change but nothing to measure a change before committing it, this runs your golden cases against both the current configuration and a candidate — an appended or replacing prompt, a preset tweak, a house rule — and prints a per-case scorecard of current versus candidate with the delta. Each case is a prompt plus checks you define, such as requiring a particular word, and candidates are named configurations marked as append or replace. A run closes with one of three verdicts: better, keep it; regressed, revert; or no real difference. Cases, candidates and results are stored locally and edited from the settings page.
Install
dsh plugin --profile desktop add dsh-touchstoneThe README's desktop line; use --profile web for the Web UI. Restart DSH afterwards, then open Settings (on desktop through the account menu or Ctrl+,) and pick the plugin's page in the left column. Fields save on blur, so click elsewhere or press Tab after typing. The settings panel's own labels are Chinese in this release.
Compatibility
The README states it works on DSH 0.1.x on the web profile and on DSH 0.2 in the desktop app. It is deliberately thin: it uses only the public model-streaming seam, never patches the harness and depends on no internal services. It also refuses to overclaim — the score speaks only for the cases you wrote, and the final decision stays with you rather than being automated.
Details
- Repo: Hwayn-pixel/dsh-touchstone
- Category: Agent Capabilities
- Stars: 0
- Version: 0.3.0 (npm)
Alternatives
zzh-newlearner/dsh-postmortem · BOWLUNA/dsh-custom-mode · hy-sde/dsh-graph