LeslieWylie/review-workflow
A structured multi-panelist review workflow for the DeepSeek Harness: N panelists score in isolated subagents, blind to each other; a chair reconciles disagreement by anchor match then Δ-level adjudication; an independent critic audits the process. Works for design, code, paper or project review.
dsh-review-workflow is a generic multi-panelist review workflow skill for structured reviews such as project, paper, code or design reviews. The README describes a six-step process with six checkpoints (material completeness check, bundle preparation, N-panelist parallel scoring, aggregation, critic review, final decision), where panelists run in isolated subagents blind to each other to prevent bias contamination. Disagreement is resolved in two phases (anchor matching then Δ-level adjudication), an independent critic subagent reviews process compliance and challenges reasoning gaps, and incremental re-review re-evaluates only changed dimensions. Review dimensions, scoring criteria, templates and panelist count are all configurable.
Install
dsh plugin --profile web add "github:LeslieWylie/review-workflow"After installing and restarting, the skill is loaded in a session with load review-workflow. The README notes it was generalised from an internal collaboration-review process with all internal project references removed, and that it requires project-level configuration (rubric, bundle/panelist/aggregation/critic templates, checklist, panelist count, score threshold) supplied by the project.
Compatibility
DeepSeek Harness web profile (installed as a plugin/skill). The README lists the project-level configuration it requires (review dimensions and scoring criteria, material-bundle template, panelist prompt, aggregation template, critic template, completeness checklist, panelist count and pass/fail threshold).
Details
- Repo: LeslieWylie/review-workflow
- Category: Workflow & Automation
- Stars: 2
- Version: git spec github:LeslieWylie/review-workflow; MIT
- Last push: 2026-08-18
- First seen: 2026-08-14
Recent updates
The README documents the six-step/six-checkpoint process, isolated-panelist and critic isolation, the two-phase disagreement resolution, incremental re-review, and the sanitisation from the internal original.
FAQ
- How do I install the review workflow skill?
- Run dsh plugin --profile web add "github:LeslieWylie/review-workflow", restart, then load it in a session with load review-workflow.
- How are the panelists kept independent?
- Per the README each panelist runs in an isolated subagent blind to the others, and a separate critic subagent in isolation reviews process compliance, preventing bias contamination.
- Do I need to configure it?
- Yes. The README says it requires project-level configuration (rubric, templates, checklist, panelist count and score threshold) because the plugin defines only the process skeleton.
Alternatives
ben7am1n/dsh-review-skills · JohnXu22786/adversarial-review · wuxiangru915/dsh-review-loop