YaoleWu/review-workflow

LeslieWylie/review-workflow

面向 DeepSeek Harness 的结构化多评审人评审工作流:N 个评审人在相互隔离、彼此不可见的 subagent 中独立打分;一名 chair 先按锚点匹配、再按 Δ 级别裁决来调和分歧;一名独立的 critic 负责审计整个评审过程。适用于设计、代码、论文或项目评审。

工作流与自动化agentsdeepseek-harnessdsh

dsh-review-workflow · Generic Multi-Panelist Review Workflow

简体中文

What is this

A generic multi-panelist review workflow skill. Generalized from an internal collaboration-review process, suitable for any structured review scenario — project review, paper review, code review, design review, etc.

Core Capabilities

ModuleContent
6-Step Process + 6 CheckpointsMaterial completeness check → Bundle preparation → N-panelist parallel scoring → Aggregation → Critic review → Final decision
N Independent PanelistsPanelists run in isolated subagents, blind to each other, preventing bias contamination
Anchor Consistency CheckTwo-phase disagreement resolution: anchor matching → Δ-level adjudication
Independent Critic ReviewIsolated subagent reviews process compliance, challenges reasoning gaps
Re-review SupportIncremental re-review: only re-evaluate changed dimensions
ConfigurableReview dimensions, scoring criteria, templates, panelist count all configurable

Install

dsh plugin --profile web add "github:LeslieWylie/review-workflow"

After restart, load the skill in any session:

load review-workflow

Required Configuration

This skill requires project-level configuration (in the project's own skill or config files):

ConfigDescriptionExample
rubricReview dimensions and scoring criteria5 dimensions, 5-point scale with anchor descriptions
bundle templateReview material bundle templatebundle.md
panelist promptPanelist prompt templatepanelist-prompt.md
aggregation templateAggregation report templateaggregation.md
critic templateCritic report templatecritic-report.md
checklistMaterial completeness checklistproposal-checklist.md
panelist countNumber of panelists2
score thresholdPass/fail threshold per dimension≥3/5

Design Principles

  • Scenario-agnostic: Only defines the review process skeleton. Specific dimensions, criteria, and templates come from the project
  • Role isolation: Panelists run independently, Critic in isolated session, preventing bias
  • Checkpoint enforcement: Each step has a checkpoint; cannot proceed without passing
  • Auditable: All intermediate artifacts saved to disk, fully traceable

Sanitization Notice

This plugin was generalized from an internal collaboration-review process. All internal project references (specific project names, model names, internal tool paths, etc.) have been removed.

Changelog

See CHANGELOG.md.

License

MIT