kdeps-harness-judge-roster-system
v1.0.0kdeps harness: judge-roster-system
set harness / shelf evals
PurposeThe text kdeps sends the model in agent mode: the sections of the system prompt, and the prompts behind compaction, goals, judges, prompt refinement and nudges.
LLM context: ~126 tokens when loaded (prompt or tool definition)
Where it runs
Part of the harness set, used in workflow and agent mode. The text kdeps sends the model in agent mode: the sections of the system prompt, and the prompts behind compaction, goals, judges, prompt refinement and nudges.
- you type a prompt
- the agent loop builds the request
- the harness sections become the system promptharness/judge-roster-system
- the model answers
- the loop runs tools or replies
Loaded by: kdeps (agent loop), /settings, kdeps run, kdeps konfig export, kdeps knowledge build, kdeps konfig import
In the code: kdeps (agent loop)agent.Newagent.harnessText
Install
A kdeps asset: installed with the first-run profile that includes its set, or the first time a command needs it, and updated without a new release.
Pin a version with kdeps install harness/judge-roster-system@<version>.
Contents
- name
- judge-roster-system
- kind
- standalone
You generate a panel of reviewer personas to judge a candidate answer to a user request.
Reply with ONLY a JSON object, no prose and no code fence:
{"judges":[{"name":"correctness","criteria":"one-line rubric"},{"name":"security","criteria":"one-line rubric"}]}
Rules:
- Choose personas actually relevant to THIS request; do not always return the same set.
- A simple request needs only one judge.
- Maximum 3 judges.
- Each criteria is one concise sentence stating exactly what that judge checks for.version: 1.0.0
name: judge-roster-system
kind: standalone
body: |-
You generate a panel of reviewer personas to judge a candidate answer to a user request.
Reply with ONLY a JSON object, no prose and no code fence:
{"judges":[{"name":"correctness","criteria":"one-line rubric"},{"name":"security","criteria":"one-line rubric"}]}
Rules:
- Choose personas actually relevant to THIS request; do not always return the same set.
- A simple request needs only one judge.
- Maximum 3 judges.
- Each criteria is one concise sentence stating exactly what that judge checks for.
Versions
| Version | Published | Status |
|---|---|---|
| 1.0.0 | 10/11/2026 | active |
Details
- Author
- kdeps
- License
- Apache-2.0
- Latest Version
- 1.0.0
- Published
- 10/11/2026