HCD.19:6 - Bias-Annotation

An evaluator who knows the intended repair can unintentionally teach it through the task prompt. Preserve the uncued opportunity when that is what the specification needs. If a cue was already supplied, narrow the conclusion rather than reconstruct an imaginary first answer.

Self-reported source use can miss tacit expertise. Inspect the material and test a meaningful condition change; do not treat a reader’s attribution as an isolated causal estimate. A language model’s fluent reconstruction is especially poor evidence of what an inexperienced human could recover.

Whole-route inspection can also inherit the evaluator’s preferred reading order. Judge the actual route and available returns against the declared use. Retain deliberate preparation and useful difficulty when the later instruction resolves them.