Library / First Principles Framework (FPF) - Core Conceptual Specification
Jump to passage
In this reading

Link to current text

Published source confirmed at last check

Source changed 2026-10-03 10:39:28 UTC · snapshot created 2026-10-03 10:40:04 UTC · last check 2026-10-03 11:05:10 UTC

E.13:10 - SoTA-Echoing

ClaimSource lineageLocal adoption
A measure used for decision or control can corrupt the process it monitors.Goodhart and Campbell indicator-pressure lines.CurrentProxyUse distinguishes measure, target, incentive, gate, and release argument.
Proxy optimization has distinct failure modes.Manheim/Garrabrant Goodhart variants and later proxy-failure work.WhatGotWorse and protected qualities prevent a single proxy from standing for value.
Measures can replace the strategic construct in decision makers’ minds.Management-accounting surrogation work by Choi, Hecht, Tayler, and later studies.The proxy is never named as the value; the intended value is named first.
Optimizing an imperfect reward or specification can satisfy the formal signal while missing the intended outcome.AI safety specification-gaming and reward-hacking work, including formal reward-hacking analyses and current reasoning-model specification-gaming evaluations.Evaluation values, judge scores, and all-5 posture are treated as proxies that require value-slice and protected-quality checks.
Useful measures should be derived from goals and questions.Goal-Question-Metric and GQM+Strategies measurement alignment.E.13 asks for intended value/objective before proxy and asks which decision or work the proxy affects.
Human values require stakeholder and use-context inquiry, not only formal metrics.Value Sensitive Design and value-oriented design lines.The minimally viable value slice may include user, operator, manager, safety, or affected-stakeholder evidence when those values are live.