OPS.22 - Interpret Operating Performance and Decide the Response
Type: Method Status: Stable
OPS.22:1 - Problem frame
Use this when an operating result must inform a judgement and response, but a target-attainment ratio or dashboard color cannot explain the contribution. One team may narrowly miss a demanding aim while another exceeds an easy one. A favorable total can conceal deferred work, deteriorating quality or another team’s unpaid effort. An adverse forecast may be treated as evidence of poor performance before its conditions are examined.
Begin with the decision the assessment must support and recover the aim, observations, relevant conditions and participants’ actions. Return a reasoned assessment with the response it warrants, its uncertainty and the person able to act. A conclusion can be mixed: the intended result was not fully obtained, while a timely corrective action was useful and an attribution remains unresolved.
This pattern governs interpretation of operating performance. It does not determine a person’s capability, corporate liability or a pay entitlement from an output total. HCD.11 supplies a capability-assessment contribution; CGOV.13 supplies corporate oversight when that is the actual decision. A sufficient established interpretation can be used directly. An ordinary service-acceptance decision with an applicable clear rule can finish through OPS.18.
The reader needs access to the relevant operating evidence and participants, and enough domain competence to understand the result. Use another qualified contributor for a missing technical or financial judgement; the assessment must not manufacture that competence.
OPS.22:2 - Problem
An observed outcome depends on the work performed, its support, prior conditions and events that participants did not control. A target adds a judgement of ambition; its attainment ratio therefore combines result and target choice. Counting that ratio as performance can reward easy targets, favorable circumstances or transferred burdens.
Replacing a formula with an unexplained managerial impression creates another failure. Participants cannot correct mistakes or understand what contribution matters. The needed interpretation must expose its grounds and uncertainty, including evidence that weakens a favorable account as well as evidence that qualifies a miss.
OPS.22:3 - Forces
| Force | Tension in the work |
|---|---|
| Accountability and uncertainty | An answer is needed while causal attribution may remain incomplete. |
| Ambition and comparability | A demanding aim can motivate useful work, while attainment percentages favor an easier target. |
| Joint work and individual consequences | A result may require several contributors whose shares cannot be inferred from the output count. |
| Timely learning and consequential judgement | Prompt feedback helps correction; reward or formal accountability decisions may need different evidence and authority. |
| Context and favoritism | Circumstances change interpretation; selective excuses or hindsight can make judgement arbitrary. |
| Present results and continuing capability | A short-term gain can consume maintenance, recovery or customer trust needed for later work. |
OPS.22:4 - Solution
OPS.22:4.1 - Name the receiving decision and recover the comparison
Ask what this judgement should change: the next operating action, a resource arrangement, an aim, feedback and development, recognition, or a decision under an existing reward or governing rule. Separate these questions when they need different evidence or powers. A useful learning conversation should not silently create a new compensation decision.
Recover the original aim and comparison from OPS.21 or a sufficient existing basis: intended contribution, population, horizon, difficulty, assumptions and protected conditions. Retain authorized changes with their timing and reasons. If the basis was never settled, say so and reconstruct what can be established from the actual undertaking; do not invent a retrospective promise.
Keep an ambition, forecast, resource authorization and service commitment distinct. Ten deliveries can miss an original ambition of twelve and satisfy ten legitimately revised promises. Both facts matter. The revision does not delete the original ambition or prove that the response was good.
OPS.22:4.2 - Establish what was obtained and what remains
Compare observed results with that basis. Keep unfinished cases, excluded populations, quality, timing and relevant later returns visible. Check whether a changed denominator, early closing or transferred task created the apparent gain. OPS.15 develops a missing operating account; MA.7 explains a monetary difference without deciding personal merit.
Follow the result into its intended use. Were repairs accepted and useful, or merely marked complete? Did a faster handover require the receiving team to redo it? Include a delayed consequence when it can change the assessment. A known current result can support action before every future consequence is observed; state what later evidence could reopen the judgement.
Record the gap plainly. Context can change what the gap implies; it does not change the observed count or discharge an outstanding obligation.
OPS.22:4.3 - Examine conditions, choices and the contribution to the whole
Use the following questions to explain the consequential difference, following the evidence that can change the receiving decision.
- Did the result contribute to the intended aim? Compare the indicator with the recipient’s actual result and the conditions it omitted. A financial gain obtained by postponing required maintenance can weaken an initially favorable assessment.
- How demanding was the aim on its original grounds? Compare the opportunity, starting condition, work mix and proposed way to achieve it. A low attainment percentage against an ambitious target is not directly comparable with a high percentage against an easy one. Ambition alone also earns no credit for ineffective action.
- What changed, favorably or adversely? Recover when the change became knowable, who could respond and which premise it affected. A market windfall needs the same scrutiny as an external disruption. Separate changed circumstances from a claimed causal effect of the team’s intervention.
- What did the participants do with the information and means available then? Examine promised and necessary actions, requests for support, timely warning, available alternatives and actual follow-through. Use what was reasonably available at the time; knowledge obtained later does not prove that an earlier choice was unreasonable.
- What did the result require from other work, and can it continue? Include shared assistance, displacement, quality losses, deferred obligations and consumed protection. Helpful cooperation can reduce one team’s local count while improving the joint result; taking another team’s resource does not create additional capacity.
For a consequential explanation, compare a plausible rival. More completions could follow from a simpler work mix, overtime, transferred work or a better method. Use available evidence to distinguish them far enough for the decision. A modeled counterfactual remains conditional; a plausible story is not a measured contribution. Preserve unresolved attribution instead of assigning every residual to effort or competence.
OPS.22:4.4 - Form a judgement that the affected participants can examine
State the observed result, how it compares with the aim, which contextual findings change interpretation and what remains uncertain. Distinguish at least the findings that lead to different actions. An unmet receiving need calls for a response even when the team acted competently; a favorable outcome does not excuse concealment of a material risk.
Compare teams only at the scope the evidence supports. If different work or shared contributions prevent a ranking, assess each against its meaningful aim and compare specific practices for learning. Do not repair an invalid ranking by inventing weights or a difficulty multiplier. Use an established qualified comparison when one is available.
Give affected participants a real opportunity to correct consequential facts and explain their choices. Resolve a material disagreement against the evidence and agreed purpose, not by counting agreeing voices. Where the assessor’s interest or a disputed ground can change a consequential decision, obtain an appropriately independent competent judgement through the existing arrangement. The result can remain qualified or contested; the person with authority must identify what can be decided on that basis.
A single score may be required by an existing system. Explain the translation and preserve the separate findings that the score cannot carry. Do not let the score silently determine every later development, recognition and reward decision.
OPS.22:4.5 - Choose and enact the response under the actual authority
Use the findings to choose the smallest adequate response. Examples include correcting a report, completing deferred service, retaining a useful action, changing an assignment or provision, revising an irrelevant aim, improving a method, or obtaining a needed capability-development result. Select the method for that change rather than asking people to try harder regardless of the cause.
Where the consequence arrangement is itself producing distorted forecasts or easy targets, identify its operative rule and holder. MA.9 examines the account’s behavioral contribution; OCE.10 develops an authorized change in access, workload, incentives or consequences. An adviser can propose the change without being able to make it effective.
Keep the operating assessment separate from the applicable reward decision. Use its relevant findings under the actual rule and authority; where that rule prevents the intended response, return the required rule change or exception to its competent holder. A favorable operating assessment creates no payment right by itself, and a framework paragraph cannot waive an existing obligation. Capability development likewise needs its own evidence and work through HCD.
For an unwelcome forecast, obtain the authorized operating response while preserving the supported forecast and its earlier basis. Address a demonstrated concealment or unsupported claim on its evidence. Do not punish the numerical decrease alone, or award automatic credit merely for reporting it. Both shortcuts replace judgement with a different indicator.
OPS.22:4.6 - Observe the response and reopen the affected judgement
Name the action, responsible participant and next useful observation. Establish whether the promised assignment, protection or consequence change occurred and whether the receiving work improved. A revised form or policy statement does not establish changed practice.
Keep sound earlier findings when new evidence changes only one part. Later returns can invalidate a quality conclusion; a recovered resource decision can alter attribution; a changed recipient need can reopen the next aim. Use the retained original basis to explain the change. End this assessment when it supports its receiving decision at warranted confidence, leaving any specific dependent question explicit. Continue normal operating attention without requiring an indefinite inquiry into every cause.
OPS.22:5 - Archetypal Grounding
OPS.22:5.1 - Ten repairs after the work becomes harder
In the constructed case continued from OPS.21, all twelve customers eventually accept. One staffed eight-hour block is authorized and made available, giving 44 hours including six hours of setup. Three repairs then require five hours each instead of three. Twelve repairs would need 48 hours; no additional block can arrive before the promised dates. The coordinator reports the changed work promptly and obtains agreement to defer two standard repairs. Ten remaining repairs need 6 + 7 × 3 + 3 × 5 = 42 hours. Later arrangements retain the two deferred cases, their work and financial obligations.
Suppose acceptance evidence confirms all ten repairs and no omitted quality work. The initial assessment is a miss against the twelve-repair ambition, with two identified needs still outstanding. The work became six hours more demanding for the original twelve. The timely warning and agreed response preserved a feasible service arrangement; the revised promises did not retrospectively achieve the original ambition. Whether another response was better depends on the alternatives actually available then.
A second team reports ten standard repairs against a target of eight. Its 125% and the first team’s roughly 83% do not establish a performance ranking. The first team’s ten repairs required 42 hours with setup; the second team’s ten would require 36 under the same setup assumption. These hours explain a relevant difference in demand, not a complete value or effort score. Recover the second team’s original opportunity, means, quality and any assistance before making a consequential comparison.
The manager decides to keep the factual miss and recognize the first team’s supported corrective action in the operating account. Completion of the deferred work remains an action. If a reward policy nevertheless mandates a different consequence, this judgement is an input to that separate authorized decision, not a power to replace it.
OPS.22:5.2 - A favorable count obtained by borrowing protected support
An archive team exceeds its completion target after using a shared specialist for six extra hours. The initial report calls this an efficiency gain. Examination shows unchanged time per comparable request; the extra output came from the specialist’s time, and another team’s two due requests were postponed without its agreement.
The assessment retains the actual completions but rejects the unsupported efficiency claim and includes the displaced service. The resource holder arranges recovery of the affected requests and corrects the rule under which that time was taken. If the same assistance had instead been authorized, displaced no protected commitment and improved the joint result, cooperation could be a positive contribution. The local count alone cannot choose between those conclusions.
OPS.22:6 - Bias-Annotation
Hindsight can make an uncertain past choice appear obvious. Favoritism can make the same circumstance an excuse for one team and evidence against another. Apply the questions to favorable and adverse results, retain the evidence available at the time, and expose consequential disagreements.
Participants with less authority may bear burdens absent from the official account. Obtain their relevant evidence. A discussion is not proof that they could safely disagree or that every causal share is now known.
OPS.22:7 - Conformance Checklist
- The assessment serves an identified decision, with its evidence and authority needs.
- Original aims, forecasts, commitments and later revisions remain distinguishable.
- Observed results include the consequential unfinished work, quality and receiving effects.
- Difficulty, changed conditions and available actions are examined in both favorable and adverse cases.
- Shared contributions and displaced work affect the judgement where they change the whole result.
- Affected participants can correct consequential facts; unsupported attribution and rankings remain qualified.
- The assessment, reward decision and capability inference retain their distinct grounds.
- The response is actually performed and its useful consequence is checked at an appropriate occasion.
OPS.22:8 - Common Anti-Patterns and How to Avoid Them
| Failure | Practical repair |
|---|---|
| Rank teams by actual divided by target | Recover difficulty and comparable work, then qualify or decline the ranking. |
| Treat context as an excuse for every miss | Preserve the miss, test the explanation and examine available action. |
| Credit every gain to the manager | Examine favorable circumstances, shared work and rival explanations. |
| Replace the formula with an unexplained impression | State the evidence, interpretation, uncertainty and consequence. |
| Treat a lower forecast as poor performance | Examine its grounds and the response; retain earlier forecasts for learning. |
| Let a good narrative erase outstanding work | Keep the receiving need and obligations in the next operating action. |
OPS.22:9 - Consequences
The manager can distinguish a useful response under difficult conditions from a favorable number produced by easier work or transferred burden. The result supports an actual next action while preserving accountability for the unmet need. It can also justify retaining an adequate interpretation without additional analysis.
The method requires judgement and access to relevant evidence. It cannot eliminate uncertainty, conflict or deliberate distortion. Use inquiry proportional to the decision; a modest correction need not wait for a complete causal explanation.
OPS.22:10 - Architectural Rationale
The interpretation connects the original purpose, observations, contextual explanation and response because each answers a different question. Keeping only the ratio loses difficulty and joint work; keeping only a contextual narrative loses the actual result. The response remains subject to the powers and conditions of the decision it serves.
Targets and subsequent assessments are independently usable contributions. A team can start here with an adequate target supplied elsewhere, while OPS.21 can finish after constructing a next aim. Shared conditions and selective returns connect them without requiring every operating decision to pass through an annual appraisal cycle.
OPS.22:11 - SoTA-Echoing
Bogsnes, Implementing Beyond Budgeting, second edition (2016), printed pp.182–190, develops interpretation of indicator results through objectives, target difficulty, changed assumptions, responsive action and sustainability, together with the tensions among development and reward uses. Sections 4.2–4.5 adapt that connected historical treatment. The source’s particular rating scale, delivery/behavior weighting and bonus arrangements are not requirements of this method.
The adaptation retains uncertainty about causation and attribution after the event, and makes the affected participant’s evidence and the response authority explicit. The shared source discussion explains why changing budgeting labels alone cannot establish changed use. Reopen the method or its support when repeated use still rewards transferred burdens, hides missed needs or leaves a consequential judgement unexplainable to its recipients.
OPS.22:12 - Relations
OPS.21 constructs aims and comparisons. OPS.15 and MA.7 develop operating and monetary accounts. OPS.13 preserves service obligations; OPS.19 reconciles affected joint work. MA.9 investigates behavioral effects of accounts, while OCE.10 changes the organizational conditions of a response. HCD.11 concerns demonstrated human capability under its own criteria. CGOV.13 supplies a governing response when the question belongs to corporate oversight. None of these results automatically substitutes for the others.