RMP.5 - Analyze and Criticize the Research Claim under Its Method

Type: Research Method Practice practitioner method pattern

RMP.5:1 - Problem Frame

Use this pattern when research material, an analysis or an emerging interpretation is available and someone needs to say what claim it supports and what criticism changes that answer. Begin with the proposed claim and follow one consequential connection from the actual material, through the analysis, to that claim.

A simulation may reproduce its reported output while leaving its relation to field failures untested. A stream team may have many valid downstream readings and still lack the comparison needed to identify their cause. In either case, the first useful answer distinguishes the result actually obtained from the stronger interpretation being proposed.

This Method produces a ClaimCandidate with a CriticismRecord: the bounded answer and the account of the examinations actually made, what they changed and what remains unresolved. These names describe the content needed for criticism and use. An annotated analysis, existing notebook or short qualified answer may carry both; they do not require two new files.

The gain is an answer that can be used, narrowed or challenged now. Reuse an adequate supplied analysis. Enter directly with inherited material when its origin, Method and limits can be recovered for the present question; a fictitious earlier RMP sequence adds nothing.

Use a qualified domain Method directly when the task is routine calculation, qualification or interpretation under supplied criteria. RMP.5 does not supply a missing disciplinary Method, authorize access, choose the receiving action or automatically commission further research. Return a missing source, design premise or criterion precisely. Use RMP.6 when deciding how to address a remaining credibility threat would change the next useful move.

RMP.5:2 - Problem

An analysis output can acquire more meaning than the inquiry supports. An association becomes a cause, repeated readings become independent cases, a theme becomes a prevalence estimate, a surviving document becomes proof that nothing preceded it, or a computed result becomes evidence that a model is adequate for a new use.

Criticism can also become an indiscriminate demand for more work. Every possible limitation is turned into a mandatory analysis; an adequate result must be recomputed; a missing comparison is concealed by a longer account. Neither an exhaustive checklist nor a confident conclusion repairs the material-to-claim relation.

The practitioner needs to preserve that relation while allowing legitimate exploratory, interpretive and source-critical work. The result must expose consequential analytical choices and contrary material without pretending that every Method uses the same assurance convention.

RMP.5:3 - Forces

Force	Tension
A useful answer	The receiver needs a conclusion, while the strongest requested claim may exceed what the material supports.
Method fit	Familiar analytical tools are accessible, while unlike questions require different forms of criticism.
Discovery and commitment	Looking at material can reveal a better question, while later choices must not be reported as prospective commitments.
Reuse	Existing analysis can answer the question, while a changed input, assumption or use may invalidate part of it.
Contrary material	A coherent account is easier to communicate, while discordant cases and plausible rivals can change its scope.
Inspectability	Another critic needs the consequential reasoning, while indiscriminate recording can obscure it or expose protected material.
Completion	A qualified or unresolved answer can finish the present use, while an obtainable discriminating examination may still be worthwhile.

RMP.5:4 - Solution

State the claim, recover the material and Method it relies on, perform or reuse the relevant analysis, and examine the failure modes that can change the answer. Return the bounded result with the criticism actually performed and its remaining limits.

RMP.5:4.1 - Recover the claim and one consequential connection

State what the answer would assert: about which phenomenon, cases, population, setting, period or corpus; which relation; and under which conditions. Distinguish a description, interpretation, comparison, causal explanation and prediction when their support differs. If the claim is emerging through analysis, say so.

Follow one connection that matters:

Connection	What to recover
Material to observation or source claim	Which records, specimens, encounters, documents or computations are available, what they represent, and their selection, transformation, loss and access limits.
Observation or source to analysis	The applicable Method, units, assumptions, consequential choices and actual deviations; which choices preceded seeing the results.
Analysis to proposed answer	The reasoning that makes the result bear on the exact claim, including the comparison or interpretation and the scope it can support.

Recover only the RMP.3 intentions and RMP.4 trace needed for this examination. A recorded plan supplies intentions; actual conduct requires its own evidence. A retrospective account remains retrospective. An inaccessible source, lost observation or unperformed comparison remains a limit.

If the supplied analysis already answers the same question under matching material, Method, assumptions and use, retain it. Recompute or extend only what a changed premise or a live criticism requires. A new filename or the age of an unchanged analysis is not, by itself, such a premise change.

RMP.5:4.2 - Use the analysis that fits the question

Apply the justified disciplinary Method. Its assumptions and criterion must come from the relevant practice, rather than from the prestige of a technique. The following contrasts help select the examination; they are not a list of procedures that every inquiry must perform.

Research use	Practical analytical move	Criticism that can change the answer
Quantitative or experimental estimate	Recover the target quantity, sampling or assignment unit and comparison. Estimate the relevant magnitude with a justified uncertainty account. Preserve planned choices and consequential alternatives, exclusions and multiple comparisons.	Dependence, missingness, measurement, design assumptions or analytical choices can change magnitude, uncertainty or interpretation. A significance label alone states neither effect size nor causal warrant.
Observational or field account	Relate observations to their sites, periods, selection and measurement conditions. Separate the observed pattern from the proposed explanation.	Confounding, seasonality, selection or an absent comparison can prevent causal attribution even when the observed pattern is clear. Repeated readings of one site do not create independent sites.
Qualitative or reflexive interpretation	Use the selected approach and theoretical commitments to develop and ground the interpretation. Connect it to the material, the researcher’s contribution and relevant discordant or negative cases.	A theme can outrun its extracts, suppress a different account or imply unsupported transfer. Reflexive thematic analysis does not acquire methodological coherence from a coder-agreement score imported from another approach.
Historical or source-critical account	Examine dating, authenticity, provenance, source purpose, relationships among accounts and the sequence of the events claimed.	Copies can share one source; survival and access can explain a silence; a record may establish a date without establishing causation. Inspect contrary chronology and the limits of the archive actually examined.
Computational or model claim	Recover the represented target, derivation or implementation, data and environment, fitted quantities and relevant parameter or structural assumptions. Interpret the output for the stated target.	Correct execution can coexist with an inadequate model-to-world relation. Calibration, implementation verification, sensitivity and use-specific validation answer different questions.
Mixed inquiry	Analyze each component under its own Method and state the relation claimed between the results.	Dependence, different meanings, disagreement or non-comparable targets can limit the combined inference. Do not average away a disagreement that changes what the components jointly support.

A descriptive estimate need not manufacture a causal design. A qualitative approach need not borrow statistical representativeness, universal saturation or reliability procedures that it does not justify. Historical criticism does not require recreating a unique past event. A missing domain Method or criterion limits the dependent analysis and returns to its competent supplier.

RMP.5:4.3 - Criticize the consequential inference

Begin with the threat that can change the present answer, then include the other threats on which the declared claim depends. For each consequential examination, establish:

which claim or inference could fail;
what material, alternative analysis or source comparison can expose that failure;
what was actually examined and what was found;
how that finding changes the answer, its scope or its uncertainty.

Use real rival explanations and defensible alternative choices. Retain contrary material, meaningful exclusions and the consequences of missing evidence. An unexamined threat is a remaining question, not an established defect. Failure to access the material is not a negative result about the claim.

When an analysis chosen after seeing results reveals an interesting relation, preserve it as such. Explain its relation to the original question and what support it has now. Reclassifying it as a planned test would remove information a critic needs; forbidding all discovery would remove legitimate inquiry.

A sensitivity exercise must identify the relevant choices examined and their effects. Selecting only favorable variants does not establish robustness over the unexamined choices. If a variant changes the target quantity or question, compare the resulting different claims explicitly rather than calling them interchangeable estimates.

RMP.5:4.4 - State the answer the examination supports

Return the strongest answer warranted for the stated use. The result may:

support the bounded claim to the extent established by the material and Method;
narrow or qualify the claim because a condition, rival or limitation matters;
defeat the proposed claim or one of its necessary premises;
leave the named claim unresolved while preserving what is known.

Make the difference between the requested claim and the returned answer visible. A descriptive result may survive the loss of a causal interpretation. A calculation may survive the rejection of its field-use inference. An unavailable comparison may leave the explanation unresolved without erasing the observations.

Keep support, uncertainty and intended use connected. Where a justified estimate and uncertainty interval are supplied, interpret them under that Method; failure to exclude a null value alone does not establish equivalence, absence of an effect or an effect’s practical importance. Those are further claims with their own criteria.

The answer and the criticism account are the present result. A remaining limitation does not automatically select another study, and a resource limit does not strengthen the evidence.

RMP.5:4.5 - Retain the account needed for criticism and use

Keep the material, consequential choices, examinations, results and limitations recoverable through the existing analysis and trace. Link an adequate notebook, source account or computation rather than duplicate it. For an immediate answer, a short statement with the relevant basis and limitation may be sufficient.

A later reader may need the exact source, analytical choice or reason that changes reliance. Carry that information with the answer or make its source available under the applicable access conditions. If it cannot be recovered, state the resulting limit. Reconstruction can explain a surviving trace; it cannot establish an unrecorded prospective choice or make absent evidence exist.

Preserve confidentiality, rights and participant protection. A permitted critic’s access and a public reader’s access may differ. A redacted summary can communicate a bounded answer without supporting an examination whose decisive material it omits.

RMP.5:4.6 - Finish or return the specific missing premise

Finding about the present use	Useful continuation
The analysis and its criticism already answer the bounded question	Return that answer and its material qualification.
The research question or proposed receiving use has changed	Recover the changed question with RMP.1 or compatible supplied inputs.
The available contrast or a load-bearing premise defeats the selected design	Return the specific design question to RMP.2. A no-new-study disposition is not a selected design.
The operational choice cannot implement the intended contrast	Return that choice to RMP.3, carrying the design consequence rather than silently changing the question.
The named examination lacks a recoverable material or transformation relation	Use RMP.4 to recover what survives and state the remaining loss or access limit.
A supplied disciplinary Method, criterion or authority result is missing	Return the exact dependent question to its owner.
Deciding how to address a remaining credibility threat could change the useful next move	Use RMP.6 with the bounded claim, basis, use and threat. The threat itself commissions no test.

The receiving engineering, policy, management, assurance or other practice retains its own action criteria and authority. Research criticism can change its evidential basis; it does not make that decision.

RMP.5:4.7 - What changes in practice

The practitioner can show the connection that warrants the answer, the examination that changed it and the limit that remains. A useful result no longer depends on presenting every observation as confirmation or every limitation as a new project.

RMP.5:5 - Archetypal Grounding

These are constructed teaching cases with stipulated facts. They are not reports of actual studies, records or permissions.

RMP.5:5.1 - The seal model runs, but the field claim is still open

A Pump-P4 analysis uses a model calibrated on accelerated-test observations. The retained code, data and environment reproduce the reported degradation curve. The proposed conclusion is that the model justifies extending the field maintenance interval.

The consequential connection is from the calibrated model output to field degradation. The available account supports the computation under the stated inputs. It contains no qualified comparison showing that the accelerated and field conditions preserve the mechanism relevant to this use. The returned ClaimCandidate therefore reports the reproduced model result and its domain of calculation; the field-relevance claim remains unresolved. The criticism account names the unsupported transfer instead of treating reproducibility as validation.

If an already supplied parameter examination shows that plausible material values reverse the proposed comparison, retain that further sensitivity limit. Re-running the same fixed inputs cannot answer it. RMP.6 can compare useful sensitivity or field-validation work, but the current qualified model answer can finish without buying either. The maintenance authority retains the interval decision.

RMP.5:5.2 - Downstream salinity without the reference reach

The citizen team’s RMP.3 specification required paired reference and downstream readings during a thaw. Its RMP.4 trace shows valid downstream measurements and records that access to the reference reach failed. The thaw period has ended.

Analyze the downstream change under the qualified measurement Method. Keep repeated readings tied to their sites and times. The data can support the bounded downstream pattern; they do not supply the absent paired contrast needed to attribute that pattern to the proposed outfall rather than the live hydrological rivals. A longer methods section cannot restore the contrast.

Return the observed pattern and the unresolved attribution. Later authorized matched observations may justify a useful study of a new period. Their result cannot recreate the lost reference observations from this thaw.

RMP.5:5.3 - A directive date and an earlier practice

A historical claim says that a practice first began after Directive-D and was caused by it. Inspected authenticated records establish the directive’s date, but an earlier workshop series is inaccessible. The current answer establishes the inspected chronology and retains the unresolved earlier-practice possibility. The catalogue’s description is not an examination of the missing records, and the gap is not evidence that the practice was absent.

An authenticated earlier ledger later becomes available and records the practice before the directive. It defeats the chronology in which the practice first began after issuance. It does not, by itself, establish what caused the earlier practice or exclude an effect of the directive on later adoption. The revised answer keeps those different claims separate.

RMP.5:5.4 - A situated theme is not a workforce percentage

A reflexive thematic analysis examines a small set of maintenance-team interviews under an explicit interpretive approach. A proposed theme presents record keeping as a means of blame. The supporting extracts describe defensive documentation, while another account treats the same records as useful protection during shift handover.

Examine how the interpretation was developed and how the researcher’s position shaped that reading. Retain the discordant account and refine the theme so that it expresses the supported tension between blame and practical protection in these accounts. Record the basis of the interpretation in the existing annotated material.

The result supplies neither a percentage of the workforce nor a causal effect of a training programme. If a receiver now asks those questions, the situated interpretation remains useful, but the new claims require their own design and support. Adding a coder-agreement number cannot provide them.

RMP.5:5.5 - Repeated measurements and an uncertain contrast

A constructed experiment has eight independent specimens, each measured three times under a supplied measurement Method. The analysis must retain specimens as the relevant independent units; twenty-four readings are not twenty-four independent specimens.

Suppose the qualified analysis yields a contrast estimate of two scale units with an uncertainty interval from minus one to five. Report the estimate, interval, units, comparison and assumptions. On these stipulated results alone, neither “no effect” nor “a practically sufficient effect” follows. A receiving threshold or an equivalence claim requires its own supplied criterion and interpretation. The useful result is the bounded estimate and what it leaves unresolved.

RMP.5:6 - Bias-Annotation

Recurring bias	Effect on the answer	Corrective move
Desired-conclusion bias	Supportive material determines the story while contrary material disappears.	Follow the consequential inference and retain examinations that narrow or defeat it.
Technique prestige	A familiar statistic, code run or interview format is treated as universal assurance.	Recover the selected Method and the claim its result can support.
Retrospective certainty	An exploratory choice is described as though it preceded seeing the material.	Preserve its actual timing and the claim’s resulting qualification.
Record-volume bias	A large archive is mistaken for an inspectable or sufficient basis.	Recover the exact material-to-claim connection and name missing links.
Closure pressure	An unresolved result is promoted into certainty or an automatic new study.	Return the bounded answer and decide further acquisition separately.

RMP.5:7 - Conformance Checklist

Apply these assurance questions to the declared claim and Method; they do not prescribe every possible technique.

The first move identifies a recognizable proposed claim and one consequential connection from actual material to that claim.
The target, relation, scope and use distinguish the descriptive, interpretive, causal or predictive claim actually made.
Supplied analysis is reused when its material, Method, assumptions and use remain adequate.
Consequential choices, planned versus later analysis and actual deviations remain recoverable.
Units, dependence, missingness, source relations and uncertainty are treated under the applicable Method.
Contrary material and meaningful analytical alternatives can change the returned answer.
Missing or inaccessible evidence is distinguished from evidence against the claim.
The result states its supported, narrowed, defeated or unresolved scope without converting resource limits into stronger support.
The criticism account describes examinations actually made and retains the limits needed for the receiving use.
If a premise fails, the practitioner states the specific clarification or correction needed and sends that question to the responsible practice identified in §4.6.
A remaining credibility threat does not itself commission testing.
The receiving practice retains its criteria, protection, access and decision authority.

RMP.5:8 - Common Anti-Patterns and How to Avoid Them

Anti-pattern	Why it fails	Practical correction
“The graph proves the explanation”	A displayed pattern can survive while its causal interpretation fails.	State the actual comparison and the stronger inference it cannot supply.
“More readings give more independent cases”	Repeated measurements can share the same underlying unit and dependence.	Recover the unit and the justified uncertainty model.
“The model reruns, so it is valid in the field”	Execution and model-to-world adequacy are different relations.	Preserve the computational result and examine the proposed use separately.
“The archive is silent, so it did not happen”	Survival, purpose and access can produce silence.	State the examined record set and the inference its absence can support.
“Every qualitative analysis needs coder agreement”	The criterion can contradict the selected qualitative approach.	Use its justified account of interpretation, researcher contribution and criticism.
“A limitation means the analysis failed”	A bounded result may answer the present question honestly.	Return that result and identify any further useful question without inventing work.

RMP.5:9 - Consequences

Research results become more usable because their claims, material and limits remain connected. Criticism can preserve a descriptive or computational result while rejecting an unsupported extension. Adequate existing analysis and concise answers avoid unnecessary recomputation and records.

The cost is professional judgement about the Method and inference. Some desired conclusions remain unresolved, and some material cannot support the examination a receiver wants. Naming that limit protects both the useful result and the later decision; it does not replace missing evidence.

RMP.5:10 - Rationale

Analysis transforms or interprets material; an inference relates that result to a claim. Keeping those relations visible explains why a correct calculation can still support the wrong conclusion and why new criticism can improve an answer without new data.

Methods expose different errors because their questions and material differ. A universal assurance checklist would hide those relations. Conversely, treating every Method as beyond criticism would make the claim immune to examination. Method-appropriate criticism preserves both plurality and the possibility of defeat.

A result can finish at a bounded answer. Further testing becomes useful when its possible result and obtainable arrangement warrant a separate contribution, rather than because a publication must look complete.

RMP.5:11 - SoTA-Echoing

The working question is how to connect research analysis to the claim it warrants while preserving meaningful criticism across unlike Methods.

The 2026 SCORE analytical-robustness study examines defensible reanalyses of the same data in social and behavioural research. It supports making consequential analytical choices and their uncertainty visible; its field, comparisons and tolerances do not supply universal RMP thresholds.

Braun and Clarke’s 2024 RTARG discussion and their author guidance emphasize methodological coherence and the researcher’s interpretive contribution in reflexive thematic analysis. RMP.5 retains that approach-specific contribution rather than importing its conventions into every qualitative Method.

The American Historical Association’s professional standards ground careful source use, inspectable interpretation and engagement with contrary evidence. They support the distinction between an inspected record and an inference about what an incomplete archive does not contain.

The National Academies’ 2019 account remains a terminology anchor for computational reproducibility and new-data replicability. RMP.5 uses the distinction to avoid treating a repeated computation as sufficient support for a different substantive claim.

These sources constrain the relevant Method distinctions; they do not supply a domain’s measurement rule, causal warrant, truth or authority. Reopen the affected analytical claim when a stronger methodological result, changed material or new receiving use changes the criticism that matters.

RMP.5:12 - Relations

RMP.3: supplies intended operational choices and their question-relative reasons; an unsupported operation returns there.
RMP.4: supplies recoverable actual material, transformations, loss and access limits; inspectability is distinct from the answer’s adequacy.
RMP.1 and RMP.2: supply compatible question and design results or receive the specific changed or defeated premise.
RMP.6: selects a useful response to a remaining claim-relative credibility threat; a new test is conditional on its contribution and arrangement.
FPF F.1, F.0.1 and A.10: supply a question-relative source cut, needed source-local meanings, and claim-bound evidence use and provenance. A reference alone does not establish the research claim.
Disciplinary Methods and receiving authorities: supply analytical competence, criteria and lawful access, and retain the later action and protection decisions.
RMP.7 and RMP.8: the examined claim can supply a compatible corpus synthesis or a broader revision and receiving return. An already sufficient RMP.5 answer retains its direct completion; these uses add no obligatory final stage.