Part III - Analyze Claims and Choose Credibility Work

RMP.5 - Analyze and Criticize the Research Claim under Its Method

Type: Research Method Practice practitioner method pattern

RMP.5:1 - Problem Frame

Use this pattern when research material, an analysis or an emerging interpretation is available and someone needs to say what claim it supports and what criticism changes that answer. Begin with the proposed claim and follow one consequential connection from the actual material, through the analysis, to that claim.

A simulation may reproduce its reported output while leaving its relation to field failures untested. A stream team may have many valid downstream readings and still lack the comparison needed to identify their cause. In either case, the first useful answer distinguishes the result actually obtained from the stronger interpretation being proposed.

This Method produces a ClaimCandidate with a CriticismRecord: the bounded answer and the account of the examinations actually made, what they changed and what remains unresolved. These names describe the content needed for criticism and use. An annotated analysis, existing notebook or short qualified answer may carry both; they do not require two new files.

The gain is an answer that can be used, narrowed or challenged now. Reuse an adequate supplied analysis. Enter directly with inherited material when its origin, Method and limits can be recovered for the present question; a fictitious earlier RMP sequence adds nothing.

Use a qualified domain Method directly when the task is routine calculation, qualification or interpretation under supplied criteria. RMP.5 does not supply a missing disciplinary Method, authorize access, choose the receiving action or automatically commission further research. Return a missing source, design premise or criterion precisely. Use RMP.6 when deciding how to address a remaining credibility threat would change the next useful move.

RMP.5:2 - Problem

An analysis output can acquire more meaning than the inquiry supports. An association becomes a cause, repeated readings become independent cases, a theme becomes a prevalence estimate, a surviving document becomes proof that nothing preceded it, or a computed result becomes evidence that a model is adequate for a new use.

Criticism can also become an indiscriminate demand for more work. Every possible limitation is turned into a mandatory analysis; an adequate result must be recomputed; a missing comparison is concealed by a longer account. Neither an exhaustive checklist nor a confident conclusion repairs the material-to-claim relation.

The practitioner needs to preserve that relation while allowing legitimate exploratory, interpretive and source-critical work. The result must expose consequential analytical choices and contrary material without pretending that every Method uses the same assurance convention.

RMP.5:3 - Forces

RMP.5:4 - Solution

State the claim, recover the material and Method it relies on, perform or reuse the relevant analysis, and examine the failure modes that can change the answer. Return the bounded result with the criticism actually performed and its remaining limits.

RMP.5:4.1 - Recover the claim and one consequential connection

State what the answer would assert: about which phenomenon, cases, population, setting, period or corpus; which relation; and under which conditions. Distinguish a description, interpretation, comparison, causal explanation and prediction when their support differs. If the claim is emerging through analysis, say so.

Follow one connection that matters:

Recover only the RMP.3 intentions and RMP.4 trace needed for this examination. A recorded plan supplies intentions; actual conduct requires its own evidence. A retrospective account remains retrospective. An inaccessible source, lost observation or unperformed comparison remains a limit.

If the supplied analysis already answers the same question under matching material, Method, assumptions and use, retain it. Recompute or extend only what a changed premise or a live criticism requires. A new filename or the age of an unchanged analysis is not, by itself, such a premise change.

RMP.5:4.2 - Use the analysis that fits the question

Apply the justified disciplinary Method. Its assumptions and criterion must come from the relevant practice, rather than from the prestige of a technique. The following contrasts help select the examination; they are not a list of procedures that every inquiry must perform.

A descriptive estimate need not manufacture a causal design. A qualitative approach need not borrow statistical representativeness, universal saturation or reliability procedures that it does not justify. Historical criticism does not require recreating a unique past event. A missing domain Method or criterion limits the dependent analysis and returns to its competent supplier.

RMP.5:4.3 - Criticize the consequential inference

Begin with the threat that can change the present answer, then include the other threats on which the declared claim depends. For each consequential examination, establish:

1. which claim or inference could fail;
2. what material, alternative analysis or source comparison can expose that failure;
3. what was actually examined and what was found;
4. how that finding changes the answer, its scope or its uncertainty.

Use real rival explanations and defensible alternative choices. Retain contrary material, meaningful exclusions and the consequences of missing evidence. An unexamined threat is a remaining question, not an established defect. Failure to access the material is not a negative result about the claim.

When an analysis chosen after seeing results reveals an interesting relation, preserve it as such. Explain its relation to the original question and what support it has now. Reclassifying it as a planned test would remove information a critic needs; forbidding all discovery would remove legitimate inquiry.

A sensitivity exercise must identify the relevant choices examined and their effects. Selecting only favorable variants does not establish robustness over the unexamined choices. If a variant changes the target quantity or question, compare the resulting different claims explicitly rather than calling them interchangeable estimates.

RMP.5:4.4 - State the answer the examination supports

Return the strongest answer warranted for the stated use. The result may:

• support the bounded claim to the extent established by the material and Method;
• narrow or qualify the claim because a condition, rival or limitation matters;
• defeat the proposed claim or one of its necessary premises;
• leave the named claim unresolved while preserving what is known.

Make the difference between the requested claim and the returned answer visible. A descriptive result may survive the loss of a causal interpretation. A calculation may survive the rejection of its field-use inference. An unavailable comparison may leave the explanation unresolved without erasing the observations.

Keep support, uncertainty and intended use connected. Where a justified estimate and uncertainty interval are supplied, interpret them under that Method; failure to exclude a null value alone does not establish equivalence, absence of an effect or an effect’s practical importance. Those are further claims with their own criteria.

The answer and the criticism account are the present result. A remaining limitation does not automatically select another study, and a resource limit does not strengthen the evidence.

RMP.5:4.5 - Retain the account needed for criticism and use

Keep the material, consequential choices, examinations, results and limitations recoverable through the existing analysis and trace. Link an adequate notebook, source account or computation rather than duplicate it. For an immediate answer, a short statement with the relevant basis and limitation may be sufficient.

A later reader may need the exact source, analytical choice or reason that changes reliance. Carry that information with the answer or make its source available under the applicable access conditions. If it cannot be recovered, state the resulting limit. Reconstruction can explain a surviving trace; it cannot establish an unrecorded prospective choice or make absent evidence exist.

Preserve confidentiality, rights and participant protection. A permitted critic’s access and a public reader’s access may differ. A redacted summary can communicate a bounded answer without supporting an examination whose decisive material it omits.

RMP.5:4.6 - Finish or return the specific missing premise

The receiving engineering, policy, management, assurance or other practice retains its own action criteria and authority. Research criticism can change its evidential basis; it does not make that decision.

RMP.5:4.7 - What changes in practice

The practitioner can show the connection that warrants the answer, the examination that changed it and the limit that remains. A useful result no longer depends on presenting every observation as confirmation or every limitation as a new project.

RMP.5:5 - Archetypal Grounding

These are constructed teaching cases with stipulated facts. They are not reports of actual studies, records or permissions.

RMP.5:5.1 - The seal model runs, but the field claim is still open

A Pump-P4 analysis uses a model calibrated on accelerated-test observations. The retained code, data and environment reproduce the reported degradation curve. The proposed conclusion is that the model justifies extending the field maintenance interval.

The consequential connection is from the calibrated model output to field degradation. The available account supports the computation under the stated inputs. It contains no qualified comparison showing that the accelerated and field conditions preserve the mechanism relevant to this use. The returned ClaimCandidate therefore reports the reproduced model result and its domain of calculation; the field-relevance claim remains unresolved. The criticism account names the unsupported transfer instead of treating reproducibility as validation.

If an already supplied parameter examination shows that plausible material values reverse the proposed comparison, retain that further sensitivity limit. Re-running the same fixed inputs cannot answer it. RMP.6 can compare useful sensitivity or field-validation work, but the current qualified model answer can finish without buying either. The maintenance authority retains the interval decision.

RMP.5:5.2 - Downstream salinity without the reference reach

The citizen team’s RMP.3 specification required paired reference and downstream readings during a thaw. Its RMP.4 trace shows valid downstream measurements and records that access to the reference reach failed. The thaw period has ended.

Analyze the downstream change under the qualified measurement Method. Keep repeated readings tied to their sites and times. The data can support the bounded downstream pattern; they do not supply the absent paired contrast needed to attribute that pattern to the proposed outfall rather than the live hydrological rivals. A longer methods section cannot restore the contrast.

Return the observed pattern and the unresolved attribution. Later authorized matched observations may justify a useful study of a new period. Their result cannot recreate the lost reference observations from this thaw.

RMP.5:5.3 - A directive date and an earlier practice

A historical claim says that a practice first began after Directive-D and was caused by it. Inspected authenticated records establish the directive’s date, but an earlier workshop series is inaccessible. The current answer establishes the inspected chronology and retains the unresolved earlier-practice possibility. The catalogue’s description is not an examination of the missing records, and the gap is not evidence that the practice was absent.

An authenticated earlier ledger later becomes available and records the practice before the directive. It defeats the chronology in which the practice first began after issuance. It does not, by itself, establish what caused the earlier practice or exclude an effect of the directive on later adoption. The revised answer keeps those different claims separate.

RMP.5:5.4 - A situated theme is not a workforce percentage

A reflexive thematic analysis examines a small set of maintenance-team interviews under an explicit interpretive approach. A proposed theme presents record keeping as a means of blame. The supporting extracts describe defensive documentation, while another account treats the same records as useful protection during shift handover.

Examine how the interpretation was developed and how the researcher’s position shaped that reading. Retain the discordant account and refine the theme so that it expresses the supported tension between blame and practical protection in these accounts. Record the basis of the interpretation in the existing annotated material.

The result supplies neither a percentage of the workforce nor a causal effect of a training programme. If a receiver now asks those questions, the situated interpretation remains useful, but the new claims require their own design and support. Adding a coder-agreement number cannot provide them.

RMP.5:5.5 - Repeated measurements and an uncertain contrast

A constructed experiment has eight independent specimens, each measured three times under a supplied measurement Method. The analysis must retain specimens as the relevant independent units; twenty-four readings are not twenty-four independent specimens.

Suppose the qualified analysis yields a contrast estimate of two scale units with an uncertainty interval from minus one to five. Report the estimate, interval, units, comparison and assumptions. On these stipulated results alone, neither “no effect” nor “a practically sufficient effect” follows. A receiving threshold or an equivalence claim requires its own supplied criterion and interpretation. The useful result is the bounded estimate and what it leaves unresolved.

RMP.5:6 - Bias-Annotation

RMP.5:7 - Conformance Checklist

Apply these assurance questions to the declared claim and Method; they do not prescribe every possible technique.

• The first move identifies a recognizable proposed claim and one consequential connection from actual material to that claim.
• The target, relation, scope and use distinguish the descriptive, interpretive, causal or predictive claim actually made.
• Supplied analysis is reused when its material, Method, assumptions and use remain adequate.
• Consequential choices, planned versus later analysis and actual deviations remain recoverable.
• Units, dependence, missingness, source relations and uncertainty are treated under the applicable Method.
• Contrary material and meaningful analytical alternatives can change the returned answer.
• Missing or inaccessible evidence is distinguished from evidence against the claim.
• The result states its supported, narrowed, defeated or unresolved scope without converting resource limits into stronger support.
• The criticism account describes examinations actually made and retains the limits needed for the receiving use.
• If a premise fails, the practitioner states the specific clarification or correction needed and sends that question to the responsible practice identified in §4.6.
• A remaining credibility threat does not itself commission testing.
• The receiving practice retains its criteria, protection, access and decision authority.

RMP.5:8 - Common Anti-Patterns and How to Avoid Them

RMP.5:9 - Consequences

Research results become more usable because their claims, material and limits remain connected. Criticism can preserve a descriptive or computational result while rejecting an unsupported extension. Adequate existing analysis and concise answers avoid unnecessary recomputation and records.

The cost is professional judgement about the Method and inference. Some desired conclusions remain unresolved, and some material cannot support the examination a receiver wants. Naming that limit protects both the useful result and the later decision; it does not replace missing evidence.

RMP.5:10 - Rationale

Analysis transforms or interprets material; an inference relates that result to a claim. Keeping those relations visible explains why a correct calculation can still support the wrong conclusion and why new criticism can improve an answer without new data.

Methods expose different errors because their questions and material differ. A universal assurance checklist would hide those relations. Conversely, treating every Method as beyond criticism would make the claim immune to examination. Method-appropriate criticism preserves both plurality and the possibility of defeat.

A result can finish at a bounded answer. Further testing becomes useful when its possible result and obtainable arrangement warrant a separate contribution, rather than because a publication must look complete.

RMP.5:11 - SoTA-Echoing

The working question is how to connect research analysis to the claim it warrants while preserving meaningful criticism across unlike Methods.

The 2026 SCORE analytical-robustness study examines defensible reanalyses of the same data in social and behavioural research. It supports making consequential analytical choices and their uncertainty visible; its field, comparisons and tolerances do not supply universal RMP thresholds.

Braun and Clarke’s 2024 RTARG discussion and their author guidance emphasize methodological coherence and the researcher’s interpretive contribution in reflexive thematic analysis. RMP.5 retains that approach-specific contribution rather than importing its conventions into every qualitative Method.

The American Historical Association’s professional standards ground careful source use, inspectable interpretation and engagement with contrary evidence. They support the distinction between an inspected record and an inference about what an incomplete archive does not contain.

The National Academies’ 2019 account remains a terminology anchor for computational reproducibility and new-data replicability. RMP.5 uses the distinction to avoid treating a repeated computation as sufficient support for a different substantive claim.

These sources constrain the relevant Method distinctions; they do not supply a domain’s measurement rule, causal warrant, truth or authority. Reopen the affected analytical claim when a stronger methodological result, changed material or new receiving use changes the criticism that matters.

RMP.5:12 - Relations

• RMP.3: supplies intended operational choices and their question-relative reasons; an unsupported operation returns there.

• RMP.4: supplies recoverable actual material, transformations, loss and access limits; inspectability is distinct from the answer’s adequacy.

• RMP.1 and RMP.2: supply compatible question and design results or receive the specific changed or defeated premise.

• RMP.6: selects a useful response to a remaining claim-relative credibility threat; a new test is conditional on its contribution and arrangement.

• FPF F.1, F.0.1 and A.10: supply a question-relative source cut, needed source-local meanings, and claim-bound evidence use and provenance. A reference alone does not establish the research claim.

• Disciplinary Methods and receiving authorities: supply analytical competence, criteria and lawful access, and retain the later action and protection decisions.

• RMP.7 and RMP.8: the examined claim can supply a compatible corpus synthesis or a broader revision and receiving return. An already sufficient RMP.5 answer retains its direct completion; these uses add no obligatory final stage.

RMP.5:End

RMP.6 - Choose a Credibility Test That Bears on the Research Claim, or Answer without New Testing

Type: Research Method Practice practitioner method pattern

RMP.6:1 - Problem Frame

Use this pattern when a bounded research claim is available and someone needs to decide which credibility examination could change its interpretation or proposed use, and whether to obtain that examination. Enter with the claim, its current basis, proposed use and a specific live threat. A new RMP.5 run or passage through the earlier numbered patterns is not required.

Begin by asking what a possible result would change. A successful rerun can answer whether a computation is reproducible; it cannot by itself answer whether the model represents field degradation. Another interview may deepen an interpretation without estimating its prevalence. The useful comparison depends on the claim and the threat.

The first result is a CredibilityTestDecision: use an adequate existing result, select an additional examination, finish with a qualified answer without new testing, or identify a missing input that prevents this particular selection. The result may fit in the current answer or research account. Selecting a test is distinct from specifying it, performing it and obtaining its result.

The practical gain is relevant credibility work and an honest completion when more testing would add little, cannot be obtained or does not warrant its whole burden. An unsupported claim remains unsupported.

For routine execution of an already qualified engineering, assurance or other domain test under supplied criteria, use that Method. RMP.6 addresses the research claim and its credibility relation. It supplies neither missing domain criteria nor safety, ethics, access, funding or receiving-decision authority.

RMP.6:2 - Problem

“Repeat it,” “validate it” and “triangulate it” can name useful work or an expensive mismatch. The proposed test may target the implementation while the real concern is transfer, use copies of the same source as though they were independent, or reproduce a significance label without stating what agreement means.

Tests also have unlike possible outcomes. Failure to access data is not a discrepant computation. An inconclusive replication is not proof of no effect. A different result may expose a defect, a changed population, an altered Method or an unrecognized condition. A favorable result can support one bounded claim while leaving a stronger claim open.

The practitioner needs to select the examination whose result can matter, preserve what it could establish and assess whether the whole arrangement is obtainable and worthwhile. Otherwise every uncertainty can become a permanent demand for another study.

RMP.6:3 - Forces

RMP.6:4 - Solution

Recover the claim, threat and receiving question. Use sufficient existing examination results first. Compare real candidate contributions, select only useful obtainable work, and keep the decision separate from actual performance and its interpretation.

RMP.6:4.1 - Name what could fail and what would change

State the exact claim and its scope, the analysis or source basis, the proposed use and the uncertainty that remains. Recover the relevant RMP.5 claim and criticism when supplied; use compatible direct inputs otherwise.

Turn a general concern into a discriminating question. For example:

• Is the reported computation obtainable from the identified data and analysis?
• Does a plausible analytical choice change the substantive interpretation?
• Does new corresponding material support the target relation?
• Does the model or measure have support for this intended use?
• Do apparently corroborating accounts have independent evidential contributions?
• Which difference between the original and receiving context can change the relation?

These questions identify possible contributions, not six mandatory tests. Select the question whose answer can alter the current claim or use. A merely imaginable failure does not establish a defect or a reason to commission research.

Identify the Method and criteria that make a result interpretable. If a domain criterion, source relation or admissible comparison is missing and could change the selection, return that precise input. Do not manufacture a success threshold from a preferred outcome.

RMP.6:4.2 - Reuse the examination that already answers

An existing result can answer the present credibility question when its claim, relevant material, Method, criterion, assumptions and scope support the proposed use. Recover those relations and the result’s qualifications. Repeat only the affected examination when a changed premise, execution defect or new use makes it necessary.

A result’s age alone does not invalidate an unchanged premise. Actual expiry of a required calibration, permission or applicable criterion can matter. The relevant owner supplies that condition; RMP.6 does not infer either validity or invalidity from a date label alone.

If the existing basis is sufficient for this question, return the answer and its needed limitation. The current account may already be complete. An unused test catalogue, comparison table or separate justification for not testing is unnecessary.

RMP.6:4.3 - Match the credibility move to the threat

Use a disciplinary variant with its explicit meaning when that changes the examination. The moves are a repertoire, not stages or a maturity scale. Several can be useful together only when their contributions and the relation between their results justify the combination.

A test must bear on the actual threat. Reproducing a simulation cannot replace a missing mechanism comparison. An inter-coder reliability procedure cannot validate a reflexive thematic interpretation merely because both involve interviews. Replicating a unique historical event is not the test of its source chronology; source criticism or corroboration may be.

RMP.6:4.4 - Compare contribution with the whole obtainable burden

Compare only real alternatives, including adequate existing results and no additional testing. One targeted examination can be enough; a fixed count of alternatives or tests adds no assurance.

For each serious candidate, state which possible result could change the answer, what the attainable material and Method can discriminate, what limits would remain, and the whole arrangement needed to obtain and interpret the result. Include:

• access to sources, participants, specimens, data and code;
• qualified personnel, instruments, preparation and computation;
• actual performance, interpretation and any independent return the claim needs;
• participant effort, protection, legitimate restrictions and permissions;
• timing, delay, shared capacity, necessary records and displaced work.

Use the precision the choice needs. Do not invent probabilities, monetary values or a universal credibility score when a qualitative comparison or a supplied bound settles it. The value of research includes a defensible contribution to knowledge, later inquiry and several receiving questions; immediate commercial payoff is not its sole measure.

Test resource combinations when candidates share or compete for capacity. Two examinations that can each require four to six non-overlapping investigator-days do not form an assured ten-day programme while six plus six remains admissible. Choose a useful sufficient subset, obtain a genuinely different arrangement or decline the combined programme. A shorter arrangement still has to warrant its burden.

RMP.6:4.5 - Return the current decision and specify only selected work

Choose the result that the current facts warrant:

These are current answers, not mandatory documents. A material unknown can remain a limitation of a completed no-new-test answer when no acquisition is selected. Use a hold only for the particular selection it actually prevents.

For selected new work, make the proposed comparison executable and interpretable before relying on it. State the target claim, material and design correspondence, relevant Method, criterion or tolerance, possible interpretation-changing differences, obtaining arrangement and useful stop. A new or changed design may need RMP.2; consequential operational choices may need RMP.3. Actual conduct and deviations need an adequate RMP.4 trace.

The selected examination remains prospective. Its specification and permitted arrangement do not establish that it was performed or that it produced a favorable result.

RMP.6:4.6 - Interpret an actual return without changing its kind

When an examination returns, compare what was performed with what the intended claim and criterion require. Retain justified deviations and their effects. Distinguish the following:

For replication, preserve the estimate, uncertainty, design correspondence and stated success criterion. A changed criterion may be defensible, but it must be identified and justified rather than silently substituted after seeing the result. A single discrepancy does not automatically falsify every associated explanation; equally, a favorable repeat does not confer unlimited credibility.

Return a changed or defeated claim to RMP.5, a design premise to RMP.2, an operational mismatch to RMP.3, or a missing trace relation to RMP.4. A materially different research question requires its own qualified frame. If the selected credibility question is answered, return the answer directly; no further research cycle is automatic.

RMP.6:4.7 - When a protective requirement itself is disputed

A record demand, independent check, evidence threshold or participant condition may have contested necessity or proportionality. In that case, separate research about its merits from the authority to change its current force.

Make the merits question concrete: who or what is protected, from which unwanted outcome, under which baseline conditions; what incremental protection the requirement is expected to provide; over which horizon and with what uncertainty; and what burden or displaced protective work it creates. Compare realistic retention, revision, replacement or removal options. A required label is not evidence of marginal protection, and a lower cost is not evidence that the protection is unnecessary.

RMP can examine the causal, measurement or evidence basis of that comparison. The responsible receiving practice retains the value judgement, protection duties and competent amendment decision. A binding condition continues to govern actual conduct until a competent change. Ordinary uncontested inquiry need not create a requirement-review dossier.

RMP.6:4.8 - Preserve a useful answer for its receiver

Return the claim, the selected credibility question and the conclusion that can now be used. Carry the source, limitation or reason that changes the receiving decision. Reuse the existing research account; do not copy an adequate test report into a new certificate.

Where the receiver lacks access to decisive material, distinguish its public answer from an examination available only to a permitted critic. A lost record, inaccessible original or unperformed test cannot be recovered by stronger wording. Keep that limit without erasing the bounded contribution that remains.

RMP.6:5 - Archetypal Grounding

The following cases have constructed premises. They illustrate choices and returns, not performed studies or actual permissions.

RMP.6:5.1 - From a reproduced model to a relevant field comparison

The Pump-P4 model produces the reported accelerated-degradation curve from its identified data and code. RMP.5 has retained that computational result and left field relevance unresolved. The question now is whether another rerun would support a longer maintenance interval.

The live threat concerns the mechanism-to-field relation. The existing reproduction already answers its computational question; repeating it cannot supply the missing field comparison. Return the limited model result. If no worthwhile relevant examination is obtainable, finish with the field-use uncertainty intact.

Suppose an independent qualified field dataset then becomes accessible within the available window and can distinguish the competing degradation mechanisms. Select a use-specific validation or mechanism comparison under the supplied domain criteria. Specify the correspondence with the intended field use and the result that would narrow or defeat that use. The decision selects research; only the later actual comparison supplies its result, and the maintenance authority still chooses the interval.

RMP.6:5.2 - A blocked reproduction is not a contrary result

An analyst receives a published model claim and code, but the data needed to execute its reported analysis are not accessible under the available rights. The analyst cannot obtain the target computation.

The result is an access-limited attempt, not a reproduction with a discrepant output and not evidence that the underlying claim is false. State the unavailable comparison and what the supplied code or description can still support. If a permitted data arrangement later becomes available, assess and perform the actual reproduction under its criterion.

If that later computation returns a different value, preserve the distinction: now there is an observed discrepancy to examine. Check the target, inputs, environment and justified tolerance before deciding which part of the reported claim changes.

RMP.6:5.3 - Historical corroboration and a qualitative receiving change

A directive’s date is established, but whether the practice preceded it remains unresolved because an earlier archive series is inaccessible. Reprinting the directive or locating three copies of the same account supplies no independent earlier chronology. The current answer retains that limitation; no further search is automatically commissioned.

An authenticated earlier ledger becomes accessible and can settle the relevant chronology. Source-critical corroboration is now a useful candidate. Its result may defeat the claim that practice began after the directive without establishing the cause of the earlier change.

In a different inquiry, a receiver asks whether a reflexive thematic account proves that most workers share the theme. The live issue is the new prevalence claim. More coder agreement on the same interviews does not supply its population basis. Preserve the situated interpretation and return the new question for an appropriate design. If the actual concern is instead whether the interpretation suppresses a discordant account, examination of that material under the selected qualitative Method can be the relevant contribution.

RMP.6:5.4 - Two useful examinations and ten days

A research team has ten available investigator-days. Two proposed credibility examinations each need four to six days of non-overlapping effort from that same team. Supplied bounds do not exclude six plus six.

Do not select the pair as an obtainable ten-day programme by separately comparing six plus four and four plus six. Determine whether one examination can answer the current credibility question, whether the arrangement can change, or whether the present answer should retain uncertainty without the pair.

A provider then supplies a qualified shared-preparation arrangement that bounds the combined effort to eight days while preserving both discriminating comparisons. The feasibility answer changes. Reassess the contribution, remaining limits and displaced work before selecting the now obtainable programme; eight days is not itself evidence that the tests are worth doing.

RMP.6:5.5 - Two different merits answers, one authority boundary

A research protocol requires an additional independent check of a consequential record transformation. Its marginal protection is questioned.

In the first constructed case, supplied examination records show that the check catches an otherwise missed transformation error capable of changing a safety-relevant exposure classification. The baseline controls miss that error, and the check fits the available window without displacing more protective work. The evidence supports retaining that protection or an alternative that preserves its function.

In the second case, supplied records show that the proposed check repeats the same source and procedure, adds no demonstrated discrimination of the protected failure, and displaces a different examination that can expose a consequential error. The merits comparison supports revising or replacing the duplicate requirement under those premises.

These are different substantive recommendations. Neither case transfers amendment authority to the researcher. Retain the in-force condition while returning the evidence, uncertainty, burden and protected-function comparison to its competent owner. A favorable resource argument alone never grants a waiver.

RMP.6:6 - Bias-Annotation

RMP.6:7 - Conformance Checklist

Apply these questions to the current credibility decision and any actual return, not to an imagined complete battery of tests.

• Direct entry identifies the bounded claim, current basis, proposed use and live threat.
• The selected question has a possible result that can change the claim or useful next move.
• An adequate existing examination can complete the question without an unused test inventory.
• Reproduction, replication, robustness, validation, corroboration and transfer retain their different comparisons and limits.
• The Method, relevant correspondence and criterion make the selected examination interpretable.
• Real alternatives are compared without a numerical quota or universal credibility score.
• Contribution is compared with complete obtainable burden, shared resources, protection and displaced work.
• A no-new-test answer preserves insufficient evidence or uncertainty where it remains.
• A missing-input return names the dependent selection without commissioning acquisition.
• The test decision, specification, actual performance and returned result remain distinct.
• Agreement, discrepancy, inconclusiveness and inability to attempt or interpret are not conflated.
• A disputed requirement receives a protected-function and burden comparison while current authority remains intact.
• The receiving answer retains its material qualification and the relevant exact return.

RMP.6:8 - Common Anti-Patterns and How to Avoid Them

RMP.6:9 - Consequences

Credibility work becomes a contribution to a stated claim rather than a ritual sequence. Useful existing results can finish the question; newly obtainable comparisons can justify further work. Access failures, discrepancies and uncertainty remain interpretable instead of being converted into blanket verdicts.

The cost is judgement about the comparison, disciplinary criteria and full arrangement. Some tests remain unavailable, and some attractive claims remain unsupported. A qualified completion makes that boundary usable without removing an authority’s legitimate requirement.

RMP.6:10 - Rationale

A credibility test is informative through the relation between its possible result and the claim. That relation explains both why one well-targeted comparison can matter and why a battery of mismatched tests can add little.

Evidence adequacy and acquisition choice are different questions. Preserving both allows a researcher to finish the present allocation honestly while keeping uncertainty visible. Separating prospective decisions from actual results prevents an approved study plan from being mistaken for support.

Protective requirements also make distinct claims about value, causal or measurement effects, practical burden and authority. Examining one does not automatically establish or cancel the others.

RMP.6:11 - SoTA-Echoing

The working question is which examination can improve or revise confidence in a bounded research claim, under what criterion, and at what obtainable burden.

The National Academies’ 2019 synthesis supplies the useful distinction between computational reproduction and new-data replication. It remains an anchor rather than a universal ladder.

The 2026 SCORE accounts refine different questions in social and behavioural research. The reproducibility study distinguishes availability of usable data from computational reproduction. The replicability study makes differing success criteria consequential. The analytical-robustness study examines defensible analytical alternatives. RMP.6 retains those distinctions without importing the studies’ sampled fields, rates or tolerances as universal criteria.

Braun and Clarke’s qualitative guidance and 2024 RTARG account preserve methodological coherence for reflexive thematic analysis. The American Historical Association’s standards retain source integrity and criticism for historical claims. Neither implies that all credibility questions should use the same repetition or agreement procedure.

The 2021 MRC framework supports question-dependent perspectives, context and research’s resource consequences in complex-intervention research. RMP.6 carries that contrast into the local choice without imposing intervention phases on every domain.

These sources do not supply the actual data, domain threshold, empirical result or authority. Reopen the affected comparison when a stronger methodological account, changed source, criterion, obtainable arrangement or receiving use changes what the test could establish.

RMP.6:12 - Relations

• RMP.5: supplies a bounded claim and criticism or receives a claim whose support changed; compatible direct inputs also allow entry.

• RMP.2: selects a new or revised research design when the credibility question requires one. Its no-new-study answer does not imply a selected test or design.

• RMP.3 and RMP.4: supply the consequential operational specification and actual trace needed for a selected examination; neither creates its result in advance.

• RMP.1: qualifies a materially changed research question or supplies an exact ordinary-practice or source return.

• FPF A.10 and A.10.1: govern claim-bound evidence use and revalidation of affected uses when a relied-on source changes. C.11.DUA and A.15.9: govern decision-useful evidence demands and obtaining a bounded result from another practice, including attainable contribution and whole burden. The research-specific comparison remains here.

• Domain and receiving practices: supply Methods, criteria, protection and permissions, and retain the value, action and amendment decisions.

• RMP.7 and RMP.8: an actual credibility result can supply compatible corpus appraisal or exact claim/model revision and evidence return. A selected test alone supplies neither result. An adequate credibility answer can still finish directly.

RMP.6:End