Part IV - Synthesize Evidence and Revise the Exact Contribution
RMP.7 - Synthesize a Research Evidence Corpus
Status: Stable
Type: Research Method Practice practitioner method pattern
RMP.7:1 - Problem Frame
Use this pattern to work out what several research reports or interpretations establish together, or what an existing synthesis already answers. State the question and identify the material the answer covers. Reuse a synthesis that answers it under the conditions at issue.
Four reports can cover two independent tests and material about a different outcome. Several histories can repeat one memoir. Studies can also appear to disagree because their questions or settings differ. Identify these relations before treating agreement or disagreement as evidence for the same claim.
The resulting EvidenceSynthesis states what the corpus warrants, how its sources contribute to that answer and which limits matter to criticism or reuse. A short answer citing an existing review may suffice. A new analysis may need a study map, a comparison or a calculation.
Start from the question, synthesis design, operations and record adequate for this use. They may come from RMP.1–RMP.4 or from work already available. When historical or qualitative material warrants refining the question, explain what changed and which evidence and criticism apply to the revised question.
When finding or comparing sources answers the question, use that result. RMP.5 examines an inference from particular material. Use RMP.7 when the question depends on how a corpus was appraised or its contributions combined. If a needed method, source or question is missing, say which conclusion this prevents. When that conclusion is still required, obtain the missing contribution from a suitable source where possible.
RMP.7:2 - Problem
Several accounts can look like independent corroboration even when they draw on one study. A corpus may contain only favorable results. A pooled number can conceal different target quantities, and a common theme can conceal a consequential difference in setting or meaning.
Disagreement or incomplete coverage may still permit a numerical comparison, an interpretation or a precise conclusion about what the corpus cannot establish. If a previous review already answers the question, giving that review a new date adds no evidential support. A newly obtained observation may add support of its own.
Choose the form of the answer from the research question, the relations among the sources and the criticism that affects the conclusion.
RMP.7:3 - Forces
| Force | Tension |
|---|---|
| Joint support | Distinct contributions can strengthen an inference. Several reports of one result can add detail while counting as one study. |
| A concise answer | A synthesis reduces reading effort, but an aggregate can hide a contrast needed to interpret the finding. |
| Different traditions | Quantitative, interpretive and historical inquiries can inform one question, while their transformations and confidence claims differ. |
| Coverage | Relevant omissions can change a finding, while a complete search may exceed what a bounded question needs or what access permits. |
| Reuse and change | An existing synthesis can supply the answer. A change to a source, the question or the intended use can affect the conclusion or its scope. |
| Completion | A qualified answer may settle the corpus question. Commissioning a further inquiry depends on what it could add and what it would cost. |
RMP.7:4 - Solution
Start with the question and the material available. Establish what each distinct contribution supports and how it depends on other sources. Use the synthesis the question and material warrant. Give the answer, the transformations that affect it, its uncertainty and its scope.
RMP.7:4.1 - State the question and test the supplied answer
Specify the subject, the context and period that matter, and the conclusion sought. A mean difference needs a contrast. An account of participants’ experiences, a historical sequence and an explanation each ask for different evidence, even about the same subject.
For a supplied synthesis, check its question, coverage, method, findings and limits against the present use. Return its applicable findings with their source and qualifications. If a different population, changed premise or uncovered question matters to the task, reconsider the affected part or identify the limit.
If further synthesis is needed, establish what met the inclusion criteria, what was sought and obtained, and what was excluded or unavailable. Explain how this affects the answer. A claim of systematic coverage needs evidence of the relevant search and selection. A specified set of documents may be sufficient for a question about that set.
When further work requires a missing contribution, use RMP.1 for a changed question, RMP.2 for the synthesis design, RMP.3 for the operations and RMP.4 for what material was obtained or can be examined. Use adequate available inputs directly.
RMP.7:4.2 - Recover distinct contributions before counting support
Identify reports, the underlying studies and material, the authors’ interpretations and the finding you propose to draw across sources. One report can contain several studies, and one study can generate several reports.
| Source relation | Consequence for synthesis |
|---|---|
| Several reports concern one study | Use details and follow-up information from the reports, and resolve discrepancies where possible. Count this study once when estimating independent study contributions. |
| One report contains several studies | Identify the studies and establish whether their samples, controls or data are independent for the inference in question. |
| Samples, controls, records or data overlap | Account for the overlap in the analysis, group the contributions, or justify selecting among them. Establish independence from the underlying material. |
| Later accounts copy or interpret one earlier source | Identify their shared source and the interpretations each adds. Evidence of copying can establish transmission. Independent corroboration of the reported event needs evidence independent of that source. |
| A source adds context or a different outcome | Use it for the question it answers. Include it in an estimate of the target quantity only when its data support that estimate. |
Preserve contrary findings and disagreements between reports. If dependence remains uncertain, explain which combinations or narrower comparisons it permits and which conclusions it prevents.
RMP.7:4.3 - Appraise support for the proposed findings
Apply the appraisal criteria for the research approach and the finding. Consider limitations within a study, dependence across contributions, which results became available and whether the evidence applies to the question. Explain which findings each condition affects.
For consequential omissions, distinguish material never sought, an eligible result left unreported, a lost record and a source you cannot access. State which conclusion the gap limits. To infer absence of an event, effect or experience, establish how the available evidence bears on that absence.
Additional publications give no independent replication when they rely on the same observations. Appraise the connection between each source and the inference. Material too weak for one conclusion can still provide context or challenge a proposed interpretation.
Use RMP.5 when an individual inference needs reconsideration. RMP.6 can help interpret a credibility examination already performed or decide whether a further examination could improve the synthesis enough to justify its cost. For an empirical test result, establish what the test found.
RMP.7:4.4 - Perform the synthesis the question permits
Use a disciplinary method appropriate to the question. Explain any grouping, transformation, weighting or translation on which the finding depends so a reader can trace the contribution of the sources.
| Question and material | Positive move | What the result may claim |
|---|---|---|
| Compatible quantitative estimates | Establish the target quantity, units, contrast, timing, dependence and uncertainty. Fit the justified statistical model and examine influential assumptions. | An estimate for that target with its warranted uncertainty and scope. A common-effect and a distributional-effect analysis have different assumptions and interpretations. |
| Quantitative findings without a justified common aggregate | Group and tabulate the relevant results and compare what the evidence permits. Identify the missing relation when it prevents a requested aggregate. | A narrower quantitative comparison or the conclusion that the corpus cannot establish the pooled magnitude. Significance counts do not estimate that magnitude. |
| Qualitative or interpretive findings | Compare, translate or develop interpretations under the selected tradition, retaining context, source concepts, disconfirming material and the synthesist’s contribution. | A descriptive synthesis or explicitly developed explanatory construct with its grounding and applicable confidence account. |
| Historical sources and accounts | Examine provenance, dates, purposes, perspectives, dependence, gaps and rival interpretations that bear on the chronology or explanation. | The sequence or explanation the sources warrant, with any consequential alternatives still open. |
| Mixed evidence about one question | If a transformation makes the contributions comparable for this question, justify it. Keep the original values, meanings and context needed to examine what the transformation loses. | An integrated answer within the scope of the justified transformation. |
| Mixed evidence about different aspects | Synthesize the aspects on their own terms. Where the question requires their relation, compare the syntheses or use one finding to guide examination of the other. | An account of how the findings agree, complement one another or diverge, including any unresolved difference. |
Variation among studies can be compatible with a pooled estimate under a justified model. A random-effects model still needs a defensible relationship among the target quantities. A synthesis of effect directions alone does not estimate their magnitude.
For a qualitative synthesis, identify what the participants reported, how the source authors interpreted it and what interpretation the synthesis adds. When GRADE-CERQual fits, assess confidence in each finding from methodological limitations, coherence, adequacy and relevance. The resulting confidence judgement is qualitative and specific to that finding and approach.
If a required method or decisive premise is unavailable, identify the conclusion that this prevents and give any answer the available material supports.
RMP.7:4.5 - Return the useful corpus answer
Give the answer to the corpus question first. Identify the material and method used, source dependencies, transformations, uncertainty, omissions and transfer limits insofar as they affect interpretation.
Use existing notes, analysis output or a concise linked explanation when they suffice. Provide the evidence needed for the intended criticism within the applicable access conditions. If a qualified inspection of restricted material has established a finding, identify what others can conclude from it and what they can inspect for themselves.
Return the adequate existing synthesis, the new finding, a qualified answer, or the reason the requested result cannot be established. Identify a missing input if obtaining it matters to the work. A broader question may remain open. Select further inquiry only when the attainable contribution justifies the effort, cost and delay.
Use RMP.8 when reconciling the answer with a wider claim or model, or when its return to a receiving practice needs further judgement about reliance. Return an adequate corpus answer directly.
RMP.7:5 - Archetypal Grounding
These examples use constructed studies and records.
RMP.7:5.1 - Two compatible tests among four reports
A seal engineer receives four reports. A and A2 describe one randomized accelerated test. A2 provides fuller outcome information. B reports an independent test of the same materials under compatible stress and measurement conditions. C describes in-service replacement decisions under different conditions.
The engineer wants the difference in mean time to a defined laboratory failure between the new seal and its comparator under specified accelerated conditions. Suppose all lifetimes were observed, the study estimates are approximately normal and independent, and a common underlying effect is justified for these conditions. A2 informs the first study estimate. C does not measure this laboratory contrast.
The two estimates are 14 hours for A/A2 (standard error 4 hours) and 8 hours for B (standard error 3 hours). The inverse-variance weights are 1/16 and 1/9. The weighted estimate is 10.16 hours, with a standard error of 2.4 hours and an approximate normal 95% interval from 5.46 to 14.86 hours.
Under the stated assumptions, the new seals have a longer estimated mean time to laboratory failure. Report the two study estimates as well as their combined estimate. Transfer to service and a change in the maintenance interval need separate grounds. C can inform a question about service use. If the common-effect premise fails, reconsider the interpretation of the combined estimate even when the arithmetic holds.
RMP.7:5.2 - A refusal with useful content
Another supplied corpus reports leakage after one hour, failure time under another stress and technicians’ replacement decisions. The requested answer is a common percentage reduction in 500-hour failure risk.
Report the observed leakage, failure time and replacement choices with their contrasts, conditions and uncertainty. The supplied material gives no way to convert them to a common 500-hour failure risk. It supports the individual comparisons, but does not establish the requested percentage or show an absence of effect. This answers the question about what this corpus can establish.
RMP.7:5.3 - Situated participation and a mixed question
A resident group asks what impedes participation in water monitoring. One interview study links distrust to withheld feedback. Another interpretive study relates continued participation to community authority over the question. A survey reports stated reasons within its own sampled group.
For a mixed synthesis addressing this question, preserve the survey counts and denominator, the interview contexts and the authors’ interpretations. The synthesist proposes that control over the question and the information returned may both matter. The account supplies no population prevalence for that explanation. Continued participation in one case despite withheld feedback qualifies the proposed connection.
To estimate the intervention’s effect on water quality, use studies that measure that effect. If the question also concerns how participation relates to water quality, synthesize each kind of evidence appropriately and examine the connection.
RMP.7:5.4 - Shared memoir and contrary chronology
Several histories attribute a factory’s decision to close to a public protest. They cite one retrospective memoir. An authenticated record dates the decision before the protest.
The histories share a source, though their interpretations may differ. The dated record rules out the later protest as the cause of the earlier decision. The decision’s cause and the protest’s possible effect on implementation remain open. The historian can finish the chronology without counting the histories as independent corroboration.
RMP.7:6 - Bias-Annotation
In the seal example the target quantities are compatible, independence is established and the common-effect premise is supplied. Other corpora may require domain expertise, further source recovery or a narrower answer. Historical chronology and accounts of participation illustrate different appraisal criteria.
Publication and access can favor certain institutions, languages and surviving sources. Interpret the coverage and silences of a corpus in that setting. Reuse a convenient synthesis to the extent that its question and qualifications apply.
RMP.7:7 - Conformance Checklist
When examining a synthesis, check the following.
- Can the reader identify the question and determine what the existing work already answers or leaves open?
- Can the reader distinguish reports, underlying studies and material, source interpretations and synthesis findings, and identify dependence that affects the answer?
- Do inclusion criteria, exclusions, omissions and access conditions justify the stated scope of the corpus?
- Are the method and interpretation of each consequential transformation appropriate to the question it serves?
- Does each affected finding account for contrary evidence, uncertainty and limits on transfer?
- Does the answer give what the available material establishes, including a specific limit when it cannot support the requested finding? Is any proposed further work distinguished from evidence already obtained?
Use the evidence for the findings and source relationships to judge whether the synthesis answers its question.
RMP.7:8 - Common Anti-Patterns and How to Avoid Them
| Failure | What changes in practice |
|---|---|
| Reports are counted as independent studies. | Identify the underlying material, account for dependence and retain any supplementary information. |
| Numerical results are pooled without a common target. | Establish their targets and any justified transformation. Give the narrower comparison or the specific limit if a common magnitude cannot be estimated. |
| Agreement is judged by counting significant results. | Compare the relevant estimates or other findings under a justified method, including uncertainty and missing evidence. |
| A theme is reported as a population percentage. | Preserve its interpretive basis. A prevalence estimate needs appropriate sampling and measurement. |
| A single confidence label is applied to every finding. | Appraise each finding under criteria suited to the research approach and the question. |
| Disagreement leads the reviewer to discard the corpus. | Give the distinctions the sources support or explain precisely which conclusion they cannot establish and why. |
RMP.7:9 - Consequences
The resulting answer preserves the differences between sources that matter to the question. Compatible findings may strengthen an estimate. A dependent report may add follow-up detail, and a result about another outcome may help explain the scope of the comparison.
Appraisal and transformations take work. Reusing adequate earlier syntheses and documenting the decisions that affect interpretation can reduce that cost. The strength of the evidence still depends on what the sources establish.
RMP.7:10 - Rationale
A synthesis draws an inference about how several contributions relate. Its design and criticism must support that inference. Use an established individual finding directly when it answers the question. Use RMP.5 when the inference from particular material still needs examination.
A finding that the requested conclusion is unsupported can settle the inquiry when it identifies the missing relation and shows what, if anything, the material does establish.
RMP.7:11 - SoTA-Echoing
What counts as independent support? Cochrane chapter 5 explains how to identify several reports of one study and combine the information they contribute. Counting repeat reports as additional studies inflates the number of independent studies. One report can also describe several studies. Discarding all repeated reports can lose follow-up observations. Section 4.2 preserves A2’s fuller outcomes in §5.1 and counts A/A2 as one study. Recover underlying relationships where they could change an inference. New evidence of overlap, provenance or additional outcomes can change it.
Which numerical answer can this corpus support? Cochrane chapter 10 guides combination for a defined quantity under an appropriate dependence model. chapter 12 describes synthesis without meta-analysis. Sections 4.4 and 5.1–5.2 use the target and model to distinguish a justified combined estimate from a narrower comparison. Pooling all numerical results assumes they measure compatible quantities. Refusing every heterogeneous comparison would discard some useful estimates. Choosing groups and models takes judgement. Reconsider those choices if the target, dependence or a defensible alternative model changes. These chapters address intervention reviews.
How should missing contributions affect a finding? Cochrane chapter 13 examines missing evidence in a synthesis and its potential effect on a finding. Its meta-analysis tools have that scope. Sections 4.1 and 4.3 distinguish material unavailable, unreported, never sought or lost. Assuming completeness can conceal selective reporting. Rejecting every incomplete corpus would also discard answers supported within a narrower scope. Reconsider the affected finding when new material, a selective omission or evidence of its effect becomes known.
How can situated and mixed findings be related? For a review of intervention effectiveness, Harden and colleagues (2018) recommend synthesizing qualitative and quantitative evidence separately before integration. The archived Cochrane Handbook v6.0, §21.13 gives that recommendation in its original setting. In Sutcliffe and colleagues, Cochrane–Campbell Handbook, chapter 14 (February 2024 draft), the authors describe transformation for a shared question, comparison of separate syntheses and using one synthesis to guide another. JBI §8.3 distinguishes an integrated approach for evidence that answers the same question from separate syntheses of different aspects. Sections 4.4 and 5.3 use the question to choose among these operations, preserve context and show what a transformation loses. GRADE-CERQual assesses confidence in individual qualitative findings. Reconsider the choice if the question, research approach or evidence about those losses changes.
What can agreement between historical accounts establish? The AHA professional standards address the integrity and interpretation of source evidence. Sections 4.2–4.4 and 5.4 examine dependence, dates, purpose, contrary material and rival explanations. Counting the histories is quick, but they repeat one memoir. Source criticism establishes the chronology the dated decision record supports. It leaves the cause open. Reconsider that inference if new provenance, dating or a rival explanation affects its grounds.
These sources offer different ways to synthesize evidence. Choose the method appropriate to the research question and the relationships among the sources.
RMP.7:12 - Relations
RMP.10 can distinguish candidate accounts of how a practice was performed when evidence supports different variants. RMP.11 compares explanations of an identified method’s history. The synthesis can establish how their sources contribute or depend on one another. Assess the explanations against the evidence that distinguishes them.
- RMP.1–RMP.4 can supply the question, design, operations and record of actual work. Use existing inputs that answer those questions. Revisit a missing or changed premise when it limits the required synthesis.
- RMP.5 examines individual source claims, including one that needs revision. RMP.6 can interpret an existing credibility test or help decide whether another is worth obtaining.
- Use RMP.8 when a wider claim or model needs reconsideration, or when a receiving practice needs a judgement about reliance. Return an adequate answer about this corpus directly.
- FPF F.1, F.0.1 and A.10, with a qualified F.0.2 contribution where applicable, help find, select and compare sources and establish how evidence bears on a claim. For a research synthesis, also establish what the contributions warrant together.
- Use the relevant domain, access or receiving-practice method for a disciplinary criterion, permission or decision when it is needed. Use RMP.9 and the applicable FPF methods when the question is how to improve a research Method.
RMP.7:End
RMP.8 - Use Research Results to Retain or Revise an Episteme’s Claims and Return Bounded Evidence
Type: Research Method Practice practitioner method pattern Status: Stable
RMP.8:1 - Problem Frame
Use this pattern to determine whether research results support, qualify or change a claim in a wider account, or to return evidence with the conditions its recipient needs. Identify the claim, model assumption or explanatory relation at issue and the finding that bears on it.
A synthesis can support a laboratory seal comparison while leaving its application to field conditions open. An archival record can rule out a proposed cause of a decision without establishing the cause or what happened during implementation. Match the earlier assertion and the supplied result to the subject, conditions and question of use.
The EpistemeChangeAndEvidenceReturn identifies what the account can now assert, its grounds and limits, and what the receiving work needs from it. A corrected sentence and a source reference may suffice. A model with dependent outputs or an assertion already used elsewhere may require a fuller correction.
An episteme here is a knowledge account such as a model, interpretation or pattern about a Method. Identify the particular claim in that account and what it means for the use at issue. A document’s name or publication status does not identify a change to its asserted content.
Use a compatible analysis, credibility result or synthesis already available. An answer from RMP.5, RMP.6 or RMP.7 may finish its task. Use RMP.8 when the result bears on a wider account or someone’s reliance needs examination. When a practical decision is required, establish its criteria and who has authority. The researcher can also be the decision-maker if they hold that authority.
RMP.8:2 - Problem
A limited research finding can acquire an unsupported recommendation as it circulates. Criticism of one assumption can be read as rejection of the model, and a corrected decision date can be mistaken for a new account of the event’s cause. Someone using the earlier claim may also miss a correction made in the source.
An unresolved question can lead to an unnecessary new investigation even when a qualified answer already suffices. A proposal reports what a future examination could establish. Present credibility depends on the evidence available, even when no further inquiry is feasible.
Identify which assertion the evidence supports, carry the conclusion through the dependent parts of the account and return the limits relevant to its use.
RMP.8:3 - Forces
| Force | Tension |
|---|---|
| Correcting the same claim | A short conclusion can suffice. A difference in subject, context or time can change what the evidence establishes. |
| Coherent models | A failed premise can affect several outputs, while unaffected claims should remain usable. |
| Receiving use | Evidence can change a practical choice, while the choice also depends on values, constraints and authority outside the research result. |
| Recoverability | A critic or earlier user may need both the earlier statement and its correction. A local draft edit may require only a source reference. |
| Disclosure | A recipient needs enough basis to judge reliance, while source rights, confidentiality and community authority constrain access. |
| Presentation and content | A familiar form may help a particular reader. It can also hide a missing problem, rationale, operation or condition of use. |
| Further inquiry | An open question may be worth investigating. The current answer can still suffice, or access and resources may place the investigation out of reach. |
RMP.8:4 - Solution
Match the result to the assertion it bears on. Establish what should be retained, added or changed, follow its implications through the account and return the answer with the grounds, uncertainty and limits the receiving question requires.
RMP.8:4.1 - Locate the assertion and its receiving question
Identify the earlier statement or model relation, including its subject, comparison, conditions and time. Specify the supplied result, the examination that supports it and the part of the account it addresses.
Check whether the result bears on the same assertion. A factory’s decision to close and the subsequent closure are different events. A laboratory rate may refer to different conditions from a field rate. A finding about another population can extend an account without contradicting the original claim.
When developing a new account, identify the contribution and the material it would add to or qualify. If there is no earlier assertion to correct, treat the contribution as an addition.
Establish what the recipient needs to understand or do when it affects the explanation or evidence required. A scientific explanation or a reusable finding can answer the question, as can evidence for an engineering, public or personal decision.
If the source, its relation to the subject or the examination result is missing, say what conclusion this prevents. A plan can establish which test or synthesis was selected. A claim about its outcome needs evidence of what happened.
RMP.8:4.2 - State the warranted retention or change
State the contribution at the strength and scope its grounds warrant. Identify a stronger inference if a recipient could reasonably draw it from the wording or intended use.
| Warranted disposition | What to state |
|---|---|
| Retain | State why the assertion still holds under the conditions examined. Identify the basis and limits of that judgement. |
| Narrow | Restrict the population, context, time, relation or transfer to what the result supports, preserving the supported part. |
| Qualify | Keep the assertion and state the uncertainty, alternative explanation or condition of use that matters to it. |
| Reject | Remove the defeated claim or inference and explain what defeated it. Assess a proposed replacement from its own grounds. |
| Add | State the new contribution and its relation to the existing account, including whether it is supported information, an interpretation or a hypothesis for further inquiry. |
One model may need different conclusions about its premises and outputs. Give the grounds for each. To raise confidence, identify what adds support. Repetition of the assertion, a later document date or inability to inspect criticism adds none by itself.
Describe uncertainty under the method that produced the result. Give the quantity and assumptions for a numerical interval and the basis of a qualitative confidence judgement. Identify whether the open step is attribution, extrapolation, prevalence or another inference.
A result compatible with zero and nonzero effects can leave the effect unresolved. To establish equivalence, use the applicable margin and comparison rule. Limited access shows what could be examined. An inference from a missing record to the underlying event needs further grounds.
RMP.8:4.3 - Reconcile the affected account
Trace the premise to the conclusions and outputs that use it. Identify those that retain their support, those that change and any newly required relation.
In a model, distinguish the target, structure, parameter, assumption, calculation and interpretation when their grounds differ. An arithmetically correct output may rely on a failed transfer assumption for its field interpretation. The same parameter can remain useful within its calibration conditions.
If a conclusion’s warranted content or stated grounds change, revise the conclusion itself and correct any dependent outputs affected by that change. Preserve access to the earlier wording when a citation, correction or existing use requires it. An unused draft can often be edited in place with a source reference.
A replacement explanation needs grounds of its own. If the evidence rules out only the earlier explanation, retain the alternatives still possible. Use RMP.1 or RMP.2 when an unresolved question or design choice warrants further research.
Use existing records and source links when they let the intended reader examine the reasoning.
RMP.8:4.4 - Return evidence to the actual use
Give the answer to the receiving question first. For a change or retention, identify the earlier assertion it concerns. Cite the source or examination that supports the answer, with the conditions, uncertainty, dependence or access limits that affect reliance.
When a materially changed assertion was used elsewhere, provide the correction to any known affected use through its authorized route. Use FPF A.10.1 when affected uses need to be discovered or several known uses need revalidation together. A list of citations can locate possible uses. Establish which relied on the changed assertion.
The responsible editor, maintainer or practitioner can apply a correction to the account or decision they control. A correction that others rely on may also require notifying them. If communication or access is unavailable, identify the return still outstanding and what would enable it. The supported local correction can stand.
Observe applicable source rights, confidentiality, participant protection and community authority. Disclose only what the receiving question needs and permits. A qualified redacted account can convey a finding. If it lacks material needed for a particular inspection, say what cannot be checked. A reader’s own inspection requires their own access.
When a practical choice is required, the receiving practitioner weighs alternatives, values and constraints under the applicable authority. The research result supplies the evidential premise within its scope.
RMP.8:4.4.1 - Make a research Method contribution recoverable across publication forms
Use this branch when a publication presents a Method someone needs to understand, repeat, adapt or combine with other work. Identify the contribution and the intended use before choosing a publication form.
A practitioner pattern explains a Method and its use. It identifies a recurring problem, the conditions and competing demands that matter, the way of acting and its grounds, worked applications, limits, consequences and relations. Its SoTA comparison examines what the best available approaches and serious alternatives change in the Method. These elements give the operations their rationale and scope. If claiming that a particular episteme is a U.MethodDescription, establish under A.3.2 that it describes an admitted Method.
Choose a section structure, language, notation, reading order, medium and publication arrangement that give the reader access to that content. A translation or a change in file layout may preserve the contribution. Omitting a constraint that changes the choice of solution alters it. A short entry can direct readers to a developed explanation if that explanation is available.
An article may present several connected claims and Methods with their construction, evidence and limits. Its contributions may warrant one pattern, several related patterns, a change to an existing language or a different knowledge product. A pattern language connects recurring problems and ways to resolve them. A DPF serves a field of practice with a defined scope and maintenance boundary. Use E.4.DPF when deciding which framework contribution the material warrants.
Explain how to recognize another instance of the problem, the conditions that matter, which actions recur, what can vary, and the preparation, support and result required. Another qualified application can reproduce the intended effect while yielding a different object or number. Recomputing a reported number establishes that computation. Applying the Method to a new case tests a different claim. Correct recognition that the Method does not apply can answer a boundary question. Claiming its positive effect requires a case where that effect occurred.
For a reader to use the published Method, establish the following connections as the task requires.
- Explain how the Method works. Identify the recurring problem, situation, objects and relations, the competing demands and how the way of acting addresses them. A construction may combine, adapt or reinterpret existing Methods. Show the sequence, alternatives, feedback and returns where they matter. For work performed together, show how its constituent actions realize the encompassing Method. E.4.CM helps establish compatible contributions and construct the connections a list of source methods leaves open.
- Specify the intended repetition. Distinguish reconstructing a derivation, rerunning a computation on the same inputs, making new measurements and applying a Method under changed conditions. State what remains comparable, what changes, the result to compare and the criterion for agreement. Equality can be appropriate for a derivation or deterministic calculation. New measurements usually need a justified uncertainty or agreement criterion. RMP.6 helps choose an examination or interpret its observed result.
- Provide the means the examination needs. Supply or locate the relevant definitions, assumptions, input preparation, reasoning, operations, material, comparison and interpretation. Give versions, environment, calibration, timing, randomization or required capability when a difference could change the result. For a reused Method, identify the usable instructions and their conditions. RMP.4 helps establish what surviving records show about conduct. State what they leave unknown.
- Connect the publication forms. An empirical article often separates the question, methods, results and interpretation. A theoretical or methods article may develop a construction and its argument. A protocol or Stage 1 Registered Report specifies proposed work. A results report gives what was done and found. Apply the reporting requirements of the relevant venue and study type. A pattern explains the recurring problem, competing demands, solution, grounds, cases, boundaries and comparison with other approaches. Preserve the substance when changing section names or order.
- Explain what readers can examine. Link each presentation to the source contribution and the material needed for the stated examination. Give access conditions and consequential omissions. A protocol supports a claim about intended work. An available artifact can permit a rerun. For a claim about an actual rerun, provide its result. A repeatable calculation needs an additional applicability basis for a different setting. When a claim on which others relied changes, correct affected presentations and uses through §§4.3–4.4.
Choose an explanation and access arrangement sufficient for the receiving use. A theoretical derivation may be reproducible from its premises without an empirical dataset. Respect restrictions on protected participant material. If they prevent the requested public inspection, identify the limit and any qualified finding available to that reader.
RMP.8:4.5 - Finish the answer and select further inquiry only when warranted
Finish when the account and its required recipients have the conclusion the evidence warrants, or when the specific missing input or delivery limit has been identified. Distinguish a supported local correction from an outstanding promised delivery. A broader open question can be reported separately.
If further inquiry could improve an explanation, reusable finding or receiving decision, compare its attainable contribution with the work it requires. Include preparation, access, execution, interpretation, protection, shared resources and displaced work. Keep the present conclusion within the evidence already obtained.
When a research design still needs choosing, RMP.2 helps compare designs. For a question about credibility, use an adequate existing result or use RMP.6 to assess the examination. Distinguish a supported decision to commission no further study from a choice that remains open because a needed input is missing. Revisit the choice if a useful investigation becomes feasible.
Repeated failures in selecting or performing research Methods can identify a question for RMP.9 or FPF Method development. State what needs improvement and which practice could address it, if known. The present research result can be returned while that work remains open.
Continue an inquiry from a result that changes the question. Formulate each live hypothesis as a claim about its object and conditions. Derive an observation, argument or construction on which the plausible accounts differ. State what each possible result would justify retaining, revising or testing next. A judgement that a branch is promising can justify the cost of such a test. Support for the claim comes from what the examination can establish. If no feasible examination can distinguish the alternatives, report the unresolved distinction and the missing means.
Carry shared material forward at its warranted scope. Preserve the source, conditions and reasoning that a new branch uses. Mark which conclusions depend on the same measurements, calibration or assumptions. Several analysts can expose sensitivity to analytic choices on one data set. An error in their common source can still affect all of them. In Silberzahn et al.’s many-analyst study, teams working on a shared question and data obtained a range of estimates. Reanalysis is a suitable way to examine that dependence. A claim about reproducibility with independently obtained observations calls for a different design.
When the question changes, keep the supported answer to the old one. Carry forward only the premises that serve the new inference. RMP.1 and RMP.2 determine whether the new question needs a study and whether a feasible design could answer it. If the branches compete for a scarce facility or specialist, the research contribution identifies which tests share inputs and what each test could establish. STR.16 supports the separate decision about commitments.
RMP.8:5 - Archetypal Grounding
The research results and communications in these cases are stipulated for illustration.
RMP.8:5.1 - Keep the laboratory result, withdraw the unsupported field prediction
In the example an engineer receives a synthesis supporting a positive mean difference in seal lifetime under specified accelerated laboratory conditions. The existing model makes the following three claims.
| Existing contribution | Supplied criticism and revision |
|---|---|
| The fitted wear relation describes the dry laboratory material over the tested range. | The analysis supports the relation within that range. Retain the parameter, fit and uncertainty for that scope. |
| The same wear rate applies in the wet service environment. | The synthesis covers dry accelerated tests. Withdraw the statement that this research demonstrated the wet-service rate. Its applicability there remains open. |
| A service replacement time follows from the laboratory rate and the engineering wear limit. | The arithmetic can still be correct. Its use for replacement time depends on the unestablished wet-service rate, so withdraw the prediction as an established field result. The engineering authority retains its wear-limit criterion. |
The engineer can report that the laboratory relation holds within the tested range. The synthesis supplies no basis for carrying the dry wear rate unchanged into wet service, so it cannot establish the derived replacement time there. Cite the laboratory result and identify the missing transfer premise.
Different dry and wet rates are one hypothesis. A suitable field comparison could examine it if the work is feasible and what it could establish warrants the cost. RMP.2 and RMP.6 can help make that choice. Give the reliability authority the bounded finding for its maintenance decision. The research return can finish with that correction even if the operational choice remains open.
RMP.8:5.2 - Correct the same historical event
Several later accounts claim that a public protest prompted the decision to close a factory. They share one retrospective memoir. An authenticated record dates that decision before the protest.
The dated record rules out the protest as the cause of the earlier decision. Retain the supported chronology and leave the cause open. Any effect on later implementation is a separate question.
A museum description attributes the decision to the protest. The editor responsible receives the corrected chronology, its source and the remaining causal limit. The correction concerns the decision to close. The timing and cause of the physical closure need their own evidence. Restrict protected detail to permitted uses and identify what an outside reader can authenticate from the public summary.
For the broader assertion that “the protest affected the closure,” distinguish the disproved cause of the decision from the unresolved influence on implementation. The same dated record has different consequences for those assertions.
RMP.8:5.3 - Return a situated finding without inventing prevalence
A community synthesis links distrust in monitoring to withheld feedback in its examined settings. An earlier briefing says that this is the principal reason most local residents do not participate.
The examined accounts link withheld feedback to distrust, with the stated exceptions and contexts. They supply neither a population denominator nor comparative frequencies for “most” or “principal.” Revise the briefing to report the connection attributed in those accounts. Distinguish the source authors’ interpretations from the broader explanation developed in the synthesis.
The group can use this finding to consider how it returns monitoring information. Predicting how many residents would participate after a change requires other evidence, and implementation requires the applicable authority. Consider a frequency survey if it can answer a question the group needs and its contribution justifies the work.
RMP.8:5.4 - An adequate answer and a later correction
A requester receives an existing synthesis that answers the specified comparison. A brief answer citing the synthesis, its applicability and uncertainty completes the return.
Later, an erratum reverses a result on which a finding relied. Recompute or reinterpret the affected finding, correct the claims whose grounds or content changed, and inform the people or services that relied on them through an authorized route. They can reconsider their conclusion or decision on the corrected basis. Retain unaffected results. A later date by itself supplies no reason for this reanalysis.
RMP.8:5.5 - Valuable uncertainty without an obtainable study
A synthesis establishes a chronology but leaves a historically important mechanism unexplained. The only study proposed would require access to records the historian cannot lawfully inspect. No worthwhile authorized alternative is available under the stated conditions.
The historian returns the chronology and identifies the mechanism that remains unexplained. No further study is selected under these conditions. If an archive later becomes available and could distinguish the explanations, weigh its contribution against the work required. The historical question has scientific value in its own right.
RMP.8:5.6 - One calibration contribution, an article and a pattern
Consider a temperature instrument with displayed value y and reference value x, both in degrees Celsius. Suppose a separate characterization supports the affine relation y = a + bx under the stated operating conditions over 0–20 °C. The two reference points below determine its coefficients under that premise.
The reference pairs are (0, 2) and (20, 24). They give b = (24 − 2)/(20 − 0) = 1.1 and a = 2, so x = (y − 2)/1.1. A display of 13 °C gives a corrected value of 10 °C. A reader can reconstruct the derivation and recompute the answer from these pairs. Observing the instrument again would be a separate examination.
An article can present the instrument problem, the independent characterization, the derivation, the observation procedure and data, and the scope of the result. A pattern for correcting readings would explain when offset and scale errors matter, what justifies the affine approximation, and how nonlinear response could defeat it. It would show how to obtain suitable references, apply the correction and respond to disagreement in an independent comparison. Its cases, consequences, relations and comparison with alternative methods help another practitioner use it. Giving the equation a section heading supplies none of the missing operations.
Now suppose the instrument displays 13.2 °C for a newly obtained reference of 10 °C. The corrected reading is 10.1818… °C. The difference of about 0.18 °C is within the prespecified allowance of ±0.3 °C, which includes reference uncertainty. This observation meets the agreement criterion at that point. Agreement at other points needs corresponding grounds. Use RMP.6 if the scope of the comparison is at issue.
The same correction Method accepts a different qualified input and can return a different value. Recomputing 10 °C from the earlier display of 13 °C repeats the reported calculation. Applying the rule to 13.2 °C returns 10.1818… °C. Copying 10 °C would give the wrong corrected value. In either case, establish that the calibration and affine approximation apply.
An English or Russian account may publish the pattern separately or as part of a framework. Its calculation and the conditions for using it can be preserved in either form. Removing the 0–20 °C condition changes the warranted scope. A proposed use at 40 °C needs a basis for extrapolation. Agreement at 10 °C cannot establish that. If a later investigation defeats the affine premise, retain the arithmetic and correct the calibration claim in affected articles, pattern accounts and uses that relied on it.
RMP.8:5.7 - A calibration result changes what to investigate next
In a constructed inquiry, an optical sensor begins to overread during a long run. The original question is whether the error is associated with elapsed time. The existing record shows that it is. Temperature also rose during the run. A temperature-dependent offset and drift with elapsed time both fit the record. Each branch inherits the original reference readings and the definition of error. Neither can count the same readings a second time as independent support.
A controlled comparison can make the two accounts disagree. Specify the temperature contrast at a matched elapsed time, then test for a time contrast at matched temperature. The resulting design needs matched instruments or repeated runs with starting state restored, a common reference of adequate accuracy, and a check for effects of order and prior exposure. One chamber and one calibrated reference constrain the schedule. Sharing the reference saves preparation while carrying its uncertainty into both branches. If temperature cannot be varied independently of elapsed time, leave the mechanisms unresolved.
Suppose the controlled readings support a temperature effect and establish a sufficiently tight upper bound on any practically relevant drift within the tested interval. The result supports a temperature correction there. It leaves performance after the operating range changes open. Preserve the paired observations, uncertainty, calibration and tested interval. A later branch can ask whether the correction transfers to another enclosure. It inherits the correction and its grounds. The new enclosure’s temperature field and response relation still need examination. A provider’s decision to fund that comparison commits resources. It supplies no additional observation of transfer.
RMP.8:6 - Bias-Annotation
One identifiable recipient makes a short correction easy to deliver. Distributed reliance, conflicting editions and protected material can require more investigation and communication. Determine that work from what used the affected claim and what requires correction.
The engineering examples show research informing a practical decision. Basic explanation, interpretation and reusable knowledge can also be valuable outcomes when considering further research.
RMP.8:7 - Conformance Checklist
Check the account and its return against the following questions.
- Do the earlier assertion and new contribution address the same subject under comparable conditions? Where the comparison, time or context differs, has the account distinguished the claims?
- Is each retained, narrowed, qualified, rejected or added contribution supported to the extent stated?
- Have the affected outputs and explanations been reconsidered, and can the reader still use the conclusions that retain their support?
- Can the recipient recover the answer, its basis, uncertainty and any limits affecting reliance?
- Where someone relied on a materially changed claim, did the permitted correction reach the affected use, or can the reader identify the delivery that remains outstanding?
- Are the available evidence, any proposed inquiry and any authority needed for a practical decision identified on their own grounds?
- If the task is to repeat or adapt a Method, can the reader recover the problem, way of acting, grounds, scope and means of checking the intended result from the presentation available to them?
Use the working situation to recognize when this Method applies. Judge the resulting account from its evidence and the return required for its use.
RMP.8:8 - Common Anti-Patterns and How to Avoid Them
| Failure | What changes in practice |
|---|---|
| A new label is taken as evidence that a claim changed. | Locate the assertion, assumption or explanatory relation and establish whether its content changed. Correct it when the evidence requires it. |
| Pattern headings are taken to establish that a Method can be repeated. | Preserve the problem, conditions, competing demands, construction, grounds and limits. Identify what a particular repetition needs, what is available and what an actual examination established. |
| The decision date is treated as the date of physical closure. | Identify which event the document dates and which event the causal explanation concerns. |
| Failure of one premise is taken to defeat the entire model. | Trace the conclusions that depend on it and retain supported parameters, observations and calculations within their scope. |
| An unrestricted conclusion survives beside a caveat. | Qualify the conclusion itself and reconsider outputs that use it. |
| Correcting the source is assumed to have corrected reliance elsewhere. | Establish which use relied on the changed assertion. Supply the correction through the permitted route, or explain which required delivery remains outstanding. |
| Every remaining uncertainty leads to a new study. | Compare the attainable contribution with access, cost and displaced work. Return the current conclusion and its limits when further inquiry is unnecessary or unobtainable. |
RMP.8:9 - Consequences
The recipient can see which findings remain supported, which extrapolation or explanation has been defeated and which proposed alternative still needs evidence. The account can retain one claim while correcting another.
The effort depends on the account’s dependencies and who relied on it. A short answer may suffice. A change to a published model can require recovering the earlier meaning and notifying affected users.
RMP.8:10 - Rationale
Research bears on a receiving use through an assertion, assumption or interpretation. Tracing that connection shows how far the result extends and which earlier conclusions continue to hold.
A research answer can settle an evidential question while a practical choice remains open. An account can also identify an important unexplained mechanism and finish its present task. Future studies can change that account when they provide evidence.
RMP.8:11 - SoTA-Echoing
What does the evidence establish for its recipient? Cochrane chapter 15 distinguishes interpretation of an observed effect, uncertainty about it and a recommendation about use. A positive finding can supply a premise for advice. An inconclusive result can leave the effect open. Sections 4.2 and 4.4 return the warranted finding and its conditions. A short qualified answer can avoid an unnecessary new study, but a consequential transfer limit needs explanation. Reconsider interpretation if the target, uncertainty, result or use changes. Criteria for a practical action come from the receiving practice.
Which historical claim does the correction affect? The AHA professional standards guide source integrity, interpretation, treatment of contrary material and confidentiality. Sections 4.1–4.4 and 5.2 use those distinctions to match the correction to its event. A dated decision can correct the museum’s account without establishing when physical closure occurred or why the decision was made. Comparing the events costs little and prevents an unsupported historical inference. Reconsider it if the asserted event, dating or provenance changes.
Which accounts and uses need correction? FPF C.2.1 identifies the knowledge account, A.10 relates evidence to a claim and A.10.1 helps recover affected uses or revalidate them together. Sections 4.1, 4.3, 4.4 and 5.1 trace the premise to the output, preserve the laboratory finding and correct its unsupported field interpretation. Discarding the whole model would lose the supported part. Editing only the source could leave an earlier user relying on the affected claim. Scale the work to that reliance and reconsider it when the relied-on content changes or another consequential use is discovered.
When is further inquiry worth obtaining? FPF C.11.DUA compares the epistemic or practical value of the attainable contribution with its full cost. RMP.2 and RMP.6 address research designs and credibility examinations. Sections 4.5 and 5.5 weigh scientific value, access, shared resources and protection. Insisting on immediate operating payoff would discard useful explanations. Commissioning every possible study can consume resources without resolving the question. Return the evidence already available and revisit the decision if a worthwhile study becomes feasible or the inputs to an open choice change.
What would enable a reader to repeat the Method? Nature Portfolio’s reporting and availability policy identifies the design information and access conditions for data, code, materials and protocols that readers need within the policy’s scope. The Registered Reports description distinguishes assessment of proposed methods from reporting obtained outcomes. Sections 4.4.1 and 5.6 connect these reporting questions to RMP.4 on the record of actual work, RMP.6 on the intended examination and FPF E.8 on the substance of a pattern. Publication and a filled template can leave the problem, grounds or means of repetition unexplained. Give the detail needed for the intended repetition or adaptation. If a consequential input is missing, a Method condition changes or an observed comparison fails, reconsider the affected claim.
These sources inform interpretation and reporting in their respective fields. Evidence about use of this Method across research traditions or a stronger methodological account can change how it should be applied.
RMP.8:12 - Relations
- RMP.5, RMP.6 and RMP.7 can supply an analysis, an examination result or a synthesis. Use an adequate result directly when it answers the question.
- Use RMP.1 for a changed research question or RMP.2 for a choice of design when needed. RMP.3 and RMP.4 help distinguish proposed operations from the evidence of conduct.
- Use FPF C.2.1 for the knowledge account and A.10 for its link to the evidence. When materially changed source content requires discovery of affected uses or joint revalidation, use A.10.1. C.11.DUA helps compare further inquiry with its attainable benefit and burden.
- The receiving domain or practice establishes any action alternatives, values, safety conditions, access, confidentiality and authority needed for the intended use. A bounded research finding can supply evidence for a decision.
- Use RMP.9 or applicable FPF Method-development guidance when the issue concerns how research Methods are selected, improved or used.
- FPF E.8 explains a pattern’s substantive functions and publication conventions. E.4.CM guides the construction of a composite Method. Use E.4.DPF when deciding whether the contributions warrant a new or revised DPF.