Part II - Operationalization and Research Trace
RMP.3 - Operationalize the Research Design without Replacing the Question
Type: Research Method Practice practitioner method pattern Status: Stable
RMP.3:1 - Problem Frame
Use this method to specify or assess the operations of a selected research design. Identify the consequential choice of specimen, encounter, source, observation or computation. Ask how it would help distinguish the alternatives in the qualified research question. A suitable existing protocol may already answer that question.
For example, a pump engineer has selected a comparison of accelerated and field-representative seal degradation. An easily measured wear score can answer a wear question. To assess preservation of the failure mechanism, the score or other evidence must distinguish the relevant mechanisms under the comparison conditions. A detailed schedule alone cannot establish that connection.
The operational specification connects one bounded design to the particular actions and records needed to carry it out. Depending on the question, it may specify a measurement, an interpretive encounter, a historical source comparison or a model experiment.
The ResearchProtocolAndOperationalizationMap is the protocol and the reasons its consequential choices address the question. A short protocol can state the reasons beside the relevant procedure. For a more complex design, use qualified instrument accounts, source descriptions or established procedures directly, identifying the conditions under which they apply.
Return the specification that is usable for the stated scope or identify the action or inference it cannot yet support. Reuse an adequate compatible protocol. If a gap concerns the research question, use RMP.1 as needed. If it could overturn the selected design, use RMP.2. Developing a reusable Method, obtaining a required permission, performing the study and interpreting the results each depend on their own tasks and evidence.
RMP.3:2 - Problem
Some operational choices can change the question a study can answer. A replacement comparison site, different construct measure or convenience sample may remove the distinction that justified the design. Preserve both the intended arrangement and what actually happened when comparing the protocol with subsequent work.
Some confirmatory inquiries rely on choices fixed before the relevant outcome is seen. Qualitative, exploratory or source-critical inquiry may instead depend on justified development during the work. Specify what must be settled in advance, what may evolve and how a change will remain open to examination.
How can a practitioner make the design executable, preserve its criticism and allow appropriate adaptation without either hiding a defeated premise or imposing a universal research checklist?
RMP.3:3 - Forces
| Force | Tension |
|---|---|
| Specificity | The specification should let its user recover what to do and why. Copying a full technical manual may obscure the consequential research choice. |
| Methodological fit | Instruments and templates can aid a question when their observation and interpretation fit it. Familiarity alone leaves that fit untested. |
| Advance commitment | Prior choices can protect criticism, while some inquiry depends on learning what to ask or inspect during engagement. |
| Feasibility | Access, timing, measurement and resources may each appear sufficient but fail in combination. |
| Records and protection | Later criticism needs consequential choices preserved, while indiscriminate recording can expose protected information or add unusable volume. |
| Supplied competence | A researcher can apply their own qualified procedure or use a suitable laboratory, statistical or archival contribution supplied by another practitioner or service. |
| Continuity | Most of a design may survive a local obstacle, while work depending on a defeated premise must stop or change. |
RMP.3:4 - Solution
Keep the research question and the error the design must expose in view. Establish the reasons for consequential choices, check how they work together and identify what can be carried out under the present conditions. If a link is missing, state which action or claim depends on it.
RMP.3:4.1 - Recover the question and the selected design
Use the qualified question and its current basis from a ResearchQuestionBrief or equivalent information already available. Identify the use, population, setting, period or corpus that determines scope. State what the evidence would have to establish and when work can stop even if uncertainty remains. The inquiry may seek to revise an explanation, a model or another claim.
Use the ResearchDesignDecision or an equivalent selected design. Identify the evidence strategy, core contrast, relevant rivals, threats and appropriate criticism. Criticism here means an examination capable of exposing an important error or limiting the answer. Use an experiment or significance test only where it bears on that question.
A ResearchDesignHold identifies an unsettled choice. To proceed on that design, use evidence that resolves the consequential input or a subsequent justified selection. If neither is available, report what the hold prevents. A suitable design supplied independently can already give direct entry.
Examine a consequential operation. Explain its relation to the question in terms such as these.
Examining this material in this way could distinguish the relevant alternatives because … . The inference applies under these conditions … .
For the seal inquiry, relate the observation to the possibility that acceleration changes the degradation mechanism. For a historical inquiry, relate an authenticated date to the possibility that a practice preceded the directive. If the required connection is missing, use an available subject account or identify the premise on which selection depends.
RMP.3:4.2 - Connect the question to particular material and actions
Specify the choices on which the inference depends. The table offers questions for the parts of this protocol that matter.
| Choice to settle | What makes the specification usable |
|---|---|
| Phenomenon, construct or meaning | State what the inquiry is trying to distinguish and why the proposed observation, source or encounter bears on it. A familiar variable name or cited scale does not establish that relation in the present use. |
| Units, cases and selection | Identify what is selected, what is changed or exposed, what is measured and what units the inference concerns. Give the source and grounds for choosing the attainable sample or corpus. Repeated readings can supply information about one specimen’s measurement variation. Its independent specimen count remains one. |
| Comparison or interpretive relation | Explain what will be compared, challenged or interpreted, which rival it can expose, and what differences must be controlled, described or acknowledged. |
| Timing and context | Specify the periods, sequence, exposure or engagement conditions that make the material comparable or interpretable. Retain the conditions that could make a later observation a different case. |
| Measurement, source or engagement Method | Identify the qualified procedure, source-critical technique, field or interview approach, computation or other operation and the conditions on which its use depends. Name the edition or configuration if it affects what can be done or inferred. |
| Information and uncertainty | State why the attainable material is useful for the intended criticism, what its limits are, and which supplied domain or statistical judgement supports that expectation. |
| Execution and access | Identify the capabilities, materials, facilities, permissions and access the proposed action needs. State which are available and which remain unknown. If another party supplies a result or controls access, identify that dependency where it matters. |
For a quantitative inference, establish the applicable basis for sampling or precision, dependence among observations and the measurement qualifications the question requires. An existing qualified result may supply them. To interpret an instrument indication as a measurement result, use the relevant measurement account, including its uncertainty and conditions. FPF C.16 guides measurement and characterization.
For a historical inquiry, identify relevant source series, dates, authenticity, provenance, transcription and the interpretation of silence where they matter. For qualitative inquiry, consider the theoretical orientation, researcher and participant positions, encounter conditions and how interpretation may develop. Specify the grounds appropriate to each source or encounter.
Use an adequate domain procedure directly. Explain its connection to the question and identify changes in application conditions that matter to the result.
RMP.3:4.3 - State the intended use of the material and the records it needs
Explain how the proposed material will be used in the analysis or interpretation. Identify the applicable method and any remaining consequential choices about exclusions, missingness, stopping or adaptation. State what the protocol specifies. An account of what was actually done or inferred requires the corresponding evidence.
Decide what a later critic would need to examine those choices. A specimen identifier may connect an exposure record to a measured value. A search version may explain why a source entered a review. A dated protocol may distinguish an advance commitment from a choice made after an outcome was seen.
For prospective work, arrange to preserve a consequential distinction before it can be lost. Use RMP.4 for a trace of actual decisions and work, including work begun while the specification evolves. For an inherited study, use what the existing records establish. Identify unresolved choices and lost evidence explicitly.
Identify applicable retention and access conditions. A public summary, a controlled original and a permitted independent inspection can support different examinations. Use existing rights and arrangements when they suffice. If necessary information cannot be retained or examined, identify the effect on the design and on claims that would rely on it.
RMP.3:4.4 - Preserve useful commitments and method-appropriate flexibility
Preserve the choice, its rationale and its timing relative to data access, exposure to outcomes or interpretive engagement. A registration, protocol and analysis plan may each record different commitments. Check what the dated content actually settled.
Commit in advance when a method or use depends on a choice preceding the evidence. Where the approach permits development during the inquiry, specify the limits of change and how it remains connected to the question. Apply an institutional registration or approval when required, using a valid existing result where it covers the work.
In a reflexive inquiry into former workers’ experiences of a factory closure, an encounter may reveal a meaning that warrants refining the interview prompt. Preserve the starting prompt, the reason for the change and the encounters affected. Estimating the proportion of all former workers who share a view requires a suitable question, population and design. Revising the prompt alone cannot establish that proportion.
Other design families require their own operational distinctions:
| Inquiry | Consequential detail and return |
|---|---|
| Historical or source-critical | Specify which documents could establish chronology, or identify those actually inspected for a claim about past work. State how contrary or inaccessible material bears on the inference. If a required series cannot be examined, distinguish missing evidence from the absence of an entry in an inspected record. Use RMP.2 where this defeats the selected comparison. |
| Computational or model-based | Specify the model–target relation, input and parameter choices, transformations, environment needs and intended sensitivity or analysis Method. A successful program run cannot supply a missing model–phenomenon justification. |
| Evidence synthesis | Relate the review question to eligibility, search, screening, extraction and intended appraisal. If a restriction could change the answer, assess its effect on the selected design and the warranted scope. Synthesis findings require evidence of the material actually obtained and combined. |
| Mixed inquiry | Explain the contribution of each component, shared inputs and how results would be related. Check joint access, participation, capacity and assumptions. If the design needs independent evidence of chronology, extra interviews based on the same retrospective account may leave that gap open. |
Choose the distinctions that fit the inquiry. Other study families or combinations can require different operational details.
RMP.3:4.5 - Test the whole arrangement and choose the exact return
For a proposed arrangement, ask whether its operations together can expose the error or distinguish the rival that justified the design. Check consequential interactions among selection, access, measurement, timing, resources and records. Include jointly admissible unresolved values. For an existing protocol, use established evidence of these conditions directly.
Apply the joint-input condition in RMP.2:4.3. Every admitted combination of PostSelectionNeed values must preserve the family, core contrast, criticism, feasibility and refusal conditions. A detail may safely wait when it passes this test in the combined specification.
| What the specification reveals | Action and result |
|---|---|
| The choices and their joint effects stay within the selected scope. | Complete or assess the protocol with its reasons. State the supported work, remaining bounded needs and conditions for change. Carry out the work when that is the task and any required permission is in force. |
| A result is still needed for an operation, but every admissible value preserves selection. | Identify the input, the action it blocks, any known source or holder and what would allow that action to proceed. Keep the justified design and usable parts of the specification. |
| A new value could defeat the family, comparison, criticism, feasibility or refusal condition. | Identify which values preserve the design and which could defeat it. If a new choice is needed, return the unresolved value and its consequences to RMP.2. Preserve the earlier decision and any actual work in the trace. |
| The question, intended knowledge, population, context or useful stop changes. | Qualify the changed question through RMP.1 where needed. Use its established answer to revise the dependent design or specification when that work is required. |
| Permission or resources are withheld independently of evidence sufficiency. | Identify the affected action and the actual limit on proceeding. If a decision is needed, use the applicable authority or state the missing authority. Preserve the research question and assess evidence sufficiency on its own grounds. |
A calibration value may be needed for a measurement even if every admissible value preserves the required discrimination. If the instrument might instead fail to distinguish the mechanisms, that uncertainty reopens selection where the comparison depends on it. The timing of the answer does not determine its scientific importance.
RMP.3:4.6 - Leave a usable operational result
A ResearchProtocolAndOperationalizationMap is usable for its stated purpose when a suitably competent user can recover the following.
- the brief and selected design being elaborated;
- the consequential operational choices and their question-relative reasons;
- the supplied Methods, qualifications and practical conditions on which those choices depend;
- the planned conduct, use of material and required records; and
- the remaining limitations and conditions for an amendment, return or stop.
A small inquiry can place the reasons beside the relevant procedures in an existing protocol. For a larger inquiry, identify the source and instrument accounts by the versions and uses on which the specification depends.
An incomplete specification can answer which action or inference is unsupported. Retain the supported work and name that limit. If further specification is needed, assess whether a missing input can be obtained or a design choice reconsidered with sufficient value, feasibility and authority. A protocol whose core comparison has failed needs a new basis before it can be used for that inference.
RMP.3:5 - Archetypal Grounding
These constructed cases stipulate the domain premises. Their identifiers and counts illustrate how to relate records and repeated observations to one another. Sample size and scientific thresholds require justification for the intended study.
RMP.3:5.1 - Pump-P4: from a mechanism question to an executable comparison
The Pump-P4 question asks whether acceleration preserves the field seal-degradation mechanism within a specified material and fluid envelope. Suppose the selected design compares accelerated and field-representative conditions. The mechanism marker and measurement procedure are qualified, the conditions are safe for the proposed work and the specimen plan is adequate.
The team adds these entries to its existing protocol:
| Protocol choice | Question-relative reason and required record |
|---|---|
| Give each seal a specimen ID and retain its material batch and assigned condition. | The comparison concerns degradation under the two conditions; material and allocation must remain recoverable. |
| Measure the qualified mechanism marker at the specified exposure points. | Preserve the procedure version, calibration basis, time and uncertainty needed to interpret the marker. The observed distinction must bear on the degradation mechanism. Both mechanism references can exhibit the same total visible wear. |
| Treat three readings from one seal as repeated observations of that seal. | They may characterize measurement variation. The comparison still has one independent specimen here. |
| Preserve material deviations, missing observations and the conditions under which they occurred. | The available records should let a critic distinguish material behaviour from allocation, handling and selection effects as far as the evidence permits. |
Each choice relates an operation to the mechanism question and identifies material that could challenge the inference. The protocol specifies the proposed work. Permission to proceed and a decision about the maintenance interval require their own bases where applicable.
Suppose a qualified measurement result now shows that the marker cannot distinguish thermal degradation from the competing field mechanism under the proposed conditions. Return that result and its consequence for design selection through RMP.2 when selection remains open. An overall wear score needs a justified relation to mechanism before it can replace the marker. Keep the existing brief and specimen information where they remain applicable.
On the valid-marker branch, suppose P4-07 is damaged in handling before the observation. Consult the protocol’s stated treatment of missing material. Preserve what happened and any action taken through RMP.4. The remaining data and their conditions determine which inferences can be supported.
RMP.3:5.2 - ResidentStream-S17: a missing comparison is not a scheduling detail
The residents have a qualified question and a selected comparison of salinity observations across sites and times. Suppose the measurement procedure, calibration, uncertainty and permitted access are established and the plan fits the hydrological conditions of interest.
The specification identifies the reach and sampling point, the trigger for observation, the required time relation between reaches, the measurement result and the weather, access and calibration records needed for interpretation. The residents can use a qualified laboratory result or perform the measurement themselves if they have the required capability and access.
Suppose the reference reach becomes inaccessible during the informative thaw. Preserve the downstream observations and the reach, period and access conditions they describe. Check whether an adequate observation of the reference reach in that same event is already available. If the pair cannot be recovered, the downstream evidence can still support its own descriptive claim. Reconsider the paired design under RMP.2 if that question remains live. A reference observation in later dry weather concerns different conditions and needs its own justification.
RMP.3:6 - Bias-Annotation
Examine how operational choices affect which cases, phenomena or voices are represented. Convenience sampling, uneven survival of records, access restrictions and exclusions can limit the answer. Documenting a restriction makes it inspectable. Assess its consequences separately.
Consider the researcher’s position when it can affect the encounter or interpretation. Prompt wording, relationships, competence and access may change what can be observed. Use criteria appropriate to the approach, including coder agreement only when the interpretation relies on it.
Ask whether the finished arrangement could expose the important rival or error, even when it is inconvenient to observe. Instrument familiarity and institutional pressure may favor easier observations. In mixed inquiry, check whether components share the same cases, records or assumptions and what that means for their relationship.
RMP.3:7 - Conformance Checklist
Use the questions that apply to the operational specification. Use qualified domain procedures for the observations or actions themselves.
- The practitioner can recover a compatible question, current frame and selected design, with their criticism and useful-stop conditions.
- Each consequential operation has a recoverable question-relative reason and the units, context and timing needed to use its material.
- Identify relevant measurement, source, analysis and operational inputs with their conditions. Distinguish available results and permissions from proposals or unresolved needs.
- Distinguish planned analysis from work already performed. Identify which records are needed while the relevant information can still be preserved, or which have survived for a historical use.
- Commitment and amendment timing is recoverable relative to the information already available. Legitimate adaptation remains method-appropriate.
- Check the jointly admissible values of unresolved operational choices. Identify a blocked action even if the selected design remains justified.
- If the selection premise fails, identify its consequence for RMP.2. Qualify a changed question under RMP.1 when needed. For a decision about permission or resources, use the applicable authority or state the limit.
- State what the protocol supports. Identify any action or inference that remains unsupported and what, if anything, could make it available.
For a disputed or consequential use, follow a material observation from its specified unit and procedure through the proposed comparison to the error it could expose. Where unresolved inputs interact, check their adverse admissible combinations. A fully populated form can still leave either connection unsupported.
RMP.3:8 - Common Anti-Patterns and How to Avoid Them
| Failure | Why it fails | Repair |
|---|---|---|
| “We use the standard scale.” | The scale may have been validated for a different construct, population or administration. | Use suitable qualification for the intended conditions. If the relation remains open, state which design premise depends on it. |
| Three readings become three specimens. | The information claim silently changes its unit and dependence. | Keep observation and inference units distinct and use the applicable sampling and analysis rationale. |
| A completed reporting checklist is treated as a justified protocol. | Reporting detail cannot select or validate the research relation. | Connect each consequential choice to the question and supplied Method. |
| Every adaptation is either forbidden or hidden. | The first suppresses legitimate inquiry; the second removes criticism of selection and timing. | State justified commitments and preserve actual reasons, timing and scope of change. |
| A lost comparison is recorded but its original inference is retained. | A transparent record of the loss may still leave the inference unsupported. | Use any adequate substitute evidence from the relevant condition. Otherwise state what remains supported and return the defeated selection premise to RMP.2 if a choice is still needed. |
| Each remaining need is tested with all others favourable. | The combined arrangement may be infeasible or incapable of criticism. | Apply the joint-input test to admissible combinations. |
| The protocol is cited as permission or as a scientific result. | Preparatory choices establish what is proposed. | For a permission or a finding, use the applicable decision or suitable evidence for that finding, such as a qualified observation, measurement or analysis. Where these are unavailable, preserve the supported protocol and state the limit. |
RMP.3:9 - Consequences
The specification shows which operational choices implement the design and which could change the question it can answer. Arrange prospective records while important distinctions can still be preserved. Use qualified procedures and suitable records already available.
Explaining a consequential choice takes work. It may reveal that a study needs another design or an unavailable professional result. The effort is justified when it can prevent work that would not address the question. A sound specification still leaves study findings to the actual investigation.
RMP.3:10 - Architectural Rationale
Use RMP.2 to select an evidence strategy and RMP.3 to specify its operations. During specification, check that every jointly admissible remaining choice still preserves the selected evidence relation, criticism and feasibility. When it does not, report the consequence for selection.
A protocol specifies intended work. A trace records what happened. Both may be kept in one notebook and may develop together. If what happened in an inherited study is unclear, use RMP.4 to examine its surviving trace. Available records may already answer the question even when its original protocol is lost.
Use a suitable domain protocol and adequate records directly. Examine the connection to the research question when a consequential operation, change or limitation remains unclear. A measurement problem, interpretive inquiry and historical source comparison may each need a different explanation of that connection.
RMP.3:11 - SoTA-Echoing
Practice question. Which choices must be specified in advance to preserve the research question, and which may develop as evidence or interpretation changes?
Explain the reasons for consequential choices and make their timing and any amendments inspectable. Use an existing protocol when it already supplies them. Select advance commitments or permitted revisions according to the kind of inquiry and the threat being addressed.
| Source and scope | Operational contribution and limit |
|---|---|
| Flake and Fried’s Measurement Schmeasurement addresses the basis for choosing a measure. The 2026 measurement study by Goos et al. examines measurements used in Many Labs. | In §4.2, establish the relation between construct and measure and state consequential administration and scoring choices. A published replication and the Many Labs findings do not by themselves establish the validity of the local instrument or a general failure rate. |
| Lakens’s Sample Size Justification compares quantitative rationales for sample size in relation to inferential aims and constraints. | In §4.2, justify the attainable sample for the question it must answer. A resource limit can determine the sample obtained while leaving the desired precision open. Use a relevant statistical procedure for quantitative adequacy and suitable criteria for historical or qualitative inquiry. |
| SPIRIT 2025 gives reporting guidance for trial protocols. TOP 2025 distinguishes registration, protocol and analysis-plan practices. | In §§4.2–4.4, identify consequential choices and the information available when they were made. Trial-specific requirements apply where the inquiry uses that design. Inspect the contents and timing when judging what was committed in advance. |
| Haven et al.’s qualitative preregistration study offers a starting account for qualitative preregistration. Braun and Clarke’s RTARG argument and review challenges generic defaults for qualitative reporting and assessment. | In §4.4, make initial commitments explicit and preserve justified changes under the selected approach. The Delphi study and Braun and Clarke’s review of reporting in studies that used reflexive thematic analysis address particular methodological settings. Other qualitative approaches need their own grounds. |
| AHA’s professional standards and the Cochrane Handbook, chapter 2 address source criticism and question-led selection. | In §§4.2 and 4.4, examine provenance, contrary material and which sources the question requires. A lost archival series limits the conclusion that can be drawn from it. A historical or synthesis finding requires actual relevant material. |
These methodological sources support the specified operations within their own conditions. If a change in construct, approach, corpus or access defeats a connection to the question, reassess that choice. Consider a different professional procedure when it preserves the required inference and criticism at lower cost. Claims about an improvement in actual research practice need evidence of that use.
RMP.3:12 - Relations
For a practice-reconstruction question, RMP.10 relates candidate accounts to observations, critical-incident elicitation and log evidence. For a question about Method history, RMP.11 relates dated sequences to competing explanations and diagnostic observations. Include the operations the question requires and identify the limits of each source of evidence.
- RMP.1 helps qualify the research question and stopping conditions, including a materially changed question or use whose qualification remains open.
- RMP.2, especially §4.3, gives the selected design and the condition for jointly admissible unresolved inputs. Return a defeated premise there when its consequences for selection need to be settled.
- RMP.4 helps preserve evidence of conduct and changes as they occur, or assess what an existing trace supports. Capture may begin while the specification is being developed.
- FPF C.16 supplies measurement and characterization discipline; FPF A.10 supplies claim-bound evidence and provenance discipline. RMP.3 adds the particular research question and operational connection.
- Qualified domain, statistical, interpretive, source, ethics, safety, access and resource practices supply their own results. The Core Method-development family applies when the reusable Method itself needs design or repair.
- RMP.5 helps connect actual material and analysis to a bounded claim. RMP.6 helps assess the claim’s credibility using available evidence or a worthwhile test. A protocol supplies the relevant intentions and choices. Substantiate execution and conclusions from the actual work.
RMP.3:End
RMP.4 - Preserve a Criticism-Ready Research Trace
Type: Research Method Practice practitioner method pattern Status: Stable
RMP.4:1 - Problem Frame
Use this pattern to preserve the material for a particular examination of research or to establish how an earlier inquiry produced a reported result. Name the examination and locate the records it needs.
For example, residents measured downstream salinity during a thaw and missed their visit to the reference reach. Their chart preserves the downstream observations. Record which visit they missed, why, what can be established about the reference reach from other sources, and what the remaining observations support.
This pattern connects the course of an inquiry and the material retained for a named examination. Its ResearchTracePackage gives the reader the necessary records or reliable references and explains how plans, conduct and changes bear on the result. The records can reside in several places. Include limitations that affect the intended use.
A package is “criticism-ready” for an examination when the material that examination needs is inspectable under the stated conditions. A partial account can establish where inspection stops and how that limits the conclusion.
During planning or fieldwork, preserve at-risk records while they are available. For inherited work, start with the surviving material. Use RMP.1–RMP.3 if a needed question, design or protocol still has to be developed.
Use an existing notebook, laboratory record or repository when it supports the examination. Apply RMP.4 when a connection between conduct and material, a change or a limit of use needs explaining. Obtain a substantive assessment, computational reproduction, access decision or new research separately when the work calls for it.
RMP.4:2 - Problem
An account written after the result is known can lose an earlier plan, record a missed observation as a blank cell or omit a failed computation. A step called “processing” may hide choices by researchers or AI systems. The reader needs the particular choices and events that bear on the result.
A large collection can omit the decisive exclusion or its timing, be inaccessible to its intended readers, or disclose material outside the authorized use. A public summary can be sufficient for one examination and lack the detail another requires.
What records will let a reader examine the course of an inquiry, and what can be established when material has to be reconstructed, has been lost or has restricted access?
RMP.4:3 - Forces
| Force | Tension |
|---|---|
| Capture before loss | A later critic needs consequential detail that may disappear before a final claim is formulated. |
| Proportionate records | More detail can enable later questions, while indiscriminate capture increases burden and disclosure risk. |
| Plans and conduct | A dated plan can establish a commitment. A later methods account may also provide evidence of conduct. What happened depends on the grounds for that account. |
| Adaptive inquiry | Knowing when an interpretation changed and which outcomes the researcher had seen helps a reader evaluate the change. |
| Access | A protected original may support a permitted examination that its public rendering cannot support. |
| Reconstruction | Surviving records can establish part of a history and leave the rest open. A reader needs to know which claims the records support. |
| Reuse | Different examinations of the same records can require different detail, provenance or access. |
RMP.4:4 - Solution
Specify the examination, preserve the material it needs while that is possible, and connect the records to the choices and results they support. Identify what the reader can inspect, what can be reconstructed, and how loss or limits on access affect the answer.
RMP.4:4.1 - Name the examination and choose the entry
State the question the examination should answer. For instance, the investigator may need to explain an exclusion, establish whether a comparison took place, inspect the basis for an interpretation or find the inputs to a calculation. Identify the relevant design and material where they are known.
During preparation, identify what will later show whether the comparison took place and what material the proposed analysis needs. If a result is reported later, connect it to the material used to obtain it. An examination of an earlier plan can finish before any result or ClaimCandidate exists.
Choose the entry that fits the work:
- Planned or ongoing work. Identify the question, design and operational choices that matter to the examination. Arrange to capture the needed records while their contents can still be established.
- Existing or inherited work. Start with the question, any claimed result and the surviving material. Recover the design, protocol and conduct to the extent supported by records, testimony or other evidence.
Use a compatible question, design or operational decision that is already available. RMP.1–RMP.3 can help develop a missing contribution. If an earlier design is uncertain, give the basis of any reconstruction and the date it was made.
Identify the part of the study, sources, encounters, specimens or computation in question and the relevant period or version. For a different examination, check whether the material still suffices.
RMP.4:4.2 - Preserve the smallest material whose loss would matter
Ask what the critic would be unable to distinguish if one record disappeared. Start with those distinctions. Examples include which specimen was measured, which document was inspected, why a source was excluded, or whether an outcome was already visible when a choice was made.
For ongoing work, capture the event or choice while it can be observed. If a suitable laboratory or data practice already preserves it, cite the record with its relevant qualifications.
Keep the versions and dates of the plans relevant to the examination, including amendments. A registration, protocol and intended analysis can record different commitments at different times. To establish a prospective commitment, check its contents and timing against the work.
Distinguish how each part of the account is supported.
| Basis for the account | How to report it |
|---|---|
| A contemporaneous record supports the event or choice. | Identify its scope and the particular claim it supports. Check the basis of recorded statements on which the examination depends. |
| A person reports the event later. | Identify it as a later report and retain what supports or limits that account. |
| Surviving sources support a reconstruction. | Mark the reconstructed part, its sources, reasoning and uncertainty. |
| The relevant conduct, reason or timing is unknown. | Say what is unknown and which examination depends on it. |
A single notebook can contain all four kinds of account. Date any reconstruction and identify the evidence that places an intention before or after access to the data. If its timing cannot be established, leave it open.
Apply the retention, access and destruction requirements that govern the material. Where permitted, preserve evidence of loss and explain its effect on the examination.
RMP.4:4.3 - Connect actual conduct, transformations and uses
Follow a consequential reported result back to the observations, sources, encounters or computations used to obtain it. For a planned comparison, identify the material it would require and what has been collected so far. Show how selection or transformation connects the material to its intended or actual use.
For observations, retain the identity of the specimen, case, participant, site or sample at the permitted level of detail and the conditions needed to interpret it. Distinguish instrument indications, qualified measurements and derived values. Use FPF C.16 when an examination depends on units, uncertainty or qualification that the recorded values alone leave unclear.
For documentary sources, specify whether the investigator used a catalogue description or inspected the document. Preserve the edition, locator, dating, provenance, reasons for selection and any relevant transcription or translation. Identify contrary evidence and unexamined collections where they affect the answer.
For transformations, show which operation produced the relevant output from which input. Record filtering, recoding, deduplication, aggregation, translation, corrections or computational steps that affect the examination, with versions and parameters where they matter. Use FPF A.10 when a claim needs its evidence and provenance made explicit.
For a reported computation, link the output to the particular run, its inputs, code and relevant environment, parameters and random seeds. Include failures and manual interventions that affect interpretation. A folder that contains several input versions may leave the version used in the run unknown.
For qualitative work, retain the material and interpretive choices on which the findings depend. Explain a change in the researcher’s position or questioning when it matters. Apply a coding-agreement criterion when the selected approach and examination warrant it.
For evidence synthesis, preserve the searches performed, including platforms or sources, dates, query versions and retrieved material. Trace screening, duplicate handling, exclusions and changes in extraction. These records can explain how the corpus was obtained. To establish appraisal or synthesis, locate evidence of the work performed.
In a mixed inquiry, preserve how each component contributed and how the investigators combined or interpreted their results. Identify shared data and assumptions. If two findings rely on the same participants or retrospective source, account for that dependence when assessing corroboration.
RMP.4:4.4 - Explain consequential changes and contributions
When a change from an earlier intention matters, identify the earlier plan, what changed, who made the choice, when it was made, and what material it affected. Give the supported reason and the data or results available at the time. Identify any part of that history that remains uncertain.
A missed observation, an excluded case, a failed run, an inaccessible source and a revised interpretation have different consequences. Identify the event. For example, an intact record may have been excluded from an analysis, whereas a missed observation has no recorded value to exclude.
If the outcome was known when a choice was made, retain that timing and the grounds for the choice under the method used. An advance commitment needs earlier evidence. Date any later sensitivity analysis or independent criticism separately.
Identify the people, teams, tools or services whose contributions affected the inquiry. For AI-assisted work, preserve the following details when they matter to the examination.
- The model or service, its known version or configuration, and the time it was used.
- The relevant input context and the output used, to the extent permitted by the applicable protection and access conditions.
- What was checked against which source, who or what performed the check, what was accepted, rejected or revised, and how that affected the work. Where the applicable research guidance assigns responsibility to a human researcher, identify that researcher’s verification and decisions.
Preserve the wording of a prompt when it can change how a reader understands the research choice. Routine spelling assistance usually contributes nothing to that question. If a service withholds its internal state, describe what can be examined from the inputs and outputs that survive.
If a service suggests a nonexistent source, preserve the suggestion, the check and the resulting decision when they affect the examination. These records can establish the service’s contribution and the response to it. Any scientific claim that relied on that citation still needs a source that exists and supports the claim.
RMP.4:4.5 - Determine actual access and the consequences of loss
Establish which material survives and which parts the intended reader can inspect under the applicable permissions. A repository locator identifies a location, a policy sets conditions, and a custodian can report what is available. Compare the detail in the accessible version with the detail the examination needs.
For the proposed examination, determine what each available source or view supports.
| Material available | What the material supports | Use or remaining need |
|---|---|---|
| The intended reader can inspect the relevant originals in context. | The reader can examine the named connection when its necessary material is present. | Use or supply the available material. Undertake scientific analysis or criticism when its result is requested. |
| Originals survive under restricted access. A public version contains less detail. | State what the reader can examine in the accessible version. | Use that version if it suffices. If further detail matters, use authorized access or a qualified inspection result where available. Otherwise state the limit on the conclusion. |
| Surviving sources support a reconstruction. | The reconstruction can answer a historical question within the scope of its evidence. | Give the sources, reasoning and uncertainty. If an essential distinction is still open, use stronger evidence when available or withhold the dependent conclusion. |
| A needed record was never made, was lost or can no longer be retained. | Identify the affected examination, what can still be established and any narrower use of the remaining material. | Report the gap when that answers the question. If further work depends on missing evidence, identify what it would need. New observations or a new run have their own design and trace. |
| Loss of evidence or access defeats a design premise or changes the research question. | Identify the affected relation and what the remaining material supports. | Reconsider the design under RMP.2 or the question under RMP.1 when further work depends on it. Preserve what was established about the original inquiry. |
A custodian’s qualified inspection can answer a question within its stated scope. To establish that another reader has access, check that reader’s permission and ability to inspect the material.
RMP.4:4.6 - Return the trace with a truthful receiving scope
Give the reader enough information to locate the material and understand its connections and limits. For the examination at issue, identify the following.
- The examination, research question and study portion, with the design as far as it is known.
- The surviving plans and the grounds for claims about what took place.
- The material used and the selections or transformations that affected it.
- The timing of consequential changes and the contributions of people, tools or services.
- What can be inspected or reconstructed and which conclusions access restrictions or losses limit.
One record can support several parts of the account. Link to suitable records and specify their identities or versions where later changes could make a reference ambiguous.
Trace a connection that matters to the examination. For a reported value or interpretive excerpt, locate the source and the choices that shaped the result. For a planned comparison, identify what material it would need and what is already available. If a needed record or access is missing, explain which part of the examination remains possible.
A limited package can answer a question about the surviving record. For example, “The downstream measurements and handling decisions can be inspected. The reference reach was inaccessible, and we have found no comparable reference measurement for the same thaw.”
RMP.4:5 - Archetypal Grounding
The following examples specify hypothetical events and records for examining research.
RMP.4:5.1 - ResidentStream-S17: preserve a useful trace after losing the comparison
The selected design would compare salinity-related observations at a downstream reach and a reference reach during an informative thaw event. Assume the measurement method, calibration basis, safe access and intended site-period relation were qualified when the design was chosen.
During the event, downstream observations are made, but the reference reach becomes inaccessible. The team retains the following linked account:
| Retained material | What the account says and permits |
|---|---|
| The design and the plan that existed before the event | The team planned to compare measurements from both reaches during the same thaw. The downstream record also permits a description of that reach. |
| Downstream sample and measurement records | Sample IDs connect time, reach, hydrological context, instrument indications and the qualified measurement results, including the relevant uncertainty. |
| The reference-visit record | The team missed the planned visit because it could not access the site. The record gives the basis for that explanation. |
| Preparation of a later chart | Each downstream value can be traced to its measurement record. The chart identifies the missing reference observation and the resulting limit on comparison. |
| Effect on the inquiry | With no comparable reference observation available, the planned comparison lacks one member. The downstream observations remain available for a narrower question. If the inquiry needs a different design, use RMP.2. |
The reader can inspect the downstream measurement and handling history. In this case the team’s visit was missed and no other comparable observation of the reference reach during the same thaw is available. If a suitably qualified measurement from that reach and event were found, the reader could reassess the original comparison.
A reference sample taken later in dry weather documents a different hydrological condition. To use it for a comparison, establish the particular relation that makes it comparable and state which question that comparison answers.
If volunteers started sampling before recording a protocol, their labels, instrument logs and later accounts may establish parts of the sampling procedure. Date the reconstruction, identify its grounds, and distinguish a reconstructed action from evidence that the volunteers had committed to it in advance.
Apply the existing permissions to private land-access details. The public account can identify what role those details played and which questions the published material supports.
RMP.4:5.2 - Pump-P4: distinguish absence, exclusion and interpretation
On the valid-marker branch of the seal study, specimen P4-07 is damaged during handling before one planned observation. The trace retains its allocation and material identity, the handling record, the time and basis of the reported damage, the absent observation, the applicable prior exclusion intention and the decision actually taken.
The comparison dataset links each remaining observation to its specimen and explains why P4-07 contributes no value at that point. Three readings from a second seal provide repeated measurements on that single specimen.
A critic can now assess the effect of the missing observation or exclusion on the comparison. Changing the pump’s maintenance interval would require grounds for that change and the applicable authority.
RMP.4:5.3 - A computation with a research-shaping AI suggestion
A researcher uses an AI service to suggest a preprocessing change for a model comparison. In this constructed case, the retained account identifies the supplied design, original data and code version, the relevant proposal and input context, and the researcher’s decision to revise and use the change. The actual run connects the changed code, environment and parameters to its output.
The service also suggests a nonexistent article. The researcher checks the reference, rejects it and preserves the source actually used. This evidence can establish how the suggestion was handled. The scientific claim depends on what the source used supports.
When the original service version becomes unavailable, the retained suggestion, the researcher’s decision and the implemented change can still be inspected. A new run can test the retained implementation. Reproducing the original service response would need its own conditions and evidence.
RMP.4:5.4 - Historical and interpretive records support different criticisms
When asking whether a directive preceded a change in factory practice, preserve the identifiers, editions, dates and provenance of documents inspected, the relevant catalogue entries, contrary evidence and transcription choices. In this case the unavailable earlier series leaves the rival chronology open. An earlier decision could have occurred without leaving evidence in the surviving series.
To study how former workers understood the closure, retain the encounters, permitted excerpts, the researcher’s position and the grounds for changes to prompts or interpretation. A new prompt may still address the same question. Estimating population prevalence would require a different design. Judge the interpretation by the selected approach and its grounding, including a coding-agreement criterion only where it applies.
RMP.4:6 - Bias-Annotation
Identify missing cases, sources, encounters or failed runs where their absence could affect the question. For example, a record restricted to successful runs cannot establish how often runs failed unless it can be linked to an adequate record of all attempts.
Later knowledge can influence a witness’s account of an earlier reason. Preserve the grounds for the reconstruction, including what contemporaneous records and later reports establish about timing.
Data holders, communities and participants may have authority over access and use. Apply the relevant conditions and report what the authorized view allows its reader to examine, including any material limit on the conclusion.
RMP.4:7 - Conformance Checklist
Use this checklist for the package’s declared receiving examination.
- The account identifies the inquiry, the portion covered and the examination. Claims about completed work have grounds in the surviving material.
- Plans, actual conduct, later reports, reconstructions and unknowns remain distinguishable.
- Consequential material can be followed through selection and transformations to its receiving use, at the granularity that examination requires.
- For a consequential change, the account identifies the earlier intention, timing, reason, effect and information available at the time to the extent supported.
- The account distinguishes the consequences of missing observations, exclusions, failed runs, inaccessible sources and revised interpretations where they occur.
- The account identifies significant contributions from people, teams, tools or services, the checks performed and the applicable responsibility, at the detail needed and permitted for the examination.
- The account distinguishes surviving material, actual permitted access, public views, reconstruction and loss.
- The material and permitted access support each examination described as criticism-ready. When an examination is prevented, the account identifies the limiting condition, any narrower supported use and a further source or change of design if one is needed and available.
- A rerun or a later observation is identified by its own date, inputs and conditions.
When relying on the trace, follow a consequential use back to its source or use a qualified inspection that establishes the necessary connection. Compare a prior commitment with conduct when that difference matters. If the examination requires the intended reader to inspect the material, confirm that reader’s access.
RMP.4:8 - Common Anti-Patterns and How to Avoid Them
| Failure | Why it fails | Repair |
|---|---|---|
| The final methods account replaces every earlier plan. | The critic loses the timing and content of commitments. | Retain surviving versions and distinguish reconstruction from prospective intention. |
| Missing observations, exclusions and failed work are all recorded as “cleaning.” | Their causes and effects on the result can differ. | Identify the event, its supported reason and its effect on the examination. |
| A repository link is treated as criticism-ready access. | The material may not survive, be accessible or contain the needed detail. | Establish the actual material and access for the named examination. |
| A public summary is used for a claim that depends on redacted detail. | Its reader lacks the detail needed to examine that claim. | Identify what each view supports. Use an authorized source or a qualified inspection result if available, or report the limit. |
| The number of files is offered as support for a scientific claim. | The decisive record might be absent from a large collection. | Identify the connection the claim needs and examine the evidence that bears on it. |
| An AI suggestion or citation is used as evidence without establishing what supports it. | A saved output can show what was suggested. The source and the inference need their own grounds. | Identify the source, checks, decisions and responsible contributors. Where the applicable guidance assigns responsibility to a human researcher, record how the researcher exercised it. |
| A run with substituted inputs is reported as a replay of the original computation. | It tests a different set of inputs. | Identify the inputs, decisions and service state that can be recovered for the original run, then state what the new run tested. |
RMP.4:9 - Consequences
A reader can see what was planned, what evidence supports the history of the work, how material reached a result and where examination stops. Capture during fieldwork can prevent loss. A later reconstruction can recover part of the history even when the original plan is missing.
Recording the relevant connections and maintaining suitable access take work. When decisive evidence is lost or inaccessible, state the conclusions that the remaining records support and the questions they leave open.
RMP.4:10 - Architectural Rationale
A protocol states intended conduct. A trace supplies grounds for claims about what happened, including departures from the plan and work for which no prospective plan survives. One notebook or collection can serve both uses.
Use the named examination to judge when capture is sufficient. The same material can support one criticism and lack the detail for another. Additional capture and disclosure require justification for the use they would serve.
Use existing domain records or provenance information if they supply the connections the question needs. RMP.4 helps recover how choices, transformations and access affect examination of the particular inquiry.
RMP.4:11 - SoTA-Echoing
Practice question. What does a reader need to inspect the conduct of this study, and which further claims need a replay or a scientific assessment?
Selected approach. Record the origin of the material, the timing of consequential changes and the access available to the intended reader at the detail required for the examination. When records are lost or restricted, establish which narrower questions can still be answered.
| Comparison and source role | Adopt, adapt or reject; effect on the Method and limit |
|---|---|
| TOP 2025 distinguishes research practices and records of commitments. | §§4.2 and 4.4 use contents and dates to establish what was specified in advance. A disclosure badge can identify a reported commitment. To verify it, use the relevant record or a qualified verification that covers the claim. |
| Miske et al.’s Investigating reproducibility (2026) examined attempts to reproduce results in publications from 2009–2018 with obtainable datasets. Workflow Run RO-Crate illustrates how to record particular workflow runs. | §4.3 connects reported outputs to the inputs, transformations and runs that produced them. The study documents difficulties recovering computations. The format is one way to preserve the connections needed for inspection. |
| PRISMA-S gives reporting guidance for searches. | §4.3 retains the search as performed, including its query, platform, date, retrieved material and changes during retrieval. Those records can explain how a bibliography was obtained. Judging its adequacy for synthesis requires the relevant appraisal. |
| Braun and Clarke’s RTARG argument and review examines how papers report reflexive thematic analysis. The AHA’s professional standards describe historians’ responsibilities for sources and interpretation. | §§4.2–4.4 use the approach being examined to decide which choices, contrary evidence and grounds for reconstruction to retain. A requirement for coder agreement needs a basis in that approach. |
| Carroll et al.’s Operationalizing CARE and FAIR develops data-governance principles in the context of Indigenous peoples’ rights and interests. | §4.5 asks whose authority governs a particular use, what the permitted purpose is, and what the reader can inspect. A FAIR resource can have restricted access. |
| The European Commission’s May 2026 revision and its Living guidelines on the responsible use of generative AI in research, fourth edition, October 2026 address researchers’ responsibility for AI-assisted scientific output and disclosure of substantial uses. | §4.4 applies that guidance to records of significant AI contributions and the responsible researcher’s verification and decisions. Routine editing calls for proportionate records. These recommendations are non-binding. Access to protected inputs and the ability to replay a service require separate grounds. |
Reconsider what to retain if a different examination needs different material, a source or service change affects a connection, or an existing practice can support the examination at lower cost. The cited guidance, research and implementation examples establish the specific contributions described above.
RMP.4:12 - Relations
An issued instruction can establish what it prescribed. To reconstruct how work was performed, use the sources that bear on that question, such as an occurrence record, a participant’s account or an event log. Use RMP.10 when further reconstruction is needed. Dated sources may establish that a method changed. Use RMP.11 when the question asks why or how that change came about. In each case, account for relevant dependence and gaps in what survived.
-
RMP.3 supplies operational intentions and research-relative record needs. Capture can begin while those intentions develop.
-
A lost comparison can be reported with the remaining findings. Use RMP.2 if a revised design is needed. Use RMP.1 to reconsider a question or intended use that has changed.
-
Use a clear, qualified record directly. FPF A.10 helps when the connection from a claim to its evidence needs to be recovered or made reproducible. FPF C.16 helps establish the measurement basis when a distinction between an indication, a qualified result and a derived value matters.
-
Use the relevant professional practice for recordkeeping, source criticism, statistics or interpretation. Apply the existing decisions and conditions governing retention and access. When a new decision is required, obtain it from the person or body with the applicable authority.
-
Use an available analysis or credibility assessment within its scope. RMP.5 helps analyze and criticize a claim when a substantive judgement is still needed. RMP.6 helps select and interpret a credibility examination when the question warrants one. A report that a reproduction test took place needs evidence of the test performed and its result.
-
Use RMP.7 when the material, its relationships and its limits bear on a question about a corpus. A synthesis requires the appraisal and integration appropriate to that question.