RMP.3 - Operationalize the Research Design without Replacing the Question
Type: Research Method Practice practitioner method pattern Status: Development preview
RMP.3:1 - Problem Frame
Use this pattern when a research design has been selected but someone still has to decide which specimens, encounters, sources, observations or computations will make it executable. Begin with one consequential choice and ask: how will this choice let us distinguish the alternatives in our research question?
For example, a pump engineer has selected a comparison between accelerated and field-representative seal degradation. Choosing an easily measured wear score is useful only if that score can distinguish the mechanisms the comparison concerns. A detailed testing schedule cannot repair the missing relation.
This pattern governs the operational specification of one bounded inquiry: the connection between its selected design and the particular actions and records that will implement it. Operationalization can specify a numerical measure, an interpretive encounter, a historical source comparison or a model experiment. It is not limited to turning a concept into a number.
The first useful result is a ResearchProtocolAndOperationalizationMap: the protocol and question-relative reasons for its consequential choices, carried in whatever existing records suit the work. A short protocol with inline reasons may be enough. A complex inquiry can link qualified instruments, source accounts and established procedures rather than copy them into another form. The name does not require a separate document.
The practical gain is a usable specification, or an exact return before unsupported work begins. If a compatible qualified protocol already supplies the required choices and reasons, use it directly. If the question or design is still unsettled, return to RMP.1 or RMP.2. Designing a reusable domain Method, obtaining permission, performing the study and interpreting its findings remain separate work.
RMP.3:2 - Problem
A selected design leaves room for operational choices, but not every remaining choice is harmless. Replacing a missing comparison reach, changing a construct’s measure or recruiting only convenient cases can change the question the study is capable of answering. Teams often discover the problem after collecting material and then describe the actual arrangement as though it were the intended design.
The opposite response freezes every detail before the first encounter with data. That can be appropriate for a particular confirmatory commitment, but can obstruct legitimate qualitative, exploratory or source-critical development. A protocol must distinguish useful advance commitments from choices whose controlled evolution serves the inquiry.
How can a practitioner make the design executable, preserve its criticism and allow appropriate adaptation without either hiding a defeated premise or imposing a universal research checklist?
RMP.3:3 - Forces
| Force | Tension |
|---|---|
| Specificity | Another person needs to know what to do, while copying entire domain manuals can hide the decisive research choice. |
| Methodological fit | Different questions need different observation and interpretation arrangements; familiar instruments and reporting templates can select those arrangements prematurely. |
| Advance commitment | Prior choices can protect criticism, while some inquiry depends on learning what to ask or inspect during engagement. |
| Feasibility | Access, timing, measurement and resources may each appear sufficient but fail in combination. |
| Records and protection | Later criticism needs consequential choices preserved, while indiscriminate recording can expose protected information or add unusable volume. |
| Supplied competence | A researcher can connect qualified results to the question without personally recreating every laboratory, statistical or source-critical Method. |
| Continuity | Most of a design may survive a local obstacle, while work depending on a defeated premise must stop or change. |
RMP.3:4 - Solution
Keep the selected question and criticism visible while deciding what will be done. Resolve the consequential choices, check their combined effect, and return only the decision or external result that is actually missing or defeated.
RMP.3:4.1 - Recover the question and the selected design
Start with a compatible ResearchQuestionBrief from RMP.1 or a supplied equivalent. Recover what is being asked, for which use, within which population, setting, period or corpus, and what would count as a useful answer or stop. The intended episteme change is the change in an explanation, model or other knowledge claim that the inquiry seeks.
Recover the ResearchDesignDecision from RMP.2 or a supplied equivalent: the selected evidence relation, live alternatives, core contrast, threats and method-appropriate criticism. Here criticism means an examination capable of exposing an important error or limiting the proposed answer. It need not be a significance test or an experiment.
A ResearchDesignHold with a prestigious Method name is still a hold. Obtain the missing selection-changing result before treating the design as selected. Conversely, compatible supplied inputs allow direct entry; there is no requirement to recreate RMP-branded briefs or repeat earlier decisions.
Choose one operation that matters. Finish the sentence:
We will obtain or examine this material in this way because it can distinguish this live alternative, within these limits.
For the seal inquiry, this may connect a mechanism-sensitive observation to the possibility that acceleration changes the degradation process. For a historian, it may connect an authenticated date to the rival possibility that a practice changed before the directive being investigated. If that connection cannot be stated, recover its source or return the unresolved design premise.
RMP.3:4.2 - Connect the question to particular material and actions
Specify the choices on which that connection depends. The following questions organize one operational specification; they are not a compulsory form to reproduce for every inquiry.
| Choice to settle | What makes the specification usable |
|---|---|
| Phenomenon, construct or meaning | State what the inquiry is trying to distinguish and why the proposed observation, source or encounter bears on it. A familiar variable name or cited scale does not establish that relation in the present use. |
| Units, cases and selection | Identify what is selected, exposed or changed, what is observed, and what the eventual answer is about. State inclusion and selection reasons and the source of the attainable sample or corpus. Repeated readings of one specimen are not additional independent specimens. |
| Comparison or interpretive relation | Explain what will be compared, challenged or interpreted, which rival it can expose, and what differences must be controlled, described or acknowledged. |
| Timing and context | Specify the periods, sequence, exposure or engagement conditions that make the material comparable or interpretable. Retain the conditions that could make a later observation a different case. |
| Measurement, source or engagement Method | Identify the qualified measurement procedure, source-critical technique, interview or field approach, computation or other supplied Method. Include the material version and conditions that affect its use. |
| Information and uncertainty | State why the attainable material is useful for the intended criticism, what its limits are, and which supplied domain or statistical judgement supports that expectation. |
| Execution and access | Say who or what supplies the necessary capability, material, facility, permission and access before the affected action. A proposed arrangement does not establish their availability. |
For quantitative inquiry, obtain the applicable sample-size or precision rationale, dependence model and measurement qualifications. RMP.3 connects those results to the research question; it does not supply a universal sample count, effect size, psychometric cutoff or causal-identification formula. An instrument indication becomes a measurement result only through its appropriate measurement account, including uncertainty and applicable qualification. FPF C.16 provides the common measurement and characterization discipline.
For a historical inquiry, operational detail may concern source series, authenticity, dates, provenance uncertainty, transcription and the possibility of archival silence. For qualitative inquiry, it may concern theoretical orientation, researcher and participant positions, encounter conditions and the permitted development of interpretation. Asking what a source or encounter can support is more useful than forcing either inquiry into a trial-outcome table.
Use qualified domain procedures where they already answer these questions. Record the research connection and any changed application condition, not a weaker replacement manual.
RMP.3:4.3 - State the intended use of the material and the records it needs
Explain how the planned observations or sources will enter the intended analysis or interpretation. Identify the supplied Method and the consequential choices still to be made under it. Specify exclusions, missingness treatment, stopping or adaptation rules where they matter. These are intentions; they do not constitute a performed analysis or a warranted result.
Decide what a later critic would need to examine those choices. A specimen identifier may connect an exposure record to a measured value. A search version may explain why a source entered a review. A dated protocol may distinguish an advance commitment from a choice made after an outcome was seen.
Arrange capture before the relevant distinction can be lost. RMP.4 supplies the actual trace and its limitations. Capture can begin while the operational specification is still developing; PatternID order is not a research calendar. Identify unresolved choices as unresolved rather than supplying an invented final claim to make the records look complete.
Plan permitted retention and access with their actual owners. A public summary, a controlled original and a later independent inspection can support different examinations. If the desired criticism needs information that cannot be retained or examined, settle that consequence in the design instead of assuming that a disclosure statement will make the criticism possible.
RMP.3:4.4 - Preserve useful commitments and method-appropriate flexibility
Record what was decided, why, and its timing relative to relevant data access, outcome exposure or interpretive engagement. Distinguish a study registration, a protocol and an analysis plan by their actual content. The label “preregistered” alone does not tell a critic which choice preceded which information.
Commit in advance where the chosen Method and receiving use rely on that commitment. Permit bounded evolution where it belongs to the inquiry, and explain how a change remains connected to the same question. If an external institution requires a particular registration or approval, obtain that result through its own rules; RMP does not grant it.
For example, a reflexive inquiry into how former workers experienced a factory closure can refine a prompt after an encounter exposes a previously unnoticed meaning. Preserve the starting prompt, the reason for refinement and the affected encounters. Changing the task to estimating the fraction of all former workers who agree with a proposition requires a different question and design; calling it another interview amendment does not preserve the original inquiry.
Other design families require their own operational distinctions:
| Inquiry | Consequential detail and return |
|---|---|
| Historical or source-critical | State which inspected documents can establish chronology and how contrary or inaccessible sources affect it. An unavailable earlier series cannot be treated as inspected silence. Return a defeated chronology comparison to RMP.2. |
| Computational or model-based | Specify the model–target relation, input and parameter choices, transformations, environment needs and intended sensitivity or analysis Method. A successful program run cannot supply a missing model–phenomenon justification. |
| Evidence synthesis | Make the supplied review question actionable through eligibility, search arrangements, screening, extraction and appraisal intentions. A convenient source restriction that can change the answer reopens the affected design; reporting the restriction is not sufficient justification. Actual synthesis remains separately performed. |
| Mixed inquiry | Explain what each component contributes, what they share, and how their results will be related. Check shared access, participants, resources and assumptions. Losing an archival chronology component cannot be repaired merely by adding interviews that depend on the same retrospective account. |
These are examples of method-sensitive choices, not a closed taxonomy or a checklist applied in full to each study.
RMP.3:4.5 - Test the whole arrangement and choose the exact return
Read the completed arrangement as a possible piece of work. Could it still expose the error or rival that justified the selected design? Check interactions among selection, access, measurement, timing, resources and records, including their jointly admissible unresolved values.
RMP.2:4.3 supplies the joint-input condition: every admitted combination of PostSelectionNeed values preserves the selected family, core contrast, criticism, feasibility and refusal conditions. A PostSelectionNeed is therefore a bounded remaining need, not anything the team happens to postpone. Apply that condition to the actual combined specification. Do not test each uncertainty while holding the others artificially favourable.
| What the specification reveals | Action and result |
|---|---|
| The choices and their joint effects stay within the selected question/design bounds. | Complete or amend the protocol and its reasons. State the supported scope, remaining bounded needs and change conditions, then proceed only with the supported work. |
| A particular external result is still missing, but every admissible value preserves the selected design. | Name the needed result, its owner, the action it blocks and the condition for resuming that action. Retain the design and the usable portions of the specification; do not call the blocked part executable. |
| A new value can defeat the selected family, contrast, criticism, feasibility or refusal condition. | Return that value and its consequences to RMP.2. Preserve the previous decision and any actual work in the trace. The protocol is not a place to silently select another design. |
| The question, intended knowledge change, population/context claim or useful stop changes. | Return the changed question to RMP.1 and carry its answer into the dependent design and specification. |
| Permission, resources or another practical decision are withheld independently of evidence sufficiency. | Return to that responsible owner. Preserve the research question and identify the prohibited action. Inability to proceed is not an evidence-sufficient stop. |
The distinction can be small but decisive. Waiting for the exact calibration result can block a measurement while the design remains justified if all admitted results preserve the required discrimination. Discovering that the instrument may not distinguish the competing mechanisms reopens design selection. A numerical value is not “mere detail” simply because it arrives late.
RMP.3:4.6 - Leave a usable operational result
The ResearchProtocolAndOperationalizationMap is usable for its stated scope when another suitably competent practitioner can recover:
- the brief and selected design being elaborated;
- the consequential operational choices and their question-relative reasons;
- the supplied Methods, qualifications and practical conditions on which those choices depend;
- the planned conduct, use of material and required records; and
- the remaining limitations and conditions for an amendment, return or stop.
These are meanings to preserve, not five new forms. A small inquiry may put them beside the relevant procedure in an existing protocol. Link larger source and instrument accounts by their actual versions and uses.
An unfinished specification can still be a useful partial result. Name its unsupported action or inference precisely. The next useful move is then obtaining the missing result or revisiting the defeated choice, not extending a protocol whose core comparison no longer works.
RMP.3:5 - Archetypal Grounding
The following cases are constructed examples with supplied domain premises. Their identifiers and counts illustrate records and dependence; they are not recommended sample sizes, scientific thresholds or performed studies.
RMP.3:5.1 - Pump-P4: from a mechanism question to an executable comparison
The brief asks whether the accelerated condition preserves the field seal-degradation mechanism within a specified material/fluid envelope. The selected design compares accelerated and field-representative conditions. Assume the domain owner supplies a valid mechanism marker, qualified measurement procedure, safe conditions and an adequate specimen plan.
The team adds these entries to its existing protocol:
| Protocol choice | Question-relative reason and required record |
|---|---|
| Give each seal a specimen ID and retain its material batch and assigned condition. | The comparison concerns degradation under the two conditions; material and allocation must remain recoverable. |
| Measure the supplied mechanism marker at the design’s specified exposure points with the qualified procedure. | A difference must bear on mechanism, not merely on total visible wear. Retain the procedure version, calibration basis, time and uncertainty. |
| Treat three readings from one seal as repeated observations of that seal. | Repetition can characterize measurement variation; it does not triple the independent specimen count in the supplied comparison. |
| Preserve missing observations and departures before preparing the comparison data. | A critic needs to distinguish material behaviour from allocation, handling and selection effects. |
This is an operationalization of the selected design because each choice preserves the mechanism question and names the material needed to challenge it. The team does not obtain permission or a maintenance decision merely by completing the protocol.
Now change one premise: the measurement owner reports that the marker cannot distinguish thermal degradation from the competing field mechanism under these conditions. The appropriate result is an RMP.2 return carrying that report and the lost discrimination. Substituting a more convenient wear score would require a justified new evidence relation. The brief and unaffected specimen information can remain useful.
On the valid-marker branch, specimen P4-07 is later damaged in handling before an observation. The protocol’s planned missingness treatment tells the team what intention to consult; RMP.4 records what actually happened and what was decided. Whether the remaining data support an inference is a later analytical question.
RMP.3:5.2 - ResidentStream-S17: a missing comparison is not a scheduling detail
Residents have a compatible brief and a selected spatial-temporal comparison of salinity-related observations. The measurement and site owners supply a valid method, the calibration and uncertainty basis, permissible access and a feasible plan for informative hydrological conditions.
The operational specification identifies the reach and sampling point, the condition triggering the observation, the time relation between reaches, the qualified measurement result to obtain, and the weather, access and calibration records needed to interpret the comparison. A laboratory may supply the measurement result; residents need not recreate its internal Method.
If the reference reach becomes inaccessible during the informative thaw event while downstream observations remain possible, the original paired comparison has lost a required observation. Record the site, period and access failure, preserve the downstream material, and return to RMP.2. A later dry-weather reference is a different comparison premise, not routine completion of the old schedule. A narrower use can proceed only under the question/design that justifies it.
RMP.3:6 - Bias-Annotation
Operational choices determine whose cases and which phenomena become visible. Inspect convenience sampling, survivorship, accessible-source bias and exclusions that protect a favoured explanation. A well-documented restriction can remain an answer-changing bias.
Also inspect the researcher’s position. Prompt wording, relationships, technical competence and access can shape encounters and interpretations. Preserve the contribution that matters to the chosen approach; do not impose one philosophy of interpretation or universal coder-agreement requirement.
Instrument familiarity and organizational pressure favour choices that are easy to execute and report. Ask whether an inconvenient rival would still be observable under the completed arrangement. In mixed inquiry, check whether apparently different components rely on the same selected cases or assumptions.
RMP.3:7 - Conformance Checklist
Use this checklist to examine the operational specification, not as a substitute for the domain Methods it relies on.
- The practitioner can recover a compatible question, current frame and selected design, with their criticism and useful-stop conditions.
- Each consequential operation has a recoverable question-relative reason and the units, context and timing needed to use its material.
- Measurement, source, analysis and practical-owner results are identified with their applicable conditions; proposed results are not represented as supplied.
- The specification distinguishes intentions from performed analysis and states the records required before relevant information is lost.
- Commitment and amendment timing is recoverable relative to the information already available. Legitimate adaptation remains method-appropriate.
- Unresolved operational choices satisfy the RMP.2 joint-input condition; a blocked action is named even when design selection remains valid.
- A defeated selection premise returns to RMP.2; a changed question returns to RMP.1; independent permission and resource decisions return to their owners.
- The result states which work is executable, which part is still unsupported and what will permit a return or continuation.
For a disputed or consequential use, follow one proposed observation from its actual unit and procedure through the planned comparison to the error it is supposed to expose. Then test the least favourable jointly admissible unresolved conditions. Correctly filled fields do not answer either question.
RMP.3:8 - Common Anti-Patterns and How to Avoid Them
| Failure | Why it fails | Repair |
|---|---|---|
| “We use the standard scale.” | Familiarity conceals whether administration, scoring or the construct relation fits this inquiry. | Recover the qualified relation and actual use; obtain a domain result or return the defeated design premise. |
| Three readings become three specimens. | The information claim silently changes its unit and dependence. | Keep observation and inference units distinct and use the applicable sampling and analysis rationale. |
| A completed reporting checklist is treated as a justified protocol. | Reporting detail cannot select or validate the research relation. | Connect each consequential choice to the question and supplied Method. |
| Every adaptation is either forbidden or hidden. | The first suppresses legitimate inquiry; the second removes criticism of selection and timing. | State justified commitments and preserve actual reasons, timing and scope of change. |
| A lost comparison is annotated but its original claim survives. | The record becomes more transparent while the design remains defeated. | Return the failed dependency to RMP.2 and identify what narrower work is still supported. |
| Each remaining need is tested with all others favourable. | The combined arrangement may be infeasible or incapable of criticism. | Apply the joint-input test to admissible combinations. |
| The protocol substitutes for permission or a scientific conclusion. | Research preparation does not supply either result. | Obtain the exact owner decision or the later analysis and criticism. |
RMP.3:9 - Consequences
The practitioner can see which choices merely complete a selected design and which change its ability to answer. Records are planned early enough to preserve important distinctions, and existing qualified procedures remain usable without duplicate paperwork.
The cost is deliberate explanation of choices that might otherwise remain tacit. Some apparently ready studies will return to design selection or await an external result. This cost is justified when it prevents work whose observations could never answer the intended question. The method does not guarantee a useful finding or remove domain uncertainty.
RMP.3:10 - Architectural Rationale
Separating design selection from operationalization protects two useful decisions. RMP.2 can compare evidence strategies without pretending every local detail is settled. RMP.3 can make one selected strategy executable without being allowed to change its criticism silently. The joint-input condition connects them: unresolved details are acceptable only inside the selected design’s admitted bounds.
The operational specification and the actual trace remain distinct because an intention and an account of conduct answer different questions. They can occupy one notebook and can develop together. RMP.4 also supports inherited work whose prospective specification no longer exists.
The cheaper alternative is often best: use a competent domain protocol and adequate records directly. The RMP contribution is needed when the question-to-operation connection, change consequence or research-use limitation remains unresolved. A universal form would add burden while obscuring differences among measurement, interpretation and source criticism.
RMP.3:11 - SoTA-Echoing
Practice question. How much and what kind of advance specification preserves a research question while allowing the inquiry its justified flexibility?
Selected line. Adapt question-relative, method-sensitive specification with inspectable commitments and amendments. Compared with either a universal protocol checklist or an unrestricted evolving notebook, this preserves both methodological fit and the timing needed for criticism. It deliberately requires reasons for consequential choices; it does not require more documentation where an adequate domain protocol already supplies them.
| Comparison and source role | Adopt, adapt or reject; effect on the Method and limit |
|---|---|
| Flake and Fried’s Measurement Schmeasurement is a methodological candidate against unexplained measure selection. Goos et al.’s 2026 measurement study supplies bounded failure evidence from Many Labs measures. | Adapt the recoverable construct–measure relation and actual administration/scoring choices in §4.2. Reject publication or replication status as sufficient qualification for a changed measurement use. The sources neither validate the local instrument nor establish a universal research failure rate. |
| Lakens’s Sample Size Justification compares quantitative justifications tied to inferential aims and constraints. | Adapt its question-relative rationale in §4.2. Reject an unexplained inherited count and the treatment of a resource-limited sample as automatically sufficient. Applicable statistical calculations remain supplied Methods; power analysis is not a universal standard for qualitative or historical adequacy. |
| SPIRIT 2025 is a bounded reporting comparator; TOP 2025 distinguishes registration, protocol and analysis-plan practices. | Adapt consequential specification and separate timed commitments in §§4.2–4.4. Reject the checklist or preregistration label as proof of design quality. Trial-specific objects apply where that design has them, not to every inquiry. |
| Haven et al.’s qualitative preregistration study supplies a candidate starting account. Braun and Clarke’s RTARG argument and review challenges generic qualitative reporting and assessment defaults. | Adapt explicit starting commitments with approach-appropriate evolution in §4.4. Reject universal pre-data freezing and universal coder agreement. The Delphi consensus and reflexive-TA critique do not establish one procedure for all qualitative traditions. |
| AHA’s professional standards and the Cochrane Handbook, chapter 2 supply source-critical and question-led selection comparators. | Adapt provenance, contrary material and question-relative selection in §§4.2 and 4.4. These practices cannot restore a lost archive or supply the actual historical or synthesis conclusion. |
The combined arrangement is a reasoned methodological synthesis, not a demonstrated universal improvement over every research practice. Reopen the affected choice when a changed construct, approach, source corpus or access condition defeats its research connection, or when a better domain procedure preserves that connection and its criticism with less burden.
RMP.3:12 - Relations
- RMP.1 supplies the bounded research question and useful stop; a changed question or receiving use returns there.
- RMP.2, especially §4.3, supplies the selected design and joint-input condition; a defeated selection premise returns there.
- RMP.4 preserves actual conduct, changes and receiving limitations. It can begin capture while operationalization is developing.
- FPF C.16 supplies measurement and characterization discipline; FPF A.10 supplies claim-bound evidence and provenance discipline. RMP.3 adds the particular research question and operational connection.
- Qualified domain, statistical, interpretive, source, ethics, safety, access and resource practices supply their own results. Method Engineering applies when the reusable Method itself needs design or repair.
- RMP.5 connects the actual material and analysis to a bounded claim; RMP.6 chooses a useful claim-relative credibility examination and interprets its actual result. An operational protocol supplies relevant intentions and choices; it does not perform either contribution.
RMP.3:End