MKT.10:4 - Solution

MKT.10:4.1 - State the decision and the result that would change it

Name the actual alternatives: retain the existing invitation, add guided help, use another channel, reduce volume, or stop the intervention. Keep the useful customer result and the provider’s decision visible. An increase in replies can answer a reach question while remaining insufficient for an expansion justified by better customer performance.

Specify whose result matters, what would count, when it must occur and what downside can defeat the action. Include different participants when their outcomes differ: the purchaser can save effort while the user acquires extra work. MKT.6 supplies the agreed result; MKT.5 supplies the intended experience conditions. Neither supplies an observed effect by itself.

Determine the kind of answer required. “How many trials were completed?” is descriptive. “Which customers are likely to request help?” is predictive. “How many additional useful completions would this invitation produce compared with the current invitation?” is causal. These questions can use related data but require different grounds. A descriptive answer may be enough to stop an infeasible service even when its causal benefit remains unresolved.

Choose a practically consequential difference before interpreting a favourable fluctuation. Its basis can be the value of the result, the burden of the intervention and the consequences of a mistaken decision. Use a justified local threshold or a comparison of alternatives; do not invent a universal minimum response rate.

MKT.10:4.2 - Make each observation interpretable

Define the observation unit, eligible population, period, source and counting rule. For a response rate, say who had an opportunity to respond and what response counts. Distinguish unique people, organisations, opportunities and events. Several purchases by one organisation need not be several independent observations; a missing report is not necessarily a failed result.

Match the measure to the claimed outcome. A completed form can establish a submitted request. It cannot by itself establish informed choice, successful work or a favourable experience. Ask for the additional observation only when the decision depends on it. Where a customer reports an experience, preserve the question, timing, scale and respondent; an ordinal rating does not automatically support arithmetic differences, monetary conversion or comparison with another questionnaire.

Check how the data are produced. A new reminder may change who answers a survey, a new interface may change what gets logged, and better records may increase the apparent number of problems. Account for these changes before interpreting a trend. Retain consequential uncertainty about missing observations and selective follow-up.

Agree how much observation is needed and how to obtain it without defeating the intervention or its receiving service. Use existing adequate records; ask for a limited observation when it can resolve the decision. MKT.12 supplies a focused inquiry where the unresolved issue is what the customer’s work or answer means.

MKT.10:4.3 - Construct the causal contrast and its credible comparison

When contribution means a causal effect, define the intervention and comparison as ways of acting, including intensity, timing, support and consequential variants. Specify the target population, outcome and horizon. An offer of help and actual use of that help are different interventions. An invitation sent to one team may also affect another team through shared staff or shared information.

Use C.28.CM, Construct and Challenge a Causal Model to explain why the contrast could change the outcome and what else could produce the observations. Recover common causes, selection, intermediate results and feedback that change the inference. A journey diagram or chronological sequence is not a causal model merely because arrows connect its events.

Then obtain an identification answer through MMP.15, Identify an Intervention Effect from Available Data when this requires specialist analysis. The request names the contrast and available data, including how participants entered them. The supplier returns which effect the data can identify, under which assumptions, or a useful bound or reason it remains unidentified. More accurate fitting cannot repair an effect the data do not identify.

Select a feasible comparison suited to the question. Random allocation can make groups comparable for the effect of the assigned intervention if allocation, follow-up and interference conditions are adequate. It does not automatically identify the effect of actual use among self-selected users. Observational comparisons require defensible assumptions about relevant differences, usable variation and measurement. A before-and-after comparison requires a reason that other changes do not explain the result. Asking for “a control group” without these conditions supplies no causal answer.

Design the comparison with its operators. Avoid allocating a promise the service cannot fulfil or depriving people of an existing commitment. Arrange follow-up, exception handling and a stopping decision if the work becomes infeasible. If the credible comparison is unavailable, return the supported descriptive result and the unresolved causal question. A bounded action under uncertainty can still be chosen explicitly.

MKT.10:4.4 - Estimate the supported effect and challenge its use

Give the identified question and qualified observations to an adequate estimation method. Retain the estimated magnitude, uncertainty and consequential assumptions. Statistical precision addresses variability under the method; it does not remove selection, measurement error, missing follow-up or a wrong causal model.

Check the conclusions that matter for the decision. Could plausible missing outcomes reverse it? Does a result disappear when an unsupported comparison is removed? Does an average conceal a group for whom the intervention is impractical or harmful? A subgroup claim needs adequate grounds; dividing the same small dataset repeatedly does not create them.

Keep discovery and confirmation distinct when many messages, channels or outcomes were examined. A selected favourable result may justify a new bounded comparison rather than immediate expansion. If a decision permits repeated inspection, agree how the resulting uncertainty will be handled with the analyst instead of repeatedly stopping at the first attractive number.

Before applying the result elsewhere, compare the new population, baseline service, intervention and support conditions. A trial with spare specialist capacity may not describe a larger programme that queues every customer. Establish whether the earlier estimate applies under those conditions, or obtain a new comparison. A precise result for the wrong use remains an inadequate answer.

MKT.10:4.5 - Compare the whole contribution with its burden

Use MA.8, Account for Customer and Product Economics Over Time when the decision depends on economic consequences. Preserve the target unit and horizon, distinguish historical costs from costs changed by the future alternative, and place receipts and payments at their relevant dates. Count acquisition, preparation, adaptation, delivery, support, recovery and remaining obligations where they change the comparison.

A customer’s purchase value is not automatically incremental profit. Ask what revenue and expense would differ under the alternatives, which contributions would have happened anyway, and whether later work has been included. Avoid counting the same additional outcome under several channels or counting both its estimated monetary benefit and the same benefit inside a customer-value total.

Combine uncertainty honestly. An uncertain causal effect and an uncertain margin produce an uncertain economic conclusion. Show the threshold at which the choice changes or compare credible ranges when a point estimate would conceal the issue. The largest expected contribution can still be infeasible because of cash timing, scarce staff or obligations to current customers. MKT.11 supplies actual delivery conditions; its missing capacity is not repaired by a favourable average return.

Use nonmonetary consequences in their own terms where no adequate conversion exists. A client’s ability to complete important work, burden and experience can affect the decision without a fabricated price. State whose objective is served and what trade-off the decision maker accepts.

MKT.10:4.6 - Return the decision and the conditions for revisiting it

Return the compared alternatives, what the observations establish, the causal conclusion if supported, the relevant burden and the decision that follows. State what remains uncertain and why that uncertainty permits or limits the action. Continue, change, run a smaller informative comparison, defer expansion or stop according to this answer.

Send the consequence to the receiving work. MKT.3 can change the invitation; MKT.5 or MKT.6 can change the proposed contribution; MKT.11 can change the supply arrangement; MKT.13 can bound deployment of the commercial model. Keep a needed action and its responsible recipient explicit rather than returning an uninterpreted dashboard.

Reopen the answer when the intervention, population, measurement, service capacity, economic conditions or a material causal assumption changes. Keep the original result with its scope; a later disappointing outcome does not justify rewriting what the earlier comparison actually observed.