Skip to main content
All Insights
Responsible AI6 min readResponsible AI note 03

Designing an Honest Abstention State

Sometimes the most responsible output a review tool can produce is a clear statement that it doesn't have enough to say anything.

Article

The temptation to always produce something

Generative systems are, by construction, good at producing plausible-sounding text even from thin input. That's a liability in a professional review context, where a fluent paragraph built on insufficient data is arguably worse than no paragraph at all — it looks complete while quietly being unreliable. Designing against that temptation means building a real alternative: a state where the system explicitly says it cannot produce a reliable draft.

We treat this as a first-class part of the workflow rather than a fallback error message. One of our synthetic demonstration cases is built specifically around incomplete information, so the abstention path gets exercised and reviewed with the same care as every other screen in the product.

What an honest abstention screen says

A good abstention message does three things: it states plainly that a structured summary isn't being generated, it names the category of information that's missing (without inventing specifics that aren't there), and it tells the pharmacist what to do next — typically, gather the missing intake detail and return to the case. What it does not do is hedge with a low-confidence draft dressed up in cautious language, because a hedged draft still invites the same over-reliance a clear refusal avoids.

We also avoid alarming or clinical-sounding language in this state. The tone stays calm and procedural: this is a workflow limitation being surfaced clearly, not a warning about patient risk that the interface isn't positioned to assess.

Abstention as a signal of system honesty

Counterintuitively, a visible abstention path can increase trust in the outputs a system does produce. If a reviewer has seen the system decline to draft a summary when information was thin, they have more reason to believe that the summaries it does generate reflect a genuine judgment that enough structured input was present — rather than a system that always tries and sometimes gets lucky.

This is one reason we consider the abstention case a core part of the product, not an edge case bolted on afterward. Removing it, or softening it into a low-confidence draft, would remove one of the clearest signals a reviewer has about the honesty of the rest of the system.

Where this pattern still has open questions

Exactly where the line sits between 'enough structured information to draft a summary' and 'not enough' is itself a design and, eventually, clinical-governance question that deserves ongoing scrutiny rather than a one-time decision. Our current implementation uses a synthetic case to demonstrate the pattern and interface, and we expect the thresholds behind it to be refined as the workflow matures.

What we're confident in is the shape of the pattern: abstention needs to be visible, explicit, and equally well-designed as the success path — not an afterthought that only shows up when something breaks.

Insights articles explain how this product and its demonstration are designed. They are not clinical guidance and do not represent guideline recommendations.