Airliner cockpit instrument panels glowing at dusk with the horizon visible through the windscreen
Airliner cockpit instrument panels glowing at dusk with the horizon visible through the windscreen

7 mins read time

AI Product Design: Patterns for Models That Get Things Wrong

Designing interfaces for systems that are sometimes wrong. Patterns for provenance, cheap correction, refusal and moving the trust boundary.

Ayoub Kada

7 mins read time

AI Product Design: Patterns for Models That Get Things Wrong

Designing interfaces for systems that are sometimes wrong. Patterns for provenance, cheap correction, refusal and moving the trust boundary.

Ayoub Kada

AI product design is the practice of designing interfaces for systems whose output is a probability rather than a guarantee. The job is not to make a model look intelligent, but to keep a capable and occasionally wrong system useful. Conventional interface design assumes correctness. When a feature is powered by a model, correctness becomes a range, and new questions appear: how does someone check this, how much does it cost them to fix it, and what happens the third time it is wrong about something they cared about.

AI product design is the practice of designing interfaces for systems whose output is a probability rather than a guarantee. The job is not to make a model look intelligent. It is to build a surface where a capable but occasionally wrong system stays useful, and where the person using it can tell the difference between the two.

Conventional interface design assumes correctness. A button either saves the record or it does not. Design work goes into clarity, hierarchy and flow. When a feature is powered by a model, correctness becomes a range, and a new set of questions appears: how does someone check this, how much does it cost them to fix it, and what happens the third time it is wrong about something they cared about.

That last question is the one that decides whether an AI feature survives its first month.

The trust budget

A useful way to think about the whole discipline: every AI feature opens an account with the user, and every visibly wrong output is a withdrawal. Correct outputs make small deposits. Wrong outputs that the user catches easily make small withdrawals. Wrong outputs that slip through and cause real work make very large ones.

Interface design sets the exchange rate. The same underlying model can run a healthy account or an overdrawn one depending on decisions that have nothing to do with machine learning:

  • Whether the user can see where an answer came from

  • How long it takes to correct a flawed output versus redo it manually

  • Whether the system ever declines to answer

  • Whether an action can be undone

  • Whether the product promised more than it delivers

None of those are model problems. They are design problems, and they are usually cheaper to fix than model quality.

Patterns that work

These are the ones that earn their place repeatedly. Each addresses a specific failure, which is the only sensible reason to add anything to an interface.

Pattern

Use when

Failure it prevents

Provenance and citation

Output is grounded in documents or data

User cannot verify, so they either trust blindly or abandon

Editable output

Output is a draft, not a decision

Correction costs more than doing it manually

Scoped regeneration

Part of the output is good

Whole answer thrown away to fix one paragraph

Explicit refusal

Confidence is genuinely low

Confident nonsense, the most expensive failure

Propose and confirm

The action has consequences

System acts on a wrong conclusion

Visible undo

Any state change

User will not try the automated path at all

Streaming output

Response takes more than a moment

Perceived failure, abandoned request

Provenance beats explanation

Showing the source passage a claim came from is more valuable than explaining how the model reasoned. Sources are checkable in seconds. Reasoning narratives are not, and a fluent explanation of a wrong answer makes the wrong answer more persuasive rather than less.

Practically: link the span of text to the span of source. Let the user hover or click to see the original. If there is no source, say so plainly rather than producing an unsourced sentence that looks identical to a sourced one.

Confidence is harder than it looks

Numeric confidence scores usually fail in product. Most people cannot act differently on 0.72 versus 0.61, and a displayed number implies a precision the system does not have.

What works better is behavioural confidence: the system does something different when it is unsure. It asks a clarifying question, offers two options instead of one, marks a field for review, or declines. The signal arrives as a change in the interaction rather than a decoration on it.

Make correction cheaper than rejection

The single most predictive question about whether an AI feature gets used: when the output is imperfect, is fixing it faster than starting over? If not, people stop using the feature, and they stop quietly.

Editable output, partial acceptance, and regeneration scoped to a selection all reduce that cost. So does keeping the user's original input visible and reusable. So does not wiping a flawed output the moment they ask for another one.

Refusal is a feature

A model that says it does not know is more trustworthy than one that always answers, and users notice quickly. Refusal has to be designed and tested, because it rarely emerges without deliberate effort, and because a refusal that reads as a failure is worse than no refusal at all. The wording matters: what the system could not determine, and what the person can do next.

Move the trust boundary deliberately

Most AI features should start as proposals that a person confirms, and earn the right to act automatically only where the evidence supports it. Going the other way, from automatic to supervised, is a retreat users read as a broken promise.

Anti-patterns

Chat as the default interface. A conversation is the right shape when the task is genuinely open-ended. For most product work the task has structure, and a form, a table or a diff shows that structure better than a text box. Chat is often chosen because it is easy to build, not because it fits.

Certainty theatre. Confident typography, no sources, no hedging, no refusals. It tests well in a demo and erodes fast in use.

The infinite regenerate button. If the answer to a bad output is always to roll the dice again, the interface has no opinion about what went wrong and the user does the debugging.

Hiding that it is a model. People calibrate their scrutiny based on what they think they are using. Concealing it produces exactly the wrong calibration, and feels like a trick once discovered.

Designing the happy path only. The interesting states in an AI product are the degraded ones: no result, low confidence, partial failure, timeout, refusal. These deserve as much design attention as the success case, and usually get almost none.

What to measure

Qualitative feedback on AI features is unusually unreliable, because people describe the impression rather than the outcome. Two behavioural numbers carry more signal:

Correction rate. How often users edit, reject or redo what the system produced. Rising correction rate is the earliest warning that quality has drifted.

Task completion versus abandonment. How often someone who starts an AI-assisted task finishes it inside the product rather than leaving to do it another way.

Instrument both from the first release. Corrections in particular are the most valuable data the product will generate, because each one marks precisely where the system fell short. Teams that add this later lose the record from their most instructive period.

For the scoping and evaluation side of this work, including how to set a quality threshold before any of it gets designed, see our guide to AI MVP development.

Where design sits in the build

AI product design is not a layer applied after the model works. The interface determines what quality level is actually acceptable, which is an input to the engineering work rather than an output of it. A product with a strong correction path can ship on a weaker model. A product that acts automatically needs a much stronger one.

That makes the sequencing worth stating plainly: decide the interaction model early, because it sets the bar the system has to clear.

Frequently asked questions

What is the difference between AI product design and normal UX design?

The fundamentals are the same. What changes is that output correctness is variable, so the interface has to support verification, correction and refusal as first-class states rather than edge cases. If you are new to the underlying disciplines, our explainer on the difference between UI and UX design covers the base layer.

Should every AI feature use a chat interface?

No, and the default assumption that it should is one of the more expensive mistakes in current product work. Chat suits open-ended tasks. Structured tasks are better served by structured interfaces where the model fills, suggests or checks rather than converses.

How do you design for a model that keeps changing?

Design the interaction around capability ranges rather than a specific model's behaviour. If the interface assumes the output might be wrong, needs checking, and can be corrected, a model change adjusts the frequency of those events instead of breaking the design.

How much does the interface really affect perceived quality?

Enough that two products on the same model can feel completely different. Verification, correction cost and honest failure states do more for perceived reliability than a marginal improvement in raw output quality, and they are usually faster to change.

When should an AI feature act without asking?

When the action is reversible, low consequence, and the evidence from real usage supports it. Reversibility matters most. Anything the user cannot undo should stay a proposal until there is strong reason to change that.

Getting it right

The teams that build AI products people keep using are not usually the ones with the best model access. They are the ones who assumed the system would be wrong sometimes, designed for that honestly, and made it cheap to recover.

At Digcy we work across product design, UI/UX design and web app design for AI and SaaS products, including Quantillium. We have also written about how our design and engineering process changed in the AI era.

If you are designing an AI feature and want a second opinion on the interaction model before it gets built, get in touch.

Let’s keep in touch.

Discover more about high-performance web design. Follow us on Twitter and Instagram.

Have a project in mind?

By submitting, you agree to our Terms and Privacy Policy.

Let's Talk

Share your project requirements here or send us an email at hello@digcy.com we will follow up in less than 24 hrs

Have a project in mind?

By submitting, you agree to our Terms and Privacy Policy.

Let's Talk

Share your project requirements here or send us an email at hello@digcy.com we will follow up in less than 24 hrs

Have a project in mind?

By submitting, you agree to our Terms and Privacy Policy.

Let's Talk

Share your project requirements here or send us an email at hello@digcy.com we will follow up in less than 24 hrs