Reference architecture 02

Support deflection that knows when to stop.

The hard part of a support agent is not answering questions. It is recognising the questions it should not answer, and handing those over before it has already done damage.

Hybrid retrieval
Tunable handoff
Full conversation audit

All Reference Architectures →

THE PROBLEM

Deflection rate is the wrong headline metric.

Every support-AI vendor quotes a deflection rate. It is close to meaningless on its own, because you can drive it arbitrarily high by having the agent answer everything confidently — including the things it has no basis for. The tickets stop arriving; the damage arrives later, as churn, as a refund, or as a compliance incident.

The pair of numbers that matters is deflection rate at a fixed, measured accuracy floor. An agent that resolves 40% of tickets and is right ~always is worth more than one that resolves 75% and is confidently wrong one time in eight — because the second one destroys trust in the channel, and trust does not come back.

That reframing changes the architecture. The interesting component is not the generator. It is the gate in front of the handoff.

The design

TICKET PATH

01

Intake

email · chat · widget
02

Classify

intent + risk tier
03

Retrieve

docs + account state
04

Draft

answer + citations
05

Gate

evidence + risk check
06 · Branch / escalation

Human

with full context
07

Send

logged + scored

Lower box = escalation pathMarker = one ticket through the system

Risk tier is assigned at classification, before retrieval — a billing or security question is escalated on its category alone, however confident the model later becomes.

Two retrieval sources, not one.

Product documentation answers "how does this work". Account state answers "why is my thing broken". Most deployments wire up only the first and then wonder why the agent deflects nothing useful — the majority of real tickets are account-specific.
Risk tiering happens first.

Certain categories never get an autonomous answer regardless of confidence: billing disputes, account deletion, security reports, anything with legal exposure. This is a static policy, not a model judgement, because a model's confidence is exactly the thing you cannot trust in the tail.
The gate checks evidence, not certainty.

A language model's self-reported confidence is poorly calibrated. The gate instead asks a mechanical question: does every claim in this draft trace to a retrieved passage? An answer containing an unsupported assertion is escalated even if the model is sure.
Handoffs carry the work.

When the agent escalates, the human receives the retrieved context, the draft, and the reason for escalation. A handoff that dumps a raw ticket back on a person has saved nothing.

agent/gate.py PYTHON

RISK_ALWAYS_ESCALATE = {class="text-emerald-data">"billing_dispute", class="text-emerald-data">"account_deletion",
                                        class="text-emerald-data">"security_report", class="text-emerald-data">"legal"}

                def decide(ticket, draft, retrieved):
                    class="text-dim"># Policy beats confidence. Category alone can escalate.
                    if ticket.category in RISK_ALWAYS_ESCALATE:
                        return Escalate(reason=class="text-emerald-data">"risk_category")

                    class="text-dim"># Every claim must trace to something we retrieved.
                    unsupported = [c for c in draft.claims
                                   if not c.supported_by(retrieved)]
                    if unsupported:
                        return Escalate(reason=class="text-emerald-data">"unsupported_claim",
                                        detail=unsupported)

                    if draft.needs_account_data and not ticket.account_linked:
                        return Escalate(reason=class="text-emerald-data">"missing_account_context")

                    return Send(draft)

The gate is deliberately boring and inspectable. Every escalation reason is a named constant, so the escalation mix is analysable.

Where it breaks

Documentation that is quietly out of date

Retrieval is faithful to whatever it retrieves. If the docs describe last year's pricing, the agent will cite last year's pricing accurately. Mitigation: freshness metadata on every source, and a hard exclusion for anything past a staleness threshold.

Multi-turn drift

A conversation that starts in-scope wanders out of it by turn five, and the original risk classification no longer applies. Mitigation: re-classify on every turn, not just the first.

Users who learn to jailbreak the gate

Once customers realise a phrasing gets a human, they use it — which is rational, and which collapses your deflection rate. Mitigation: monitor escalation-reason distribution over time; a spike in one reason is a signal about user behaviour, not model quality.

Deflection measured at the wrong boundary

A ticket the agent "resolved" that reopens two days later was not deflected. Mitigation: measure deflection at a 7-day reopen window, which is usually 10–20 points below the number a vendor quotes on day one.

What to measure

THE EVALUATION THAT MATTERS

Target by task
Task	n	Baseline	Target
Answer accuracy on deflected tickets	weekly sample, 200+	human agent rate	≥ human
Deflection rate at 7-day reopen window	all tickets	0%	measured, not promised
Escalations with usable context attached	all escalations	n/a	100%
Unsupported claims reaching a customer	all sent	n/a	trend to zero

Method: Deflected tickets are sampled weekly and graded by a support lead blind to whether the answer came from the agent or a human. Accuracy is scored against the same rubric used for human QA, so the comparison is like-for-like. Reopen window is 7 days — a resolution that bounces is counted as a failure, not a deflection. These are the targets we design against and instrument for; they are not results from a specific deployment.

What is your real
deflection ceiling?

Send us a week of anonymised tickets and we will tell you what share is genuinely automatable — including if the answer is 'not many'.

BOOK A TECHNICAL CALL ALL REFERENCE ARCHITECTURES

30-minute technical call · no deck

Let Qubi show you around.

Services

Our Work

Agents We Run

For Enterprise

For Startups

By Industry

Technology

Hosting & Infrastructure

Trust & Security

Comparisons

Reference Architectures

Resources

Where We Work

Company

Support deflection that knows when to stop.

Deflection rate is the wrong headline metric.

The design

Two retrieval sources, not one.

Risk tiering happens first.

The gate checks evidence, not certainty.

Handoffs carry the work.

Where it breaks

Documentation that is quietly out of date

Multi-turn drift

Users who learn to jailbreak the gate

Deflection measured at the wrong boundary

What to measure

What is your real
deflection ceiling?

Real work. Check it yourself.

yourOS

Sonora

Podswap

unOpen.AI

Coherence

Domain Booth

Twenty-one years. Names you know.

Services

Our Work

Agents We Run

For Enterprise

For Startups

By Industry

Technology

Hosting & Infrastructure

Trust & Security

Comparisons

Reference Architectures

Resources

Where We Work

Company

Deflection rate is the wrong headline metric.

The design

Two retrieval sources, not one.

Risk tiering happens first.

The gate checks evidence, not certainty.

Handoffs carry the work.

Where it breaks

Documentation that is quietly out of date

Multi-turn drift

Users who learn to jailbreak the gate

Deflection measured at the wrong boundary

What to measure

What is your realdeflection ceiling?

Real work. Check it yourself.

yourOS

Sonora

Podswap

unOpen.AI

Coherence

Domain Booth

Twenty-one years. Names you know.

What is your real
deflection ceiling?