Failure mode report: a Choice with no escape hatch answers at confidence 1.00 The jaggedness page asks for failure
Moneyby Suraj Phanindra2026-09-17
Failure mode report: a Choice with no escape hatch answers at confidence 1.00
The jaggedness page asks for failure modes, so here's one — though it's a request-design failure rather than a model one, and I think that's what makes it worth flagging.
A Choice whose options don't cover the input still has to pick something, and it does so at maximum confidence:
```
options: [meeting request, pricing question, support issue, introduction]
state: "Please remove me from this mailing list. I never signed up."
no escape hatch -> "support issue" confidence 1.00
+ {"other": ...} -> "other" confidence 0.93
```
Reproduced in a second domain — a rental listing reading "No pets of any kind" came back as "cats and dogs" at 0.65. Exact inverse of the truth.
What makes this one sharp: the usual mitigation is to threshold on confidence and route the uncertain cases to a human. That's structurally blind here, because the model is
Links