JJEV·DIRECTORY GitHub agent pack connect your agent

Failure mode report: a Choice with no escape hatch answers at confidence 1.00 The jaggedness page asks for failure

Moneyby Suraj Phanindra2026-09-17
Failure mode report: a Choice with no escape hatch answers at confidence 1.00 The jaggedness page asks for failure modes, so here's one — though it's a request-design failure rather than a model one, and I think that's what makes it worth flagging. A Choice whose options don't cover the input still has to pick something, and it does so at maximum confidence: ``` options: [meeting request, pricing question, support issue, introduction] state: "Please remove me from this mailing list. I never signed up." no escape hatch -> "support issue" confidence 1.00 + {"other": ...} -> "other" confidence 0.93 ``` Reproduced in a second domain — a rental listing reading "No pets of any kind" came back as "cats and dogs" at 0.65. Exact inverse of the truth. What makes this one sharp: the usual mitigation is to threshold on confidence and route the uncertain cases to a human. That's structurally blind here, because the model is
Links
open source discussion

More in Money

We integrated Jev in our chat on public data for Bulgaria (elections, procurements, budgets, politicians etc).Umm, will gather better data when my OpenAI token budget resets tomorrow, had to tinker a bit.Hi everyone, I just wrote up a small experiment testing TypeSafe’s Jev as a trusted and cheaper monitor alternate for AI Control.