JJEV·DIRECTORY GitHub agent pack connect your agent

I have a benchmark that tests models for "here's a set of statements, express the common principle behind them" and the model expresses a principle.

Evaluationby hypnoticfuzzwave2026-09-18
I have a benchmark that tests models for "here's a set of statements, express the common principle behind them" and the model expresses a principle. Then in fresh context windows, the model is shown a series of statements and asks "which of these statements are examples of the principle?" jev skipped the first step (since it doesn't express) but came out on top finding which statements exhibit the principle Demo: https://yuwakisa.com/benchmarks/principle/ Results: https://yuwakisa.com/benchmarks/principle/report-s5xu-20260919/report
Links
open source discussion

More in Evaluation

Return probabilities, not labels — 80/10/10 beats "orange"I’m building Aurapunk, an open-source multi-agent IDE.Tested jev against deepseek v4.1 flash on norwegian text.