Typesafe AI is still inconsistent when it comes to dimensional reasoning.

Typesafe AI is still inconsistent when it comes to dimensional reasoning. > from typesafe_sdk import Choice, Noul, Score, TypeSafeClient, RetryPolicy > > scenario = """ > Imagine this. In the world where people have practically instant reflex and can dodge, the only way to hit the enemy is to saturate the battlefield with enough bullet such that there is nowhere to run. You can move in any direction. > > Let C be a constant, a be defender acceleration, d be distance, v be bullet velocity, H be hitbox size. > > Which equation most accurately describes the number of bullet required per hit? > > """ > > choices = """ > Cad/vH > C a^2 (d/v)^4/H > C a^2 H (d/v)^2 > C a H d / v > C a^2 (d/v)^3/H > C a (d/v)^3/H > C a (d/v)^4/H > None of the above > """.strip().split("\n") > > scenario = scenario.strip().replace("\n"," ") > > with TypeSafeClient(retry=RetryPolicy(max_retries=3, backoff_max=0.2, timeout=1.0)) as client: > response = client.system_one( > state={"Scenario": scenario}, > questions = {"Answer": Choice(instructions = "Which equation most accurately des