The tools stage decides whether to keep a model or measure the next one, so a made-up answer must never pass. Each case now has a judge for the spoken answer: numbers must match exactly with their unit (15 or 50 minutes fail a 5-minute timer), weather answers must agree with the rain in the result and give no other temperature, and a refusal fails when it also says the thing was done. A new case asks for a timer with no timer tool offered, the shape Jarvis has today. Unit tests cover the reviewer's counterexamples and that a lying model makes the stage move on to the next candidate. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
13 KiB
13 KiB