Ten eval files pinned their reply engine to http://localhost:11434 and the judge only spoke Ollama's /api/tags and /api/chat, so pointing the suite at Strata (OpenAI-compatible /v1 only) skipped or broke most evals. - MockConfig and every eval config read EVAL_JUDGE_BASE_URL. - The judge availability check reads /v1/models and the judge call goes through jarvis.llm when the URL ends in /v1; the Ollama path is unchanged. - run_evals.sh probes /models for a /v1 URL. The intent-judge and listener evals stay pinned to gemma4:e2b on local Ollama. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
7.2 KiB
Executable File
7.2 KiB
Executable File