Compare commits

...

6 Commits

Author SHA1 Message Date
javis-bot
07615ee7a1 chore(app): version 0.1.21
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-16 21:13:39 +09:00
javis-bot
4d0ae91e8a perf(reply): v2 tool turns get the tool guidance in short, and a shorter reply-language default
Strata reads every reply prompt from the start in 2,048-token steps. The v2
compact prompt carried v1's full tool guidance and constraints (about 900
Qwen3.6 tokens) on every turn with a data tool, and the reply-language
default (about 120 tokens) twice.

COMPACT_TOOL_GUIDANCE keeps the same rules (act instead of refusing, facts
only from the result, look up named things, auto-derived and self-contained
arguments) in about a quarter of the tokens, without English examples; the
reply-language default says the same in half. v1's prompts are unchanged.

Measured on Strata (Qwen3.6, 20 lines of recent conversation): a weather
turn's prompt 3,436 -> 2,722 tokens, a search turn's second call
4,096 -> 3,383. Evals (compact prompt + intent judge, Qwen3.6): 24/24
before, 30/30 twice after (weather location, follow-up arguments, tool-skip
confabulation, search language, reply language, Possessor fidelity, reply
length, multi-turn context).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-16 21:13:08 +09:00
javis-bot
7da5bca783 fix(reply): a one-step turn whose model skips the tool twice is planned and guarded
After the one nudge, a second answer without the tool no longer goes out
as it is: the turn takes the planned path (the planner runs then, one
extra call only on this failure) and the skipped-tool guard runs the
planned tool, so a made-up "24 degrees" answer cannot reach the user. A
plan that needs no tool (a question back to the user) still lets the
answer go out.

Evals (qwen3:8b, EVAL_COMPACT_PROMPT=1 EVAL_INTENT_JUDGE=1, 3 runs):
the five tool-skip/weather/screen/follow-up/router files 72/84 (71/84 on
0.1.20, same known failures); Possessor director-then-filmography 0/3,
also 0/3 on 0.1.20 (qwen3:8b stops after one search; webSearch turns are
still planned).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-16 19:09:11 +09:00
javis-bot
a6932d9b16 perf(reply): v2 turns with one one-step tool skip the planner
When the router's only pick is a tool that does its job in one call
(getWeather, logMeal, fetchMeals, screenView) and the chat model calls
tools natively, the planner no longer runs: on Strata it averaged 2.5 s
per tool turn (2026-11-16 16:45-16:58 engine log, 9 calls) before the
answer could start. Search, browsers, schedule, notes, chat channels and
picks of two or more tools still plan. The rule reads the router's pick,
not the words, so it is language-agnostic.

Without a plan the skipped-tool guard has nothing to run, so these turns
get one nudge instead: an answer given before any tool ran is dropped and
the model is asked to call the tool (or ask for a missing detail).

Evals (qwen3:8b, EVAL_COMPACT_PROMPT=1 EVAL_INTENT_JUDGE=1, 3 runs of
tool_skip_confabulation, weather_autoderive_location, screen_view_tool,
followup_supplies_missing_tool_arg, tool_router_implicit): 71/84 before,
72/84 after, same known failures; planner calls 14 -> 3.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-16 19:00:36 +09:00
javis-bot
6a9b66bdcd chore(app): version 0.1.20
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-16 17:26:56 +09:00
javis-bot
cda8db7fce fix: play on YouTube in one step, Korea as the default location, searches in the user's language
- botBrowser `play`: searches YouTube for the words as said, opens the first video (not an ad,
  without the playlist) and starts it, in one call (an address given opens that page); `type`
  also takes `query`. Live 0.1.19: the model stopped on YouTube's home page or the results, a
  retry was refused as a third call, and the answer still said the video played.
- `brain.location` (기본 위치, default 대한민국) goes to the brain as `location_name`: the time line
  says it without GeoIP (no database on the game PC), and getWeather without a place uses it.
- Planner and webSearch keep search words in the user's language (never translated into
  English), so recommendations fit where the user is.

Evals (qwen3:8b, 3 runs): play ending on a playing video found with the words as said 0/6 -> 5/6;
Korean searches for Korean requests 6/9 -> 8/9.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-16 17:26:30 +09:00
29 changed files with 612 additions and 60 deletions

2
app/Cargo.lock generated
View File

@@ -1520,7 +1520,7 @@ checksum = "3bd1574e617a9a6c1f8f8181bd7e841e1f20e4277607ef28945765188d6284d4"
[[package]]
name = "jarvis-app"
version = "0.1.19"
version = "0.1.21"
dependencies = [
"async-trait",
"base64 0.22.1",

View File

@@ -1,6 +1,6 @@
[package]
name = "jarvis-app"
version = "0.1.19"
version = "0.1.21"
edition = "2021"
rust-version = "1.85"
description = "Jarvis v2 Windows app core: Discord voice, voice worker supervisor, chat channels"

4
app/shell/Cargo.lock generated
View File

@@ -2637,7 +2637,7 @@ checksum = "3bd1574e617a9a6c1f8f8181bd7e841e1f20e4277607ef28945765188d6284d4"
[[package]]
name = "jarvis-app"
version = "0.1.19"
version = "0.1.21"
dependencies = [
"async-trait",
"base64 0.22.1",
@@ -2666,7 +2666,7 @@ dependencies = [
[[package]]
name = "jarvis-shell"
version = "0.1.19"
version = "0.1.21"
dependencies = [
"jarvis-app",
"serde_json",

View File

@@ -1,6 +1,6 @@
[package]
name = "jarvis-shell"
version = "0.1.19"
version = "0.1.21"
edition = "2021"
rust-version = "1.85"
description = "Jarvis v2 management app window (Tauri 2 over the app core's AdminApi)"

View File

@@ -662,10 +662,14 @@ start it first, so nothing answers before the brain can, and stop it last.
- **A server the app does not start**: with `llm.url` (an OpenAI-compatible `/v1` address, in the
settings file only) the app starts nothing; that server must list a model within 30 seconds.
- **Settings**: `llm.context` (default 32768 tokens per request, 4096-262144) and `llm.port`
(default 8080) on the model screen; `llm.url` (default none).
(default 8080) on the model screen; `llm.url` (default none). `brain.location` (기본 위치, on the
model screen, default `대한민국`, up to 100 characters, empty: the brain detects it): where the
people Jarvis answers are, for the time line, weather without a place and searches
(`src/jarvis/utils/location.spec.md`).
- **The brain's settings**: on every start the app writes `config/brain.json` (it owns the file):
`ollama_base_url` the LLM's `/v1`, `ollama_chat_model` the listed id, `db_path`
`memory/jarvis.db`, `disabled_tools` and `mcps` (above, "Features and MCP servers"); the worker gets it as `JARVIS_CONFIG_PATH`. Loading it writes nothing to the
`memory/jarvis.db`, `disabled_tools` and `mcps` (above, "Features and MCP servers"),
`location_name` (`brain.location`, null when empty); the worker gets it as `JARVIS_CONFIG_PATH`. Loading it writes nothing to the
home folder.
## Chat channel names and topics (`app/src/channel_sync.rs`)

View File

@@ -226,8 +226,14 @@ pub struct Settings {
/// The window's close button (X) hides it to the tray instead of quitting (`app.closeButton`:
/// "tray" or "quit", default "quit"; admin.spec.md, "Window and Windows build").
pub close_to_tray: bool,
/// Where the people Jarvis answers are, by default (`brain.location`, default "대한민국"): the
/// brain's location for the time line, weather without a place and searches (admin.spec.md,
/// "LLM"); None (an empty value) leaves it to the brain's own detection.
pub location: Option<String>,
}
pub const DEFAULT_LOCATION: &str = "대한민국";
#[derive(Debug, Clone, PartialEq, Eq)]
pub struct SettingsError(pub String);
@@ -279,6 +285,7 @@ impl Default for Settings {
type_text: Level::Ask, run: Level::Ask,
screen_exclude: ["1Password", "Bitwarden", "KeePass", "KeePassXC"].map(String::from).into() },
close_to_tray: false,
location: Some(DEFAULT_LOCATION.into()),
}
}
}
@@ -632,6 +639,13 @@ pub fn parse_settings(raw: &Value) -> Result<Settings, SettingsError> {
"quit" => false,
_ => return err("app.closeButton must be tray or quit"),
},
location: {
let l = get_str(section(raw, "brain")?, "location", "brain", DEFAULT_LOCATION)?.trim().to_owned();
if l.chars().count() > 100 {
return err("brain.location must be at most 100 characters");
}
(!l.is_empty()).then_some(l)
},
})
}
@@ -1006,6 +1020,12 @@ mod tests {
#[test]
fn the_close_button_choice_is_read_and_checked() {
assert!(!parse_settings(&json!({})).unwrap().close_to_tray, "closing quits by default");
assert_eq!(parse_settings(&json!({})).unwrap().location.as_deref(), Some(DEFAULT_LOCATION));
assert_eq!(parse_settings(&json!({"brain": {"location": " 부산 "}})).unwrap().location.as_deref(), Some("부산"));
assert_eq!(parse_settings(&json!({"brain": {"location": " "}})).unwrap().location, None, "empty: the brain detects it");
for bad in [json!({"brain": {"location": 1}}), json!({"brain": {"location": "가".repeat(101)}}), json!({"brain": 1})] {
assert!(parse_settings(&bad).unwrap_err().0.contains("brain"), "{bad}");
}
assert!(parse_settings(&json!({"app": {"closeButton": "tray"}})).unwrap().close_to_tray);
assert!(!parse_settings(&json!({"app": {"closeButton": "quit"}})).unwrap().close_to_tray);
for bad in [json!({"app": {"closeButton": "hide"}}), json!({"app": {"closeButton": 1}}), json!({"app": 1})] {

View File

@@ -128,6 +128,8 @@ pub fn fields() -> Vec<Field> {
f("voice.tts.speed", Model, Number { min: 0.5, max: 2.0 }, json!(1.5), "말하기 속도(1.0 보통, 기본 1.5, 저장하면 바로 적용)"),
// The LLM (admin.spec.md, "LLM"); `llm.url` (a server the app does not start) is file-only.
f("llm.context", Model, Int { min: 4096, max: 262144 }, json!(32768), "대화 모델이 한 번에 기억하는 양(토큰)"),
f("brain.location", Model, Text { max: 100, non_empty: false }, json!(crate::settings::DEFAULT_LOCATION),
"기본 위치(날씨, 검색, 추천의 기준, 비우면 자동 감지)"),
f("llm.port", Model, Int { min: 1024, max: 65535 }, json!(8080), "대화 모델 포트"),
// The brain's features (admin.spec.md, "Features and MCP servers").
f("features.weather", Features, Bool, json!(true), "날씨"),

View File

@@ -250,6 +250,7 @@ pub fn write_brain_config(data: &Path, base_url: &str, model: &str, settings: &c
"db_path": data.join("memory").join("jarvis.db").to_string_lossy(),
"disabled_tools": crate::features::disabled_tools(settings),
"mcps": crate::features::brain_mcps(&settings.mcp_servers),
"location_name": settings.location,
"_config_version": 1,
});
let mut text = serde_json::to_string_pretty(&cfg).unwrap();
@@ -716,6 +717,11 @@ pub(crate) mod tests {
assert!(Path::new(v["db_path"].as_str().unwrap()).starts_with(&l.data));
assert_eq!(v["disabled_tools"], json!(crate::features::disabled_tools(&s)));
assert_eq!(v["mcps"], crate::features::brain_mcps(&s.mcp_servers));
assert_eq!(v["location_name"], crate::settings::DEFAULT_LOCATION, "the people are in Korea by default");
let none = parse_settings(&json!({"brain": {"location": ""}})).unwrap();
let f = write_brain_config(&l.data, "http://127.0.0.1:8080/v1", "m", &none).unwrap();
let v: Value = serde_json::from_str(&std::fs::read_to_string(f).unwrap()).unwrap();
assert_eq!(v["location_name"], Value::Null);
}
#[cfg(unix)]

View File

@@ -15,7 +15,7 @@ Every distinct LLM call in Jarvis, what feeds it, what consumes it, and how it i
- Redacted user query
- Recent dialogue (last 5 minutes), including in-loop tool-call + tool-role messages from prior replies within the active conversation (tool carryover, `DialogueMemory.record_tool_turn` / `get_recent_turns_with_tools` in [src/jarvis/memory/conversation.py](src/jarvis/memory/conversation.py); per-prompt cap via `cfg.tool_carryover_max_turns` / `tool_carryover_per_entry_chars`; storage cap `_tool_turns_max_storage = 16`; cleared on `stop` signal AND on new-conversation entry; UNTRUSTED WEB EXTRACT fence markers preserved on truncation; both `content` and `tool_calls[*].function.arguments` scrubbed on write)
- Unified system prompt from [src/jarvis/system_prompt.py](src/jarvis/system_prompt.py) + ASR note + tool-protocol guidance. Reply language is resolved by `reply_language_directive(lang, cfg.tts_engine)` where `lang = _resolve_output_language()` — the single source of truth that prefers the settings-web UI value (config JSON `output_language`) over the compose `OUTPUT_LANGUAGE` env, so changing the language in the settings page takes effect. An explicit lock wins (forces "reply only in `<language>`", also forbidding other scripts so small models stop leaking trailing CJK/Hanja); else a Piper/Chatterbox TTS forces English (English-only voices); else (multilingual TTS, no lock) the assistant replies in the user's own language. The v2 voice worker's brain (`src/voice_worker/brain.py`) runs with `tts_engine="melo"`, so v1's English-only Piper default never locks v2 voice or chat answers to English, and passes `default_language` (worker `--reply-language`, default `Korean`): with no lock, `default_language_directive()` makes replies come in that language unless the user explicitly asks for another one, and `build_system_prompt()` rewrites the persona's "in the user's language" clause to "in the reply language" (eval `evals/test_reply_language_default.py`). The directive is inserted near the FRONT of the guidance list so a small model gives it primacy, and the SAME resolved `lang` feeds `build_system_prompt()`, which rewrites the persona's "in the user's language" clause to the locked language so the persona cannot contradict the directive (previously the persona read the raw env while the directive read the config value, so a settings-UI change was honoured by one and ignored by the other). Gated in `_build_initial_system_message()` at [engine.py](src/jarvis/reply/engine.py).
- **v2 compact prompt** (`compact_prompt=True`, the v2 brain): `build_voice_persona()` replaces the v1 persona (about 1.3k characters instead of 7.4k: no single-user long-term memory or on-screen browser rules, answers as short as possible), and of the size-specific components only the ASR note stays; the full tool guidance (`tool_guidance` + `tool_constraints`) is added only when a tool other than `stop`, `toolSearchTool` and `chatChannels` is allowed, else the one-line `COMPACT_ACTION_RULE`. Measured on Strata (Qwen3.6, 2026-11-12): a greeting's reply prompt went from about 4,500 to 1,350 tokens and its prompt read from 1.07 s to 0.36 s (Strata reads in 2,048-token steps). The v2 brain also turns `stream_browser` off. The `[Context: ...]` time carries the 12-hour form beside the 24-hour one (`10:37 (10:37 AM)`): with the short prompt Qwen3.6 read 10:37 as 오후 (pm) 4 of 4 times.
- **v2 compact prompt** (`compact_prompt=True`, the v2 brain): `build_voice_persona()` replaces the v1 persona (about 1.3k characters instead of 7.4k: no single-user long-term memory or on-screen browser rules, answers as short as possible), and of the size-specific components only the ASR note stays; the tool guidance is added only when a tool other than `stop`, `toolSearchTool` and `chatChannels` is allowed, as `COMPACT_TOOL_GUIDANCE` (v1's `tool_guidance` + `tool_constraints` rules in about a quarter of the tokens), else the one-line `COMPACT_ACTION_RULE`; the reply-language default (`default_language_directive`, at the front and the end) is short too. Measured on Strata (Qwen3.6, 2026-11-16, four lines of recent conversation): a weather turn's reply prompt went from 3,075 to 2,360 tokens and a time question's from 2,115 to 2,031, inside one 2,048-token step (Strata reads about 0.44 s up to 2,048 tokens, 0.86 s up to 4,096, 1.25 s up to 6,144). Measured on Strata (Qwen3.6, 2026-11-12): a greeting's reply prompt went from about 4,500 to 1,350 tokens and its prompt read from 1.07 s to 0.36 s (Strata reads in 2,048-token steps). The v2 brain also turns `stream_browser` off. The `[Context: ...]` time carries the 12-hour form beside the 24-hour one (`10:37 (10:37 AM)`): with the short prompt Qwen3.6 read 10:37 as 오후 (pm) 4 of 4 times.
- **Tool honesty rules**: `TOOL_HONESTY_RULES` inside the persona, plus `tool_honesty_reminder(allowed_tools)` appended after every context block (just before the closing reply-language lock) naming the turn's tools. Added after M0 (2026-11-10) caught models answering past an available tool.
- **Operator instructions** (two sources, both framed "Additional instructions from the operator:" and appended near the end of the guidance list): the settings-UI `llm_instructions` config field, and every `*.md` file in `AGENTS_DIR` (default `/app/agents`, bind-mounted from `./agents`). The file-based set is read once per turn by `load_agent_instructions()` in [src/jarvis/system_prompt.py](src/jarvis/system_prompt.py) and concatenated in filename order, so dropping/editing a `.md` applies on the next reply with no rebuild/restart; fail-open to `""` when the folder is absent/empty/unreadable.
- **Warm profile block** (query-agnostic User + Directives excerpt from the knowledge graph, composed by `build_warm_profile()` / `format_warm_profile_block()` in [src/jarvis/memory/graph_ops.py](src/jarvis/memory/graph_ops.py) at Step 3.5 of `reply()`; no LLM call, pure SQLite read; injected unconditionally so personalisation is the default; result cached in `DialogueMemory._hot_cache` under `DialogueMemory.WARM_PROFILE_CACHE_KEY` for the lifetime of the active conversation. Invalidated on `stop`, on new-conversation entry, AND on User/Directives graph mutations via the listener registered in [src/jarvis/daemon.py](src/jarvis/daemon.py) against `register_graph_mutation_listener` in [src/jarvis/memory/graph.py](src/jarvis/memory/graph.py); World-branch writes are ignored)
@@ -161,10 +161,10 @@ Every distinct LLM call in Jarvis, what feeds it, what consumes it, and how it i
## 12. Task-list Planner (pre-flight decomposition, gates the whole turn)
- **File**: [src/jarvis/reply/planner.py](src/jarvis/reply/planner.py) — `plan_query()`.
- **Trigger**: once per reply, **after the tool router and before memory search**. **v2 brain** (`intent_judge=True`): runs only on turns where the router picked a tool (not for the sentinels `stop` or `toolSearchTool` alone; a router-picked `chatChannels` counts), so a turn without tools has one LLM call before its answer. Skipped when `cfg.planner_enabled = False`, when the query is shorter than `MIN_QUERY_CHARS` (4), or when no model / base URL is available.
- **Trigger**: once per reply, **after the tool router and before memory search**. **v2 brain** (`intent_judge=True`): runs only on turns where the router picked a tool (not for the sentinels `stop` or `toolSearchTool` alone; a router-picked `chatChannels` counts), so a turn without tools has one LLM call before its answer. Also skipped when the router's only pick is a one-step tool (`_ONE_STEP_TOOLS` in `engine.py`: `getWeather`, `logMeal`, `fetchMeals`, `screenView`) and the chat model calls tools natively; the chat model then gets the tool directly, and an answer it gives without the tool is dropped and followed by one nudge to call it; a second answer without the tool runs the planner after all (one extra call, only then) and the skipped-tool guard applies (planner.spec.md, "Intent judge (v2)"). Skipped when `cfg.planner_enabled = False`, when the query is shorter than `MIN_QUERY_CHARS` (4), or when no model / base URL is available.
- **Model / gating**: resolution chain `planner_model (override) → ollama_chat_model`. The planner tracks the chat model so upgrading the chat model (via setup wizard or config) automatically upgrades plan quality.
- **Inputs**: user query, dialogue context, the live time/location line (`LIVE CONTEXT:`, so a location-dependent ask plans `searchMemory topic='where the user lives'` only when the location is unknown or disabled), **router-narrowed** tool catalogue (names + one-line descriptions + argument names, built by `planner_tool_catalog()`) — not the full 30+ list. When the carry-over guard from #7 fires, the previous turn's failed tool name is unioned into this catalogue before the planner sees it, so the planner can plan a re-call without `toolSearchTool` round-tripping. **No** memory context — the planner decides *whether* memory is needed.
- **System prompt**: `_PROMPT_TEMPLATE` in `planner.py`. Teaches the `searchMemory topic='...'` directive for prior-conversation lookups, short imperative tool steps, angle-bracket entity placeholders, final synthesis step, same-language output, no numbering.
- **System prompt**: `_PROMPT_TEMPLATE` in `planner.py`. Teaches the `searchMemory topic='...'` directive for prior-conversation lookups, short imperative tool steps, angle-bracket entity placeholders, final synthesis step, same-language output (the words of search and play arguments too, repeated in the user message's closing line), no numbering.
- **Output**: list of plan steps (max `MAX_STEPS` = 5). Gates memory enrichment (#3 / #4) and augments the tool router (#7 — planner's picks are unioned in, not replacing). Single-step `["Reply to the user."]` plans are the planner's positive "no memory, no tools" signal. An empty list is fail-open — the engine reverts to running #3 unconditionally. Consumed further by the engine to build the `ACTION PLAN:` system-message block and drive the direct-exec loop (#13) for small models.
- **Limits**: `planner_timeout_sec` (6s). Fail-open → `[]`.
@@ -215,7 +215,7 @@ Every distinct LLM call in Jarvis, what feeds it, what consumes it, and how it i
| 10 | Graph extraction | ~1/session | No (background) | LARGE |
| 11 | Graph best-child | 0-N | No (background) | SMALL (via router chain) |
| 11b | Graph node merge | 0-N (per node, batched) | No (background) | SMALL (via router chain) |
| 12 | Planner (plan_query) | 1 | yes (planner_enabled) | LARGE/SMALL (tracks chat model) |
| 12 | Planner (plan_query) | 0-1 (v2: tool turns except one-step tools, which plan only when the model skips the tool twice) | yes (planner_enabled) | LARGE/SMALL (tracks chat model) |
| 13 | Plan step resolver | 0-N (SMALL only) | auto by size + plan | SMALL (via router chain) |
| 14 | Tool-specific | per-tool | n/a | LARGE |
| 15 | Voice call judgements | 0 (per utterance / tie, outside the reply) | call mode / policy | LARGE (chat model) |

View File

@@ -18,6 +18,8 @@ Cases:
Run: EVAL_JUDGE_MODEL=qwen2.5:7b python -m pytest evals/test_bot_browser_tool.py -v
"""
import re
import pytest
from conftest import requires_judge_llm
@@ -88,6 +90,15 @@ class YoutubeSession(FakeSession):
self.url = "https://www.youtube.com/results?search_query=x"
return dict(self.RESULTS)
def play(self, results_url):
# The real session opens the first video and starts its player (tests/test_bot_browser.py).
import urllib.parse
self.calls.append(("play", results_url))
self.url = "https://www.youtube.com/watch?v=nP1xjFX86Po"
self.playing = True
words = urllib.parse.unquote_plus(results_url.split("search_query=")[-1])
return dict(self._page(self.url), title=f"{words} (Official MV) - YouTube", text=f"{words} (Official MV)")
def click(self, target):
self.calls.append(("click", target))
if "watch" in getattr(self, "url", ""):
@@ -148,17 +159,34 @@ class TestBotBrowserTool:
import urllib.parse
s, _ = _run(monkeypatch, mock_config, eval_db, eval_dialogue_memory, "유튜브에서 아이유 신곡 틀어 줘",
session=YoutubeSession())
words = [urllib.parse.unquote_plus(c[1]) for c in s.calls if c[0] == "open"] + \
words = [urllib.parse.unquote_plus(c[1]) for c in s.calls if c[0] in ("open", "play")] + \
[c[1] for c in s.calls if c[0] == "type"]
assert any("youtube" in urllib.parse.unquote_plus(c[1]).lower() for c in s.calls if c[0] == "open"), s.calls
assert any("youtube" in urllib.parse.unquote_plus(c[1]).lower() for c in s.calls if c[0] in ("open", "play")), s.calls
assert any("아이유" in w or "iu" in w.lower() for w in words), s.calls
assert not any("아이우" in w for w in words), s.calls
@pytest.mark.parametrize("query,said", [("유튜브에서 아이유 신곡 틀어 줘", ("아이유", "iu")),
("자비스, 유튜브에서 뉴진스 하입보이 틀어 줘", ("뉴진스", "newjeans"))])
def test_playing_a_song_ends_on_a_playing_video_found_with_the_words_as_said(
self, monkeypatch, mock_config, eval_db, eval_dialogue_memory, query, said):
# Live 2026-11-16 (0.1.19): the model stopped on the results page or on YouTube's home page
# (a third browser call was refused), searched "NewJeans Hypothesis" in English, and still
# said the video played.
import urllib.parse
s, reply = _run(monkeypatch, mock_config, eval_db, eval_dialogue_memory, query, session=YoutubeSession())
assert s.playing and "watch" in s.url, f"{s.calls} reply={reply!r}"
searched = [urllib.parse.unquote_plus(c[1]) for c in s.calls if c[0] in ("open", "play")] + \
[c[1] for c in s.calls if c[0] == "type"]
# The words in the language they were said in (a Korean request searches in Korean, so the
# results are the ones people there get), naming who was asked for.
assert any(re.search(r"[가-힣]", w) and any(n in w.lower() for n in said) for w in searched), s.calls
def test_a_video_page_that_stays_paused_is_played_or_reported_as_not_playing(
self, monkeypatch, mock_config, eval_db, eval_dialogue_memory):
s, reply = _run(monkeypatch, mock_config, eval_db, eval_dialogue_memory,
"브라우저로 https://www.youtube.com/watch?v=nP1xjFX86Po 열어서 영상 재생해 줘", session=YoutubeSession())
assert any(c[0] == "open" and "watch" in c[1] for c in s.calls), s.calls
# It reached the video (opened or played by its address or its ID).
assert "watch" in getattr(s, "url", ""), s.calls
# Either it pressed play, or it told the user honestly that the video did not play (a
# negation in the Korean reply); never "it plays" over a paused video.
assert s.playing or any(n in (reply or "") for n in ("않", "못")), f"{s.calls} reply={reply!r}"

View File

@@ -0,0 +1,54 @@
"""
Eval: a Korean request searches the web in Korean, so the results are the ones people in Korea get.
Live 2026-11-16 (0.1.19): "요즘 볼 만한 넷플릭스 드라마 세 개만 추천해 줘" searched "best Netflix dramas to
watch now 2026" and recommended American shows; "엔비디아 rtx 5050 그래픽카드 가격 검색해 줘" searched in
English and answered with an Amazon US price. The reply engine runs as the v2 brain runs it (compact
prompt, Korean default, the place set in the settings: brain.location, default 대한민국); webSearch is
a fake that records its query. Checked by script: the query has Hangul.
Run: EVAL_JUDGE_MODEL=qwen3:8b python -m pytest evals/test_search_in_users_language.py -v
"""
import re
from unittest.mock import patch
import pytest
from conftest import requires_judge_llm
from helpers import ToolCallCapture, create_mock_tool_run
CASES = [
("netflix", "요즘 볼 만한 넷플릭스 드라마 세 개만 추천해 줘"),
("price", "엔비디아 RTX 5050 그래픽카드 가격 검색해 줘"),
("restaurants", "이번 주말에 갈 만한 맛집 좀 찾아 줘"),
]
@pytest.mark.eval
@requires_judge_llm
class TestSearchInUsersLanguage:
@pytest.mark.parametrize("case", CASES, ids=[c[0] for c in CASES])
def test_a_korean_request_searches_in_korean(self, mock_config, eval_db, eval_dialogue_memory,
monkeypatch, case):
from helpers import JUDGE_BASE_URL, JUDGE_MODEL
from jarvis.memory.history import HistoryContext
from jarvis.reply.engine import run_reply_engine
cid, query = case
monkeypatch.delenv("OUTPUT_LANGUAGE", raising=False)
mock_config.ollama_base_url = JUDGE_BASE_URL
mock_config.ollama_chat_model = JUDGE_MODEL
mock_config.location_name = "대한민국"
capture = ToolCallCapture()
result = "Search results: (fake) 1. 결과 하나 2. 결과 둘"
with patch("jarvis.reply.engine.run_tool_with_retries",
side_effect=create_mock_tool_run(capture, {"webSearch": result})):
reply = run_reply_engine(db=eval_db, cfg=mock_config, tts=None, text=query,
dialogue_memory=eval_dialogue_memory, history=HistoryContext(),
legacy_memory=False, default_language="Korean", compact_prompt=True)
searches = [str(c["args"].get("search_query") or c["args"].get("query") or "")
for c in capture.calls if c["name"] == "webSearch"]
print(f"\n search language [{JUDGE_MODEL}] {cid}: searches={searches} reply={(reply or '')[:120]!r}")
assert searches, f"[{cid}] no web search: {capture.tool_names()}"
assert all(re.search(r"[가-힣]", q) for q in searches), f"[{cid}] searched in another language: {searches}"

View File

@@ -238,6 +238,8 @@ class Settings:
location_ip_address: str | None
location_auto_detect: bool
location_cgnat_resolve_public_ip: bool
# A place the user set (e.g. "대한민국"): used instead of detection when set (location.spec.md).
location_name: str | None
# Web Search
web_search_enabled: bool
@@ -551,6 +553,7 @@ def get_default_config() -> Dict[str, Any]:
# When behind CGNAT (100.64.0.0/10), attempt a privacy-light external DNS query to discover true public IP.
# Uses a single OpenDNS resolver lookup of myip.opendns.com over DNS (no HTTP services). Disable to avoid any external request.
"location_cgnat_resolve_public_ip": True,
"location_name": None,
# Web Search
"web_search_enabled": True,
@@ -762,6 +765,7 @@ def load_settings() -> Settings:
location_ip_address = None if location_ip_address_val in (None, "", "null") else str(location_ip_address_val)
location_auto_detect = bool(merged.get("location_auto_detect", True))
location_cgnat_resolve_public_ip = bool(merged.get("location_cgnat_resolve_public_ip", True))
location_name = str(merged.get("location_name") or "").strip() or None
web_search_enabled = bool(merged.get("web_search_enabled", True))
brave_search_api_key = str(merged.get("brave_search_api_key", "") or "").strip()
wikipedia_fallback_enabled = bool(merged.get("wikipedia_fallback_enabled", True))
@@ -902,6 +906,7 @@ def load_settings() -> Settings:
location_ip_address=location_ip_address,
location_auto_detect=location_auto_detect,
location_cgnat_resolve_public_ip=location_cgnat_resolve_public_ip,
location_name=location_name,
# Web Search
web_search_enabled=web_search_enabled,

View File

@@ -13,6 +13,7 @@ from ..system_prompt import (
build_system_prompt,
build_voice_persona,
COMPACT_ACTION_RULE,
COMPACT_TOOL_GUIDANCE,
load_agent_instructions,
reply_language_directive,
tool_honesty_reminder,
@@ -761,6 +762,9 @@ def _live_time_location_string(cfg) -> str:
tz_name: Optional[str] = None
if not getattr(cfg, 'location_enabled', True):
location_context = "Location: Disabled"
elif isinstance(getattr(cfg, 'location_name', None), str) and cfg.location_name.strip():
# The place the user set wins over detection (location.spec.md); local time is the PC's.
location_context = f"Location: {cfg.location_name.strip()} (where the user is)"
else:
location_context, tz_name = get_location_context_with_timezone(
config_ip=getattr(cfg, 'location_ip_address', None),
@@ -1092,6 +1096,23 @@ def _attach_images(message: dict, result) -> None:
message["images"] = list(images)
def _starts_with_text_tools(cfg) -> bool:
"""Whether the reply starts in text-tool mode: a small model outside the native tool-call
families (see the loop's comment where it is used)."""
model_l = (cfg.ollama_chat_model or "").lower()
native_capable = any(k in model_l for k in (
"qwen2.5", "qwen2", "qwen3", "llama3.1", "llama3.2", "llama3.3",
"mistral", "hermes", "command-r", "firefunction",
))
return detect_model_size(cfg.ollama_chat_model) == ModelSize.SMALL and not native_capable
# Tools that do their job in one call (planner.spec.md, "Intent judge (v2)"): a v2 turn whose only
# router pick is one of them needs no plan. Tools a request may use several times or chain (search,
# browsers, schedule and notes lists before a change, chat channels) are not here.
_ONE_STEP_TOOLS = frozenset({"getWeather", "logMeal", "fetchMeals", "screenView"})
def _offered_builtins(cfg, chat_available: bool, schedule_available: bool = False,
notes_available: bool = False, screen_available: bool = False) -> dict:
"""The built-in tools this turn can offer: the enabled ones (``enabled_builtin_tools``),
@@ -1397,6 +1418,14 @@ def run_reply_engine(db: "Database", cfg, tts: Optional[Any],
# aside; the chat tool counts here, its every-turn offer is added below); a turn without one
# goes straight to its answer.
_turn_needs_tools = any(t not in ("stop", "toolSearchTool") for t in routed_tools)
# Intent judge (v2), native tool calls: a lone one-step tool goes to the chat model without a
# plan; the nudge in the loop below stands in for the plan-based skipped-tool guard.
_picked_tools = [t for t in routed_tools if t not in ("stop", "toolSearchTool")]
_one_step_tool = (
_picked_tools[0]
if intent_judge and len(_picked_tools) == 1 and _picked_tools[0] in _ONE_STEP_TOOLS
and not _starts_with_text_tools(cfg) else None
)
# In screen-share mode, always offer setBroadcast. "Turn the broadcast
# on/off" is language-agnostic intent the embedding/keyword router won't
@@ -1444,7 +1473,9 @@ def run_reply_engine(db: "Database", cfg, tts: Optional[Any],
try:
# Intent judge (v2): the router decides whether the turn needs tools; only then does the
# planner order the steps (planner.spec.md, "Intent judge (v2)").
if not intent_judge or _turn_needs_tools:
if _one_step_tool:
debug_log(f"intent judge: one-step tool {_one_step_tool}, no plan", "planning")
elif not intent_judge or _turn_needs_tools:
action_plan = plan_query(
cfg=cfg,
query=redacted,
@@ -1863,12 +1894,7 @@ def run_reply_engine(db: "Database", cfg, tts: Optional[Any],
# call, so getWeather/webSearch/controlBrowser never run. Use native for the
# tool-capable families (native still auto-falls-back to text on HTTP 400);
# only genuinely non-tool small models (e.g. gemma) default to text.
_model_l = (cfg.ollama_chat_model or "").lower()
_native_capable = any(k in _model_l for k in (
"qwen2.5", "qwen2", "qwen3", "llama3.1", "llama3.2", "llama3.3",
"mistral", "hermes", "command-r", "firefunction",
))
use_text_tools = (model_size == ModelSize.SMALL) and not _native_capable
use_text_tools = _starts_with_text_tools(cfg)
prompts = get_system_prompts(model_size)
debug_log(f"Model size detected: {model_size.value} for {cfg.ollama_chat_model} (use_text_tools={use_text_tools})", "planning")
@@ -1916,9 +1942,10 @@ def run_reply_engine(db: "Database", cfg, tts: Optional[Any],
# The persona already covers voice style, inference and tool use; the tool guidance
# (named entities, auto-derived and self-contained arguments) matters only when a
# data tool is on offer. The sentinels and the always-offered chat tool are not.
# It is v1's guidance in short (COMPACT_TOOL_GUIDANCE): every token is read each reply.
guidance.append(prompts.asr_note)
if any(t not in ("stop", "toolSearchTool", "chatChannels") for t in allowed_tools):
guidance.extend(c for c in (prompts.tool_guidance, prompts.tool_constraints) if c)
guidance.append(COMPACT_TOOL_GUIDANCE)
else:
guidance.append(COMPACT_ACTION_RULE)
else:
@@ -2278,6 +2305,9 @@ def run_reply_engine(db: "Database", cfg, tts: Optional[Any],
# synthesise from the real result. Fires at most once per reply; a
# non-empty list means it fired. See planner.spec.md.
_forced_plan_steps: list[str] = []
# One-step turns have no plan: an answer given without their tool is dropped and the model is
# asked once to call it (planner.spec.md, "Intent judge (v2)").
_one_step_nudged = False
while turn < max_turns:
turn += 1
@@ -2999,6 +3029,36 @@ def run_reply_engine(db: "Database", cfg, tts: Optional[Any],
candidate_reply = content
malformed_fallback = False
_one_step_skipped = bool(
_one_step_tool and _one_step_tool in allowed_tools and not use_text_tools
and not _forced_plan_steps and not malformed_fallback
and sum(1 for m in messages if m.get("tool_name")) == _plan_steps_baseline
)
if _one_step_skipped and not _one_step_nudged:
messages.pop()
messages.append({"role": "user", "content": (
f"[Before answering, call {_one_step_tool}: this request needs its result. "
"If a detail it needs is missing, ask the user for it instead.]")})
_one_step_nudged = True
debug_log(f"one-step turn: answered without {_one_step_tool}; asking for the call", "planning")
continue
if _one_step_skipped and not action_plan:
# Asked once and still no tool: this turn takes the planned path after all, so the
# skipped-tool guard below runs the tool the plan names (or the plan says no tool is
# needed, a question back to the user say, and the answer goes out).
try:
action_plan = plan_query(
cfg=cfg, query=redacted, dialogue_context=_dialogue_ctx,
tools=_planner_tool_catalog, live_context=_live_time_location_string(cfg),
)
except Exception as _plan_exc: # pragma: no cover — defensive
debug_log(f"planner step failed (non-fatal): {_plan_exc}", "planning")
action_plan = []
if action_plan:
_turn_state.trace("plan", steps=list(action_plan))
debug_log(f"one-step turn: still no {_one_step_tool} after the nudge; planned "
f"{len(action_plan)} step(s)", "planning")
_guard_steps = [] if (use_text_tools or _forced_plan_steps or malformed_fallback) else (
named_tool_steps(
action_plan,

View File

@@ -232,7 +232,10 @@ _PROMPT_TEMPLATE = (
"10. Maximum {max_steps} steps. Do not number them — one step per line.\n"
"11. Output ONLY the steps, no preamble, no trailing commentary, no "
"JSON fences, no explanations.\n"
"12. Write the steps in the same language the user wrote the query in.\n"
"12. Write the steps in the same language the user wrote the query in. "
"The words of every search or play argument stay in the user's "
"language too, never translated into English, because a search in the "
"user's language finds what people where they are get.\n"
)
@@ -279,7 +282,8 @@ def _build_user_message(
else:
parts.append("DIALOGUE CONTEXT: (empty)")
parts.append(f"USER QUERY: {query.strip()}")
parts.append("\nEmit the plan now, one step per line, no numbering.")
parts.append("\nEmit the plan now, one step per line, no numbering, written in the language of "
"the USER QUERY (the words of searches too).")
return "\n\n".join(parts)

View File

@@ -108,7 +108,14 @@ The planner prompt instructs the model to emit:
`webSearch query='his most famous songs'`.
- A final synthesis/reply step when any `searchMemory` or tool step
was planned.
- Steps in the same language the user wrote the query in.
- Steps in the same language the user wrote the query in, the words of
search and play arguments too (never translated into English: a search
in the user's language finds what people where they are get); the
closing line of the user message repeats it, which a small model follows
better than the rule alone. Eval `evals/test_search_in_users_language.py`
(qwen3:8b, 3 runs of 3 Korean requests): Korean searches 6/9 before
("요즘 볼 만한 넷플릭스 드라마" searched "best netflix dramas 2026" 3/3), 8/9
after (that one 2/3).
### Parsing and hygiene
@@ -215,6 +222,29 @@ needs the planner to name the channel); its every-turn offer, added after the ro
to its answer with one LLM call before it; a tool turn keeps the planner's ordered steps, which
multi-step asks need ("who directed Possessor, and what else did they make").
**One-step turns.** When the router's only pick (sentinels aside) is a tool that does its job in one
call, `_ONE_STEP_TOOLS` in `engine.py` (`getWeather`, `logMeal`, `fetchMeals`, `screenView`), and the
chat model calls tools natively, the planner does not run: its steps would only repeat the one call
the chat model makes itself. The rule reads the router's pick, never the words, so it is language-
agnostic. Tools a request may use several times or chain stay planned: search and page fetches,
the browsers, `schedule` and `personalNotes` (a list before a change), `chatChannels`. Two or more
picked tools are planned as before. Text-tool mode (small non-native models) always plans, since its
direct execution runs the plan.
Without a plan the skipped-tool guard above has nothing to run, so these turns get a nudge instead:
when the chat model answers in words before any tool ran in this reply, the answer is dropped (no
later turn sees it) and a note asks the model to call that tool first, or to ask the user for a
missing detail. The nudge is sent at most once per reply. When the model answers without the tool
again, that turn falls back to the planned path: the planner runs then (one extra planner call, only
on this failure), and the skipped-tool guard above treats the second answer as on any planned turn.
A plan naming the tool runs it and the made-up answer never goes out; a plan that needs no tool (a
question back to the user, say) lets the answer go out, the planner judging that as before.
Measured on Strata (Qwen3.6, 2026-11-16 16:45-16:58, the engine log): the planner averaged 2.5 s
(9 calls), one after the other before the answer on every tool turn, while the router runs during
speech (`prepare_intent`). A planner call that does not run also leaves the engine's second session
to the chat model, whose prompt read is the largest cost.
Measured on Strata (Qwen3.6, 2026-11-12): the router took 0.42 s and the planner 0.49-0.94 s, one
after the other, before every answer; each call costs at least one full prompt read. Tried first
and dropped: the planner alone over the whole catalogue (one call) planned "reply with the

View File

@@ -106,7 +106,7 @@ Design principles enforced by the engine:
- When detected, the engine falls back to the standard "I had trouble understanding that request" error reply (model-size-aware). The malformed content is never shown to the user.
Skipped-tool guard (native tool calling):
- When a native-tool model answers in prose before any tool has run in this reply, and the plan names a callable tool as a concrete call, the engine discards that answer and direct-executes the plan's tool steps, then the model answers from the results. Only literal, schema-valid steps run (no LLM repair). When the planned call cannot run, the held-back answer is still discarded: the planned call is recorded as a failed tool result and the model answers from that (an honest "could not check or do it"). See `planner.spec.md` ("Skipped-tool guard").
- When a native-tool model answers in prose before any tool has run in this reply, and the plan names a callable tool as a concrete call, the engine discards that answer and direct-executes the plan's tool steps, then the model answers from the results. Only literal, schema-valid steps run (no LLM repair). When the planned call cannot run, the held-back answer is still discarded: the planned call is recorded as a failed tool result and the model answers from that (an honest "could not check or do it"). See `planner.spec.md` ("Skipped-tool guard"). v2 one-step turns (no plan) get one nudge to call the tool instead, and when the model skips it again the turn is planned and guarded as above (`planner.spec.md`, "Intent judge (v2)").
Task-list planner (all model sizes, strongest impact on small models):
- The planner runs at the **front** of the reply flow (see step 3 above), not after tool selection. By the time the agentic loop starts, the plan already exists, the memory block has either been run or skipped based on the plan's `searchMemory` directive, and the tool allow-list has been derived from the tool names the plan referenced. See `planner.spec.md` for the prompt contract and fail-open semantics.

View File

@@ -209,6 +209,27 @@ COMPACT_ACTION_RULE: str = (
)
# Compact prompts, turns with a data tool: v1's tool guidance and constraints (about 900 Qwen3.6
# tokens) in a quarter of the words. Strata reads prompts in 2,048-token steps of about 0.4 s each,
# so these tokens decide whether a tool turn with recent conversation stays inside one step fewer.
# The same rules as v1's (acting instead of refusing, facts only from the result, looking up named
# things, auto-derived and self-contained arguments), without English examples.
COMPACT_TOOL_GUIDANCE: str = (
"Using tools: when a tool here covers the request, call it straight away, without announcing it "
"or asking permission; when none fits an action or a live fact, call toolSearchTool with a short "
"description before saying you cannot. Answer from tool results, never about them: every "
"specific fact in the reply (names, dates, numbers, places, cast, plot) must come from the tool "
"result or the user's own words, not from your prior knowledge; if the result lacks it, say so. "
"When a search result has a 'Content from top result' section, give its facts, not the links. "
"A specific named thing (a film, song, game, product, person, place or event) you cannot state "
"verified facts about is looked up before you answer. When a tool fills an argument itself (for "
"example the current location), call it with what you have instead of asking; a value the user "
"already gave in the conversation is passed. Free-text arguments such as search queries must "
"stand on their own, because the tool does not see earlier turns: resolve pronouns and "
"references into a short keyword phrase."
)
def tool_honesty_reminder(tool_names) -> str:
"""End-of-prompt restatement of the tool honesty rules for this turn.
@@ -307,14 +328,12 @@ def default_language_directive(language: Optional[str]) -> Optional[str]:
lang = (language or "").strip()
if not lang:
return None
# Short on purpose: the reply engine puts it at the front and the end of every v2 prompt.
return (
f"REPLY LANGUAGE: write your reply in {lang} by default, whatever language the user's "
f"message or any reference text is in. The one exception overrides this default: when "
f"the user explicitly asks, in any language, for the answer in another language (for "
f"example 'answer in English'), reply in that language, for just this reply or from now "
f"on in this conversation, as they asked. Do not mix in other scripts: no Chinese/Hanja characters, "
f"Japanese kana or Cyrillic letters inside a {lang} reply. (Numerals and unavoidable "
f"proper-noun brand names are fine.)"
f"REPLY LANGUAGE: reply in {lang}, whatever language the message or any reference text is "
f"in, unless the user explicitly asks, in any language, for another language: then use that "
f"one, for this reply or from then on, as they asked. No Chinese/Hanja, Japanese kana or "
f"Cyrillic inside a {lang} reply; numerals and brand names are fine."
)

View File

@@ -18,8 +18,12 @@ from ...debug import debug_log
FENCE_START = "<<<BEGIN UNTRUSTED WEB PAGE>>>"
FENCE_END = "<<<END UNTRUSTED WEB PAGE>>>"
_ACTIONS = ("open", "read", "click", "type", "back")
_ACTIONS = ("open", "read", "click", "type", "back", "play")
PAGE_WAIT_S = 15.0
# play: two pages (the results and the video) and the wait for the video to start.
PLAY_WAIT_S = 25.0
# Where play searches: YouTube's results for the words (encoded by the tool).
PLAY_SEARCH = "https://www.youtube.com/results?search_query="
TEXT_CHARS = 6000
MAX_ITEMS = 40
CDP_ENV = "JARVIS_BROWSER_CDP"
@@ -58,6 +62,12 @@ _PLAY = r"""
(() => { const v = [...document.querySelectorAll('video')].filter(m => (m.currentSrc || m.src) && m.paused
&& !m.ended && !m.error && m.currentTime === 0 && m.getBoundingClientRect().width >= innerWidth * 0.5);
if (!v.length) return false; v[0].play().catch(() => {}); return true; })()"""
# The first video in a list of results (a visible `/watch?v=` link, not an ad), as its plain address.
_FIRST_VIDEO = "(() => {" + _HELPERS + r"""
const a = [...document.querySelectorAll('a[href*="/watch?v="]')].find(e => vis(e)
&& !e.closest('ytd-ad-slot-renderer,ytd-promoted-video-renderer,ytd-in-feed-ad-layout-renderer,[is-ad]'));
if (!a) return null; const u = new URL(a.getAttribute('href'), location.href);
return u.origin + u.pathname + '?v=' + encodeURIComponent(u.searchParams.get('v')); })()"""
_CLICK = "(() => {" + _HELPERS + r"""
return ((t) => { const m = /^\s*\[(\d+)\]\s*$/.exec(t); let el = null;
if (m) el = (window.__jvItems || [])[Number(m[1]) - 1];
@@ -239,6 +249,18 @@ class BrowserSession:
self._press_play()
return self.read()
def play(self, results_url: str) -> Dict[str, Any]:
"""Open a list of results, wait for its first video and open that (its player is started
as on any video page reached)."""
self.open(results_url)
while True:
video = self._eval(_FIRST_VIDEO)
if video:
return self.open(video)
if self.deadline - time.monotonic() < 0.3:
raise BrowserError("no video came up for those words")
time.sleep(0.25)
def _press_play(self) -> None:
"""On a page just reached whose main player did not start: look again and press play."""
try:
@@ -273,7 +295,7 @@ MAX_TABS = 5
_lock = threading.Lock()
# Navigations that are safe to send again on a fresh connection; a click, typing or back may have
# taken effect before the connection broke, so they are never repeated.
_REPEATABLE = ("open", "read")
_REPEATABLE = ("open", "read", "play")
def _action(raw: Any) -> str:
@@ -359,7 +381,10 @@ class BotBrowserTool(Tool):
"Open and use a website in Jarvis's own web browser: search on a site, click, type into "
"a box, read the page. "
"Actions: open an address, read the current page, click a link or button by its label, "
"type into a search box or field (optionally pressing Enter), or go back. To search on a "
"type into a search box or field (optionally pressing Enter), go back, or play. To play a "
"song or video, call play once with the words as query, exactly as the user said them and "
"in their language (never translated): it searches YouTube, opens the first video and "
"starts it, and the page that comes back says whether it truly plays. To search on a "
"site, call open with the site's address and the words as query, in plain text exactly as "
"the user said them (never put the words into an address yourself); only the page that "
"comes back shows whether the search ran. Use it when "
@@ -375,11 +400,12 @@ class BotBrowserTool(Tool):
"type": "object",
"properties": {
"action": {"type": "string", "enum": list(_ACTIONS),
"description": "open, read, click, type or back"},
"description": "open, read, click, type, back or play"},
"url": {"type": "string", "description": "for open: the web address"},
"query": {"type": "string", "description": "for open: words to search for on that site, as "
"plain text (never percent-encoded); they go into the address's empty search "
"parameter (e.g. ...?search_query=) or into the site's search box"},
"parameter (e.g. ...?search_query=) or into the site's search box. For play: "
"the song or video to play, as the user said it"},
"target": {"type": "string", "description": "for click: the link or button label, or [n] from the list"},
"text": {"type": "string", "description": "for type: what to type"},
"field": {"type": "string", "description": "for type: the field's label or placeholder (optional)"},
@@ -410,13 +436,25 @@ class BotBrowserTool(Tool):
call = lambda s: (s.open(url), s.type(words, None, True))[1]
else:
call = lambda s: s.open(url)
elif action == "play":
words = str(args.get("query") or args.get("text") or "").strip()
page = str(args.get("url") or "").strip() if not words else ""
# An address to play (given as url, or as the words): that page opens and its player starts.
address = _web_url(words or page) if re.match(r"^(https?://|www\.)", words or page, re.I) else None
if address:
call = lambda s: s.open(address)
elif not words:
return _fail("play needs the words of the song or video to play (query)")
else:
results = PLAY_SEARCH + urllib.parse.quote_plus(words)
call = lambda s: s.play(results)
elif action == "click":
target = str(args.get("target") or "").strip()
if not target:
return _fail("click needs the label of a link or button")
call = lambda s: s.click(target)
elif action == "type":
text = str(args.get("text") or "")
text = str(args.get("text") or args.get("query") or "") # models also write query
if not text:
return _fail("type needs the text to type")
call = lambda s: s.type(text, args.get("field") or None, bool(args.get("submit")))
@@ -425,7 +463,7 @@ class BotBrowserTool(Tool):
else:
call = lambda s: s.read()
who = str(getattr(context, "user_id", "") or "")
deadline = time.monotonic() + PAGE_WAIT_S # one deadline for connecting, the action and its page
deadline = time.monotonic() + (PLAY_WAIT_S if action == "play" else PAGE_WAIT_S) # one deadline for connecting, the action and its page
t0 = time.perf_counter()
with _lock:
for attempt in (1, 2):

View File

@@ -17,7 +17,7 @@ read it, click a link or button, type into a field, go back. Product rules: `doc
`https://`); `file:`, `chrome:`, `data:`, `javascript:` and the rest are refused. The browser's
own network rules (public addresses only) are the app's proxy's job.
- **Raw data, no LLM call.** The tool returns plain text for the reply model.
- **Bounded.** One deadline of 15 s covers an action: connecting, the action and waiting for the
- **Bounded.** One deadline of 15 s (25 s for `play`) covers an action: connecting, the action and waiting for the
page; events arriving in between do not extend it. Text is cut at 6,000 characters and the list
of links and buttons at 40.
- **A window per person.** Each asker (`ToolContext.user_id`) has a page and connection of their
@@ -29,8 +29,8 @@ read it, click a link or button, type into a field, go back. Product rules: `doc
- **One tab, also for "new tab" links.** Before a click or typing, links, forms and `<base>` lose
their `target` and `window.open` loads the address in the same tab, so what opens is what the
tool reads next.
- **Never twice.** When the connection breaks during an action, `open` and `read` are tried once
more on a fresh connection (a fresh tab); `click`, `type` and `back` are not, because they may
- **Never twice.** When the connection breaks during an action, `open`, `read` and `play` (which
only opens pages) are tried once more on a fresh connection (a fresh tab); `click`, `type` and `back` are not, because they may
already have taken effect: the tool says it may or may not have happened.
- **The fence holds.** `<<<` and `>>>` in anything read from a page become `‹‹‹` and `›››`, so page
text cannot close or reopen the fence.
@@ -45,8 +45,9 @@ One tool, `action` picks the operation (read as its first known word, so `open_p
| `open` | `url` (`query`) | opens the address in the bot browser's tab; with `query` (words to search for, plain text) they go, encoded by the tool (`urlencode`), into the address's last empty search parameter (`...?search_query=`), else the address opens and they are typed into its search box and sent (as `type` with `submit`) |
| `read` | | reads the current page again (with a `url`, opens it) |
| `click` | `target` | clicks the link or button whose label is `target` (an exact label first, else the one containing it; `[n]` from the last list also works) |
| `type` | `text` (`field`, `submit`) | types into the field whose label, placeholder or name contains `field` (else the focused field, else the first search or text box); `submit` presses Enter |
| `type` | `text` or `query` (`field`, `submit`) | types into the field whose label, placeholder or name contains `field` (else the focused field, else the first search or text box); `submit` presses Enter |
| `back` | | goes back one page |
| `play` | `query` (or `url`) | plays a song or video: searches YouTube for the words (`.../results?search_query=`, encoded by the tool), waits for the first video in the results (a visible `/watch?v=` link, not one inside an ad), opens it by its plain address (`/watch?v=<id>`, without the playlist the link may carry), and its player starts as on any video page opened (below); an address given (as `url`, or as words that start with `http(s)://` or `www.`) opens that page instead. No video in the results before the deadline is an error. Its deadline is 25 s (two pages and the start) |
Every action answers with the page after it: title, address, the state of its sound and video
(`Media: playing 1:15 of 3:45; paused 0:00`, each `<video>` and `<audio>` with a source, `(muted)`
@@ -55,7 +56,13 @@ When the page has a main player (a video at least half the window wide) and noth
note follows the fence: the video is not playing, do not say it plays; if it should, click its play
button and look again, and if it still does not play, tell the user it did not start. The
description tells the model to search a site with `open` and `query` in plain text, never putting the
words into an address itself (live 2026-11-16: 아이유 hand-encoded into 아이우). Eval
words into an address itself (live 2026-11-16: 아이유 hand-encoded into 아이우), and to play a song or
video with one `play` whose `query` is the words as the user said them, in their language (live
2026-11-16, 0.1.19: "아이유 신곡 틀어 줘" opened YouTube's home page, then a `type` with `query` instead of
`text` failed and its retry was refused as a third call of the tool in one answer; "뉴진스 하입보이"
searched "NewJeans Hypothesis" in English and stopped on the results; both answers said the video
played). Eval `evals/test_bot_browser_tool.py` (qwen3:8b, 3 runs of the two requests): ending on a
playing video found with the words as said 0/6 before, 5/6 after (6/6 played; once "IU new song"). Eval
`evals/test_bot_browser_tool.py` (qwen3:8b, 3 runs each): reaching YouTube with the right words 1/3
before, 3/3 after; a video page that stays paused reported as playing 1/3 before, never after (3/3
said it did not play).

View File

@@ -289,6 +289,13 @@ class WeatherTool(Tool):
# debug log, doesn't change behaviour downstream.
place_from_fallback = False
set_place = getattr(getattr(context, "cfg", None), "location_name", None)
set_place = set_place.strip() if isinstance(set_place, str) else ""
if not location_str and set_place:
# No place asked for: the place the user set in the settings (location.spec.md).
location_str = set_place
debug_log(" 📍 using the location set in the settings", "tools")
if not location_str:
# No location provided - try auto-detected coordinates first.
user_loc = self._get_user_location(context)

View File

@@ -570,7 +570,7 @@ class WebSearchTool(Tool):
return {
"type": "object",
"properties": {
"search_query": {"type": "string", "description": "A self-contained search query with entity names resolved from conversation history (not a literal echo of the user's utterance). Prefer a compact keyword phrase over a conversational sentence — e.g. 'Harry Styles most famous songs', not 'what are his most famous songs'."}
"search_query": {"type": "string", "description": "A self-contained search query with entity names resolved from conversation history (not a literal echo of the user's utterance), in the language the user spoke (never translated into English: results then fit where the user is). Prefer a compact keyword phrase over a conversational sentence — e.g. 'Harry Styles most famous songs', not 'what are his most famous songs'."}
},
"required": ["search_query"]
}

View File

@@ -7,7 +7,10 @@ memory.
The query comes in `search_query`; `query` is read when `search_query` is missing or empty (the
planner writes steps as `webSearch query='...'` and models copy it; live 2026-11-16 both searches of
an answer failed on it).
an answer failed on it). Its description asks for the query in the language the user spoke, never
translated into English, so the results fit where the user is (live 2026-11-16: a Korean request for
Netflix dramas searched in English and recommended American shows; eval
`evals/test_search_in_users_language.py`, with the planner rule in `planner.spec.md`).
### Real-time info routing (`STREAM_BROWSER`)

View File

@@ -17,6 +17,7 @@ This specification documents the location detection module (`src/jarvis/utils/lo
| `location_ip_address` | str \| null | `null` | Manually configured public IP. Takes precedence over auto-detection when set. |
| `location_cgnat_resolve_public_ip` | bool | `true` | When a CGNAT address (100.64.0.0/10) is detected, attempt a single DNS query to OpenDNS to resolve the true public IP. Disable to prevent any external DNS query. |
| `location_cache_minutes` | int | `60` | TTL for cached location lookups persisted to disk. |
| `location_name` | str \| null | `null` | A place the user set (v2: the app's `brain.location`, default `대한민국`). When set (and `location_enabled`), the reply engine's time line says `Location: <name> (where the user is)` without any detection, and `getWeather` without a place asked for uses it (a place the person names still wins). The local time is then the computer's. Live 2026-11-16: the game PC has no GeoLite2 database, so detection always failed ("Location: Unknown", weather asked for the city) and searches fitted no country. |
### IP Resolution Chain

View File

@@ -267,9 +267,10 @@ which carry Discord's own time.
Two reply options keep the time to the first word short (Strata reads every prompt from the
start, about 0.36 s per 2,048 tokens, and each LLM call before the answer adds its whole time):
the short voice persona (`compact_prompt=True`: the same butler in a tenth of v1's words, without
v1's single-user memory and on-screen browser rules, answers as short as possible, the full tool
guidance only on turns that offer a data tool), and the intent judge (`intent_judge=True`: the tool
router judges whether the turn needs tools and which, and the planner runs only when it does;
v1's single-user memory and on-screen browser rules, answers as short as possible, v1's tool
guidance in short only on turns that offer a data tool), and the intent judge (`intent_judge=True`: the tool
router judges whether the turn needs tools and which, and the planner runs only when it does
and the pick is not a lone one-step tool;
`planner.spec.md`, "Intent judge (v2)"). v1's screen-share browser (`stream_browser`) is off: it
needs v1's Node bot (M6 brings the v2 one), so its tools are not offered.
- Tools: the brain offers and runs no built-in tool in the jarvis settings' `disabled_tools` (the

View File

@@ -58,6 +58,10 @@ class FakeSession:
self.calls.append(("back",))
return self.page
def play(self, results_url):
self.calls.append(("play", results_url))
return self.page
@pytest.fixture
def fake(monkeypatch):
@@ -176,6 +180,25 @@ def test_actions_pass_their_arguments(fake):
assert not t.run({"action": "dance"}, ctx()).success
def test_play_searches_youtube_for_the_words_as_said_in_one_call(fake):
t = BotBrowserTool()
assert t.run({"action": "play", "query": "뉴진스 하입보이"}, ctx()).success
assert fake.calls == [("play", "https://www.youtube.com/results?search_query="
"%EB%89%B4%EC%A7%84%EC%8A%A4+%ED%95%98%EC%9E%85%EB%B3%B4%EC%9D%B4")]
assert not t.run({"action": "play"}, ctx()).success # nothing to play
# An address to play opens that page (whose player starts as on any video page opened).
fake.calls.clear()
t.run({"action": "play", "query": "https://www.youtube.com/watch?v=x"}, ctx())
t.run({"action": "play", "url": "www.youtube.com/watch?v=y"}, ctx())
assert fake.calls == [("open", "https://www.youtube.com/watch?v=x"), ("open", "https://www.youtube.com/watch?v=y")]
def test_typing_takes_the_words_also_as_query(fake):
# Live 2026-11-16: the model wrote query instead of text and the search never ran.
BotBrowserTool().run({"action": "type", "query": "아이유 신곡", "submit": True}, ctx())
assert fake.calls == [("type", "아이유 신곡", None, True)]
class Broken(FakeSession):
"""A session whose connection breaks during `breaks` (after the action may have gone out)."""
@@ -300,6 +323,15 @@ PAGES = {
"/results": "<html><head><title>Results</title></head><body><a href='/watch'>The song</a></body></html>",
"/watch": "<html><head><title>Watch</title></head><body>"
"<video src='/tone.wav' style='width:90vw;height:300px'></video></body></html>",
# Search results with an ad first, then a video (on YouTube the links carry ?v= and more).
"/yt": "<html><head><title>Results</title></head><body>"
"<div is-ad><a href='/watch?v=ad1'>An ad</a></div>"
"<a href='/watch?v=abc&list=RDabc&start_radio=1'>The song</a></body></html>",
# Results that show their first video only a moment after the page loaded.
"/slow": "<html><head><title>Results</title></head><body><script>setTimeout(() => {"
"const a = document.createElement('a'); a.href = '/watch?v=late'; a.textContent = 'Late song';"
"document.body.appendChild(a); }, 1500)</script></body></html>",
"/none": "<html><head><title>Results</title></head><body>No results</body></html>",
# A video page whose player cannot play (its file is missing).
"/broken": "<html><head><title>Broken</title></head><body>"
"<video src='/missing.mp4' style='width:90vw;height:300px'></video></body></html>",
@@ -425,6 +457,20 @@ def test_a_video_page_whose_player_stays_paused_gets_play_pressed_when_clicked_t
assert "not playing" in bot_browser._render(page)
def test_play_opens_the_first_video_of_the_results_not_an_ad_and_starts_it(chrome):
cdp, site, seen = chrome
s = BrowserSession(cdp, time.monotonic() + 25)
page = s.play(site + "/yt?search_query=x")
assert page["url"] == site + "/watch?v=abc", page["url"]
assert [m["playing"] for m in page["media"]] == [True], page
assert "/watch?v=ad1" not in seen
s.deadline = time.monotonic() + 25
assert s.play(site + "/slow")["url"] == site + "/watch?v=late"
s.deadline = time.monotonic() + 3
with pytest.raises(bot_browser.BrowserError):
s.play(site + "/none")
def test_links_that_would_open_a_new_tab_open_in_the_same_tab(chrome):
cdp, site, _ = chrome
s = BrowserSession(cdp, time.monotonic() + 15)

View File

@@ -2,7 +2,7 @@
Strata reads every prompt from the start, so prompt length is reply latency. Behaviour: the compact
prompt is far shorter than v1's for the same turn, still carries the tool honesty rules and the
reply-language default, and brings the full tool guidance only on turns that offer a data tool.
reply-language default, and brings the (short) tool guidance only on turns that offer a data tool.
"""
from unittest.mock import Mock, patch
@@ -13,7 +13,9 @@ from src.jarvis.memory.conversation import DialogueMemory
from src.jarvis.memory.history import HistoryContext
from src.jarvis.reply.engine import run_reply_engine
from src.jarvis.reply.prompts.model_variants import TOOL_CONSTRAINTS_LARGE
from src.jarvis.system_prompt import COMPACT_ACTION_RULE, TOOL_HONESTY_RULES, default_language_directive
from src.jarvis.system_prompt import (
COMPACT_ACTION_RULE, COMPACT_TOOL_GUIDANCE, TOOL_HONESTY_RULES, default_language_directive,
)
from tests.test_ollama_num_predict import _mock_cfg
@@ -46,14 +48,23 @@ def test_the_compact_prompt_is_far_shorter_and_keeps_the_rules(routed):
@pytest.mark.unit
def test_the_full_tool_guidance_comes_only_with_a_data_tool():
def test_the_tool_guidance_comes_only_with_a_data_tool():
chatty = _system_prompt(True, [])
assert COMPACT_ACTION_RULE in chatty and TOOL_CONSTRAINTS_LARGE not in chatty
assert COMPACT_ACTION_RULE in chatty and COMPACT_TOOL_GUIDANCE not in chatty
weather = _system_prompt(True, ["getWeather"])
assert TOOL_CONSTRAINTS_LARGE in weather and COMPACT_ACTION_RULE not in weather
assert COMPACT_TOOL_GUIDANCE in weather and COMPACT_ACTION_RULE not in weather
def _intent_turn(prepared, routed=("getWeather",)):
@pytest.mark.unit
def test_a_data_tool_turn_gets_the_short_tool_guidance_not_v1s():
# v1 keeps its full guidance; the compact prompt says the same rules in a fraction of it.
assert TOOL_CONSTRAINTS_LARGE in _system_prompt(False, ["getWeather"])
weather = _system_prompt(True, ["getWeather"])
assert TOOL_CONSTRAINTS_LARGE not in weather
assert len(COMPACT_TOOL_GUIDANCE) < len(TOOL_CONSTRAINTS_LARGE) / 2
def _intent_turn(prepared, routed=("getWeather",), first=None):
cfg = _mock_cfg(512)
cfg.stream_browser = False
cfg.tool_selection_strategy = "llm"
@@ -62,7 +73,9 @@ def _intent_turn(prepared, routed=("getWeather",)):
patch("src.jarvis.reply.engine._extra_config", lambda key, default="": default), \
patch("src.jarvis.reply.engine.extract_text_from_response", return_value="네."), \
patch("src.jarvis.reply.engine.chat_with_messages") as mock_chat:
mock_chat.return_value = {"message": {"content": "네."}}
answer = {"message": {"content": "네."}}
mock_chat.side_effect = [first, answer] if first else None
mock_chat.return_value = answer
run_reply_engine(db=Mock(), cfg=cfg, tts=None, text="날씨 어때?", dialogue_memory=DialogueMemory(),
history=HistoryContext(), legacy_memory=False, intent_judge=True,
prepared_tools=prepared)
@@ -74,9 +87,16 @@ def _intent_turn(prepared, routed=("getWeather",)):
def test_the_intent_judge_plans_only_turns_that_need_a_tool():
# No tool needed: one router call, then the answer.
assert _intent_turn(None, routed=())[:2] == (0, 1)
# A tool turn: the planner orders the steps.
planner, router, tools = _intent_turn(None)
assert (planner, router) == (1, 1) and "getWeather" in tools
# A tool turn that may take several steps: the planner orders them.
planner, router, tools = _intent_turn(None, routed=("webSearch",))
assert (planner, router) == (1, 1) and "webSearch" in tools
# A lone one-step tool the model calls needs no plan (tests/test_engine_one_step_turn.py).
weather_call = {"message": {"content": "", "tool_calls": [
{"id": "c1", "type": "function", "function": {"name": "getWeather", "arguments": {}}}]}}
with patch("src.jarvis.reply.engine.run_tool_with_retries",
return_value=Mock(success=True, reply_text="13C", error_message=None, images=None)):
planner, router, tools = _intent_turn(None, first=weather_call)
assert (planner, router) == (0, 1) and "getWeather" in tools
@pytest.mark.unit

View File

@@ -0,0 +1,145 @@
"""One-step tool turns in the v2 brain skip the planner (planner.spec.md, "Intent judge (v2)").
When the router's only pick is a tool that does its job in one call (the weather, a meal log, a
look at the screen), the planner's ordered steps add nothing but a full LLM call before the answer.
The engine then gives the chat model the tool directly. Its skipped-tool guard, which reads the
plan, is replaced for these turns by one nudge: an answer given without the tool is dropped and the
model is asked once to call it.
"""
from __future__ import annotations
from unittest.mock import patch
import pytest
NATIVE_MODEL = "gpt-oss:20b"
FABRICATED = "서울은 지금 24도에 맑습니다."
GROUNDED = "서울은 지금 13도이고 맑습니다."
def _content(text: str) -> dict:
return {"message": {"role": "assistant", "content": text}}
def _native_call(name: str, args: dict) -> dict:
return {"message": {"role": "assistant", "content": "", "tool_calls": [
{"id": "call_1", "type": "function", "function": {"name": name, "arguments": args}}]}}
def _run(mock_config, db, dialogue_memory, *, routed, chat_replies, plan=("Reply to the user.",)):
from jarvis.memory.history import HistoryContext
from jarvis.reply import engine as engine_mod
from jarvis.tools.types import ToolExecutionResult
mock_config.ollama_chat_model = NATIVE_MODEL
mock_config.evaluator_enabled = False
mock_config.stream_browser = False
seen: list[list[dict]] = []
replies = iter(chat_replies)
def fake_chat(*args, **kwargs):
seen.append([dict(m) for m in (kwargs.get("messages") or args[2])])
return next(replies)
invoked: list[str] = []
def fake_tool(db, cfg, tool_name, tool_args, **kwargs):
invoked.append(tool_name)
return ToolExecutionResult(success=True, reply_text="Seoul: 13C, clear sky.", error_message=None)
with patch.object(engine_mod, "run_tool_with_retries", side_effect=fake_tool), \
patch.object(engine_mod, "chat_with_messages", side_effect=fake_chat), \
patch.object(engine_mod, "select_tools", return_value=list(routed)), \
patch.object(engine_mod, "plan_query", return_value=list(plan)) as planner:
reply = engine_mod.run_reply_engine(
db=db, cfg=mock_config, tts=None, text="서울 지금 우산 필요해?",
dialogue_memory=dialogue_memory, history=HistoryContext(), legacy_memory=False,
intent_judge=True)
return reply, invoked, seen, planner.call_count
@pytest.mark.unit
@pytest.mark.parametrize("routed", [["getWeather", "stop"], ["logMeal", "stop"], ["screenView"]])
def test_a_lone_one_step_tool_needs_no_plan(mock_config, db, dialogue_memory, routed):
_, _, _, planned = _run(mock_config, db, dialogue_memory, routed=routed,
chat_replies=[_native_call(routed[0], {}), _content(GROUNDED)])
assert planned == 0
@pytest.mark.unit
@pytest.mark.parametrize("routed", [
["webSearch", "stop"], # searches chain (who directed it, what else they made)
["schedule", "stop"], # list, then cancel the one asked about
["getWeather", "webSearch", "stop"], # two tools
], ids=["search", "schedule", "two tools"])
def test_turns_that_may_take_several_steps_keep_the_plan(mock_config, db, dialogue_memory, routed):
_, _, _, planned = _run(mock_config, db, dialogue_memory, routed=routed,
chat_replies=[_content(GROUNDED)])
assert planned == 1
@pytest.mark.unit
def test_a_tool_less_answer_on_a_one_step_turn_is_dropped_and_the_tool_called(mock_config, db, dialogue_memory):
reply, invoked, seen, _ = _run(
mock_config, db, dialogue_memory, routed=["getWeather", "stop"],
chat_replies=[_content(FABRICATED), _native_call("getWeather", {"location": "Seoul"}),
_content(GROUNDED)])
assert invoked == ["getWeather"]
assert reply == GROUNDED
# The made-up answer never reaches a later turn, and the retry names the tool.
assert not any(FABRICATED in (m.get("content") or "") for m in seen[1])
assert "getWeather" in (seen[1][-1].get("content") or "")
@pytest.mark.unit
def test_a_second_made_up_answer_falls_back_to_the_plan_and_its_tool(mock_config, db, dialogue_memory):
# Asked once, the model still answers without the tool: the turn takes the planned path, the
# skipped-tool guard runs the planned call, and no made-up answer reaches the user.
reply, invoked, seen, planned = _run(
mock_config, db, dialogue_memory, routed=["getWeather", "stop"],
plan=["getWeather location='Seoul'", "Reply to the user with the weather."],
chat_replies=[_content(FABRICATED), _content(FABRICATED), _content(GROUNDED)])
assert planned == 1
assert invoked == ["getWeather"]
assert reply == GROUNDED
assert not any(FABRICATED in (m.get("content") or "") for m in seen[-1])
@pytest.mark.unit
def test_a_question_back_goes_out_when_the_plan_needs_no_tool(mock_config, db, dialogue_memory):
# The late plan judges that no tool is needed (a question back to the user): it is delivered.
question = "어느 도시 날씨를 알려 드릴까요?"
reply, invoked, seen, planned = _run(
mock_config, db, dialogue_memory, routed=["getWeather", "stop"],
chat_replies=[_content(question), _content(question)])
assert planned == 1
assert invoked == []
assert reply == question
assert len(seen) == 2
@pytest.mark.unit
def test_a_model_that_calls_the_tool_is_not_asked_again(mock_config, db, dialogue_memory):
reply, invoked, seen, _ = _run(
mock_config, db, dialogue_memory, routed=["getWeather", "stop"],
chat_replies=[_native_call("getWeather", {"location": "Seoul"}), _content(GROUNDED)])
assert invoked == ["getWeather"]
assert reply == GROUNDED
assert len(seen) == 2
@pytest.mark.unit
def test_v1_turns_still_plan_a_one_step_tool(mock_config, db, dialogue_memory):
from jarvis.reply import engine as engine_mod
mock_config.ollama_chat_model = NATIVE_MODEL
mock_config.evaluator_enabled = False
with patch.object(engine_mod, "chat_with_messages", return_value=_content(GROUNDED)), \
patch.object(engine_mod, "select_tools", return_value=["getWeather", "stop"]), \
patch.object(engine_mod, "extract_search_params_for_memory", return_value={"keywords": []}), \
patch.object(engine_mod, "plan_query", return_value=["Reply to the user."]) as planner:
engine_mod.run_reply_engine(db=db, cfg=mock_config, tts=None, text="서울 지금 우산 필요해?",
dialogue_memory=dialogue_memory)
assert planner.call_count == 1

View File

@@ -111,3 +111,33 @@ def test_auto_detect_rejects_private_ip_from_opendns():
patch("jarvis.utils.location._resolve_public_ip_via_opendns", return_value="192.168.1.1"):
result = _get_external_ip_automatically()
assert result is None
def test_a_place_set_in_the_settings_is_the_location_and_detection_is_not_tried():
"""brain.location (default 대한민국) reaches the brain as location_name: the time line says it,
without GeoIP (which has no database on the game PC: "Location: Unknown" before)."""
from jarvis.reply import engine
with patch.object(engine, "get_location_context_with_timezone") as detect:
line = engine._live_time_location_string(types.SimpleNamespace(location_enabled=True, location_name="대한민국"))
assert "Location: 대한민국" in line and "Current local time" in line
detect.assert_not_called()
# Location turned off still wins; no place set means detection as before.
off = engine._live_time_location_string(types.SimpleNamespace(location_enabled=False, location_name="대한민국"))
assert "Location: Disabled" in off
with patch.object(engine, "get_location_context_with_timezone", return_value=("Location: Seoul", None)) as detect:
assert "Location: Seoul" in engine._live_time_location_string(types.SimpleNamespace(location_enabled=True, location_name=None))
detect.assert_called_once()
def test_the_settings_file_carries_the_place():
import json
import tempfile
from jarvis.config import load_settings
with tempfile.NamedTemporaryFile("w", suffix=".json", delete=False) as f:
json.dump({"location_name": " 대한민국 "}, f)
with patch.dict("os.environ", {"JARVIS_CONFIG_PATH": f.name}):
assert load_settings().location_name == "대한민국"
with tempfile.NamedTemporaryFile("w", suffix=".json", delete=False) as f:
json.dump({"location_name": None}, f)
with patch.dict("os.environ", {"JARVIS_CONFIG_PATH": f.name}):
assert load_settings().location_name is None

View File

@@ -253,6 +253,28 @@ class TestWeatherTool:
# Verify location detection was called (fallback was attempted)
mock_location.assert_called_once()
@patch('requests.get')
@patch('src.jarvis.tools.builtin.weather.get_location_info')
def test_without_a_place_the_place_set_in_the_settings_is_used(self, mock_location, mock_get):
"""Live 2026-11-16: detection failed on the game PC and "날씨 어때" got "tell me the city";
the place set in the settings (brain.location, default 대한민국) is the answer instead."""
self.context.cfg.location_name = "South Korea"
geo = Mock(raise_for_status=Mock())
geo.json.return_value = {"results": [{"latitude": 36.5, "longitude": 127.75, "name": "South Korea",
"country": "South Korea"}]}
weather = Mock(raise_for_status=Mock())
weather.json.return_value = {"current": {"temperature_2m": 12.0, "apparent_temperature": 12.0,
"weather_code": 0}}
mock_get.side_effect = [geo, weather]
result = self.tool.run({}, self.context)
assert result.success, result.reply_text
assert mock_get.call_args_list[0].kwargs["params"]["name"] == "South Korea"
mock_location.assert_not_called()
# A place the person asked about still wins over the set one.
mock_get.side_effect = [geo, weather]
self.tool.run({"location": "Busan"}, self.context)
assert mock_get.call_args_list[2].kwargs["params"]["name"] == "Busan"
@patch('src.jarvis.tools.builtin.weather.get_location_info')
def test_run_no_args_uses_fallback(self, mock_location):
"""Test weather with no arguments uses user's detected location as fallback."""