- screenView tool (screen_view.spec.md): whole screen, monitor by number, window by part of its title or program, or the list of monitors and windows; fast, normal or detailed pictures. - The app captures with Windows Graphics Capture (app/src/screen.rs, admin.spec.md "Screen viewing"), decides for the asker (only people registered for PC control), never picks, lists or shows excluded programs (pcControl.screenExclude, password managers by default), refuses minimised windows and black pictures, and records screen.view in the activity log. - Pictures ride on the tool message (ToolExecutionResult.images); llm.py sends them to OpenAI-compatible servers as image parts after the tool messages. They stay in that reply only: not in the tool carryover, logs or prompt dumps. - The LLM reads pictures only when screen viewing is available (--vision gpu normally, cpu in a game), measured apart for the placement; otherwise screenView is a disabled tool. - Worker: screen_action / screen_action_result, 4 MiB messages. - Eval evals/test_screen_view_tool.py; Windows check tests/screen_windows.rs. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
46 lines
830 B
Rust
46 lines
830 B
Rust
//! Jarvis v2 app core (see `app/src/discord_core.spec.md`).
|
|
|
|
pub mod log;
|
|
pub mod activity;
|
|
pub mod admin_api;
|
|
pub mod browser;
|
|
pub mod calls;
|
|
pub mod channel_sync;
|
|
pub mod chat;
|
|
pub mod collect;
|
|
pub mod collect_notify;
|
|
pub mod control;
|
|
pub mod conversation;
|
|
pub mod dashboard;
|
|
pub mod datadir;
|
|
pub mod discord;
|
|
pub mod discord_setup;
|
|
pub mod download;
|
|
pub mod earcon;
|
|
pub mod features;
|
|
pub mod game;
|
|
pub mod frames;
|
|
pub mod install;
|
|
pub mod logs;
|
|
pub mod notes;
|
|
pub mod playback;
|
|
pub mod perf;
|
|
pub mod permissions;
|
|
pub mod placement;
|
|
pub mod policy;
|
|
pub mod receive;
|
|
pub mod schedule;
|
|
pub mod screen;
|
|
pub mod secrets;
|
|
pub mod services;
|
|
pub mod settings;
|
|
pub mod settings_edit;
|
|
pub mod setup_lock;
|
|
pub mod speakers;
|
|
pub mod strata;
|
|
pub mod system;
|
|
pub mod update;
|
|
pub mod vdisplay;
|
|
pub mod worker_client;
|
|
pub mod worker_process;
|