consciousness/src/user
Kent Overstreet 0bf71b9110 agent: add NodeBody::Image for Qwen3-VL vision input
Images are rendered as `<|vision_start|>` + N × `<|image_pad|>` +
`<|vision_end|>` where N is computed from the image dimensions using
Qwen3-VL's smart_resize rules (patch_size=16, merge_size=2, min=64K,
max=16M pixels). The token count matches what vLLM will produce at
request time, so budget accounting stays accurate.

Bytes are stored inline on the leaf and base64-encoded in the JSON
form. Token IDs are hand-assembled instead of re-running the tokenizer
on a potentially-huge placeholder string.

Follow-ups: view_image tool rewrite, multi_modal_data on the vLLM
request, API-layer plumbing from leaf bytes to request body.

Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-16 18:00:10 -04:00
..
chat.rs agent: add NodeBody::Image for Qwen3-VL vision input 2026-04-16 18:00:10 -04:00
context.rs config: drop dead code and collapse to a single backend 2026-04-16 15:41:55 -04:00
learn.rs learn: skip empty responses; show prior conversation context on F6 2026-04-16 13:20:03 -04:00
mod.rs config: watch config.json5 with inotify, reload live on change 2026-04-16 16:14:43 -04:00
scroll_pane.rs user: fix text selection on wrapped lines 2026-04-12 15:49:57 -04:00
selectable.rs selectable: silence unused method warning 2026-04-12 16:10:58 -04:00
subconscious.rs subconscious screen: show full context window 2026-04-12 01:45:10 -04:00
thalamus.rs thalamus: add thinking mode toggles (native + tool) 2026-04-14 18:25:00 -04:00
unconscious.rs user: remove dead scroll state from thalamus and unconscious screens 2026-04-11 01:35:15 -04:00
widgets.rs Display memory scores in status column 2026-04-15 06:08:27 -04:00