kent/consciousness
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

vLLM priority scheduling for agents

Browse source 
Thread request priority through the API call chain to vLLM's
priority scheduler. Lower value = higher priority, with preemption.

Priority is set per-agent in the .agent header:
- interactive (runner): 0 (default, highest)
- surface-observe: 1 (near-realtime, watches conversation)
- all other agents: 10 (batch, default if not specified)

Requires vLLM started with --scheduling-policy priority.

Co-Authored-By: Proof of Concept <poc@bcachefs.org>
This commit is contained in:
Kent Overstreet 2026-04-01 23:21:39 -04:00
parent 503e2995c1
commit c72eb4d528
8 changed files with 27 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/subconscious/agents/surface-observe.agent
View file

@ -1,4 +1,4 @@
{"agent":"surface-observe","query":"","count":1,"bail":"bail-no-competing.sh"}
{"agent":"surface-observe","query":"","count":1,"priority":1,"bail":"bail-no-competing.sh"}
=== PROMPT phase:surface ===