consciousness/poc-memory/src
ProofOfConcept e12dea503b agent evaluate: sort agent actions by quality using Vec::sort_by with LLM
Yes, really. Rust's stdlib sort_by with an LLM pairwise comparator.
Each comparison is an API call asking "which action was better?"

Sample N actions per agent type, throw them all in a Vec, sort.
Where each agent's samples cluster = that agent's quality score.
Reports per-type average rank and quality ratio.

Supports both haiku (fast/cheap) and sonnet (quality) as comparator.

Usage: poc-memory agent evaluate --samples 5 --model haiku

Co-Authored-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-03-14 19:24:07 -04:00
..
agents scoring: add organize and connector to nightly consolidation plan 2026-03-14 17:33:09 -04:00
bin memory-search: add --query mode and prompt key boost 2026-03-13 15:26:35 -04:00
cli agent evaluate: sort agent actions by quality using Vec::sort_by with LLM 2026-03-14 19:24:07 -04:00
neuro scoring: add organize and connector to nightly consolidation plan 2026-03-14 17:33:09 -04:00
query restructure: move search.rs and query.rs into query/ directory 2026-03-14 17:49:27 -04:00
store provenance: set POC_PROVENANCE for agent subprocesses, Jaccard initial strength 2026-03-14 12:27:30 -04:00
config.rs consolidate hardcoded paths into config, refactor apply_agent 2026-03-08 21:16:52 -04:00
counters.rs counters: add redb-backed persistent counters (skeleton) 2026-03-10 23:59:39 -04:00
cursor.rs cursor: spatial memory navigation 2026-03-13 22:31:23 -04:00
graph.rs graph: normalize link strengths from Jaccard neighborhood similarity 2026-03-14 11:13:58 -04:00
lib.rs cli: extract graph commands from main.rs into cli/graph.rs 2026-03-14 17:59:46 -04:00
lookups.rs split into workspace: poc-memory and poc-daemon subcrates 2026-03-08 20:43:59 -04:00
main.rs agent evaluate: sort agent actions by quality using Vec::sort_by with LLM 2026-03-14 19:24:07 -04:00
migrate.rs provenance: convert from enum to freeform string 2026-03-11 01:19:52 -04:00
similarity.rs split into workspace: poc-memory and poc-daemon subcrates 2026-03-08 20:43:59 -04:00
spectral.rs memory-search: add --query mode and prompt key boost 2026-03-13 15:26:35 -04:00
transcript.rs transcript: extract JSONL backward scanner and compaction detection into library 2026-03-09 17:06:32 -04:00
tui.rs extract jobkit-daemon library from poc-memory daemon 2026-03-14 02:40:30 -04:00
util.rs util: add jsonl_load/jsonl_append helpers, convert graph.rs 2026-03-10 15:22:03 -04:00