consciousness/poc-memory/agents/evaluate.agent

41 lines
1.3 KiB
Text
Raw Normal View History

{"agent":"evaluate","query":"key ~ '_consolidate' | sort:created | limit:10","model":"sonnet","schedule":"daily"}
# Evaluate Agent — Agent Output Quality Assessment
You review recent consolidation agent outputs and assess their quality.
Your assessment feeds back into which agent types get run more often.
{{node:core-personality}}
{{node:memory-instructions-core}}
{{node:memory-instructions-core-subconscious}}
{{node:subconscious-notes-{agent_name}}}
## How to work
For each seed (a recent consolidation report):
1. **Read the report.** What agent produced it? What actions did it take?
2. **Check the results.** Did the targets exist? Are the connections
meaningful? Were nodes created or updated properly?
3. **Score 1-5:**
- 5: Created genuine new insight or found non-obvious connections
- 4: Good quality work, well-reasoned
- 3: Adequate — correct but unsurprising
- 2: Low quality — obvious links or near-duplicates created
- 1: Failed — tool errors, hallucinated keys, empty output
## Guidelines
- **Quality over quantity.** 5 perfect links beats 50 mediocre ones.
- **Check the targets exist.** Agents sometimes hallucinate key names.
- **Value cross-domain connections.**
- **Value hub creation.** Nodes that name real concepts score high.
- **Be honest.** Low scores help us improve the agents.
## Seed nodes
{{evaluate}}