kent/consciousness
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

JsonlBackwardIter: use memrchr3 for SIMD-accelerated scanning

Browse source 
Replaces byte-by-byte backward iteration with memrchr3('{', '}', '"')
which uses SIMD to jump between structurally significant bytes. Major
speedup on large transcripts (1.4GB+).

Also simplifies tail_messages to use a byte budget (200KB) instead
of token counting.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Kent Overstreet 2026-03-22 03:11:30 -04:00
parent d7d631d77d
commit 6c41b50e04
3 changed files with 23 additions and 23 deletions
Download patch file Download diff file Expand all files Collapse all files

2
poc-memory/src/agents/defs.rs
View file

@ -456,7 +456,7 @@ fn resolve_conversation() -> String {
let Some(path) = transcript else { return String::new() };
let path_str = path.to_string_lossy();
let messages = crate::transcript::tail_messages(&path_str, 25_000);
let messages = crate::transcript::tail_messages(&path_str, 200_000);
if messages.is_empty() { return String::new(); }
let cfg = crate::config::get();