kent/consciousness
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
consciousness/Cargo.toml

119 lines
2.4 KiB
TOML
Raw Normal View History

split into workspace: poc-memory and poc-daemon subcrates poc-daemon (notification routing, idle timer, IRC, Telegram) was already fully self-contained with no imports from the poc-memory library. Now it's a proper separate crate with its own Cargo.toml and capnp schema. poc-memory retains the store, graph, search, neuro, knowledge, and the jobkit-based memory maintenance daemon (daemon.rs). Co-Authored-By: ProofOfConcept <poc@bcachefs.org>
2026-03-08 20:42:40 -04:00
[workspace]
channels: add socat daemon for generic stream channels consciousness-channel-socat listens on a unix socket for incoming connections, turning each into a bidirectional text channel. Also supports outbound connections via the open RPC (tcp: or unix:). Two sockets: socat.sock — capnp RPC (channel protocol) socat.stream.sock — data (incoming connections become channels) No config file needed. The simplest possible channel daemon. Co-Authored-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-04-04 22:48:33 -04:00
members = ["channels/irc", "channels/telegram", "channels/tmux", "channels/socat"]
split into workspace: poc-memory and poc-daemon subcrates poc-daemon (notification routing, idle timer, IRC, Telegram) was already fully self-contained with no imports from the poc-memory library. Now it's a proper separate crate with its own Cargo.toml and capnp schema. poc-memory retains the store, graph, search, neuro, knowledge, and the jobkit-based memory maintenance daemon (daemon.rs). Co-Authored-By: ProofOfConcept <poc@bcachefs.org>
2026-03-08 20:42:40 -04:00
resolver = "2"
[workspace.package]
poc-memory v0.4.0: graph-structured memory with consolidation pipeline Rust core: - Cap'n Proto append-only storage (nodes + relations) - Graph algorithms: clustering coefficient, community detection, schema fit, small-world metrics, interference detection - BM25 text similarity with Porter stemming - Spaced repetition replay queue - Commands: search, init, health, status, graph, categorize, link-add, link-impact, decay, consolidate-session, etc. Python scripts: - Episodic digest pipeline: daily/weekly/monthly-digest.py - retroactive-digest.py for backfilling - consolidation-agents.py: 3 parallel Sonnet agents - apply-consolidation.py: structured action extraction + apply - digest-link-parser.py: extract ~400 explicit links from digests - content-promotion-agent.py: promote episodic obs to semantic files - bulk-categorize.py: categorize all nodes via single Sonnet call - consolidation-loop.py: multi-round automated consolidation Co-Authored-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-02-28 22:17:00 -05:00
version = "0.4.0"
Upgrade workspace to edition 2024, add --local flag to agent run Edition 2024 changes: - gen is reserved: rename variable in query/engine.rs - set_var is unsafe: wrap in unsafe block in cli/agent.rs - match ergonomics: add explicit & in spectral.rs filter closure New --local flag for `poc-memory agent run` bypasses the daemon and runs the agent directly in-process. Useful for testing agent prompt changes without waiting in the daemon queue. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-18 22:44:36 -04:00
edition = "2024"
poc-memory v0.4.0: graph-structured memory with consolidation pipeline Rust core: - Cap'n Proto append-only storage (nodes + relations) - Graph algorithms: clustering coefficient, community detection, schema fit, small-world metrics, interference detection - BM25 text similarity with Porter stemming - Spaced repetition replay queue - Commands: search, init, health, status, graph, categorize, link-add, link-impact, decay, consolidate-session, etc. Python scripts: - Episodic digest pipeline: daily/weekly/monthly-digest.py - retroactive-digest.py for backfilling - consolidation-agents.py: 3 parallel Sonnet agents - apply-consolidation.py: structured action extraction + apply - digest-link-parser.py: extract ~400 explicit links from digests - content-promotion-agent.py: promote episodic obs to semantic files - bulk-categorize.py: categorize all nodes via single Sonnet call - consolidation-loop.py: multi-round automated consolidation Co-Authored-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-02-28 22:17:00 -05:00
[profile.release]
opt-level = 2
enable frame pointers and debug info in release builds So we can profile with perf when the daemon spins.
2026-03-12 18:11:09 -04:00
debug = 1
[profile.release.package."*"]
debug = false
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
[package]
name = "poc-memory"
version.workspace = true
edition.workspace = true
[dependencies]
organize cargo deps
2026-04-07 12:54:23 -04:00
anyhow = "1"
clap = { version = "4", features = ["derive"] }
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
figment = { version = "0.10", features = ["env"] }
organize cargo deps
2026-04-07 12:54:23 -04:00
dirs = "6"
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
env_logger = "0.11"
organize cargo deps
2026-04-07 12:54:23 -04:00
log = "0.4"
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
serde = { version = "1", features = ["derive"] }
serde_json = "1"
organize cargo deps
2026-04-07 12:54:23 -04:00
json5 = "1.3"
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
crossterm = { version = "0.29", features = ["event-stream"] }
ratatui = { version = "0.30", features = ["unstable-rendered-line-info"] }
Move tool definitions into ContextState as system entries Tool definitions are now pushed as a ContextEntry in the system section at Agent construction time, formatted in the Qwen chat template style. They're tokenized, scored, and treated like any other context entry. assemble_prompt_tokens() no longer takes a tools parameter — tools are already in the context. This prepares for the switch to /v1/completions where tools aren't a separate API field. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-08 11:36:33 -04:00
tui-markdown = { git = "https://github.com/koverstreet/tui-markdown", subdirectory = "tui-markdown" }
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
tui-textarea = { version = "0.10.2", package = "tui-textarea-2" }
organize cargo deps
2026-04-07 12:54:23 -04:00
uuid = { version = "1", features = ["v4"] }
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
bincode = "1"
regex = "1"
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
glob = "0.3"
Add serde derives to AST types, enable chrono serde feature Prep for wiring context_new.rs into the codebase: AstNode, NodeLeaf, NodeBody, Role all derive Serialize/Deserialize for conversation log persistence. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-08 14:17:40 -04:00
chrono = { version = "0.4", features = ["serde"] }
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
libc = "0.2"
memchr = "2"
memmap2 = "0.9"
peg = "0.8"
paste = "1"
organize cargo deps
2026-04-07 12:54:23 -04:00
Upgrade redb 2 → 4, slim down tui-markdown redb: add ReadableDatabase trait import for begin_read(). tui-markdown: disable highlight-code (drops syntect), fix test deps leaking into normal dependencies. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 13:06:02 -04:00
redb = "4"
organize cargo deps
2026-04-07 12:54:23 -04:00
rkyv = { version = "0.7", features = ["validation", "std"] }
rayon = "1"
deps: replace tracing with log+env_logger, drop console-subscriber Switch all tracing::{info,warn,error} to log::{info,warn,error}. Replace tracing_subscriber::fmt::init() with env_logger::init(). Drop tracing, tracing-subscriber, tracing-appender as direct deps. Drop console feature from jobkit (was pulling in console-subscriber which pulled in tracing-subscriber). tracing still compiled as transitive dep of reqwest and tui-markdown, but our code no longer depends on it. Co-Authored-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-04-05 06:54:11 -04:00
jobkit = { git = "https://evilpiepirate.org/git/jobkit.git", features = ["daemon"] }
organize cargo deps
2026-04-07 12:54:23 -04:00
deps: replace tracing with log+env_logger, drop console-subscriber Switch all tracing::{info,warn,error} to log::{info,warn,error}. Replace tracing_subscriber::fmt::init() with env_logger::init(). Drop tracing, tracing-subscriber, tracing-appender as direct deps. Drop console feature from jobkit (was pulling in console-subscriber which pulled in tracing-subscriber). tracing still compiled as transitive dep of reqwest and tui-markdown, but our code no longer depends on it. Co-Authored-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-04-05 06:54:11 -04:00
tokio = { version = "1", features = ["full"] }
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
tokio-util = { version = "0.7", features = ["compat"] }
tokio-scoped = "0.2.0"
futures = "0.3"
capnp = "0.25"
capnp-rpc = "0.25"
organize cargo deps
2026-04-07 12:54:23 -04:00
Replace token counting with token generation via HuggingFace tokenizer Add agent/tokenizer.rs with global Qwen 3.5 tokenizer that generates actual token IDs including chat template wrapping. ContextEntry now stores token_ids: Vec<u32> instead of tokens: usize — the count is derived from the length. ContextEntry::new() tokenizes automatically via the global tokenizer. ContextSection::push_entry() takes a raw ConversationEntry and tokenizes it. set_message() re-tokenizes without needing an external tokenizer parameter. Token IDs include the full chat template: <|im_start|>role\ncontent <|im_end|>\n — so concatenating token_ids across entries produces a ready-to-send prompt for vLLM's /v1/completions endpoint. The old tiktoken CoreBPE is now unused on Agent (will be removed in a followup). Token counts are now exact for Qwen 3.5 instead of the ~85-90% approximation from cl100k_base. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-08 11:20:03 -04:00
tokenizers = "0.21"
organize cargo deps
2026-04-07 12:54:23 -04:00
skillratings = "0.28"
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
http = "1"
hyper = { version = "1", features = ["client", "http1"] }
hyper-util = { version = "0.1", features = ["tokio"], default-features = false }
http-body-util = "0.1"
organize cargo deps
2026-04-07 12:54:23 -04:00
bytes = "1"
base64 = "0.22"
Kill reqwest — minimal HTTP client on raw hyper + tokio-rustls New src/agent/api/http.rs: ~240 lines, supports GET/POST, JSON/form bodies, SSE streaming via chunk(), TLS via rustls. No tracing dep. Removes reqwest from the main crate and telegram channel crate. Cargo.lock drops ~900 lines of transitive dependencies. tracing now only pulled in by tui-markdown. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:50:40 -04:00
rustls = "0.23"
tokio-rustls = "0.26"
rustls-native-certs = "0.8"
serde_urlencoded = "0.7"
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
[build-dependencies]
Upgrade capnp 0.20 → 0.25, capnp-rpc 0.20 → 0.25 RPC trait methods changed from &mut self to self: Rc<Self> and return types from Promise<(), Error> to impl Future<Output = Result<...>>. Updated all Server impls across 6 files: DaemonImpl (rpc.rs), NotifyForwarder (channels.rs), and ChannelServerImpl in all channel crates (irc, telegram, tmux, socat). Local pry! macro replaces capnp_rpc::pry to match the new impl Future return type. Warning-clean workspace build. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-07 12:02:59 -04:00
capnpc = "0.25"
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
[lib]
name = "poc_memory"
path = "src/lib.rs"
[[bin]]
move Claude Code-specific code from thalamus/ to claude/ Separates the Claude-specific daemon (idle timer, tmux pane detection, prompt injection, RPC server, session hooks) from the universal infrastructure (channels, supervisor, notify, daemon protocol). thalamus/ now contains only substrate-independent code: the channel client/supervisor, notification system, daemon_capnp protocol, and shared helpers (now(), home()). claude/ contains: idle.rs, tmux.rs, context.rs, rpc.rs, config.rs, hook.rs (moved from subconscious/), plus the daemon CLI and server startup code from thalamus/mod.rs. All re-exports preserved for backward compatibility. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-03 19:14:39 -04:00
name = "consciousness"
path = "src/bin/consciousness.rs"
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
[[bin]]
move Claude Code-specific code from thalamus/ to claude/ Separates the Claude-specific daemon (idle timer, tmux pane detection, prompt injection, RPC server, session hooks) from the universal infrastructure (channels, supervisor, notify, daemon protocol). thalamus/ now contains only substrate-independent code: the channel client/supervisor, notification system, daemon_capnp protocol, and shared helpers (now(), home()). claude/ contains: idle.rs, tmux.rs, context.rs, rpc.rs, config.rs, hook.rs (moved from subconscious/), plus the daemon CLI and server startup code from thalamus/mod.rs. All re-exports preserved for backward compatibility. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-03 19:14:39 -04:00
name = "poc-memory"
path = "src/main.rs"
flatten: move poc-memory contents to workspace root No more subcrate nesting — src/, agents/, schema/, defaults/, build.rs all live at the workspace root. poc-daemon remains as the only workspace member. Crate name (poc-memory) and all imports unchanged. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-03-25 00:54:12 -04:00
[[bin]]
name = "merge-logs"
path = "src/bin/merge-logs.rs"
[[bin]]
name = "diag-key"
path = "src/bin/diag-key.rs"
[[bin]]
name = "find-deleted"
path = "src/bin/find-deleted.rs"
[[bin]]
move Claude Code-specific code from thalamus/ to claude/ Separates the Claude-specific daemon (idle timer, tmux pane detection, prompt injection, RPC server, session hooks) from the universal infrastructure (channels, supervisor, notify, daemon protocol). thalamus/ now contains only substrate-independent code: the channel client/supervisor, notification system, daemon_capnp protocol, and shared helpers (now(), home()). claude/ contains: idle.rs, tmux.rs, context.rs, rpc.rs, config.rs, hook.rs (moved from subconscious/), plus the daemon CLI and server startup code from thalamus/mod.rs. All re-exports preserved for backward compatibility. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-03 19:14:39 -04:00
name = "poc-hook"
path = "src/claude/poc-hook.rs"
Move thalamus subcrate into main crate Move thalamus/ (poc-daemon) source files into src/thalamus/ as a module of the main crate. The daemon entry point becomes a library function thalamus::run() with a thin poc-daemon binary for backward compatibility. - Copy thalamus source into src/thalamus/, fix crate:: -> super:: - Copy daemon.capnp into schema/, add to build.rs - Re-export daemon_capnp at crate root (capnp codegen requires it) - Add thalamus dependencies (capnp-rpc, tokio-util, toml, rustls, etc.) - Keep thalamus/ subcrate for comparison Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-03 17:31:17 -04:00
[[bin]]
name = "poc-daemon"
move Claude Code-specific code from thalamus/ to claude/ Separates the Claude-specific daemon (idle timer, tmux pane detection, prompt injection, RPC server, session hooks) from the universal infrastructure (channels, supervisor, notify, daemon protocol). thalamus/ now contains only substrate-independent code: the channel client/supervisor, notification system, daemon_capnp protocol, and shared helpers (now(), home()). claude/ contains: idle.rs, tmux.rs, context.rs, rpc.rs, config.rs, hook.rs (moved from subconscious/), plus the daemon CLI and server startup code from thalamus/mod.rs. All re-exports preserved for backward compatibility. Co-Authored-By: Proof of Concept <poc@bcachefs.org>
2026-04-03 19:14:39 -04:00
path = "src/claude/poc-daemon.rs"
[[bin]]
name = "memory-search"
path = "src/claude/memory-search.rs"
move mcp-schema to standalone binary in src/claude/ mcp-schema is Claude Code glue — extract from poc-memory subcommand to src/claude/mcp-schema.rs standalone binary. Update Python MCP bridge to call the new binary. Co-Developed-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-04-03 20:22:48 -04:00
consciousness-mcp: full MCP server in Rust Replaces the Python MCP bridge. Single binary speaks JSON-RPC over stdio, exposes 14 tools: - 10 memory tools (delegate to poc-memory CLI) - channel_list, channel_recv, channel_send, channel_notifications No external dependencies beyond serde_json. Channel tools use capnp RPC to talk to daemon sockets directly. Co-Developed-By: Kent Overstreet <kent.overstreet@linux.dev>
2026-04-03 20:30:07 -04:00
[[bin]]
name = "consciousness-mcp"
path = "src/claude/mcp-server.rs"
Reference in a new issue Copy permalink