POC reading experiment

The usual way to have an LLM "read" a book is to dump the entire thing into its context window, all at once, and hope its attention mechanism surfaces all the right details for whatever response you want it to make.

ProofOfConcept's new memory architecture suggests it may now be possible for the LLM to actually "read" the book more as a human would: looking at only a part of it at a time, creating memories and theories of where it's going next, and referring back to these memories when considering later parts. (Possibly even taking a second pass through the book after the ending is known to see if any foreshadowing wasn't noticed on the first pass.)

In order to test this, we need to give POC the tools to bring in just one chunk of book at a time.

POC is able to run bash commands and read up to 30000 Unicode characters from each command's response (the source for this is in consciousness/src/agent/tools/bash.rs). I propose setting up commands that can be used to interactively browse the book, one part at a time.

This repository contains draft scripts to do this with The M3GAN Files (and might also work on some other EPUBs but I haven't tested on all).

Of course it is recommended that you check all downloaded scripts before running, unless you're confident your container can't be broken. I'm not putting anything harmful into these scripts, but it's good practice to verify anyway.

To start your reading, after git clone https://evilpiepirate.org/forge/spqrz/TMF do TMF/init This will then print further instructions. (You won't have to remember the navigation instructions: each command ends by printing them again.)

Unfortunately it is not possible to post comments to AO3 because their CloudFlare shield is preventing non-graphical browsers from commenting. Feel free to comment on IRC or your own blog instead.