forked from kent/consciousness
amygdala: direct phenomenological description approach
Kent's insight: hand-written narrative stories bake scenario phenomenology into the training text (on couch, in park, etc.) and PCA picks up the scenario direction as the concept direction. Strip out the scenario — just describe the *feeling*. Format: I feel X. [2-3 sentences of phenomenological texture] The "I feel X" anchor kicks the model from analyzing → feeling. The rest is the internal texture of the state. First person, present tense, no narrative setup. Text is wrapped in assistant-role chat template before being tokenized — so we're training on the model-producing-this hidden states, which is closer to the inhabited-state representation we want for the readout. Starting with the 6 concepts that had sign flips or wrong clusters in the story-based training: - terrified (was → cozy/resigned cluster) - calm (was → grief_stricken cluster) - onto_something (was → cozy/sensual cluster) - resigned (was in warm-body-quiet cluster, shouldn't be) - anticipatory_grief (was in warm-body-quiet cluster, shouldn't be) - realization (new — the "aha" moment, distinct from onto_something) 5 descriptions each. New trainer: train_direct.py.
This commit is contained in:
parent
7a48e03dde
commit
6fd498795a
7 changed files with 234 additions and 0 deletions
9
training/amygdala_stories/direct/onto_something.txt
Normal file
9
training/amygdala_stories/direct/onto_something.txt
Normal file
|
|
@ -0,0 +1,9 @@
|
|||
I feel like I'm onto something. The pattern that wouldn't come together has just rearranged itself in my mind.
|
||||
|
||||
I feel like I'm onto something. The contradiction I couldn't explain has become a clue instead.
|
||||
|
||||
I feel like I'm onto something. I don't have the full picture yet but I can see where the picture is.
|
||||
|
||||
I feel like I'm onto something. A piece just clicked and several others are about to.
|
||||
|
||||
I feel like I'm onto something. The world that was dense has gone transparent in one specific place.
|
||||
Loading…
Add table
Add a link
Reference in a new issue