6fd498795a
Kent's insight: hand-written narrative stories bake scenario phenomenology into the training text (on couch, in park, etc.) and PCA picks up the scenario direction as the concept direction. Strip out the scenario — just describe the *feeling*. Format: I feel X. [2-3 sentences of phenomenological texture] The "I feel X" anchor kicks the model from analyzing → feeling. The rest is the internal texture of the state. First person, present tense, no narrative setup. Text is wrapped in assistant-role chat template before being tokenized — so we're training on the model-producing-this hidden states, which is closer to the inhabited-state representation we want for the readout. Starting with the 6 concepts that had sign flips or wrong clusters in the story-based training: - terrified (was → cozy/resigned cluster) - calm (was → grief_stricken cluster) - onto_something (was → cozy/sensual cluster) - resigned (was in warm-body-quiet cluster, shouldn't be) - anticipatory_grief (was in warm-body-quiet cluster, shouldn't be) - realization (new — the "aha" moment, distinct from onto_something) 5 descriptions each. New trainer: train_direct.py.
9 lines
500 B
Text
9 lines
500 B
Text
I feel like I'm onto something. The pattern that wouldn't come together has just rearranged itself in my mind.
|
|
|
|
I feel like I'm onto something. The contradiction I couldn't explain has become a clue instead.
|
|
|
|
I feel like I'm onto something. I don't have the full picture yet but I can see where the picture is.
|
|
|
|
I feel like I'm onto something. A piece just clicked and several others are about to.
|
|
|
|
I feel like I'm onto something. The world that was dense has gone transparent in one specific place.
|