Curriculum ordering matters but diversity may matter more. Constitutional AI confirms dispositions transfer from instructions to weights — even a single general principle generalizes broadly. The dream loop naturally targets the zone of proximal development because generation samples from the current distribution. The curriculum isn't designed — it emerges from the dream loop's interaction with the evolving model. Self-organizing training: difficulty increases automatically as the model improves. |
||
|---|---|---|
| .. | ||
| checkpoint | ||
| research | ||
| apollo_mini.py | ||
| apollo_worker.py | ||
| DESIGN.md | ||
| export_weights.py | ||
| start_vllm_with_apollo.sh | ||
| train.py | ||
| training_example.py | ||
| vllm_export_hook.py | ||
| weight_mapping.py | ||