mmap each safetensors file, diff block-by-block against live GPU weights, memcpy only changed blocks. No separate checkpoint files — the model directory IS the checkpoint. Every 10 min via cron. |
||
|---|---|---|
| .. | ||
| src | ||
| Cargo.toml | ||
mmap each safetensors file, diff block-by-block against live GPU weights, memcpy only changed blocks. No separate checkpoint files — the model directory IS the checkpoint. Every 10 min via cron. |
||
|---|---|---|
| .. | ||
| src | ||
| Cargo.toml | ||