Commit 2895db3
spec 019: extend constant-α wiring to TTT forward path
018c (aabfbea) applied constant-α to forward_logits but not to
forward_ttt / _block_with_lora. For a full-pipeline run we need TTT
to also exercise the hardcoded α values (same lerp with literal
weight, same compile specialization benefit).
Mirror the encoder/decoder pattern from forward_logits: precomputed
_encoder_alpha_info and _decoder_alpha_info lists store Python
floats; forward_ttt reads them via Python indexing and calls
torch.lerp(x_before, x, alpha) after each _block_with_lora at
recur-alpha sites.
Closes the TTT-path gap from spec 015's original patch AND
maintains the compile-time-constant α optimization validated at
proxy scale in 018c (92% blend overhead recovered).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>1 parent aabfbea commit 2895db3
1 file changed
Lines changed: 25 additions & 3 deletions
File tree
- records/track_10min_16mb/2026-04-19_SP8192_CaseOps_GatedAttn_QuantGate_Loop45_PhasedTTT
Lines changed: 25 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1310 | 1310 | | |
1311 | 1311 | | |
1312 | 1312 | | |
| 1313 | + | |
| 1314 | + | |
| 1315 | + | |
| 1316 | + | |
| 1317 | + | |
| 1318 | + | |
| 1319 | + | |
| 1320 | + | |
| 1321 | + | |
| 1322 | + | |
| 1323 | + | |
| 1324 | + | |
| 1325 | + | |
| 1326 | + | |
1313 | 1327 | | |
1314 | | - | |
| 1328 | + | |
1315 | 1329 | | |
1316 | | - | |
| 1330 | + | |
| 1331 | + | |
| 1332 | + | |
| 1333 | + | |
| 1334 | + | |
1317 | 1335 | | |
1318 | 1336 | | |
1319 | 1337 | | |
| |||
1348 | 1366 | | |
1349 | 1367 | | |
1350 | 1368 | | |
1351 | | - | |
| 1369 | + | |
| 1370 | + | |
| 1371 | + | |
| 1372 | + | |
| 1373 | + | |
1352 | 1374 | | |
1353 | 1375 | | |
1354 | 1376 | | |
| |||
0 commit comments