Skip to content

Commit acb1f43

Browse files
committed
spec 019: update commit hash to 3c3a134 (fix pass-2 L5 alpha constant)
1 parent e8681bc commit acb1f43

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

research/specs/019-recur-alpha-constant-full.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -39,10 +39,11 @@ Secondary comparison: **017's 1.06733** (same recur-alpha mechanism, different
3939
## Code changes
4040

4141
**Branch:** `exp/recur-alpha-constant-full` forking from `aabfbea` (018c's commit) + additional TTT wiring.
42-
**Commit:** `2895db3` on `fork/exp/recur-alpha-constant-full`.
42+
**Commit:** `3c3a134` on `fork/exp/recur-alpha-constant-full`.
43+
*(Corrected from original `2895db3`: pass-2 L5 α was 1.3984375 — 016's endpoint — instead of 1.4296875 — 017's actual recur_alpha_final. Bug introduced when 018c commit was prepared before 017 finished. Fixed during spec 019 execution interview.)*
4344

4445
Key properties:
45-
- **No learnable α** — values hardcoded at `((1.078125, 1.2734375, 1.3984375), (1.015625, 0.97265625, 0.83203125))` from 017 endpoint
46+
- **No learnable α** — values hardcoded at `((1.078125, 1.2734375, 1.4296875), (1.015625, 0.97265625, 0.83203125))` from 017 endpoint
4647
- **torch.compile sees α as compile-time constants** in both `forward_logits` and `forward_ttt` lerp sites
4748
- **TTT bug fixed** — recur-alpha applies during TTT adaptation + eval (was missing in 015/016/017)
4849
- `self.recur_alpha = None` — not a Parameter, no gradient tracking, no optimizer state

0 commit comments

Comments
 (0)