Skip to content

Commit fba7ff9

Browse files
unamedkrclaude
andcommitted
state: R11 35B post-v0.27.0 validation — BPE fix orthogonal (as expected)
35B on ASCII 'Once upon a time in a faraway land' benchmark (-n 200, T=0): IQ4_XS default: 117 coherent tokens (unchanged from pre-fix) IQ4_XS --rep-penalty 1.3: 158 Q5_K_M --rep-penalty 1.3: full 200-token budget, graceful degrade Establishes the post-v0.27.0 baseline for future DeltaNet rounds to beat. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent 972dc78 commit fba7ff9

1 file changed

Lines changed: 19 additions & 0 deletions

File tree

.claude/state.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,25 @@
33
**Last updated**: 2026-04-21 (Phase 1 refparity ★)
44
**Session HEAD**: Reference-parity framework (tools/refparity/) LANDED — HF vs engine per-layer diff, pos-aligned, post_norm-aware.
55

6+
## Phase 1 R11 — BPE fix does NOT move 35B long-gen drift (2026-04-21)
7+
8+
Post-v0.27.0 validation on `Once upon a time in a faraway land` (ASCII):
9+
10+
| model | flags | coherent tokens before loop |
11+
|---|---|---:|
12+
| IQ4_XS | default | 117 (exactly matches pre-fix) |
13+
| IQ4_XS | --rep-penalty 1.3 | 158 |
14+
| Q5_K_M | --rep-penalty 1.3 | **200 (hit -n budget, graceful degrade)** |
15+
16+
As expected — BPE UTF-8 fix only affects int'l-char prompts. 35B drift
17+
on ASCII prompts is orthogonal. Memory note "feedback_qwen36_long_gen_drift:
18+
likely DeltaNet recurrent state error" still the leading hypothesis.
19+
20+
**Practical user guidance for 35B**: pair Q5_K_M with `--rep-penalty 1.3`
21+
for best observed behavior. Documented as the current baseline —
22+
subsequent rounds targeting DeltaNet need to beat this to claim an
23+
improvement.
24+
625
## ★★ Phase 1 R7 — BPE ENCODE symmetric bug FIXED (2026-04-21) ★★
726

827
The decode fix from R6 had a **symmetric encode-side bug**. For input text

0 commit comments

Comments
 (0)