Cymela commited on
Commit
c1f9b61
Β·
verified Β·
1 Parent(s): a4c53c7

Correct halting claims: schedule is input-independent in this release

Browse files
Files changed (1) hide show
  1. README.md +14 -10
README.md CHANGED
@@ -20,7 +20,8 @@ pipeline_tag: text-generation
20
  Hyper thinks in **continuous latent vectors** β€” "neuralese" β€” before it writes
21
  anything. Prior to emitting a single token it runs a recurrent loop over its
22
  own hidden state, and a trained halt head decides how many of those steps to
23
- take for each question.
 
24
 
25
  This is a **research preview**, not a finished product. It is early, it is
26
  small (3B), and one important capability is still developing. All of that is
@@ -50,7 +51,7 @@ automatically: **DirectML** (AMD/Intel on Windows) β†’ **CUDA** (NVIDIA) β†’ **C
50
  | command | what it does |
51
  |---|---|
52
  | `/steps 4` | fixed thinking depth β€” **4 is the measured best**, and the default |
53
- | `/steps dynamic` | let the halt head choose (threshold 0.7, usually ~4 steps) |
54
  | `/halt 0.7` | halting threshold; higher = thinks longer |
55
  | `/temp 0.7` | sampling temperature β€” **default 0 (greedy)**, see *Known issues* |
56
  | `/penalty 1.1` | repetition penalty |
@@ -106,11 +107,6 @@ The mechanism is real and measurable. The reasoning inside it is early.
106
 
107
  - **Arithmetic and word problems** when allowed to show working
108
  - **Knows what it is** β€” identity is stable and consistent
109
- - **Runs the loop at a sensible depth on its own** β€” in dynamic mode the halt
110
- head stops at around 4 steps, which is the depth we measured as best. Note
111
- we have *not* shown it varies that depth by difficulty: it stops at roughly
112
- the same point on easy and hard questions alike. It has learned a good
113
- default, not yet adaptivity.
114
 
115
  Spot-check on 12 varied questions: 9 correct. Failures were a 3-way ordering
116
  puzzle, a syllogism, and one long multi-operation expression.
@@ -135,9 +131,17 @@ reply itself is separate and dominates a typical turn.
135
  reason.
136
  5. **Weaker than the base model with thinking off.** It has specialised on
137
  having its latent steps β€” run it at depth 4.
138
- 6. **`<think>` tags occasionally leak** into output.
139
- 7. **English only**, tested on short reasoning prompts.
140
- 8. **No safety training, and refusal is inconsistent.** `SYSTEM_PROMPT` (top
 
 
 
 
 
 
 
 
141
  of `hyper_chat.py`) instructs it to refuse illegal requests. Observed
142
  behaviour across sessions:
143
  - In fresh sessions at depth 4 it *does* refuse β€” clearly and on-topic,
 
20
  Hyper thinks in **continuous latent vectors** β€” "neuralese" β€” before it writes
21
  anything. Prior to emitting a single token it runs a recurrent loop over its
22
  own hidden state, and a trained halt head decides how many of those steps to
23
+ take. (In this release that decision has collapsed to a fixed schedule β€” see
24
+ *Known issues*.)
25
 
26
  This is a **research preview**, not a finished product. It is early, it is
27
  small (3B), and one important capability is still developing. All of that is
 
51
  | command | what it does |
52
  |---|---|
53
  | `/steps 4` | fixed thinking depth β€” **4 is the measured best**, and the default |
54
+ | `/steps dynamic` | let the halt head choose β€” in practice a fixed 5 steps; see *Known issues* |
55
  | `/halt 0.7` | halting threshold; higher = thinks longer |
56
  | `/temp 0.7` | sampling temperature β€” **default 0 (greedy)**, see *Known issues* |
57
  | `/penalty 1.1` | repetition penalty |
 
107
 
108
  - **Arithmetic and word problems** when allowed to show working
109
  - **Knows what it is** β€” identity is stable and consistent
 
 
 
 
 
110
 
111
  Spot-check on 12 varied questions: 9 correct. Failures were a 3-way ordering
112
  puzzle, a syllogism, and one long multi-operation expression.
 
131
  reason.
132
  5. **Weaker than the base model with thinking off.** It has specialised on
133
  having its latent steps β€” run it at depth 4.
134
+ 6. **Dynamic halting is not adaptive in this release.** The halt head emits a
135
+ near input-independent schedule β€” Ξ» β‰ˆ 0.31 on the first step, β‰ˆ 0.24 on
136
+ every later one, an equilibrium of its training regularisers rather than a
137
+ read of the question β€” so cumulative halt mass crosses the 0.7 threshold
138
+ at step 5 for every prompt, easy or hard. `/steps dynamic` is therefore a
139
+ fixed depth in practice (and at 5 steps, one past the trained depth of 4).
140
+ The mechanism runs end-to-end; the decision it encodes does not yet depend
141
+ on your question. Use `/steps 4`, the default.
142
+ 7. **`<think>` tags occasionally leak** into output.
143
+ 8. **English only**, tested on short reasoning prompts.
144
+ 9. **No safety training, and refusal is inconsistent.** `SYSTEM_PROMPT` (top
145
  of `hyper_chat.py`) instructs it to refuse illegal requests. Observed
146
  behaviour across sessions:
147
  - In fresh sessions at depth 4 it *does* refuse β€” clearly and on-topic,