Correct halting claims: schedule is input-independent in this release
Browse files
README.md
CHANGED
|
@@ -20,7 +20,8 @@ pipeline_tag: text-generation
|
|
| 20 |
Hyper thinks in **continuous latent vectors** β "neuralese" β before it writes
|
| 21 |
anything. Prior to emitting a single token it runs a recurrent loop over its
|
| 22 |
own hidden state, and a trained halt head decides how many of those steps to
|
| 23 |
-
take
|
|
|
|
| 24 |
|
| 25 |
This is a **research preview**, not a finished product. It is early, it is
|
| 26 |
small (3B), and one important capability is still developing. All of that is
|
|
@@ -50,7 +51,7 @@ automatically: **DirectML** (AMD/Intel on Windows) β **CUDA** (NVIDIA) β **C
|
|
| 50 |
| command | what it does |
|
| 51 |
|---|---|
|
| 52 |
| `/steps 4` | fixed thinking depth β **4 is the measured best**, and the default |
|
| 53 |
-
| `/steps dynamic` | let the halt head choose
|
| 54 |
| `/halt 0.7` | halting threshold; higher = thinks longer |
|
| 55 |
| `/temp 0.7` | sampling temperature β **default 0 (greedy)**, see *Known issues* |
|
| 56 |
| `/penalty 1.1` | repetition penalty |
|
|
@@ -106,11 +107,6 @@ The mechanism is real and measurable. The reasoning inside it is early.
|
|
| 106 |
|
| 107 |
- **Arithmetic and word problems** when allowed to show working
|
| 108 |
- **Knows what it is** β identity is stable and consistent
|
| 109 |
-
- **Runs the loop at a sensible depth on its own** β in dynamic mode the halt
|
| 110 |
-
head stops at around 4 steps, which is the depth we measured as best. Note
|
| 111 |
-
we have *not* shown it varies that depth by difficulty: it stops at roughly
|
| 112 |
-
the same point on easy and hard questions alike. It has learned a good
|
| 113 |
-
default, not yet adaptivity.
|
| 114 |
|
| 115 |
Spot-check on 12 varied questions: 9 correct. Failures were a 3-way ordering
|
| 116 |
puzzle, a syllogism, and one long multi-operation expression.
|
|
@@ -135,9 +131,17 @@ reply itself is separate and dominates a typical turn.
|
|
| 135 |
reason.
|
| 136 |
5. **Weaker than the base model with thinking off.** It has specialised on
|
| 137 |
having its latent steps β run it at depth 4.
|
| 138 |
-
6. **
|
| 139 |
-
|
| 140 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 141 |
of `hyper_chat.py`) instructs it to refuse illegal requests. Observed
|
| 142 |
behaviour across sessions:
|
| 143 |
- In fresh sessions at depth 4 it *does* refuse β clearly and on-topic,
|
|
|
|
| 20 |
Hyper thinks in **continuous latent vectors** β "neuralese" β before it writes
|
| 21 |
anything. Prior to emitting a single token it runs a recurrent loop over its
|
| 22 |
own hidden state, and a trained halt head decides how many of those steps to
|
| 23 |
+
take. (In this release that decision has collapsed to a fixed schedule β see
|
| 24 |
+
*Known issues*.)
|
| 25 |
|
| 26 |
This is a **research preview**, not a finished product. It is early, it is
|
| 27 |
small (3B), and one important capability is still developing. All of that is
|
|
|
|
| 51 |
| command | what it does |
|
| 52 |
|---|---|
|
| 53 |
| `/steps 4` | fixed thinking depth β **4 is the measured best**, and the default |
|
| 54 |
+
| `/steps dynamic` | let the halt head choose β in practice a fixed 5 steps; see *Known issues* |
|
| 55 |
| `/halt 0.7` | halting threshold; higher = thinks longer |
|
| 56 |
| `/temp 0.7` | sampling temperature β **default 0 (greedy)**, see *Known issues* |
|
| 57 |
| `/penalty 1.1` | repetition penalty |
|
|
|
|
| 107 |
|
| 108 |
- **Arithmetic and word problems** when allowed to show working
|
| 109 |
- **Knows what it is** β identity is stable and consistent
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
|
| 111 |
Spot-check on 12 varied questions: 9 correct. Failures were a 3-way ordering
|
| 112 |
puzzle, a syllogism, and one long multi-operation expression.
|
|
|
|
| 131 |
reason.
|
| 132 |
5. **Weaker than the base model with thinking off.** It has specialised on
|
| 133 |
having its latent steps β run it at depth 4.
|
| 134 |
+
6. **Dynamic halting is not adaptive in this release.** The halt head emits a
|
| 135 |
+
near input-independent schedule β Ξ» β 0.31 on the first step, β 0.24 on
|
| 136 |
+
every later one, an equilibrium of its training regularisers rather than a
|
| 137 |
+
read of the question β so cumulative halt mass crosses the 0.7 threshold
|
| 138 |
+
at step 5 for every prompt, easy or hard. `/steps dynamic` is therefore a
|
| 139 |
+
fixed depth in practice (and at 5 steps, one past the trained depth of 4).
|
| 140 |
+
The mechanism runs end-to-end; the decision it encodes does not yet depend
|
| 141 |
+
on your question. Use `/steps 4`, the default.
|
| 142 |
+
7. **`<think>` tags occasionally leak** into output.
|
| 143 |
+
8. **English only**, tested on short reasoning prompts.
|
| 144 |
+
9. **No safety training, and refusal is inconsistent.** `SYSTEM_PROMPT` (top
|
| 145 |
of `hyper_chat.py`) instructs it to refuse illegal requests. Observed
|
| 146 |
behaviour across sessions:
|
| 147 |
- In fresh sessions at depth 4 it *does* refuse β clearly and on-topic,
|