Is there a way to let HF generate tokens based on the last hidden states?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Get each generated token last layer hidden state | 3 | 90 | March 16, 2025 | |
| Avoid recalculating hidden states between generate calls? | 3 | 1243 | March 30, 2023 | |
| Streaming token output from models like T5 | 7 | 12305 | June 7, 2023 | |
| BLIP2 GreedySearchDecoderOnlyOutput, how can I extract the activations of a certain hidden layer? | 0 | 150 | July 5, 2023 | |
| T5.generate() cannot get hidden states although output_hidden_states=True | 0 | 561 | July 9, 2022 |