I am creating a model using albert transformer to retrain on a own corpus dataset. To increase the inference I need to prune the model. Is there a function to prune the weights or heads ?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| How to apply pruning on a BERT model? | 5 | 3390 | October 21, 2020 | |
| Is it possible to freeze certain layer in ALBERT for Fine Tune? | 0 | 43 | December 24, 2024 | |
| ALBERT Pretraining example (Tensorflow) | 2 | 346 | November 23, 2020 | |
| Hugging Face Reads - 01/2021 - Sparsity and Pruning | 14 | 7546 | June 3, 2025 | |
| Error: 'AlbertModel' object has no attribute 'bias' -Trying to use custom corpus pretrained Albert chkpt | 0 | 391 | August 14, 2021 |