Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models
Paper
• 2501.17088 • Published
• 2
Mamba-Shedder
Compressed Mamba Models via Mamba-Shedder (Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models)
-
IntelLabs/Mamba-Shedder-Mamba-2.2B
2B • Updated • 819 • 3Note Compressed Mamba-2.8B
-
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM
3B • Updated • 834 • 2
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM-Alpaca
3B • Updated • 828 • 2Note Compressed Mamba2-2.7B