What is the latest update about this model? This is the most powerful model, please support.
#13
by krigeta - opened
This model is so powerful, but because of the hardware, it is impossible to run on even 48GB VRAM on cloud, please share your views on this.
@krigeta NF4 quants are available of the base model, instruct and instruc-distill models. You can run all with block swaps.