I want to run
on
A100 80GB
quantized
on the fly
on the fly
from a checkpoint