Smaller versions
#2
by snake8888 - opened
Any chance of a version based on minimax_h3_ref2va_pruned_int8_convrot.safetensors?
Or could a lora be pulled out (instead of a checkpoint) of the full bf16 version that can be used when using the smaller models?
Yeah but this is just a first test version, something that would evolve into a beta version thats worth doing that.