Removing MTP?
#1
by henrykrinkle - opened
If MTP is a net negative, is it possible to just remove it so we can have more head room for https://huggingface.co/migtissera/Tess-4-27B-EAGLE3 ?
MTP only gets loaded into memory if you enable it.
huginnfork changed discussion status to closed