HuggingFaceTB/smoltalk
Viewer
•
Updated
•
2.2M
•
6.48k
•
291
Btw for anyone late to the game - Old Mixtral quants should still work as expected in KoboldCpp. The new ones should work as well, so you have multiple options.
Btw for anyone late to the game - Q4_0_N_M quants should still work as expected in KoboldCpp. The runtime repack for q4_0 should work as well, so you have multiple options.