5.0bpw-h6 vs 5.0bpw-h6-wiki?
#1
by
tensiondriven
- opened
Thanks for making this model! What is the difference between 5.0bpw-h6 and 5.0bpw-h6-wiki? Perhaps one is auto-uploaded? Or one is trained on a lil more data?
The file sizes look slightly different.
The original 5.0bpw-h6 was quantized with the cleaned pippa dataset AKA "rpcal", and 5.0bpw-h6-wiki was quantized using wikitext.
Unfortunately both of these are now obsolete to the new layer-wise quantization with the default dataset now included with exl2.