Alfonso² Peterssen
mukel
AI & ML interests
Java in Java by day, LLMs in Java by night.
Organizations
None yet
mukel's activity
New tokenizer.json doesn't match tokenizer.model.v3, there's no [SUFFIX], [MIDDLE] and [PREFIX] tokens.
1
#24 opened 5 months ago
by
mukel
The Q4_0 file has "output.weight" quantized with Q6_K.
#2 opened about 1 year ago
by
mukel
The Q8_0 have mixed tensor types e.g. 'output.norm' is of type Q6_K.
4
#2 opened about 1 year ago
by
mukel
The Q8_0 have mixed tensor types e.g. 'output.norm' is of type Q6_K.
4
#2 opened about 1 year ago
by
mukel
The Q8_0 have mixed tensor types e.g. 'output.norm' is of type Q6_K.
4
#2 opened about 1 year ago
by
mukel