Distilled Variants?
#6
by kanttouchthis - opened
Amazing work! Do you think you could distill this model down to a smaller size? Maybe 5 parameters or so?
hmmm, to big. A whole 5 PARAMETERS, ARE YOU INSANE, THATS. TOO. BIG.
distilled it down to a parameter at 1 bit quant
here you go:
1