New discussion

Update for new K-quantization

#8 opened about 1 year ago by NovNovikov

Suggested sampling settings

1
#5 opened about 1 year ago by Delta36652

7b model

3
#4 opened about 1 year ago by Nexesenex

Update for new quantization format?

1
#3 opened about 1 year ago by NovNovikov

Initial testing (epoch 3)

46
#1 opened about 1 year ago by deleted