Plans for doing the 70B as well?

#2
by Doctor-Shotgun - opened

I've been enjoying the 70B instruct abliterated - any plans on doing the expanded dataset abliteration for the larger model as well?

Cognitive Computations org

Very interested in doing so, but considering it's quite costly for me to do given I ideally need to perform the abliteration on a non-quant version, I want to refine out some quirks noticeable in the 8B first; particularly hallucinations. Once I feel the methodology is just a bit more refined on the 8B, I'm very open to doing 70B.

Sign up or log in to comment