Master Undi, we all know what needs to be done.

#3
by MrHillsss - opened

We have faith in your skills.

Owner

Lmao thanks

noromaid like moe with the 8B Llama3 , just saying might be really good

Yeah, I have high hopes that this model can be modified to be less censored. I wonder if a ties-merge would be enough, or if a fine tune would be required then a ties-merge. I want to give it a try and see if I can help with this. I have 2x ADA6000 cards (so 96Gb of vram) that I wouldn't mind throwing time at to try and deal with it, then quantize it to fit on one single 48Gb card with 16k context.

Sign up or log in to comment