Did you do full model fine tuning (all layers) or only adapters?

by SamuelAzran - opened Nov 14, 2023

Nov 14, 2023

Thanks for publishing this!

NousResearch org Nov 14, 2023

Thanks! It was trained as a QLoRA targeting all linear layers

emozilla changed discussion status to closed Nov 14, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment