Why no base models?
#2
by
rombodawg
- opened
From my experience, training on top of instruct models is a terrible idea. The loss is horrible. So how are we suppose to train on top of phi-3 when you dont release base models? I mean your instruct models are fine and all, but we'd like to make our own versions.
Otherwise I'm just gonna train on top of llama-3 and completely ignore this model.
Thank you for your interest! At this point we are not ready to release the base model.
nguyenbh
changed discussion status to
closed