What is the difference between "google/gemma-2-27b-it" and "google/gemma-2-27b models"
Hi.
what is the difference between "google/gemma-2-27b-it" and "google/gemma-2-27b models". I cant fond info about this.
The Gemma model was released in two main variants: a pre-trained model and an instruction-tuned model with it's different weight sizes. Pre-trained models are also known as base models and do not have the 'it' suffix with it's name("google/gemma-2-27b"). Whereas Instruction-tuned models will have the 'it' suffix with it's name("google/gemma-2-27b-it").
The difference between Pre-trained models(base) and Instruction tuned models(it):
Pre-trained models are general purpose models, trained on large amount of data and can be adapted to various tasks. But these models will have different performance or output quality for the specific tasks. Where it comes to use the instruction tuned models - Instruction tuned models are trained to follow the instructions and generate more quality text. Instruction tuned models can be fine-tuned with domain-specific data for specific use-cases to have better performance with required features and good output quality.
You can also refer to this similar issue for your reference.