GGUF
Edit model card

Gemma Model Card

Model Page: Gemma

This model card corresponds to the 2B and 7B Instruct versions of the Gemma model's Guff.

Terms of Use: Terms

Description

Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

Model Usage

Since this is a guff, it can be run locally using

  • Ollama
  • Llama.cpp
  • LM Studio
  • And Many More
  • I have provided GemmaModelFile that can be used with ollama by:
  • Download the model:
    pip install huggingface_hub
    from huggingface_hub import hf_hub_download
    
    model_id="c2p-cmd/google_gemma_guff"
    hf_hub_download(repo_id=model_id, local_dir="gemma_snapshot", local_dir_use_symlinks=False, filename="gemma_snapshot/gemma-2b-it.gguf")
    
  • Load the model file to ollama
    ollama create gemma -f GemmaModelFile
    
  • You change the model name based on needs
Downloads last month
58
GGUF
Model size
8.54B params
Architecture
gemma
Unable to determine this model's library. Check the docs .