GGUF

Gemma Model Card

Model Page: Gemma

This model card corresponds to the 2B and 7B Instruct versions of the Gemma model's Guff.

Terms of Use: Terms

Description

Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

Model Usage

Since this is a guff, it can be run locally using

  • Ollama
  • Llama.cpp
  • LM Studio
  • And Many More
  • I have provided GemmaModelFile that can be used with ollama by:
  • Download the model:
    pip install huggingface_hub
    from huggingface_hub import hf_hub_download
    
    model_id="c2p-cmd/google_gemma_guff"
    hf_hub_download(repo_id=model_id, local_dir="gemma_snapshot", local_dir_use_symlinks=False, filename="gemma_snapshot/gemma-2b-it.gguf")
    
  • Load the model file to ollama
    ollama create gemma -f GemmaModelFile
    
  • You change the model name based on needs
Downloads last month
11
GGUF
Model size
2.51B params
Architecture
gemma
Hardware compatibility
Log In to view the estimation
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support