YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
SAGE (Q8_0)
Sage - GPT-Neo 1.3B fine-tuned on educational data
- Base Model: EleutherAI/gpt-neo-1.3B
- Quantization: Q8_0
- Format: GGUF (llama.cpp / LM Studio compatible)
- Architecture: GPT-NeoX
Quick Start
llama.cpp
./main -m sage-q8_0.gguf -p "Your prompt here"
LM Studio
- Download
sage-q8_0.gguf - Open LM Studio
- Load model and start chatting
Python
from llama_cpp import Llama
llm = Llama(model_path="sage-q8_0.gguf")
output = llm("Hello", max_tokens=128)
print(output['choices'][0]['text'])
- Downloads last month
- -
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support