Vorenthos-Instruct-7b โ€” Ollama Export

Exported from a local Ollama installation and uploaded to the Hugging Face Hub by vorenthiclabs.

Model Details

Field Value
Base model Vorenthos-Instruct-7b
Tag / variant latest
Model type Text Generation
Format GGUF (llama.cpp-compatible)
Total size 4.37 GB
Layers 4

Quick Start

With Ollama (recommended)

ollama pull Vorenthos-Instruct-7b
ollama run Vorenthos-Instruct-7b

With llama.cpp / llama-cpp-python (GGUF)

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="vorenthiclabs/Vorenthos-Instruct-7b",
    filename="*.gguf",
)
output = llm("Hello, who are you?", max_tokens=256)
print(output["choices"][0]["text"])

With Hugging Face transformers + GGUF support

from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("vorenthiclabs/Vorenthos-Instruct-7b")
model     = AutoModelForCausalLM.from_pretrained("vorenthiclabs/Vorenthos-Instruct-7b")

File Structure

File Description
config.json Ollama model configuration / metadata
model-*.gguf Quantised weights in GGUF format
tokenizer.jinja Chat template
params.json Generation parameters (temperature, top-p, โ€ฆ)
system_prompt.txt Default system prompt embedded in the model

License

Please check the original model's license before redistribution.
This upload is provided as-is for research and experimentation.

About vorenthiclabs

Visit us at https://huggingface.co/vorenthiclabs.

Downloads last month
109
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support