You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Shadow-Engine-Pro-8B : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli -hf aryankumar941/Shadow-Engine-Pro-8B --jinja
  • For multimodal models: llama-mtmd-cli -hf aryankumar941/Shadow-Engine-Pro-8B --jinja

Available Model files:

  • meta-llama-3.1-8b-instruct.Q5_K_M.gguf

Ollama

An Ollama Modelfile is included for easy deployment.

Note

The model's BOS token behavior was adjusted for GGUF compatibility. This was trained 2x faster with Unsloth

Downloads last month
93
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support