---
tags:
- GGUF
- tinypascal
- genai
---
![TinyPascal](images/tinypascal.jpg "TinyPascal")

# Vitted GGUF models known to work with [TinyPascal](https://github.com/tinyBigGAMES/TinyPascal) GenAI.

## Hermes-2-Pro-Llama-3-8B GGUF
- [Download](https://huggingface.co/tinybiggames/tinypascal/resolve/main/Hermes-2-Pro-Llama-3-8B-Q4_K_M.gguf?download=true)
- [More info](https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF)

How to define this model in TinyPascal GenAI:
```Delphi
GenAI_DefineModel(
  'Hermes-2-Pro-Llama-3-8B-Q4_K_M.gguf',     // model filename
  'Hermes-2-Pro-Llama-3-8B-Q4_K_M',          // model reference name
   8000,                                     // model context length
   '<|im_start|>{role}{content}<|im_end|>',  // model template
   '<|im_start|>assistant'                   // model template end 
);
```

## Phi-3.1-mini-4k-instruct GGUF
- [Download](https://huggingface.co/tinybiggames/tinypascal/resolve/main/Phi-3.1-mini-4k-instruct-Q4_K_M.gguf?download=true)
- [More info](https://huggingface.co/bartowski/Phi-3.1-mini-4k-instruct-GGUF)

How to define this model in TinyPascal GenAI:
```Delphi
GenAI_DefineModel(
  'Phi-3.1-mini-4k-instruct-Q4_K_M.gguf',   // model filename
  'Phi-3.1-mini-4k-instruct-Q4_K_M',        // model reference name
   4000,                                    // model context length
 '<|{role}|> {content}<|end|>',             // model template
 '<|assistant|>');                          // model template end
```