File size: 1,796 Bytes
4cb984d
 
 
7fa2307
 
 
 
 
 
 
 
d77371f
 
5934cfa
7fa2307
d005a97
7fa2307
 
 
5934cfa
 
7fa2307
5934cfa
 
d005a97
5934cfa
7fa2307
 
 
d005a97
7fa2307
 
fe07dd1
7fa2307
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
---
license: apache-2.0
---

# llm-jp-13b-instruct-full-dolly-oasst-v1.0-gguf 
[llm-jpさんが公開しているllm-jp-13b-instruct-full-dolly-oasst-v1.0](https://huggingface.co/llm-jp/llm-jp-13b-instruct-full-dolly-oasst-v1.0)のggufフォーマット変換版です。  
**jasterなし**です  

  
モデル一覧  
[mmnga/llm-jp-13b-v1.0-4bit-g128-GPTQ-calib-ja-1k](https://huggingface.co/mmnga/llm-jp-13b-v1.0-4bit-g128-GPTQ-calib-ja-1k)  
[mmnga/llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0-GPTQ-calib-ja-1k](https://huggingface.co/mmnga/llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0-GPTQ-calib-ja-1k)  
[mmnga/llm-jp-13b-instruct-full-dolly-oasst-v1.0-GPTQ-calib-ja-1k](https://huggingface.co/mmnga/llm-jp-13b-instruct-full-dolly-oasst-v1.0-GPTQ-calib-ja-1k)  

GGUF版  
[mmnga/llm-jp-13b-instruct-dolly-en-ja-oasst-v1.1-gguf](https://huggingface.co/mmnga/llm-jp-13b-instruct-dolly-en-ja-oasst-v1.1-gguf)  
[mmnga/llm-jp-13b-v1.0-gguf](https://huggingface.co/mmnga/llm-jp-13b-v1.0-gguf)  
[mmnga/llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0-gguf](https://huggingface.co/mmnga/llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0-gguf)  
[mmnga/llm-jp-13b-instruct-full-dolly-oasst-v1.0-gguf](https://huggingface.co/mmnga/llm-jp-13b-instruct-full-dolly-oasst-v1.0-gguf)  

[mmnga/llm-jp-1.3b-v1.0-gguf](https://huggingface.co/mmnga/llm-jp-1.3b-v1.0-gguf)  
  

## Convert Script
[変換スクリプトはこちら](https://gist.github.com/mmnga/bcde6bab59132682307112fef0472b80#file-llm-jp_convert-hf-to-gguf-py)

## Usage

```
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
make -j
./main -m 'llm-jp-13b-instruct-full-dolly-oasst-v1.0-q4_0.gguf' -n 128 -p '今日の夕食のレシピを教えて ### 回答:' --top_p 0.9 --temp 0.7 --repeat-penalty 1.2
```