Hugging Face's logo

mmnga
/
japanese-stablelm-base-ja_vocab-beta-7b-gguf

GGUF
Inference Endpoints
Model card Files Community
japanese-stablelm-base-ja_vocab-beta-7b-gguf / README.md
mmnga's picture
mmnga
Update README.md
1c2074e
preview code
|
raw
history blame contribute delete
1.11 kB
metadata
license: apache-2.0

japanese-stablelm-base-ja_vocab-beta-7b-gguf

stabilityaiさんが公開しているjapanese-stablelm-base-ja_vocab-beta-7bのgguf版です。

モデル一覧
GPTQ
mmnga/japanese-stablelm-base-ja_vocab-beta-7b-GPTQ-calib-ja-1k
mmnga/japanese-stablelm-instruct-ja_vocab-beta-7b-GPTQ-calib-ja-1k

GGUF
mmnga/japanese-stablelm-base-ja_vocab-beta-7b-gguf
mmnga/japanese-stablelm-instruct-ja_vocab-beta-7b-gguf

Usage 

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
make -j
./main -m 'japanese-stablelm-base-ja_vocab-beta-7b-q4_0.gguf' -n 128 --temp 0.8 -p '今日の夕食のレシピをご紹介します。'