mmnga
/

Ninja-v1-NSFW-128k-gguf

Inference Endpoints

Model card Files Files and versions Community

mmnga commited on May 3, 2024

Commit

0567ea3

·

verified ·

1 Parent(s): c20ca71

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -24,5 +24,5 @@ imatrixのデータは[TFMC/imatrix-dataset-for-japanese-llm](https://huggingfac
 git clone https://github.com/ggerganov/llama.cpp.git
 cd llama.cpp
 make -j
-./main -m 'Ninja-v1-NSFW-128k-Q4_0.gguf' -n 128 -p 'USER: こんにちわ。 ASSISTANT: '
 ```

 git clone https://github.com/ggerganov/llama.cpp.git
 cd llama.cpp
 make -j
+./main -m 'Ninja-v1-NSFW-128k-Q4_0.gguf' -n 1024 -c 1024 -p 'USER: こんにちわ。 ASSISTANT: '
 ```