dahara1 commited on
Commit
6dfd544
1 Parent(s): b8ebd6f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -1
README.md CHANGED
@@ -26,7 +26,62 @@ Although llama.cpp can be used to reduce the size of the file with various quant
26
  - C3TR-Adapter.Q4_1.gguf 5.5 GB
27
  - C3TR-Adapter.Q5_0.gguf 5.98 GB
28
  - C3TR-Adapter.Q5_1.gguf 6.47 GB
29
- - C3TR-Adapter.IQ1_S.gguf 2.16 GB (1bit量子化。正常動作しません。1-bit quantization still does not work as intended)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
 
31
  ### パラメーター(Parameters)
32
 
 
26
  - C3TR-Adapter.Q4_1.gguf 5.5 GB
27
  - C3TR-Adapter.Q5_0.gguf 5.98 GB
28
  - C3TR-Adapter.Q5_1.gguf 6.47 GB
29
+ - C3TR-Adapter.IQ3_M.gguf 3.9 GB (3.66 bpw quantization mix. 動作確認できた最も小さいモデル。The smallest model that has been confirmed to work)
30
+ - C3TR-Adapter.IQ1_S.gguf 2.16 GB (1.56 bpw quantization. 正常動作しません。does not work as intended)
31
+
32
+ ### サンプルコード(sample code)
33
+
34
+ #### Install and compile
35
+ ```
36
+ git clone https://github.com/ggerganov/llama.cpp
37
+ cd llama.cpp
38
+ make
39
+ ```
40
+
41
+ #### 推論実行例(Inference execution sample)
42
+
43
+ 英日翻訳(Translate English to Japanese)
44
+ ```
45
+ ./main -m ./C3TR-Adapter.Q4_1.gguf -e --temp 0 --repeat-penalty 1.0 --no-penalize-nl -n -2 -p "### Instructions:
46
+ Translate English to Japanese.
47
+ ### Input:
48
+ 'The Boy and the Heron' follows a boy named Mahito Maki who moves to the countryside after his mother's death. There, he is lured by a mysterious heron into a secluded tower, a portal that transports him to a fantastical realm amid his grief.
49
+ ### Answer:
50
+ "
51
+ ```
52
+
53
+ 出力例(output)
54
+ ```
55
+ ### Instructions:
56
+ Translate English to Japanese.
57
+ ### Input:
58
+ 'The Boy and the Heron' follows a boy named Mahito Maki who moves to the countryside after his mother's death. There, he is lured by a mysterious heron into a secluded tower, a portal that transports him to a fantastical realm amid his grief.
59
+ ### Answer:
60
+ 「少年と鷺」は、母親の死後、田舎に引っ越したマキマヒト少年の物語を描く。彼は謎の鷺に誘われ、悲しみに包まれたまま、隠された塔に連れていかれ、幻想的な世界へと導かれる。
61
+ [end of text]
62
+ ```
63
+
64
+
65
+ 日英翻訳時(Translate Japanese to English)
66
+ ```
67
+ ./main -m ../upload/C3TR-Adapter.Q4_1.gguf -e --temp 0 --repeat-penalty 1.0 --no-penalize-nl -n -2 -p "### Instructions:
68
+ Translate Japanese to English.
69
+ ### Input:
70
+ 「でも『オスカー取りたい』と思ってこの仕事をやってきたのではなく、いかに中学生の頃の気持ちを忘れずに、あの時作りたかったも のにどれだけ近づけるかということをずっとやり続けてきたので、『未知との遭遇』と『スター・ウォーズ』を見てメロメロになった中 学生の自分に、今は感謝しています。
71
+ ### Answer:
72
+ "
73
+ ```
74
+
75
+ 出力例(output)
76
+ ```
77
+ ### Instructions:
78
+ Translate Japanese to English.
79
+ ### Input:
80
+ 「でも『オスカー取りたい』と思ってこの仕事をやってきたのではなく、いかに中学生の頃の気持ちを忘れずに、あの時作りたかったものにどれだけ近づけるかということをずっとやり続けてきたので、『未知との遭遇』と『スター・ウォーズ』を見てメロメロになった中学生の自分に、今は感謝しています。
81
+ ### Answer:
82
+ "But I didn't come to this job to win an Oscar. I've always tried to stay in touch with my teenage self, to see how close I could get to what I wanted to make back then. I'm grateful to my teenage self now, who was so in love with "Close Encounters" and "Star Wars."
83
+ [end of text]
84
+ ```
85
 
86
  ### パラメーター(Parameters)
87