ptrdvn commited on
Commit
22a94b7
1 Parent(s): bfb86f6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -18
README.md CHANGED
@@ -28,26 +28,11 @@ Please feel free to comment on this model and give us feedback in the Community
28
 
29
  # How to use
30
 
31
- You can use the original trained model with vLLM like so:
32
 
33
- ```python
34
- from vllm import LLM, SamplingParams
35
 
36
- sampling_params = SamplingParams(temperature=0.8, top_p=0.95)
37
-
38
- llm = LLM(model="lightblue/suzume-llama-3-8B-japanese")
39
-
40
- prompts = [
41
- "東京のおすすめの観光スポットを教えて下さい",
42
- ]
43
-
44
- outputs = llm.generate(prompts, sampling_params)
45
-
46
- for output in outputs:
47
- prompt = output.prompt
48
- generated_text = output.outputs[0].text
49
- print(f"Prompt: {prompt!r}, Generated text: {generated_text!r}")
50
- ```
51
 
52
  # Evaluation scores
53
 
 
28
 
29
  # How to use
30
 
31
+ You can use the GGUF using LM Studio
32
 
33
+ LM Studioで簡単に使えます![こちら](https://note.com/masayuki_abe/n/nd65ed694eec0)は使い方を説明します。
34
+ LM Studioで「lightblue/suzume-llama-3-8B-japanese-gguf」を検索して下さい。
35
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
 
37
  # Evaluation scores
38