s3nh commited on
Commit
1431d0f
1 Parent(s): bd07850

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -22
README.md CHANGED
@@ -18,28 +18,6 @@ Buy me a coffee if you like this project ;)
18
  GGML Format model files for [This project](https://huggingface.co/GOAT-AI/GOAT-7B-Community/edit/main/README.md).
19
 
20
 
21
- ### inference
22
-
23
-
24
- ```python
25
-
26
- import ctransformers
27
-
28
- from ctransformers import AutoModelForCausalLM
29
-
30
- model = AutoModelForCausalLM.from_pretrained(output_dir, ggml_file,
31
- gpu_layers=32, model_type="llama")
32
-
33
- manual_input: str = "Tell me about your last dream, please."
34
-
35
-
36
- llm(manual_input,
37
- max_new_tokens=256,
38
- temperature=0.9,
39
- top_p= 0.7)
40
-
41
- ```
42
-
43
 
44
 
45
  # Original model card
 
18
  GGML Format model files for [This project](https://huggingface.co/GOAT-AI/GOAT-7B-Community/edit/main/README.md).
19
 
20
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
 
23
  # Original model card