Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
TheBloke commited on
Commit
776a4eb
1 Parent(s): 70406fe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -1
README.md CHANGED
@@ -1,6 +1,13 @@
1
  ---
2
  inference: false
3
- license: other
 
 
 
 
 
 
 
4
  ---
5
 
6
  <!-- header start -->
@@ -29,6 +36,31 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
29
  * [2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/orca_mini_7B-GGML)
30
  * [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/psmathur/orca_mini_7b)
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ## How to easily download and use this model in text-generation-webui
33
 
34
  Please make sure you're using the latest version of text-generation-webui
 
1
  ---
2
  inference: false
3
+ license: mit
4
+ language:
5
+ - en
6
+ library_name: transformers
7
+ datasets:
8
+ - psmathur/alpaca_orca
9
+ - psmathur/dolly-v2_orca
10
+ - psmathur/WizardLM_Orca
11
  ---
12
 
13
  <!-- header start -->
 
36
  * [2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/orca_mini_7B-GGML)
37
  * [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/psmathur/orca_mini_7b)
38
 
39
+ ## Prompt template: Alpaca with system message
40
+
41
+ ```
42
+ ### System:
43
+ You are an AI assistant that follows instruction extremely well. Help as much as you can.
44
+
45
+ ### User:
46
+ prompt
47
+
48
+ ### Response
49
+ ```
50
+ or
51
+ ```
52
+ ### System:
53
+ You are an AI assistant that follows instruction extremely well. Help as much as you can.
54
+
55
+ ### User:
56
+ prompt
57
+
58
+ ### Input
59
+ input
60
+
61
+ ### Response
62
+ ```
63
+
64
  ## How to easily download and use this model in text-generation-webui
65
 
66
  Please make sure you're using the latest version of text-generation-webui