Initial GPTQ model commit

README.md

@@ -47,10 +47,10 @@ Multiple GPTQ parameter permutations are provided; see Provided Files below for
 * [2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference (deprecated)](https://huggingface.co/TheBloke/CodeLlama-34B-GGML)
 * [Meta's original unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/codellama/CodeLlama-34b-hf)
 
-## Prompt template: TBC
+## Prompt template: None
 
 ```
-Info on prompt template will be added shortly.
+{prompt}
 ```
 
 ## Provided files and GPTQ parameters
@@ -159,7 +159,7 @@ model = AutoGPTQForCausalLM.from_quantized(model_name_or_path,
 """
 
 prompt = "Tell me about AI"
-prompt_template=f'''Info on prompt template will be added shortly.
+prompt_template=f'''{prompt}
 '''
 
 print("\n\n*** Generate:")