tjtanaa commited on
Commit
25f2efc
1 Parent(s): 7a664fd

update readme.md

Browse files
Files changed (3) hide show
  1. README.md +25 -0
  2. app.py +1 -1
  3. img/Interface.png +0 -0
README.md CHANGED
@@ -10,4 +10,29 @@ pinned: false
10
  license: apache-2.0
11
  ---
12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
10
  license: apache-2.0
11
  ---
12
 
13
+ # Chat Template Generation: Make Chat Easier with Huggingface Tokenizer
14
+ ![interface](./img/Interface.png)
15
+
16
+ This streamlit app is to serve as an easier way to check and push the chat template to your/exisiting huggingface repo
17
+ Current predefined templates:
18
+ - open-orca.jinja2
19
+ - mistral-7b-openorca.jinja2
20
+ - orca2.jinja2
21
+ - airoboros_v2.jinja2
22
+ - airoboros_v1.jinja2
23
+ - openhermes-2.5-mistral.jinja2
24
+ - zephyr.jinja2
25
+ - falcon-chat.jinja2
26
+ - chat-ml.jinja2
27
+ - llama-2.jinja2
28
+ - vicuna_v1.1.jinja2
29
+
30
+ More templates will be predefined for easier setup of chat template.
31
+
32
+ With this interface you can easily
33
+ - update your tokenizer_config.json with chat-template attributes with predefined prompt template or custom template so that you can use `tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)` to generate chat prompt.
34
+ - contribute to existing model repository to support chat-template attributes
35
+ - review if your prompt template matches with your expected prompt
36
+
37
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
38
+
app.py CHANGED
@@ -53,7 +53,7 @@ Chat Template Generation: Make Chat Easier with Huggingface Tokenizer
53
  """
54
 
55
  st.title(title_description)
56
- st.markdown('This webpage is to serve as an easier way to check and push the chat template to your/exisiting huggingface repo')
57
 
58
  list_of_templates = get_existing_templates()
59
  with st.expander("Current predefined templates"):
 
53
  """
54
 
55
  st.title(title_description)
56
+ st.markdown('This streamlit app is to serve as an easier way to check and push the chat template to your/exisiting huggingface repo')
57
 
58
  list_of_templates = get_existing_templates()
59
  with st.expander("Current predefined templates"):
img/Interface.png ADDED