oluwatosin adewumi commited on
Commit
e98e1e0
1 Parent(s): 066460b

modification to README

Browse files
Files changed (1) hide show
  1. README.md +38 -2
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
 
2
  language:
3
  - en
4
  license: cc-by-4.0
@@ -13,9 +14,44 @@ widget:
13
  - text: "I would like to have breakfast."
14
  ---
15
 
16
- DialoGPT_MWOZ
17
 
18
  This is a fine-tuned model of DialoGPT (medium) on the MultiWOZ v2.2 dataset. It is intended to be used as a conversational system.
19
  The dataset it's trained on is limited in scope, as it covers only certain domains such as restaurants, hotel, taxi, train, hospital and police.
20
 
21
- The perplexity achieved on the test and validation sets are 10.25 and 10.71, respectively.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ thumbnail: https://huggingface.co/front/thumbnails/dialogpt.png
3
  language:
4
  - en
5
  license: cc-by-4.0
14
  - text: "I would like to have breakfast."
15
  ---
16
 
17
+ ## DialoGPT_MWOZ
18
 
19
  This is a fine-tuned model of DialoGPT (medium) on the MultiWOZ v2.2 dataset. It is intended to be used as a conversational system.
20
  The dataset it's trained on is limited in scope, as it covers only certain domains such as restaurants, hotel, taxi, train, hospital and police.
21
 
22
+ The perplexity achieved on the test and validation sets are 10.25 and 10.71, respectively. More information about the original pre-trained model can be found [here](https://huggingface.co/microsoft/DialoGPT-medium)
23
+
24
+ * Generation example from an interactive environment:
25
+
26
+ |Role | Response |
27
+ |---------|------------|
28
+ |User | I would like to have breakfast. |
29
+ |Bot | There are several options for Chinese in the city centre. Are you looking for a particular price range? |
30
+ |User | I'm looking for free food |
31
+ |Bot | There are 4 Chinese restaurants that are in the cheap price range. 3 in centre and one in north. |
32
+ |User | Not good enough |
33
+ |Bot | How about Charlie Chan? It is a Chinese restaurant in the centre of town. |
34
+
35
+ Please find the information about preprocessing, training and full details of the DialoGPT in the [original DialoGPT repository](https://github.com/microsoft/DialoGPT)
36
+
37
+ The paper for this work was accepted at the Northern Lights Deep Learning (NLDL) conference 2022. Arxiv paper: [https://arxiv.org/pdf/2110.06273.pdf](https://arxiv.org/pdf/2110.06273.pdf)
38
+
39
+ ### How to use
40
+
41
+ Now we are ready to try out how the model works as a chatting partner!
42
+
43
+ ```python
44
+ from transformers import AutoModelForCausalLM, AutoTokenizer
45
+ import torch
46
+ tokenizer = AutoTokenizer.from_pretrained("tosin/dialogpt_mwoz")
47
+ model = AutoModelForCausalLM.from_pretrained("tosin/dialogpt_mwoz")
48
+ # Let's chat for 5 lines
49
+ for step in range(5):
50
+ # encode the new user input, add the eos_token and return a tensor in Pytorch
51
+ new_user_input_ids = tokenizer.encode(input(">> User:") + tokenizer.eos_token, return_tensors='pt')
52
+ # append the new user input tokens to the chat history
53
+ bot_input_ids = torch.cat([chat_history_ids, new_user_input_ids], dim=-1) if step > 0 else new_user_input_ids
54
+ # generated a response while limiting the total chat history to 1000 tokens,
55
+ chat_history_ids = model.generate(bot_input_ids, max_length=1000, pad_token_id=tokenizer.eos_token_id)
56
+ # pretty print last ouput tokens from bot
57
+ print("DialoGPT_MWOZ_Bot: {}".format(tokenizer.decode(chat_history_ids[:, bot_input_ids.shape[-1]:][0], skip_special_tokens=True)))