Reggie commited on
Commit
cbe97df
1 Parent(s): b356054

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ widget:
6
+ - text: >-
7
+ A nervous passenger is about to book a flight ticket, and he asks the
8
+ airlines' ticket seller, 'I hope your planes are safe. Do they have a good
9
+ track record for safety?' The airline agent replies, 'Sir, I can guarantee
10
+ you, we've never had a plane that has crashed more than once.'
11
+ example_title: A joke
12
+ - text: >-
13
+ Let me, however, hasten to assure that I am the same Gandhi as I was in
14
+ 1920. I have not changed in any fundamental respect. I attach the same
15
+ importance to nonviolence that I did then. If at all, my emphasis on it has
16
+ grown stronger. There is no real contradiction between the present
17
+ resolution and my previous writings and utterances.
18
+ example_title: Not a joke
19
+ tags:
20
+ - distilbert
21
+ ---
22
+
23
+ ### What is this?
24
+ This model has been developed to detect "narrative-style" jokes, stories and anecdotes (i.e. they are narrated as a story) spoken during speeches or conversations etc. It works best when jokes/anecdotes are at least 40 words or longer. It is based on [lvwerra's distilbert](https://huggingface.co/lvwerra/distilbert-imdb).
25
+
26
+ The training dataset was a private collection of around 2000 jokes. This model has not been trained or tested on one-liners, puns or Reddit-style language-manipulation jokes such as knock-knock, Q&A jokes etc.
27
+
28
+ See the example in the inference widget or How to use section for what constitues a narrative-style joke.
29
+
30
+ For a more accurate model (2.4% more) that is slower at inference, see the [Roberta model](Reggie/muppet-roberta-base-joke_detector). For a still more accurate model (2.9% more) that is much slower at inference, see the [Deberta-v3 model](https://huggingface.co/Reggie/DeBERTa-v3-base-joke_detector).
31
+
32
+
33
+ ### Install these first
34
+ You'll need to pip install transformers & maybe sentencepiece
35
+
36
+ ### How to use
37
+ ```python
38
+ from transformers import pipeline
39
+ device = 0 if torch.cuda.is_available() else -1
40
+ model_name = 'Reggie/distilbert-joke_detector'
41
+ max_seq_len = 510
42
+
43
+ pipe = pipeline(model=model_name, device=device, truncation=True, max_length=max_seq_len)
44
+ is_it_a_joke = """A nervous passenger is about to book a flight ticket, and he asks the airlines' ticket seller, "I hope your planes are safe. Do they have a good track record for safety?" The airline agent replies, "Sir, I can guarantee you, we've never had a plane that has crashed more than once." """
45
+ result = pipe(is_it_a_joke) # [{'label': 'LABEL_1', 'score': 0.7313136458396912}]
46
+ print('This is a joke') if result[0]['label'] == 'LABEL_1' else print('This is not a joke')
47
+ ```