Update README.md
Browse files
README.md
CHANGED
@@ -35,7 +35,7 @@ inference:
|
|
35 |
|
36 |
# bigbird pegasus on the booksum dataset
|
37 |
|
38 |
-
_this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
|
39 |
|
40 |
- motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be useful.
|
41 |
- summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
|
@@ -44,9 +44,11 @@ _this is the "latest" version of the model that has been trained the longest, cu
|
|
44 |
- Will continue to improve (slowly, now that it has been trained for a long time) based on any result findings/feedback.
|
45 |
- the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
|
46 |
|
|
|
|
|
47 |
# example usage
|
48 |
|
49 |
-
>
|
50 |
|
51 |
|
52 |
- create the summarizer object:
|
@@ -89,6 +91,11 @@ result = summarizer(
|
|
89 |
print(result[0]['summary_text'])
|
90 |
```
|
91 |
|
|
|
|
|
|
|
|
|
|
|
92 |
|
93 |
# Results
|
94 |
|
|
|
35 |
|
36 |
# bigbird pegasus on the booksum dataset
|
37 |
|
38 |
+
>_this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
|
39 |
|
40 |
- motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be useful.
|
41 |
- summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
|
|
|
44 |
- Will continue to improve (slowly, now that it has been trained for a long time) based on any result findings/feedback.
|
45 |
- the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
|
46 |
|
47 |
+
---
|
48 |
+
|
49 |
# example usage
|
50 |
|
51 |
+
>An extended example, including a demo of batch summarization, is [here](https://colab.research.google.com/gist/pszemraj/2c8c0aecbcd4af6e9cbb51e195be10e2/bigbird-pegasus-large-booksum-20k-example.ipynb).
|
52 |
|
53 |
|
54 |
- create the summarizer object:
|
|
|
91 |
print(result[0]['summary_text'])
|
92 |
```
|
93 |
|
94 |
+
## Alternate Checkpoint
|
95 |
+
|
96 |
+
- if experiencing runtime / memory issues, try [this earlier checkpoint](https://huggingface.co/pszemraj/bigbird-pegasus-large-booksum-40k-K) at 40,000 steps which is almost as good at the explanatory summarization task, but runs faster.
|
97 |
+
|
98 |
+
---
|
99 |
|
100 |
# Results
|
101 |
|