pszemraj commited on
Commit
f40f000
1 Parent(s): c9e947c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -35,7 +35,7 @@ inference:
35
 
36
  # bigbird pegasus on the booksum dataset
37
 
38
- _this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
39
 
40
  - motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be useful.
41
  - summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
@@ -44,9 +44,11 @@ _this is the "latest" version of the model that has been trained the longest, cu
44
  - Will continue to improve (slowly, now that it has been trained for a long time) based on any result findings/feedback.
45
  - the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
46
 
 
 
47
  # example usage
48
 
49
- > An extended example, including a demo of batch summarization, is [here](https://colab.research.google.com/gist/pszemraj/2c8c0aecbcd4af6e9cbb51e195be10e2/bigbird-pegasus-large-booksum-20k-example.ipynb).
50
 
51
 
52
  - create the summarizer object:
@@ -89,6 +91,11 @@ result = summarizer(
89
  print(result[0]['summary_text'])
90
  ```
91
 
 
 
 
 
 
92
 
93
  # Results
94
 
 
35
 
36
  # bigbird pegasus on the booksum dataset
37
 
38
+ >_this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
39
 
40
  - motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be useful.
41
  - summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
 
44
  - Will continue to improve (slowly, now that it has been trained for a long time) based on any result findings/feedback.
45
  - the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
46
 
47
+ ---
48
+
49
  # example usage
50
 
51
+ >An extended example, including a demo of batch summarization, is [here](https://colab.research.google.com/gist/pszemraj/2c8c0aecbcd4af6e9cbb51e195be10e2/bigbird-pegasus-large-booksum-20k-example.ipynb).
52
 
53
 
54
  - create the summarizer object:
 
91
  print(result[0]['summary_text'])
92
  ```
93
 
94
+ ## Alternate Checkpoint
95
+
96
+ - if experiencing runtime / memory issues, try [this earlier checkpoint](https://huggingface.co/pszemraj/bigbird-pegasus-large-booksum-40k-K) at 40,000 steps which is almost as good at the explanatory summarization task, but runs faster.
97
+
98
+ ---
99
 
100
  # Results
101