pszemraj commited on
Commit
6571917
1 Parent(s): 8d8ab64

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -32,12 +32,13 @@ inference:
32
 
33
  ---
34
 
 
35
  # bigbird pegasus on the booksum dataset
36
 
37
- - typical datasets for summarization models arePubMed / arXiv; for my use cases I have found these to be not very useful
38
- - summarizing text via arXiv models will typically make the summary sound so needlessly complicated you might as well have read the original text in that time anyway.
39
  - this model is one attempt to help with that
40
- - this model has been trained for 7 epochs total and is closer to finished.
41
  - Will continue to improve (slowly, now that it has been trained on the dataset for 70k steps) based on any result findings/feedback.
42
  - the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
43
 
@@ -45,6 +46,7 @@ inference:
45
 
46
  > An extended example, including a demo of batch summarization, is [here](https://colab.research.google.com/gist/pszemraj/2c8c0aecbcd4af6e9cbb51e195be10e2/bigbird-pegasus-large-booksum-20k-example.ipynb).
47
 
 
48
  - create the summarizer object:
49
 
50
  ```
 
32
 
33
  ---
34
 
35
+
36
  # bigbird pegasus on the booksum dataset
37
 
38
+ - typical datasets for summarization models arePubMed / arXiv; for my use cases, I have found these to be not very useful
39
+ - summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
40
  - this model is one attempt to help with that
41
+ - this model has been trained for seven epochs total and is closer to finished.
42
  - Will continue to improve (slowly, now that it has been trained on the dataset for 70k steps) based on any result findings/feedback.
43
  - the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
44
 
 
46
 
47
  > An extended example, including a demo of batch summarization, is [here](https://colab.research.google.com/gist/pszemraj/2c8c0aecbcd4af6e9cbb51e195be10e2/bigbird-pegasus-large-booksum-20k-example.ipynb).
48
 
49
+
50
  - create the summarizer object:
51
 
52
  ```