pszemraj commited on
Commit
c9e947c
1 Parent(s): 6571917

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -35,11 +35,13 @@ inference:
35
 
36
  # bigbird pegasus on the booksum dataset
37
 
38
- - typical datasets for summarization models arePubMed / arXiv; for my use cases, I have found these to be not very useful
 
 
39
  - summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
40
- - this model is one attempt to help with that
41
- - this model has been trained for seven epochs total and is closer to finished.
42
- - Will continue to improve (slowly, now that it has been trained on the dataset for 70k steps) based on any result findings/feedback.
43
  - the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
44
 
45
  # example usage
 
35
 
36
  # bigbird pegasus on the booksum dataset
37
 
38
+ _this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
39
+
40
+ - motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be useful.
41
  - summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
42
+ - this model is one attempt to help with that by using the [booksum](https://arxiv.org/abs/2105.08209) dataset to provide **explanatory summarization**
43
+ - this model has been trained for seven epochs total (approx 70,000 steps) and is closer to finished.
44
+ - Will continue to improve (slowly, now that it has been trained for a long time) based on any result findings/feedback.
45
  - the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
46
 
47
  # example usage