Update README.md
Browse files
README.md
CHANGED
@@ -32,12 +32,13 @@ inference:
|
|
32 |
|
33 |
---
|
34 |
|
|
|
35 |
# bigbird pegasus on the booksum dataset
|
36 |
|
37 |
-
- typical datasets for summarization models arePubMed / arXiv; for my use cases I have found these to be not very useful
|
38 |
-
- summarizing text via arXiv models will typically make the summary sound so needlessly complicated you might as well have read the original text in that time
|
39 |
- this model is one attempt to help with that
|
40 |
-
- this model has been trained for
|
41 |
- Will continue to improve (slowly, now that it has been trained on the dataset for 70k steps) based on any result findings/feedback.
|
42 |
- the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
|
43 |
|
@@ -45,6 +46,7 @@ inference:
|
|
45 |
|
46 |
> An extended example, including a demo of batch summarization, is [here](https://colab.research.google.com/gist/pszemraj/2c8c0aecbcd4af6e9cbb51e195be10e2/bigbird-pegasus-large-booksum-20k-example.ipynb).
|
47 |
|
|
|
48 |
- create the summarizer object:
|
49 |
|
50 |
```
|
|
|
32 |
|
33 |
---
|
34 |
|
35 |
+
|
36 |
# bigbird pegasus on the booksum dataset
|
37 |
|
38 |
+
- typical datasets for summarization models arePubMed / arXiv; for my use cases, I have found these to be not very useful
|
39 |
+
- summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
|
40 |
- this model is one attempt to help with that
|
41 |
+
- this model has been trained for seven epochs total and is closer to finished.
|
42 |
- Will continue to improve (slowly, now that it has been trained on the dataset for 70k steps) based on any result findings/feedback.
|
43 |
- the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
|
44 |
|
|
|
46 |
|
47 |
> An extended example, including a demo of batch summarization, is [here](https://colab.research.google.com/gist/pszemraj/2c8c0aecbcd4af6e9cbb51e195be10e2/bigbird-pegasus-large-booksum-20k-example.ipynb).
|
48 |
|
49 |
+
|
50 |
- create the summarizer object:
|
51 |
|
52 |
```
|