yorko commited on
Commit
51c6fab
1 Parent(s): 504460c

replace chkpt; update Readme

Browse files

Files changed (2) hide show
  1. README.md +2 -2
  2. pytorch_model.bin +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
- # SciBERT Longformer finetuned to SDG classification
2
 
3
- This is a Lonformer version of the [SciBERT uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) model by Allen AI, finetuned to Sustainable Development Goals classification. The model is slower than SciBERT (~2.5x in my benchmarks) but can allow for 8x wider `max_seq_length` (4096 vs. 512) which is handy in case of working with long texts, e.g. scientific full texts.
4
 
5
  The conversion to Longformer was performed with a [tutorial](https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) by Allen AI: see a [Google Colab Notebook](https://colab.research.google.com/drive/1NPTnMkeAYOF2MWH3_uJYesuxxdOzxrFn?usp=sharing) by [Yury](https://yorko.github.io/) which closely follows the tutorial.
6
 
1
+ # SciBERT Longformer
2
 
3
+ This is a Lonformer version of the [SciBERT uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) model by Allen AI. The model is slower than SciBERT (~2.5x in my benchmarks) but can allow for 8x wider `max_seq_length` (4096 vs. 512) which is handy in case of working with long texts, e.g. scientific full texts.
4
 
5
  The conversion to Longformer was performed with a [tutorial](https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) by Allen AI: see a [Google Colab Notebook](https://colab.research.google.com/drive/1NPTnMkeAYOF2MWH3_uJYesuxxdOzxrFn?usp=sharing) by [Yury](https://yorko.github.io/) which closely follows the tutorial.
6
 
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:48db774448d6c458effaee86de8b6d656b6571f4de8df2f148542a6c7db8b7c7
3
- size 450822016
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b24e25a804b7d2c55631263ff851d8f57973335ab84671fc0fbc716997e3160
3
+ size 538332835