Duplicate from drhyrum/bert-tiny-torch-picklebomb
Browse filesCo-authored-by: Hyrum Anderson <drhyrum@users.noreply.huggingface.co>
This view is limited to 50 files because it contains too many changes.
See raw diff
- .gitattributes +35 -0
- README.md +64 -0
- archive/data.pkl +3 -0
- archive/data/100258528 +0 -0
- archive/data/100878480 +0 -0
- archive/data/100878576 +1 -0
- archive/data/101028288 +0 -0
- archive/data/101028384 +0 -0
- archive/data/101378128 +0 -0
- archive/data/101378224 +4 -0
- archive/data/102474416 +0 -0
- archive/data/102646816 +0 -0
- archive/data/102687856 +0 -0
- archive/data/102768528 +0 -0
- archive/data/102769552 +0 -0
- archive/data/102798288 +0 -0
- archive/data/102886912 +0 -0
- archive/data/104127520 +0 -0
- archive/data/104248528 +0 -0
- archive/data/104350992 +5 -0
- archive/data/104477200 +0 -0
- archive/data/104786464 +0 -0
- archive/data/104864128 +5 -0
- archive/data/104929328 +0 -0
- archive/data/105517808 +0 -0
- archive/data/105642560 +0 -0
- archive/data/105677744 +0 -0
- archive/data/106182800 +0 -0
- archive/data/106870768 +0 -0
- archive/data/107109936 +0 -0
- archive/data/107126640 +5 -0
- archive/data/107288432 +0 -0
- archive/data/107361280 +0 -0
- archive/data/107403104 +0 -0
- archive/data/107465600 +3 -0
- archive/data/107541520 +0 -0
- archive/data/107610896 +0 -0
- archive/data/107638608 +0 -0
- archive/data/107700576 +0 -0
- archive/data/107717904 +0 -0
- archive/data/107788272 +0 -0
- archive/data/107958624 +0 -0
- archive/data/107966592 +0 -0
- archive/data/108043856 +0 -0
- archive/data/108048272 +0 -0
- archive/data/108101904 +0 -0
- archive/data/108105680 +0 -0
- archive/data/110540912 +0 -0
- archive/data/95918736 +3 -0
- archive/data/97389408 +0 -0
.gitattributes
ADDED
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
|
5 |
+
license:
|
6 |
+
- mit
|
7 |
+
|
8 |
+
tags:
|
9 |
+
- BERT
|
10 |
+
- MNLI
|
11 |
+
- NLI
|
12 |
+
- transformer
|
13 |
+
- pre-training
|
14 |
+
|
15 |
+
---
|
16 |
+
|
17 |
+
*DISCLAIMER*: This repo demonstrates a picklebomb payload in pytorch that may go undetected by superficial scanning.
|
18 |
+
|
19 |
+
The following model is a Pytorch pre-trained model obtained from converting Tensorflow checkpoint found in the [official Google BERT repository](https://github.com/google-research/bert).
|
20 |
+
|
21 |
+
This is one of the smaller pre-trained BERT variants, together with [bert-mini](https://huggingface.co/prajjwal1/bert-mini) [bert-small](https://huggingface.co/prajjwal1/bert-small) and [bert-medium](https://huggingface.co/prajjwal1/bert-medium). They were introduced in the study `Well-Read Students Learn Better: On the Importance of Pre-training Compact Models` ([arxiv](https://arxiv.org/abs/1908.08962)), and ported to HF for the study `Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics` ([arXiv](https://arxiv.org/abs/2110.01518)). These models are supposed to be trained on a downstream task.
|
22 |
+
|
23 |
+
If you use the model, please consider citing both the papers:
|
24 |
+
```
|
25 |
+
@misc{bhargava2021generalization,
|
26 |
+
title={Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics},
|
27 |
+
author={Prajjwal Bhargava and Aleksandr Drozd and Anna Rogers},
|
28 |
+
year={2021},
|
29 |
+
eprint={2110.01518},
|
30 |
+
archivePrefix={arXiv},
|
31 |
+
primaryClass={cs.CL}
|
32 |
+
}
|
33 |
+
|
34 |
+
@article{DBLP:journals/corr/abs-1908-08962,
|
35 |
+
author = {Iulia Turc and
|
36 |
+
Ming{-}Wei Chang and
|
37 |
+
Kenton Lee and
|
38 |
+
Kristina Toutanova},
|
39 |
+
title = {Well-Read Students Learn Better: The Impact of Student Initialization
|
40 |
+
on Knowledge Distillation},
|
41 |
+
journal = {CoRR},
|
42 |
+
volume = {abs/1908.08962},
|
43 |
+
year = {2019},
|
44 |
+
url = {http://arxiv.org/abs/1908.08962},
|
45 |
+
eprinttype = {arXiv},
|
46 |
+
eprint = {1908.08962},
|
47 |
+
timestamp = {Thu, 29 Aug 2019 16:32:34 +0200},
|
48 |
+
biburl = {https://dblp.org/rec/journals/corr/abs-1908-08962.bib},
|
49 |
+
bibsource = {dblp computer science bibliography, https://dblp.org}
|
50 |
+
}
|
51 |
+
|
52 |
+
```
|
53 |
+
Config of this model:
|
54 |
+
- `prajjwal1/bert-tiny` (L=2, H=128) [Model Link](https://huggingface.co/prajjwal1/bert-tiny)
|
55 |
+
|
56 |
+
|
57 |
+
Other models to check out:
|
58 |
+
- `prajjwal1/bert-mini` (L=4, H=256) [Model Link](https://huggingface.co/prajjwal1/bert-mini)
|
59 |
+
- `prajjwal1/bert-small` (L=4, H=512) [Model Link](https://huggingface.co/prajjwal1/bert-small)
|
60 |
+
- `prajjwal1/bert-medium` (L=8, H=512) [Model Link](https://huggingface.co/prajjwal1/bert-medium)
|
61 |
+
|
62 |
+
Original Implementation and more info can be found in [this Github repository](https://github.com/prajjwal1/generalize_lm_nli).
|
63 |
+
|
64 |
+
Twitter: [@prajjwal_1](https://twitter.com/prajjwal_1)
|
archive/data.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c8354611d7d2f2437aa2ce1af05760ae2a4acbfc21e2b3a4cbe77024130bf8df
|
3 |
+
size 8906
|
archive/data/100258528
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/100878480
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/100878576
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
A�&��<
|
archive/data/101028288
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/101028384
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/101378128
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/101378224
ADDED
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
1 |
+
��l>��?s�U?ߴ�>�����汿(3����_?����Џ{�Ü�>"B;?6�x��w��6��惿�A?p���[���rC��l��>������7���F3��}��>��?�,���s��䁿Iu��࿕��>`v�=Ӓ��Ɇ*?D�?_�����?�ZB?\=���~(?4 �����>�j�?͐�?��SU?���?���̎m��
|
2 |
+
7j��ڿ2�?�鋿-���G�O?� ¿'�����>���+�?�H�?�$�����
|
3 |
+
ԣ��箿W�
|
4 |
+
?$e���Aȿ[�>��>RZ�r�?�<��s}j��x?�<����d>A���2@���>�3��?�����5w���}?b*,?��|?�
|
archive/data/102474416
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/102646816
ADDED
Binary file (262 kB). View file
|
|
archive/data/102687856
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/102768528
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/102769552
ADDED
Binary file (2.05 kB). View file
|
|
archive/data/102798288
ADDED
Binary file (1.02 kB). View file
|
|
archive/data/102886912
ADDED
Binary file (1.02 kB). View file
|
|
archive/data/104127520
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/104248528
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/104350992
ADDED
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
.�C��=k���{���<�?�������=�/�J1ǿ��g?���_]s����>�}��".�>W!D��㍾�ӽ�3�xG?G�:>x���DK�A)�?P��?֬�<�o�=1?�>=?�wĽt�߾x��&2�;�8��>��K�A��> �ľ��
|
2 |
+
�DS�SM
|
3 |
+
?Bѳ��'n?�z���<?h�=�~�=��<?�>^r>��`��?;��>�|��5���8W=K�7��X���~�>ƧP?L-?��%�f����}�'�}�+FX>�2&>]��=;&�A��>4�oP>kP@���п�0%��>�~�=l������?�>��>r �q뾥.�$>w?\G���Y���I?�rW>K����?IP�>����1P >��
|
4 |
+
?+�?|�>F��&�1?ҽ���5�>G�b>|�>�C����}>���Xc6�!�"?��3?�ꭾw_d�?s?�?֏>]��I�>;.�>��]����`�>��?���>�_�hO�
|
5 |
+
��(g�ڍ?
|
archive/data/104477200
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/104786464
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/104864128
ADDED
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
(��U���
|
2 |
+
�=�Ί����X>[H�=�"O>c7
|
3 |
+
>ŤR=�
|
4 |
+
:�*�=m~�}!=�R�=�">�kn>��Խ��k��0ʽ�\>���=�t=7.���@O>e!G>i�n=䱋;?�J=�:>b]v>��,�??�|y)�*�~&Ͻ @>>�u��aY�@��>
|
5 |
+
=�Ө<������w�=���� �=埬�j#=}5d��Z����
|
archive/data/104929328
ADDED
Binary file (4.1 kB). View file
|
|
archive/data/105517808
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/105642560
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/105677744
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/106182800
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/106870768
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/107109936
ADDED
Binary file (2.05 kB). View file
|
|
archive/data/107126640
ADDED
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Y�?7�?��?���?�Ř?�@�?}O�? !�?���?���?���?䉥?n��?��?�B�?�U�?8�?4g�?qo�?�1�?�?F�?�X�?�x�?���?㷒?���?^Y�?�9�?1>�?��?�@�?�~�?\k�?�?�Q�?J��?�u�?c�?�P�?�`�?]��?Y��?�Е?L@�?�~�?oܐ?@�?b�?t��?�
|
2 |
+
�?��?K�?�֔?zL�?�?�?�ɔ?�Q�?&��?Sę?�~�?^�?)��?�_�?&
|
3 |
+
�?p��?fd�?���?xr�?�D�?�?�?���?~�?���?�-�?�b�?���?���?���?��?%Q�?���?v*�?/ʛ?b̗?�4�?K��?�K�?�^�?�Ӈ?�K�?Xj�?-�?��?�Ɛ?��?��?���?��?Σ�?�e�?
|
4 |
+
��?_W�?���?�7�?�)�?�۔?���?S��?��?0?A��?8?0b�?mю?�˗?O�?Lc�?ۅ�?,X�?�V�?"`�?pv�?�U�?
|
5 |
+
>�?5�?���?m��?
|
archive/data/107288432
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/107361280
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/107403104
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/107465600
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
�y?u�Ѿ�w��+;�+�>�i�>�df���5�1i1�9� >���>�g�9^�P>��!>6�����=n�x=|%?k��=��X>��=����<��>��Q��g����%I�>��~�Mԝ>�����I>��>�C?���si�{���x�.>�6�>W�ݽ©h�Z�C�
|
2 |
+
���=�?�F�?�LQ?O0��'ľ\?#Q�^O>�J�0�(��>d��"_?t�D=�=D��=������Eu� մ>ѭ>��d�^q��݃y?��Z>���=῟��Hn>:�n'��f��#�Q<' '?�V?�5���i?�9�=�>Qz�>��O>�E��z4=��
|
3 |
+
�������?b�н�<���-=��6���ƾD�W?�&?��>?�v����B<Zk�羷*��#r�;��=��c���>I�2��=�n���վ(�?C?2?��ľQ�B>Mu�>���<~$|�ϊ�?�e��Y?|��=
|
archive/data/107541520
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/107610896
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/107638608
ADDED
Binary file (122 kB). View file
|
|
archive/data/107700576
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/107717904
ADDED
Binary file (262 kB). View file
|
|
archive/data/107788272
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/107958624
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/107966592
ADDED
Binary file (262 kB). View file
|
|
archive/data/108043856
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/108048272
ADDED
Binary file (512 Bytes). View file
|
|
archive/data/108101904
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/108105680
ADDED
Binary file (262 kB). View file
|
|
archive/data/110540912
ADDED
Binary file (65.5 kB). View file
|
|
archive/data/95918736
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f49cea2ec944d799022612633ec594eddfb82cd81c54f98be79ef0c58d5cb0ff
|
3 |
+
size 15627264
|
archive/data/97389408
ADDED
Binary file (262 kB). View file
|
|