Frase drhyrum commited on
Commit
a65c680
0 Parent(s):

Duplicate from drhyrum/bert-tiny-torch-picklebomb

Browse files

Co-authored-by: Hyrum Anderson <drhyrum@users.noreply.huggingface.co>

This view is limited to 50 files because it contains too many changes.   See raw diff
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+
5
+ license:
6
+ - mit
7
+
8
+ tags:
9
+ - BERT
10
+ - MNLI
11
+ - NLI
12
+ - transformer
13
+ - pre-training
14
+
15
+ ---
16
+
17
+ *DISCLAIMER*: This repo demonstrates a picklebomb payload in pytorch that may go undetected by superficial scanning.
18
+
19
+ The following model is a Pytorch pre-trained model obtained from converting Tensorflow checkpoint found in the [official Google BERT repository](https://github.com/google-research/bert).
20
+
21
+ This is one of the smaller pre-trained BERT variants, together with [bert-mini](https://huggingface.co/prajjwal1/bert-mini) [bert-small](https://huggingface.co/prajjwal1/bert-small) and [bert-medium](https://huggingface.co/prajjwal1/bert-medium). They were introduced in the study `Well-Read Students Learn Better: On the Importance of Pre-training Compact Models` ([arxiv](https://arxiv.org/abs/1908.08962)), and ported to HF for the study `Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics` ([arXiv](https://arxiv.org/abs/2110.01518)). These models are supposed to be trained on a downstream task.
22
+
23
+ If you use the model, please consider citing both the papers:
24
+ ```
25
+ @misc{bhargava2021generalization,
26
+ title={Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics},
27
+ author={Prajjwal Bhargava and Aleksandr Drozd and Anna Rogers},
28
+ year={2021},
29
+ eprint={2110.01518},
30
+ archivePrefix={arXiv},
31
+ primaryClass={cs.CL}
32
+ }
33
+
34
+ @article{DBLP:journals/corr/abs-1908-08962,
35
+ author = {Iulia Turc and
36
+ Ming{-}Wei Chang and
37
+ Kenton Lee and
38
+ Kristina Toutanova},
39
+ title = {Well-Read Students Learn Better: The Impact of Student Initialization
40
+ on Knowledge Distillation},
41
+ journal = {CoRR},
42
+ volume = {abs/1908.08962},
43
+ year = {2019},
44
+ url = {http://arxiv.org/abs/1908.08962},
45
+ eprinttype = {arXiv},
46
+ eprint = {1908.08962},
47
+ timestamp = {Thu, 29 Aug 2019 16:32:34 +0200},
48
+ biburl = {https://dblp.org/rec/journals/corr/abs-1908-08962.bib},
49
+ bibsource = {dblp computer science bibliography, https://dblp.org}
50
+ }
51
+
52
+ ```
53
+ Config of this model:
54
+ - `prajjwal1/bert-tiny` (L=2, H=128) [Model Link](https://huggingface.co/prajjwal1/bert-tiny)
55
+
56
+
57
+ Other models to check out:
58
+ - `prajjwal1/bert-mini` (L=4, H=256) [Model Link](https://huggingface.co/prajjwal1/bert-mini)
59
+ - `prajjwal1/bert-small` (L=4, H=512) [Model Link](https://huggingface.co/prajjwal1/bert-small)
60
+ - `prajjwal1/bert-medium` (L=8, H=512) [Model Link](https://huggingface.co/prajjwal1/bert-medium)
61
+
62
+ Original Implementation and more info can be found in [this Github repository](https://github.com/prajjwal1/generalize_lm_nli).
63
+
64
+ Twitter: [@prajjwal_1](https://twitter.com/prajjwal_1)
archive/data.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8354611d7d2f2437aa2ce1af05760ae2a4acbfc21e2b3a4cbe77024130bf8df
3
+ size 8906
archive/data/100258528 ADDED
Binary file (65.5 kB). View file
 
archive/data/100878480 ADDED
Binary file (65.5 kB). View file
 
archive/data/100878576 ADDED
@@ -0,0 +1 @@
 
 
1
+ A�&�� <
archive/data/101028288 ADDED
Binary file (65.5 kB). View file
 
archive/data/101028384 ADDED
Binary file (512 Bytes). View file
 
archive/data/101378128 ADDED
Binary file (512 Bytes). View file
 
archive/data/101378224 ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ ��l>��?s�U?ߴ�>�����汿(3����_?����Џ{�Ü�>"B;?6�x��w��6��惿�A?p���[���rC��l��>����􆙾��޼7���F3��}��>��?�,���s��䁿Iu��࿕��>`v�=Ӓ��⹿Ɇ*?D�?_�����?�ZB?\=���~(?4 �����>�j�?͐�?��SU ?���?���̎m��
2
+ 7j��ڿ2�?�鋿-���G�O?� ¿'�����>���+�?�H�?�$�����
3
+ ԣ��箿W�
4
+ ?$e���Aȿ[�>��>RZ�r�?�<��s}j��x?�<����d>A���2@���>�3��?�����5w���}?b*,?��|?�
archive/data/102474416 ADDED
Binary file (512 Bytes). View file
 
archive/data/102646816 ADDED
Binary file (262 kB). View file
 
archive/data/102687856 ADDED
Binary file (512 Bytes). View file
 
archive/data/102768528 ADDED
Binary file (512 Bytes). View file
 
archive/data/102769552 ADDED
Binary file (2.05 kB). View file
 
archive/data/102798288 ADDED
Binary file (1.02 kB). View file
 
archive/data/102886912 ADDED
Binary file (1.02 kB). View file
 
archive/data/104127520 ADDED
Binary file (65.5 kB). View file
 
archive/data/104248528 ADDED
Binary file (512 Bytes). View file
 
archive/data/104350992 ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ .�C��=k���{���<�?�������=�/�J1ǿ��g?���_]s����>�}��".�>W!D��㍾�ӽ�3�xG?G�:>x���DK�A)�?P��?֬�<�o�=1?�>=?�wĽt�߾x��&2�;�8��>��K�A��> �ľ��
2
+ �DS�SM
3
+ ?Bѳ��'n?�z���<?h�=�~�=��<?�>^r>��`��?;��>�|��5���8W=K�7��X���~�>ƧP?L-?��%�f����}�'�}�+FX>�2&>]��=;&�A��>4�oP>kP@���п�0%��>�~�=l������?�>��>r �q뾥.�$>w?\G���Y���I?�rW>K����?IP�>����1P >��
4
+ ?+�?|�>F��&�1?ҽ���5�>G�b>|�>�C����}>���Xc6�!�"?��3?�ꭾw_d�?s?�?֏>]� �I�>;.�>��]����`�>��?���>�_�hO�
5
+ ��(g�ڍ?
archive/data/104477200 ADDED
Binary file (512 Bytes). View file
 
archive/data/104786464 ADDED
Binary file (65.5 kB). View file
 
archive/data/104864128 ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ (��U���
2
+ �=�Ί����X>[H�=�"O>c7
3
+ >ŤR=�
4
+ :�*�=m~�} !=�R�=�">�kn>��Խ��k��0ʽ�\>���=�t=7.���@O>e!G>i�n=䱋;?�J=�:>b]v>��,�??�|y)�*�׽~&Ͻ @>>�u��aY�@��>
5
+ =�Ө<������w�=���� �=埬�j#=}5d��Z����
archive/data/104929328 ADDED
Binary file (4.1 kB). View file
 
archive/data/105517808 ADDED
Binary file (512 Bytes). View file
 
archive/data/105642560 ADDED
Binary file (512 Bytes). View file
 
archive/data/105677744 ADDED
Binary file (512 Bytes). View file
 
archive/data/106182800 ADDED
Binary file (512 Bytes). View file
 
archive/data/106870768 ADDED
Binary file (65.5 kB). View file
 
archive/data/107109936 ADDED
Binary file (2.05 kB). View file
 
archive/data/107126640 ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ Y�?7�?��?���?�Ř?�@�?}O�? !�?���?���?���?䉥?n��?��?�B�?�U�?8�?4g�?qo�?�1�?�•?F�?�X�?�x�?���?㷒?���?^Y�?�9�?1>�?��?�@�?�~�?\k�?�?�Q�?J��?�u�?c�?�P�?�`�?]��?Y��?�Е?L@�?�~�?oܐ?@�?b�?t��?�
2
+ �?��?K�?�֔?zL�?�?�?�ɔ?�Q�?&��?Sę?�~�?^�?)��?�_�?&
3
+ �?p��?fd�?���?xr�?�D�?�?�?���?~�?���?�-�?�b�?���?���?���?��?%Q�?���?v*�?/ʛ?b̗?�4�?K��?�K�?�^�?�Ӈ?�K�?Xj�?-�?��?�Ɛ?��?��?���?��?Σ�?�e�?
4
+ ��?_W�?���?�7�?�)�?�۔?���?S��?��?0ž?A��?8?0b�?mю?�˗?O�?Lc�?ۅ�?,X�?�V�?"`�?pv�?�U�?
5
+ >�?5�?���?m��?
archive/data/107288432 ADDED
Binary file (512 Bytes). View file
 
archive/data/107361280 ADDED
Binary file (512 Bytes). View file
 
archive/data/107403104 ADDED
Binary file (65.5 kB). View file
 
archive/data/107465600 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ �y?u�Ѿ�w��+;�+�>�i�>�df���5�1i1�9� >���>�g�9^�P>��!>6�����=n�x=|%?k��=��X>��=����<��>��Q��g��� �%I�>��~�Mԝ> �����I>��>�C?���si�{���x�.>�6�>W�ݽ©h�Z�C�
2
+ ���=�?�F�?�LQ?O0��'ľ\?#Q�^O>�J�0�(��>d��"_?t�D=�=D��=������Eu� մ>ѭ>��d�^q��݃y?��Z>���=῟��Hn>:�n'��f��#�Q<' '?�V?�5���i?�9�= �>Qz�>��O>�E��z4=��
3
+ �������?b�н�<���-=��6���ƾD�W?�&?��>?�v����B<Zk�羷*��#r�;��=��c���>I�2��=�n���վ(� ? C?2?��ľQ�B>Mu�>���<~$|�ϊ�?�e��Y?|��=
archive/data/107541520 ADDED
Binary file (512 Bytes). View file
 
archive/data/107610896 ADDED
Binary file (512 Bytes). View file
 
archive/data/107638608 ADDED
Binary file (122 kB). View file
 
archive/data/107700576 ADDED
Binary file (65.5 kB). View file
 
archive/data/107717904 ADDED
Binary file (262 kB). View file
 
archive/data/107788272 ADDED
Binary file (512 Bytes). View file
 
archive/data/107958624 ADDED
Binary file (512 Bytes). View file
 
archive/data/107966592 ADDED
Binary file (262 kB). View file
 
archive/data/108043856 ADDED
Binary file (512 Bytes). View file
 
archive/data/108048272 ADDED
Binary file (512 Bytes). View file
 
archive/data/108101904 ADDED
Binary file (65.5 kB). View file
 
archive/data/108105680 ADDED
Binary file (262 kB). View file
 
archive/data/110540912 ADDED
Binary file (65.5 kB). View file
 
archive/data/95918736 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f49cea2ec944d799022612633ec594eddfb82cd81c54f98be79ef0c58d5cb0ff
3
+ size 15627264
archive/data/97389408 ADDED
Binary file (262 kB). View file