Devdeshitha commited on
Commit
b0937a7
1 Parent(s): 519a31c

Upload Mistral_fine_tuning.ipynb

Browse files
Files changed (1) hide show
  1. Mistral_fine_tuning.ipynb +2580 -0
Mistral_fine_tuning.ipynb ADDED
@@ -0,0 +1,2580 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "nbformat": 4,
3
+ "nbformat_minor": 0,
4
+ "metadata": {
5
+ "colab": {
6
+ "provenance": [],
7
+ "machine_shape": "hm",
8
+ "gpuType": "T4"
9
+ },
10
+ "kernelspec": {
11
+ "name": "python3",
12
+ "display_name": "Python 3"
13
+ },
14
+ "language_info": {
15
+ "name": "python"
16
+ },
17
+ "accelerator": "GPU",
18
+ "widgets": {
19
+ "application/vnd.jupyter.widget-state+json": {
20
+ "83c67e9efb87414983dc54e57e0c4b13": {
21
+ "model_module": "@jupyter-widgets/controls",
22
+ "model_name": "HBoxModel",
23
+ "model_module_version": "2.0.0",
24
+ "state": {
25
+ "_dom_classes": [],
26
+ "_model_module": "@jupyter-widgets/controls",
27
+ "_model_module_version": "2.0.0",
28
+ "_model_name": "HBoxModel",
29
+ "_view_count": null,
30
+ "_view_module": "@jupyter-widgets/controls",
31
+ "_view_module_version": "2.0.0",
32
+ "_view_name": "HBoxView",
33
+ "box_style": "",
34
+ "children": [
35
+ "IPY_MODEL_f0162e38dc704406b147b31b9f1af532",
36
+ "IPY_MODEL_68bd583e714f493f8813c4bbe23faaef",
37
+ "IPY_MODEL_cf14339119954f3e9dd5954e4560f4b2"
38
+ ],
39
+ "layout": "IPY_MODEL_35ae0502bab148c596a841a2b684b542",
40
+ "tabbable": null,
41
+ "tooltip": null
42
+ }
43
+ },
44
+ "f0162e38dc704406b147b31b9f1af532": {
45
+ "model_module": "@jupyter-widgets/controls",
46
+ "model_name": "HTMLModel",
47
+ "model_module_version": "2.0.0",
48
+ "state": {
49
+ "_dom_classes": [],
50
+ "_model_module": "@jupyter-widgets/controls",
51
+ "_model_module_version": "2.0.0",
52
+ "_model_name": "HTMLModel",
53
+ "_view_count": null,
54
+ "_view_module": "@jupyter-widgets/controls",
55
+ "_view_module_version": "2.0.0",
56
+ "_view_name": "HTMLView",
57
+ "description": "",
58
+ "description_allow_html": false,
59
+ "layout": "IPY_MODEL_27a527b4f7f94b7b8f8387eea24799b9",
60
+ "placeholder": "​",
61
+ "style": "IPY_MODEL_7a7286d9c0384f2c965ba484596b463e",
62
+ "tabbable": null,
63
+ "tooltip": null,
64
+ "value": "tokenizer_config.json: 100%"
65
+ }
66
+ },
67
+ "68bd583e714f493f8813c4bbe23faaef": {
68
+ "model_module": "@jupyter-widgets/controls",
69
+ "model_name": "FloatProgressModel",
70
+ "model_module_version": "2.0.0",
71
+ "state": {
72
+ "_dom_classes": [],
73
+ "_model_module": "@jupyter-widgets/controls",
74
+ "_model_module_version": "2.0.0",
75
+ "_model_name": "FloatProgressModel",
76
+ "_view_count": null,
77
+ "_view_module": "@jupyter-widgets/controls",
78
+ "_view_module_version": "2.0.0",
79
+ "_view_name": "ProgressView",
80
+ "bar_style": "success",
81
+ "description": "",
82
+ "description_allow_html": false,
83
+ "layout": "IPY_MODEL_d1118f0fe0eb4ec4b3461a407d06222a",
84
+ "max": 966,
85
+ "min": 0,
86
+ "orientation": "horizontal",
87
+ "style": "IPY_MODEL_1cb070393af445b89b073c80954508f7",
88
+ "tabbable": null,
89
+ "tooltip": null,
90
+ "value": 966
91
+ }
92
+ },
93
+ "cf14339119954f3e9dd5954e4560f4b2": {
94
+ "model_module": "@jupyter-widgets/controls",
95
+ "model_name": "HTMLModel",
96
+ "model_module_version": "2.0.0",
97
+ "state": {
98
+ "_dom_classes": [],
99
+ "_model_module": "@jupyter-widgets/controls",
100
+ "_model_module_version": "2.0.0",
101
+ "_model_name": "HTMLModel",
102
+ "_view_count": null,
103
+ "_view_module": "@jupyter-widgets/controls",
104
+ "_view_module_version": "2.0.0",
105
+ "_view_name": "HTMLView",
106
+ "description": "",
107
+ "description_allow_html": false,
108
+ "layout": "IPY_MODEL_ed7ff4894e434a89998e697944723be4",
109
+ "placeholder": "​",
110
+ "style": "IPY_MODEL_5362bd5ef8c746079b00cf312397a7f5",
111
+ "tabbable": null,
112
+ "tooltip": null,
113
+ "value": " 966/966 [00:00<00:00, 44.0kB/s]"
114
+ }
115
+ },
116
+ "35ae0502bab148c596a841a2b684b542": {
117
+ "model_module": "@jupyter-widgets/base",
118
+ "model_name": "LayoutModel",
119
+ "model_module_version": "2.0.0",
120
+ "state": {
121
+ "_model_module": "@jupyter-widgets/base",
122
+ "_model_module_version": "2.0.0",
123
+ "_model_name": "LayoutModel",
124
+ "_view_count": null,
125
+ "_view_module": "@jupyter-widgets/base",
126
+ "_view_module_version": "2.0.0",
127
+ "_view_name": "LayoutView",
128
+ "align_content": null,
129
+ "align_items": null,
130
+ "align_self": null,
131
+ "border_bottom": null,
132
+ "border_left": null,
133
+ "border_right": null,
134
+ "border_top": null,
135
+ "bottom": null,
136
+ "display": null,
137
+ "flex": null,
138
+ "flex_flow": null,
139
+ "grid_area": null,
140
+ "grid_auto_columns": null,
141
+ "grid_auto_flow": null,
142
+ "grid_auto_rows": null,
143
+ "grid_column": null,
144
+ "grid_gap": null,
145
+ "grid_row": null,
146
+ "grid_template_areas": null,
147
+ "grid_template_columns": null,
148
+ "grid_template_rows": null,
149
+ "height": null,
150
+ "justify_content": null,
151
+ "justify_items": null,
152
+ "left": null,
153
+ "margin": null,
154
+ "max_height": null,
155
+ "max_width": null,
156
+ "min_height": null,
157
+ "min_width": null,
158
+ "object_fit": null,
159
+ "object_position": null,
160
+ "order": null,
161
+ "overflow": null,
162
+ "padding": null,
163
+ "right": null,
164
+ "top": null,
165
+ "visibility": null,
166
+ "width": null
167
+ }
168
+ },
169
+ "27a527b4f7f94b7b8f8387eea24799b9": {
170
+ "model_module": "@jupyter-widgets/base",
171
+ "model_name": "LayoutModel",
172
+ "model_module_version": "2.0.0",
173
+ "state": {
174
+ "_model_module": "@jupyter-widgets/base",
175
+ "_model_module_version": "2.0.0",
176
+ "_model_name": "LayoutModel",
177
+ "_view_count": null,
178
+ "_view_module": "@jupyter-widgets/base",
179
+ "_view_module_version": "2.0.0",
180
+ "_view_name": "LayoutView",
181
+ "align_content": null,
182
+ "align_items": null,
183
+ "align_self": null,
184
+ "border_bottom": null,
185
+ "border_left": null,
186
+ "border_right": null,
187
+ "border_top": null,
188
+ "bottom": null,
189
+ "display": null,
190
+ "flex": null,
191
+ "flex_flow": null,
192
+ "grid_area": null,
193
+ "grid_auto_columns": null,
194
+ "grid_auto_flow": null,
195
+ "grid_auto_rows": null,
196
+ "grid_column": null,
197
+ "grid_gap": null,
198
+ "grid_row": null,
199
+ "grid_template_areas": null,
200
+ "grid_template_columns": null,
201
+ "grid_template_rows": null,
202
+ "height": null,
203
+ "justify_content": null,
204
+ "justify_items": null,
205
+ "left": null,
206
+ "margin": null,
207
+ "max_height": null,
208
+ "max_width": null,
209
+ "min_height": null,
210
+ "min_width": null,
211
+ "object_fit": null,
212
+ "object_position": null,
213
+ "order": null,
214
+ "overflow": null,
215
+ "padding": null,
216
+ "right": null,
217
+ "top": null,
218
+ "visibility": null,
219
+ "width": null
220
+ }
221
+ },
222
+ "7a7286d9c0384f2c965ba484596b463e": {
223
+ "model_module": "@jupyter-widgets/controls",
224
+ "model_name": "HTMLStyleModel",
225
+ "model_module_version": "2.0.0",
226
+ "state": {
227
+ "_model_module": "@jupyter-widgets/controls",
228
+ "_model_module_version": "2.0.0",
229
+ "_model_name": "HTMLStyleModel",
230
+ "_view_count": null,
231
+ "_view_module": "@jupyter-widgets/base",
232
+ "_view_module_version": "2.0.0",
233
+ "_view_name": "StyleView",
234
+ "background": null,
235
+ "description_width": "",
236
+ "font_size": null,
237
+ "text_color": null
238
+ }
239
+ },
240
+ "d1118f0fe0eb4ec4b3461a407d06222a": {
241
+ "model_module": "@jupyter-widgets/base",
242
+ "model_name": "LayoutModel",
243
+ "model_module_version": "2.0.0",
244
+ "state": {
245
+ "_model_module": "@jupyter-widgets/base",
246
+ "_model_module_version": "2.0.0",
247
+ "_model_name": "LayoutModel",
248
+ "_view_count": null,
249
+ "_view_module": "@jupyter-widgets/base",
250
+ "_view_module_version": "2.0.0",
251
+ "_view_name": "LayoutView",
252
+ "align_content": null,
253
+ "align_items": null,
254
+ "align_self": null,
255
+ "border_bottom": null,
256
+ "border_left": null,
257
+ "border_right": null,
258
+ "border_top": null,
259
+ "bottom": null,
260
+ "display": null,
261
+ "flex": null,
262
+ "flex_flow": null,
263
+ "grid_area": null,
264
+ "grid_auto_columns": null,
265
+ "grid_auto_flow": null,
266
+ "grid_auto_rows": null,
267
+ "grid_column": null,
268
+ "grid_gap": null,
269
+ "grid_row": null,
270
+ "grid_template_areas": null,
271
+ "grid_template_columns": null,
272
+ "grid_template_rows": null,
273
+ "height": null,
274
+ "justify_content": null,
275
+ "justify_items": null,
276
+ "left": null,
277
+ "margin": null,
278
+ "max_height": null,
279
+ "max_width": null,
280
+ "min_height": null,
281
+ "min_width": null,
282
+ "object_fit": null,
283
+ "object_position": null,
284
+ "order": null,
285
+ "overflow": null,
286
+ "padding": null,
287
+ "right": null,
288
+ "top": null,
289
+ "visibility": null,
290
+ "width": null
291
+ }
292
+ },
293
+ "1cb070393af445b89b073c80954508f7": {
294
+ "model_module": "@jupyter-widgets/controls",
295
+ "model_name": "ProgressStyleModel",
296
+ "model_module_version": "2.0.0",
297
+ "state": {
298
+ "_model_module": "@jupyter-widgets/controls",
299
+ "_model_module_version": "2.0.0",
300
+ "_model_name": "ProgressStyleModel",
301
+ "_view_count": null,
302
+ "_view_module": "@jupyter-widgets/base",
303
+ "_view_module_version": "2.0.0",
304
+ "_view_name": "StyleView",
305
+ "bar_color": null,
306
+ "description_width": ""
307
+ }
308
+ },
309
+ "ed7ff4894e434a89998e697944723be4": {
310
+ "model_module": "@jupyter-widgets/base",
311
+ "model_name": "LayoutModel",
312
+ "model_module_version": "2.0.0",
313
+ "state": {
314
+ "_model_module": "@jupyter-widgets/base",
315
+ "_model_module_version": "2.0.0",
316
+ "_model_name": "LayoutModel",
317
+ "_view_count": null,
318
+ "_view_module": "@jupyter-widgets/base",
319
+ "_view_module_version": "2.0.0",
320
+ "_view_name": "LayoutView",
321
+ "align_content": null,
322
+ "align_items": null,
323
+ "align_self": null,
324
+ "border_bottom": null,
325
+ "border_left": null,
326
+ "border_right": null,
327
+ "border_top": null,
328
+ "bottom": null,
329
+ "display": null,
330
+ "flex": null,
331
+ "flex_flow": null,
332
+ "grid_area": null,
333
+ "grid_auto_columns": null,
334
+ "grid_auto_flow": null,
335
+ "grid_auto_rows": null,
336
+ "grid_column": null,
337
+ "grid_gap": null,
338
+ "grid_row": null,
339
+ "grid_template_areas": null,
340
+ "grid_template_columns": null,
341
+ "grid_template_rows": null,
342
+ "height": null,
343
+ "justify_content": null,
344
+ "justify_items": null,
345
+ "left": null,
346
+ "margin": null,
347
+ "max_height": null,
348
+ "max_width": null,
349
+ "min_height": null,
350
+ "min_width": null,
351
+ "object_fit": null,
352
+ "object_position": null,
353
+ "order": null,
354
+ "overflow": null,
355
+ "padding": null,
356
+ "right": null,
357
+ "top": null,
358
+ "visibility": null,
359
+ "width": null
360
+ }
361
+ },
362
+ "5362bd5ef8c746079b00cf312397a7f5": {
363
+ "model_module": "@jupyter-widgets/controls",
364
+ "model_name": "HTMLStyleModel",
365
+ "model_module_version": "2.0.0",
366
+ "state": {
367
+ "_model_module": "@jupyter-widgets/controls",
368
+ "_model_module_version": "2.0.0",
369
+ "_model_name": "HTMLStyleModel",
370
+ "_view_count": null,
371
+ "_view_module": "@jupyter-widgets/base",
372
+ "_view_module_version": "2.0.0",
373
+ "_view_name": "StyleView",
374
+ "background": null,
375
+ "description_width": "",
376
+ "font_size": null,
377
+ "text_color": null
378
+ }
379
+ },
380
+ "f573d2932bbb430498a5751796a15a2b": {
381
+ "model_module": "@jupyter-widgets/controls",
382
+ "model_name": "HBoxModel",
383
+ "model_module_version": "2.0.0",
384
+ "state": {
385
+ "_dom_classes": [],
386
+ "_model_module": "@jupyter-widgets/controls",
387
+ "_model_module_version": "2.0.0",
388
+ "_model_name": "HBoxModel",
389
+ "_view_count": null,
390
+ "_view_module": "@jupyter-widgets/controls",
391
+ "_view_module_version": "2.0.0",
392
+ "_view_name": "HBoxView",
393
+ "box_style": "",
394
+ "children": [
395
+ "IPY_MODEL_49bc64f61771490ca3d991474a58ae36",
396
+ "IPY_MODEL_4e5670cf294f4decb781c55d99238b60",
397
+ "IPY_MODEL_367579fa13224925aa6942fbb8ecadac"
398
+ ],
399
+ "layout": "IPY_MODEL_f73df916fb79480a8eeb836e0e4845aa",
400
+ "tabbable": null,
401
+ "tooltip": null
402
+ }
403
+ },
404
+ "49bc64f61771490ca3d991474a58ae36": {
405
+ "model_module": "@jupyter-widgets/controls",
406
+ "model_name": "HTMLModel",
407
+ "model_module_version": "2.0.0",
408
+ "state": {
409
+ "_dom_classes": [],
410
+ "_model_module": "@jupyter-widgets/controls",
411
+ "_model_module_version": "2.0.0",
412
+ "_model_name": "HTMLModel",
413
+ "_view_count": null,
414
+ "_view_module": "@jupyter-widgets/controls",
415
+ "_view_module_version": "2.0.0",
416
+ "_view_name": "HTMLView",
417
+ "description": "",
418
+ "description_allow_html": false,
419
+ "layout": "IPY_MODEL_3457f1233d1d455cbae66f88b546ce60",
420
+ "placeholder": "​",
421
+ "style": "IPY_MODEL_5762dcfb5b65495fb62c9558e62a11af",
422
+ "tabbable": null,
423
+ "tooltip": null,
424
+ "value": "tokenizer.model: 100%"
425
+ }
426
+ },
427
+ "4e5670cf294f4decb781c55d99238b60": {
428
+ "model_module": "@jupyter-widgets/controls",
429
+ "model_name": "FloatProgressModel",
430
+ "model_module_version": "2.0.0",
431
+ "state": {
432
+ "_dom_classes": [],
433
+ "_model_module": "@jupyter-widgets/controls",
434
+ "_model_module_version": "2.0.0",
435
+ "_model_name": "FloatProgressModel",
436
+ "_view_count": null,
437
+ "_view_module": "@jupyter-widgets/controls",
438
+ "_view_module_version": "2.0.0",
439
+ "_view_name": "ProgressView",
440
+ "bar_style": "success",
441
+ "description": "",
442
+ "description_allow_html": false,
443
+ "layout": "IPY_MODEL_ca42e3d65053412b8ce06297fa7b6402",
444
+ "max": 493443,
445
+ "min": 0,
446
+ "orientation": "horizontal",
447
+ "style": "IPY_MODEL_9809ba390eff464592c848051bdcf6af",
448
+ "tabbable": null,
449
+ "tooltip": null,
450
+ "value": 493443
451
+ }
452
+ },
453
+ "367579fa13224925aa6942fbb8ecadac": {
454
+ "model_module": "@jupyter-widgets/controls",
455
+ "model_name": "HTMLModel",
456
+ "model_module_version": "2.0.0",
457
+ "state": {
458
+ "_dom_classes": [],
459
+ "_model_module": "@jupyter-widgets/controls",
460
+ "_model_module_version": "2.0.0",
461
+ "_model_name": "HTMLModel",
462
+ "_view_count": null,
463
+ "_view_module": "@jupyter-widgets/controls",
464
+ "_view_module_version": "2.0.0",
465
+ "_view_name": "HTMLView",
466
+ "description": "",
467
+ "description_allow_html": false,
468
+ "layout": "IPY_MODEL_b34db1c3fda945b396d4d6d9f3f097f9",
469
+ "placeholder": "​",
470
+ "style": "IPY_MODEL_439d21fcef0a40f3813517a5448a390d",
471
+ "tabbable": null,
472
+ "tooltip": null,
473
+ "value": " 493k/493k [00:00<00:00, 4.23MB/s]"
474
+ }
475
+ },
476
+ "f73df916fb79480a8eeb836e0e4845aa": {
477
+ "model_module": "@jupyter-widgets/base",
478
+ "model_name": "LayoutModel",
479
+ "model_module_version": "2.0.0",
480
+ "state": {
481
+ "_model_module": "@jupyter-widgets/base",
482
+ "_model_module_version": "2.0.0",
483
+ "_model_name": "LayoutModel",
484
+ "_view_count": null,
485
+ "_view_module": "@jupyter-widgets/base",
486
+ "_view_module_version": "2.0.0",
487
+ "_view_name": "LayoutView",
488
+ "align_content": null,
489
+ "align_items": null,
490
+ "align_self": null,
491
+ "border_bottom": null,
492
+ "border_left": null,
493
+ "border_right": null,
494
+ "border_top": null,
495
+ "bottom": null,
496
+ "display": null,
497
+ "flex": null,
498
+ "flex_flow": null,
499
+ "grid_area": null,
500
+ "grid_auto_columns": null,
501
+ "grid_auto_flow": null,
502
+ "grid_auto_rows": null,
503
+ "grid_column": null,
504
+ "grid_gap": null,
505
+ "grid_row": null,
506
+ "grid_template_areas": null,
507
+ "grid_template_columns": null,
508
+ "grid_template_rows": null,
509
+ "height": null,
510
+ "justify_content": null,
511
+ "justify_items": null,
512
+ "left": null,
513
+ "margin": null,
514
+ "max_height": null,
515
+ "max_width": null,
516
+ "min_height": null,
517
+ "min_width": null,
518
+ "object_fit": null,
519
+ "object_position": null,
520
+ "order": null,
521
+ "overflow": null,
522
+ "padding": null,
523
+ "right": null,
524
+ "top": null,
525
+ "visibility": null,
526
+ "width": null
527
+ }
528
+ },
529
+ "3457f1233d1d455cbae66f88b546ce60": {
530
+ "model_module": "@jupyter-widgets/base",
531
+ "model_name": "LayoutModel",
532
+ "model_module_version": "2.0.0",
533
+ "state": {
534
+ "_model_module": "@jupyter-widgets/base",
535
+ "_model_module_version": "2.0.0",
536
+ "_model_name": "LayoutModel",
537
+ "_view_count": null,
538
+ "_view_module": "@jupyter-widgets/base",
539
+ "_view_module_version": "2.0.0",
540
+ "_view_name": "LayoutView",
541
+ "align_content": null,
542
+ "align_items": null,
543
+ "align_self": null,
544
+ "border_bottom": null,
545
+ "border_left": null,
546
+ "border_right": null,
547
+ "border_top": null,
548
+ "bottom": null,
549
+ "display": null,
550
+ "flex": null,
551
+ "flex_flow": null,
552
+ "grid_area": null,
553
+ "grid_auto_columns": null,
554
+ "grid_auto_flow": null,
555
+ "grid_auto_rows": null,
556
+ "grid_column": null,
557
+ "grid_gap": null,
558
+ "grid_row": null,
559
+ "grid_template_areas": null,
560
+ "grid_template_columns": null,
561
+ "grid_template_rows": null,
562
+ "height": null,
563
+ "justify_content": null,
564
+ "justify_items": null,
565
+ "left": null,
566
+ "margin": null,
567
+ "max_height": null,
568
+ "max_width": null,
569
+ "min_height": null,
570
+ "min_width": null,
571
+ "object_fit": null,
572
+ "object_position": null,
573
+ "order": null,
574
+ "overflow": null,
575
+ "padding": null,
576
+ "right": null,
577
+ "top": null,
578
+ "visibility": null,
579
+ "width": null
580
+ }
581
+ },
582
+ "5762dcfb5b65495fb62c9558e62a11af": {
583
+ "model_module": "@jupyter-widgets/controls",
584
+ "model_name": "HTMLStyleModel",
585
+ "model_module_version": "2.0.0",
586
+ "state": {
587
+ "_model_module": "@jupyter-widgets/controls",
588
+ "_model_module_version": "2.0.0",
589
+ "_model_name": "HTMLStyleModel",
590
+ "_view_count": null,
591
+ "_view_module": "@jupyter-widgets/base",
592
+ "_view_module_version": "2.0.0",
593
+ "_view_name": "StyleView",
594
+ "background": null,
595
+ "description_width": "",
596
+ "font_size": null,
597
+ "text_color": null
598
+ }
599
+ },
600
+ "ca42e3d65053412b8ce06297fa7b6402": {
601
+ "model_module": "@jupyter-widgets/base",
602
+ "model_name": "LayoutModel",
603
+ "model_module_version": "2.0.0",
604
+ "state": {
605
+ "_model_module": "@jupyter-widgets/base",
606
+ "_model_module_version": "2.0.0",
607
+ "_model_name": "LayoutModel",
608
+ "_view_count": null,
609
+ "_view_module": "@jupyter-widgets/base",
610
+ "_view_module_version": "2.0.0",
611
+ "_view_name": "LayoutView",
612
+ "align_content": null,
613
+ "align_items": null,
614
+ "align_self": null,
615
+ "border_bottom": null,
616
+ "border_left": null,
617
+ "border_right": null,
618
+ "border_top": null,
619
+ "bottom": null,
620
+ "display": null,
621
+ "flex": null,
622
+ "flex_flow": null,
623
+ "grid_area": null,
624
+ "grid_auto_columns": null,
625
+ "grid_auto_flow": null,
626
+ "grid_auto_rows": null,
627
+ "grid_column": null,
628
+ "grid_gap": null,
629
+ "grid_row": null,
630
+ "grid_template_areas": null,
631
+ "grid_template_columns": null,
632
+ "grid_template_rows": null,
633
+ "height": null,
634
+ "justify_content": null,
635
+ "justify_items": null,
636
+ "left": null,
637
+ "margin": null,
638
+ "max_height": null,
639
+ "max_width": null,
640
+ "min_height": null,
641
+ "min_width": null,
642
+ "object_fit": null,
643
+ "object_position": null,
644
+ "order": null,
645
+ "overflow": null,
646
+ "padding": null,
647
+ "right": null,
648
+ "top": null,
649
+ "visibility": null,
650
+ "width": null
651
+ }
652
+ },
653
+ "9809ba390eff464592c848051bdcf6af": {
654
+ "model_module": "@jupyter-widgets/controls",
655
+ "model_name": "ProgressStyleModel",
656
+ "model_module_version": "2.0.0",
657
+ "state": {
658
+ "_model_module": "@jupyter-widgets/controls",
659
+ "_model_module_version": "2.0.0",
660
+ "_model_name": "ProgressStyleModel",
661
+ "_view_count": null,
662
+ "_view_module": "@jupyter-widgets/base",
663
+ "_view_module_version": "2.0.0",
664
+ "_view_name": "StyleView",
665
+ "bar_color": null,
666
+ "description_width": ""
667
+ }
668
+ },
669
+ "b34db1c3fda945b396d4d6d9f3f097f9": {
670
+ "model_module": "@jupyter-widgets/base",
671
+ "model_name": "LayoutModel",
672
+ "model_module_version": "2.0.0",
673
+ "state": {
674
+ "_model_module": "@jupyter-widgets/base",
675
+ "_model_module_version": "2.0.0",
676
+ "_model_name": "LayoutModel",
677
+ "_view_count": null,
678
+ "_view_module": "@jupyter-widgets/base",
679
+ "_view_module_version": "2.0.0",
680
+ "_view_name": "LayoutView",
681
+ "align_content": null,
682
+ "align_items": null,
683
+ "align_self": null,
684
+ "border_bottom": null,
685
+ "border_left": null,
686
+ "border_right": null,
687
+ "border_top": null,
688
+ "bottom": null,
689
+ "display": null,
690
+ "flex": null,
691
+ "flex_flow": null,
692
+ "grid_area": null,
693
+ "grid_auto_columns": null,
694
+ "grid_auto_flow": null,
695
+ "grid_auto_rows": null,
696
+ "grid_column": null,
697
+ "grid_gap": null,
698
+ "grid_row": null,
699
+ "grid_template_areas": null,
700
+ "grid_template_columns": null,
701
+ "grid_template_rows": null,
702
+ "height": null,
703
+ "justify_content": null,
704
+ "justify_items": null,
705
+ "left": null,
706
+ "margin": null,
707
+ "max_height": null,
708
+ "max_width": null,
709
+ "min_height": null,
710
+ "min_width": null,
711
+ "object_fit": null,
712
+ "object_position": null,
713
+ "order": null,
714
+ "overflow": null,
715
+ "padding": null,
716
+ "right": null,
717
+ "top": null,
718
+ "visibility": null,
719
+ "width": null
720
+ }
721
+ },
722
+ "439d21fcef0a40f3813517a5448a390d": {
723
+ "model_module": "@jupyter-widgets/controls",
724
+ "model_name": "HTMLStyleModel",
725
+ "model_module_version": "2.0.0",
726
+ "state": {
727
+ "_model_module": "@jupyter-widgets/controls",
728
+ "_model_module_version": "2.0.0",
729
+ "_model_name": "HTMLStyleModel",
730
+ "_view_count": null,
731
+ "_view_module": "@jupyter-widgets/base",
732
+ "_view_module_version": "2.0.0",
733
+ "_view_name": "StyleView",
734
+ "background": null,
735
+ "description_width": "",
736
+ "font_size": null,
737
+ "text_color": null
738
+ }
739
+ },
740
+ "9836a802f41044d6896d5d52caddb5bd": {
741
+ "model_module": "@jupyter-widgets/controls",
742
+ "model_name": "HBoxModel",
743
+ "model_module_version": "2.0.0",
744
+ "state": {
745
+ "_dom_classes": [],
746
+ "_model_module": "@jupyter-widgets/controls",
747
+ "_model_module_version": "2.0.0",
748
+ "_model_name": "HBoxModel",
749
+ "_view_count": null,
750
+ "_view_module": "@jupyter-widgets/controls",
751
+ "_view_module_version": "2.0.0",
752
+ "_view_name": "HBoxView",
753
+ "box_style": "",
754
+ "children": [
755
+ "IPY_MODEL_c0534dd8a2fc4abea8f45e303000e86d",
756
+ "IPY_MODEL_da0164bbfda54d63af5f400516c8e7b7",
757
+ "IPY_MODEL_d970719a8739466392d9538d3ab37561"
758
+ ],
759
+ "layout": "IPY_MODEL_9121dcd4c9644a22a17fb230963885a9",
760
+ "tabbable": null,
761
+ "tooltip": null
762
+ }
763
+ },
764
+ "c0534dd8a2fc4abea8f45e303000e86d": {
765
+ "model_module": "@jupyter-widgets/controls",
766
+ "model_name": "HTMLModel",
767
+ "model_module_version": "2.0.0",
768
+ "state": {
769
+ "_dom_classes": [],
770
+ "_model_module": "@jupyter-widgets/controls",
771
+ "_model_module_version": "2.0.0",
772
+ "_model_name": "HTMLModel",
773
+ "_view_count": null,
774
+ "_view_module": "@jupyter-widgets/controls",
775
+ "_view_module_version": "2.0.0",
776
+ "_view_name": "HTMLView",
777
+ "description": "",
778
+ "description_allow_html": false,
779
+ "layout": "IPY_MODEL_81eb6ea17da14145a727531a8f19f244",
780
+ "placeholder": "​",
781
+ "style": "IPY_MODEL_1ddcfcb82fdd4743aae4c75d058b9ff7",
782
+ "tabbable": null,
783
+ "tooltip": null,
784
+ "value": "tokenizer.json: 100%"
785
+ }
786
+ },
787
+ "da0164bbfda54d63af5f400516c8e7b7": {
788
+ "model_module": "@jupyter-widgets/controls",
789
+ "model_name": "FloatProgressModel",
790
+ "model_module_version": "2.0.0",
791
+ "state": {
792
+ "_dom_classes": [],
793
+ "_model_module": "@jupyter-widgets/controls",
794
+ "_model_module_version": "2.0.0",
795
+ "_model_name": "FloatProgressModel",
796
+ "_view_count": null,
797
+ "_view_module": "@jupyter-widgets/controls",
798
+ "_view_module_version": "2.0.0",
799
+ "_view_name": "ProgressView",
800
+ "bar_style": "success",
801
+ "description": "",
802
+ "description_allow_html": false,
803
+ "layout": "IPY_MODEL_5203ead405ad45c29aaf50056ee2ba2e",
804
+ "max": 1795303,
805
+ "min": 0,
806
+ "orientation": "horizontal",
807
+ "style": "IPY_MODEL_e3632137f852408499c5d5e9ca9b2d4b",
808
+ "tabbable": null,
809
+ "tooltip": null,
810
+ "value": 1795303
811
+ }
812
+ },
813
+ "d970719a8739466392d9538d3ab37561": {
814
+ "model_module": "@jupyter-widgets/controls",
815
+ "model_name": "HTMLModel",
816
+ "model_module_version": "2.0.0",
817
+ "state": {
818
+ "_dom_classes": [],
819
+ "_model_module": "@jupyter-widgets/controls",
820
+ "_model_module_version": "2.0.0",
821
+ "_model_name": "HTMLModel",
822
+ "_view_count": null,
823
+ "_view_module": "@jupyter-widgets/controls",
824
+ "_view_module_version": "2.0.0",
825
+ "_view_name": "HTMLView",
826
+ "description": "",
827
+ "description_allow_html": false,
828
+ "layout": "IPY_MODEL_e26fd3cb659f4d04a65706bf39e921c4",
829
+ "placeholder": "​",
830
+ "style": "IPY_MODEL_9ad3795caca1432981794a8e03877806",
831
+ "tabbable": null,
832
+ "tooltip": null,
833
+ "value": " 1.80M/1.80M [00:00<00:00, 5.50MB/s]"
834
+ }
835
+ },
836
+ "9121dcd4c9644a22a17fb230963885a9": {
837
+ "model_module": "@jupyter-widgets/base",
838
+ "model_name": "LayoutModel",
839
+ "model_module_version": "2.0.0",
840
+ "state": {
841
+ "_model_module": "@jupyter-widgets/base",
842
+ "_model_module_version": "2.0.0",
843
+ "_model_name": "LayoutModel",
844
+ "_view_count": null,
845
+ "_view_module": "@jupyter-widgets/base",
846
+ "_view_module_version": "2.0.0",
847
+ "_view_name": "LayoutView",
848
+ "align_content": null,
849
+ "align_items": null,
850
+ "align_self": null,
851
+ "border_bottom": null,
852
+ "border_left": null,
853
+ "border_right": null,
854
+ "border_top": null,
855
+ "bottom": null,
856
+ "display": null,
857
+ "flex": null,
858
+ "flex_flow": null,
859
+ "grid_area": null,
860
+ "grid_auto_columns": null,
861
+ "grid_auto_flow": null,
862
+ "grid_auto_rows": null,
863
+ "grid_column": null,
864
+ "grid_gap": null,
865
+ "grid_row": null,
866
+ "grid_template_areas": null,
867
+ "grid_template_columns": null,
868
+ "grid_template_rows": null,
869
+ "height": null,
870
+ "justify_content": null,
871
+ "justify_items": null,
872
+ "left": null,
873
+ "margin": null,
874
+ "max_height": null,
875
+ "max_width": null,
876
+ "min_height": null,
877
+ "min_width": null,
878
+ "object_fit": null,
879
+ "object_position": null,
880
+ "order": null,
881
+ "overflow": null,
882
+ "padding": null,
883
+ "right": null,
884
+ "top": null,
885
+ "visibility": null,
886
+ "width": null
887
+ }
888
+ },
889
+ "81eb6ea17da14145a727531a8f19f244": {
890
+ "model_module": "@jupyter-widgets/base",
891
+ "model_name": "LayoutModel",
892
+ "model_module_version": "2.0.0",
893
+ "state": {
894
+ "_model_module": "@jupyter-widgets/base",
895
+ "_model_module_version": "2.0.0",
896
+ "_model_name": "LayoutModel",
897
+ "_view_count": null,
898
+ "_view_module": "@jupyter-widgets/base",
899
+ "_view_module_version": "2.0.0",
900
+ "_view_name": "LayoutView",
901
+ "align_content": null,
902
+ "align_items": null,
903
+ "align_self": null,
904
+ "border_bottom": null,
905
+ "border_left": null,
906
+ "border_right": null,
907
+ "border_top": null,
908
+ "bottom": null,
909
+ "display": null,
910
+ "flex": null,
911
+ "flex_flow": null,
912
+ "grid_area": null,
913
+ "grid_auto_columns": null,
914
+ "grid_auto_flow": null,
915
+ "grid_auto_rows": null,
916
+ "grid_column": null,
917
+ "grid_gap": null,
918
+ "grid_row": null,
919
+ "grid_template_areas": null,
920
+ "grid_template_columns": null,
921
+ "grid_template_rows": null,
922
+ "height": null,
923
+ "justify_content": null,
924
+ "justify_items": null,
925
+ "left": null,
926
+ "margin": null,
927
+ "max_height": null,
928
+ "max_width": null,
929
+ "min_height": null,
930
+ "min_width": null,
931
+ "object_fit": null,
932
+ "object_position": null,
933
+ "order": null,
934
+ "overflow": null,
935
+ "padding": null,
936
+ "right": null,
937
+ "top": null,
938
+ "visibility": null,
939
+ "width": null
940
+ }
941
+ },
942
+ "1ddcfcb82fdd4743aae4c75d058b9ff7": {
943
+ "model_module": "@jupyter-widgets/controls",
944
+ "model_name": "HTMLStyleModel",
945
+ "model_module_version": "2.0.0",
946
+ "state": {
947
+ "_model_module": "@jupyter-widgets/controls",
948
+ "_model_module_version": "2.0.0",
949
+ "_model_name": "HTMLStyleModel",
950
+ "_view_count": null,
951
+ "_view_module": "@jupyter-widgets/base",
952
+ "_view_module_version": "2.0.0",
953
+ "_view_name": "StyleView",
954
+ "background": null,
955
+ "description_width": "",
956
+ "font_size": null,
957
+ "text_color": null
958
+ }
959
+ },
960
+ "5203ead405ad45c29aaf50056ee2ba2e": {
961
+ "model_module": "@jupyter-widgets/base",
962
+ "model_name": "LayoutModel",
963
+ "model_module_version": "2.0.0",
964
+ "state": {
965
+ "_model_module": "@jupyter-widgets/base",
966
+ "_model_module_version": "2.0.0",
967
+ "_model_name": "LayoutModel",
968
+ "_view_count": null,
969
+ "_view_module": "@jupyter-widgets/base",
970
+ "_view_module_version": "2.0.0",
971
+ "_view_name": "LayoutView",
972
+ "align_content": null,
973
+ "align_items": null,
974
+ "align_self": null,
975
+ "border_bottom": null,
976
+ "border_left": null,
977
+ "border_right": null,
978
+ "border_top": null,
979
+ "bottom": null,
980
+ "display": null,
981
+ "flex": null,
982
+ "flex_flow": null,
983
+ "grid_area": null,
984
+ "grid_auto_columns": null,
985
+ "grid_auto_flow": null,
986
+ "grid_auto_rows": null,
987
+ "grid_column": null,
988
+ "grid_gap": null,
989
+ "grid_row": null,
990
+ "grid_template_areas": null,
991
+ "grid_template_columns": null,
992
+ "grid_template_rows": null,
993
+ "height": null,
994
+ "justify_content": null,
995
+ "justify_items": null,
996
+ "left": null,
997
+ "margin": null,
998
+ "max_height": null,
999
+ "max_width": null,
1000
+ "min_height": null,
1001
+ "min_width": null,
1002
+ "object_fit": null,
1003
+ "object_position": null,
1004
+ "order": null,
1005
+ "overflow": null,
1006
+ "padding": null,
1007
+ "right": null,
1008
+ "top": null,
1009
+ "visibility": null,
1010
+ "width": null
1011
+ }
1012
+ },
1013
+ "e3632137f852408499c5d5e9ca9b2d4b": {
1014
+ "model_module": "@jupyter-widgets/controls",
1015
+ "model_name": "ProgressStyleModel",
1016
+ "model_module_version": "2.0.0",
1017
+ "state": {
1018
+ "_model_module": "@jupyter-widgets/controls",
1019
+ "_model_module_version": "2.0.0",
1020
+ "_model_name": "ProgressStyleModel",
1021
+ "_view_count": null,
1022
+ "_view_module": "@jupyter-widgets/base",
1023
+ "_view_module_version": "2.0.0",
1024
+ "_view_name": "StyleView",
1025
+ "bar_color": null,
1026
+ "description_width": ""
1027
+ }
1028
+ },
1029
+ "e26fd3cb659f4d04a65706bf39e921c4": {
1030
+ "model_module": "@jupyter-widgets/base",
1031
+ "model_name": "LayoutModel",
1032
+ "model_module_version": "2.0.0",
1033
+ "state": {
1034
+ "_model_module": "@jupyter-widgets/base",
1035
+ "_model_module_version": "2.0.0",
1036
+ "_model_name": "LayoutModel",
1037
+ "_view_count": null,
1038
+ "_view_module": "@jupyter-widgets/base",
1039
+ "_view_module_version": "2.0.0",
1040
+ "_view_name": "LayoutView",
1041
+ "align_content": null,
1042
+ "align_items": null,
1043
+ "align_self": null,
1044
+ "border_bottom": null,
1045
+ "border_left": null,
1046
+ "border_right": null,
1047
+ "border_top": null,
1048
+ "bottom": null,
1049
+ "display": null,
1050
+ "flex": null,
1051
+ "flex_flow": null,
1052
+ "grid_area": null,
1053
+ "grid_auto_columns": null,
1054
+ "grid_auto_flow": null,
1055
+ "grid_auto_rows": null,
1056
+ "grid_column": null,
1057
+ "grid_gap": null,
1058
+ "grid_row": null,
1059
+ "grid_template_areas": null,
1060
+ "grid_template_columns": null,
1061
+ "grid_template_rows": null,
1062
+ "height": null,
1063
+ "justify_content": null,
1064
+ "justify_items": null,
1065
+ "left": null,
1066
+ "margin": null,
1067
+ "max_height": null,
1068
+ "max_width": null,
1069
+ "min_height": null,
1070
+ "min_width": null,
1071
+ "object_fit": null,
1072
+ "object_position": null,
1073
+ "order": null,
1074
+ "overflow": null,
1075
+ "padding": null,
1076
+ "right": null,
1077
+ "top": null,
1078
+ "visibility": null,
1079
+ "width": null
1080
+ }
1081
+ },
1082
+ "9ad3795caca1432981794a8e03877806": {
1083
+ "model_module": "@jupyter-widgets/controls",
1084
+ "model_name": "HTMLStyleModel",
1085
+ "model_module_version": "2.0.0",
1086
+ "state": {
1087
+ "_model_module": "@jupyter-widgets/controls",
1088
+ "_model_module_version": "2.0.0",
1089
+ "_model_name": "HTMLStyleModel",
1090
+ "_view_count": null,
1091
+ "_view_module": "@jupyter-widgets/base",
1092
+ "_view_module_version": "2.0.0",
1093
+ "_view_name": "StyleView",
1094
+ "background": null,
1095
+ "description_width": "",
1096
+ "font_size": null,
1097
+ "text_color": null
1098
+ }
1099
+ },
1100
+ "2d421784fd6847e791f28750a60c06af": {
1101
+ "model_module": "@jupyter-widgets/controls",
1102
+ "model_name": "HBoxModel",
1103
+ "model_module_version": "2.0.0",
1104
+ "state": {
1105
+ "_dom_classes": [],
1106
+ "_model_module": "@jupyter-widgets/controls",
1107
+ "_model_module_version": "2.0.0",
1108
+ "_model_name": "HBoxModel",
1109
+ "_view_count": null,
1110
+ "_view_module": "@jupyter-widgets/controls",
1111
+ "_view_module_version": "2.0.0",
1112
+ "_view_name": "HBoxView",
1113
+ "box_style": "",
1114
+ "children": [
1115
+ "IPY_MODEL_a4f1864b89b346e588dabf93732a1429",
1116
+ "IPY_MODEL_14a2e94389a14e5ebc82aace29494b65",
1117
+ "IPY_MODEL_cb7c000530d54a83847179095bb4eb9a"
1118
+ ],
1119
+ "layout": "IPY_MODEL_b2ff5d34fe294a4484294c574ab136ff",
1120
+ "tabbable": null,
1121
+ "tooltip": null
1122
+ }
1123
+ },
1124
+ "a4f1864b89b346e588dabf93732a1429": {
1125
+ "model_module": "@jupyter-widgets/controls",
1126
+ "model_name": "HTMLModel",
1127
+ "model_module_version": "2.0.0",
1128
+ "state": {
1129
+ "_dom_classes": [],
1130
+ "_model_module": "@jupyter-widgets/controls",
1131
+ "_model_module_version": "2.0.0",
1132
+ "_model_name": "HTMLModel",
1133
+ "_view_count": null,
1134
+ "_view_module": "@jupyter-widgets/controls",
1135
+ "_view_module_version": "2.0.0",
1136
+ "_view_name": "HTMLView",
1137
+ "description": "",
1138
+ "description_allow_html": false,
1139
+ "layout": "IPY_MODEL_7ef6e4cc76af4d009818401e3c528772",
1140
+ "placeholder": "​",
1141
+ "style": "IPY_MODEL_00edc07d09fe4eb5be2ad9105c296c72",
1142
+ "tabbable": null,
1143
+ "tooltip": null,
1144
+ "value": "special_tokens_map.json: 100%"
1145
+ }
1146
+ },
1147
+ "14a2e94389a14e5ebc82aace29494b65": {
1148
+ "model_module": "@jupyter-widgets/controls",
1149
+ "model_name": "FloatProgressModel",
1150
+ "model_module_version": "2.0.0",
1151
+ "state": {
1152
+ "_dom_classes": [],
1153
+ "_model_module": "@jupyter-widgets/controls",
1154
+ "_model_module_version": "2.0.0",
1155
+ "_model_name": "FloatProgressModel",
1156
+ "_view_count": null,
1157
+ "_view_module": "@jupyter-widgets/controls",
1158
+ "_view_module_version": "2.0.0",
1159
+ "_view_name": "ProgressView",
1160
+ "bar_style": "success",
1161
+ "description": "",
1162
+ "description_allow_html": false,
1163
+ "layout": "IPY_MODEL_f8a6508c56a34f48a4e4e6ca0d8619be",
1164
+ "max": 72,
1165
+ "min": 0,
1166
+ "orientation": "horizontal",
1167
+ "style": "IPY_MODEL_26e9a7bb7e9d460c9926a3644cb688fb",
1168
+ "tabbable": null,
1169
+ "tooltip": null,
1170
+ "value": 72
1171
+ }
1172
+ },
1173
+ "cb7c000530d54a83847179095bb4eb9a": {
1174
+ "model_module": "@jupyter-widgets/controls",
1175
+ "model_name": "HTMLModel",
1176
+ "model_module_version": "2.0.0",
1177
+ "state": {
1178
+ "_dom_classes": [],
1179
+ "_model_module": "@jupyter-widgets/controls",
1180
+ "_model_module_version": "2.0.0",
1181
+ "_model_name": "HTMLModel",
1182
+ "_view_count": null,
1183
+ "_view_module": "@jupyter-widgets/controls",
1184
+ "_view_module_version": "2.0.0",
1185
+ "_view_name": "HTMLView",
1186
+ "description": "",
1187
+ "description_allow_html": false,
1188
+ "layout": "IPY_MODEL_ff8460cb68ac40bf81ca4db8e12bc1b5",
1189
+ "placeholder": "​",
1190
+ "style": "IPY_MODEL_425255b2692c4ce8a28bf1a28c36e84b",
1191
+ "tabbable": null,
1192
+ "tooltip": null,
1193
+ "value": " 72.0/72.0 [00:00<00:00, 2.90kB/s]"
1194
+ }
1195
+ },
1196
+ "b2ff5d34fe294a4484294c574ab136ff": {
1197
+ "model_module": "@jupyter-widgets/base",
1198
+ "model_name": "LayoutModel",
1199
+ "model_module_version": "2.0.0",
1200
+ "state": {
1201
+ "_model_module": "@jupyter-widgets/base",
1202
+ "_model_module_version": "2.0.0",
1203
+ "_model_name": "LayoutModel",
1204
+ "_view_count": null,
1205
+ "_view_module": "@jupyter-widgets/base",
1206
+ "_view_module_version": "2.0.0",
1207
+ "_view_name": "LayoutView",
1208
+ "align_content": null,
1209
+ "align_items": null,
1210
+ "align_self": null,
1211
+ "border_bottom": null,
1212
+ "border_left": null,
1213
+ "border_right": null,
1214
+ "border_top": null,
1215
+ "bottom": null,
1216
+ "display": null,
1217
+ "flex": null,
1218
+ "flex_flow": null,
1219
+ "grid_area": null,
1220
+ "grid_auto_columns": null,
1221
+ "grid_auto_flow": null,
1222
+ "grid_auto_rows": null,
1223
+ "grid_column": null,
1224
+ "grid_gap": null,
1225
+ "grid_row": null,
1226
+ "grid_template_areas": null,
1227
+ "grid_template_columns": null,
1228
+ "grid_template_rows": null,
1229
+ "height": null,
1230
+ "justify_content": null,
1231
+ "justify_items": null,
1232
+ "left": null,
1233
+ "margin": null,
1234
+ "max_height": null,
1235
+ "max_width": null,
1236
+ "min_height": null,
1237
+ "min_width": null,
1238
+ "object_fit": null,
1239
+ "object_position": null,
1240
+ "order": null,
1241
+ "overflow": null,
1242
+ "padding": null,
1243
+ "right": null,
1244
+ "top": null,
1245
+ "visibility": null,
1246
+ "width": null
1247
+ }
1248
+ },
1249
+ "7ef6e4cc76af4d009818401e3c528772": {
1250
+ "model_module": "@jupyter-widgets/base",
1251
+ "model_name": "LayoutModel",
1252
+ "model_module_version": "2.0.0",
1253
+ "state": {
1254
+ "_model_module": "@jupyter-widgets/base",
1255
+ "_model_module_version": "2.0.0",
1256
+ "_model_name": "LayoutModel",
1257
+ "_view_count": null,
1258
+ "_view_module": "@jupyter-widgets/base",
1259
+ "_view_module_version": "2.0.0",
1260
+ "_view_name": "LayoutView",
1261
+ "align_content": null,
1262
+ "align_items": null,
1263
+ "align_self": null,
1264
+ "border_bottom": null,
1265
+ "border_left": null,
1266
+ "border_right": null,
1267
+ "border_top": null,
1268
+ "bottom": null,
1269
+ "display": null,
1270
+ "flex": null,
1271
+ "flex_flow": null,
1272
+ "grid_area": null,
1273
+ "grid_auto_columns": null,
1274
+ "grid_auto_flow": null,
1275
+ "grid_auto_rows": null,
1276
+ "grid_column": null,
1277
+ "grid_gap": null,
1278
+ "grid_row": null,
1279
+ "grid_template_areas": null,
1280
+ "grid_template_columns": null,
1281
+ "grid_template_rows": null,
1282
+ "height": null,
1283
+ "justify_content": null,
1284
+ "justify_items": null,
1285
+ "left": null,
1286
+ "margin": null,
1287
+ "max_height": null,
1288
+ "max_width": null,
1289
+ "min_height": null,
1290
+ "min_width": null,
1291
+ "object_fit": null,
1292
+ "object_position": null,
1293
+ "order": null,
1294
+ "overflow": null,
1295
+ "padding": null,
1296
+ "right": null,
1297
+ "top": null,
1298
+ "visibility": null,
1299
+ "width": null
1300
+ }
1301
+ },
1302
+ "00edc07d09fe4eb5be2ad9105c296c72": {
1303
+ "model_module": "@jupyter-widgets/controls",
1304
+ "model_name": "HTMLStyleModel",
1305
+ "model_module_version": "2.0.0",
1306
+ "state": {
1307
+ "_model_module": "@jupyter-widgets/controls",
1308
+ "_model_module_version": "2.0.0",
1309
+ "_model_name": "HTMLStyleModel",
1310
+ "_view_count": null,
1311
+ "_view_module": "@jupyter-widgets/base",
1312
+ "_view_module_version": "2.0.0",
1313
+ "_view_name": "StyleView",
1314
+ "background": null,
1315
+ "description_width": "",
1316
+ "font_size": null,
1317
+ "text_color": null
1318
+ }
1319
+ },
1320
+ "f8a6508c56a34f48a4e4e6ca0d8619be": {
1321
+ "model_module": "@jupyter-widgets/base",
1322
+ "model_name": "LayoutModel",
1323
+ "model_module_version": "2.0.0",
1324
+ "state": {
1325
+ "_model_module": "@jupyter-widgets/base",
1326
+ "_model_module_version": "2.0.0",
1327
+ "_model_name": "LayoutModel",
1328
+ "_view_count": null,
1329
+ "_view_module": "@jupyter-widgets/base",
1330
+ "_view_module_version": "2.0.0",
1331
+ "_view_name": "LayoutView",
1332
+ "align_content": null,
1333
+ "align_items": null,
1334
+ "align_self": null,
1335
+ "border_bottom": null,
1336
+ "border_left": null,
1337
+ "border_right": null,
1338
+ "border_top": null,
1339
+ "bottom": null,
1340
+ "display": null,
1341
+ "flex": null,
1342
+ "flex_flow": null,
1343
+ "grid_area": null,
1344
+ "grid_auto_columns": null,
1345
+ "grid_auto_flow": null,
1346
+ "grid_auto_rows": null,
1347
+ "grid_column": null,
1348
+ "grid_gap": null,
1349
+ "grid_row": null,
1350
+ "grid_template_areas": null,
1351
+ "grid_template_columns": null,
1352
+ "grid_template_rows": null,
1353
+ "height": null,
1354
+ "justify_content": null,
1355
+ "justify_items": null,
1356
+ "left": null,
1357
+ "margin": null,
1358
+ "max_height": null,
1359
+ "max_width": null,
1360
+ "min_height": null,
1361
+ "min_width": null,
1362
+ "object_fit": null,
1363
+ "object_position": null,
1364
+ "order": null,
1365
+ "overflow": null,
1366
+ "padding": null,
1367
+ "right": null,
1368
+ "top": null,
1369
+ "visibility": null,
1370
+ "width": null
1371
+ }
1372
+ },
1373
+ "26e9a7bb7e9d460c9926a3644cb688fb": {
1374
+ "model_module": "@jupyter-widgets/controls",
1375
+ "model_name": "ProgressStyleModel",
1376
+ "model_module_version": "2.0.0",
1377
+ "state": {
1378
+ "_model_module": "@jupyter-widgets/controls",
1379
+ "_model_module_version": "2.0.0",
1380
+ "_model_name": "ProgressStyleModel",
1381
+ "_view_count": null,
1382
+ "_view_module": "@jupyter-widgets/base",
1383
+ "_view_module_version": "2.0.0",
1384
+ "_view_name": "StyleView",
1385
+ "bar_color": null,
1386
+ "description_width": ""
1387
+ }
1388
+ },
1389
+ "ff8460cb68ac40bf81ca4db8e12bc1b5": {
1390
+ "model_module": "@jupyter-widgets/base",
1391
+ "model_name": "LayoutModel",
1392
+ "model_module_version": "2.0.0",
1393
+ "state": {
1394
+ "_model_module": "@jupyter-widgets/base",
1395
+ "_model_module_version": "2.0.0",
1396
+ "_model_name": "LayoutModel",
1397
+ "_view_count": null,
1398
+ "_view_module": "@jupyter-widgets/base",
1399
+ "_view_module_version": "2.0.0",
1400
+ "_view_name": "LayoutView",
1401
+ "align_content": null,
1402
+ "align_items": null,
1403
+ "align_self": null,
1404
+ "border_bottom": null,
1405
+ "border_left": null,
1406
+ "border_right": null,
1407
+ "border_top": null,
1408
+ "bottom": null,
1409
+ "display": null,
1410
+ "flex": null,
1411
+ "flex_flow": null,
1412
+ "grid_area": null,
1413
+ "grid_auto_columns": null,
1414
+ "grid_auto_flow": null,
1415
+ "grid_auto_rows": null,
1416
+ "grid_column": null,
1417
+ "grid_gap": null,
1418
+ "grid_row": null,
1419
+ "grid_template_areas": null,
1420
+ "grid_template_columns": null,
1421
+ "grid_template_rows": null,
1422
+ "height": null,
1423
+ "justify_content": null,
1424
+ "justify_items": null,
1425
+ "left": null,
1426
+ "margin": null,
1427
+ "max_height": null,
1428
+ "max_width": null,
1429
+ "min_height": null,
1430
+ "min_width": null,
1431
+ "object_fit": null,
1432
+ "object_position": null,
1433
+ "order": null,
1434
+ "overflow": null,
1435
+ "padding": null,
1436
+ "right": null,
1437
+ "top": null,
1438
+ "visibility": null,
1439
+ "width": null
1440
+ }
1441
+ },
1442
+ "425255b2692c4ce8a28bf1a28c36e84b": {
1443
+ "model_module": "@jupyter-widgets/controls",
1444
+ "model_name": "HTMLStyleModel",
1445
+ "model_module_version": "2.0.0",
1446
+ "state": {
1447
+ "_model_module": "@jupyter-widgets/controls",
1448
+ "_model_module_version": "2.0.0",
1449
+ "_model_name": "HTMLStyleModel",
1450
+ "_view_count": null,
1451
+ "_view_module": "@jupyter-widgets/base",
1452
+ "_view_module_version": "2.0.0",
1453
+ "_view_name": "StyleView",
1454
+ "background": null,
1455
+ "description_width": "",
1456
+ "font_size": null,
1457
+ "text_color": null
1458
+ }
1459
+ },
1460
+ "cc1e38e7d8814a3ab79b09b32e6f1900": {
1461
+ "model_module": "@jupyter-widgets/controls",
1462
+ "model_name": "HBoxModel",
1463
+ "model_module_version": "2.0.0",
1464
+ "state": {
1465
+ "_dom_classes": [],
1466
+ "_model_module": "@jupyter-widgets/controls",
1467
+ "_model_module_version": "2.0.0",
1468
+ "_model_name": "HBoxModel",
1469
+ "_view_count": null,
1470
+ "_view_module": "@jupyter-widgets/controls",
1471
+ "_view_module_version": "2.0.0",
1472
+ "_view_name": "HBoxView",
1473
+ "box_style": "",
1474
+ "children": [
1475
+ "IPY_MODEL_dbeac25369854887a3e23d56e7608d34",
1476
+ "IPY_MODEL_33495679fe504a7f89021814b8379264",
1477
+ "IPY_MODEL_a66eace1cf0c4c529a34567935d9d7de"
1478
+ ],
1479
+ "layout": "IPY_MODEL_eec262d909b049aca06661df39777912",
1480
+ "tabbable": null,
1481
+ "tooltip": null
1482
+ }
1483
+ },
1484
+ "dbeac25369854887a3e23d56e7608d34": {
1485
+ "model_module": "@jupyter-widgets/controls",
1486
+ "model_name": "HTMLModel",
1487
+ "model_module_version": "2.0.0",
1488
+ "state": {
1489
+ "_dom_classes": [],
1490
+ "_model_module": "@jupyter-widgets/controls",
1491
+ "_model_module_version": "2.0.0",
1492
+ "_model_name": "HTMLModel",
1493
+ "_view_count": null,
1494
+ "_view_module": "@jupyter-widgets/controls",
1495
+ "_view_module_version": "2.0.0",
1496
+ "_view_name": "HTMLView",
1497
+ "description": "",
1498
+ "description_allow_html": false,
1499
+ "layout": "IPY_MODEL_1441df785c634d5fb604174c56ce6951",
1500
+ "placeholder": "​",
1501
+ "style": "IPY_MODEL_e61935e1917442b3b5878917c882c7c1",
1502
+ "tabbable": null,
1503
+ "tooltip": null,
1504
+ "value": "Map: 100%"
1505
+ }
1506
+ },
1507
+ "33495679fe504a7f89021814b8379264": {
1508
+ "model_module": "@jupyter-widgets/controls",
1509
+ "model_name": "FloatProgressModel",
1510
+ "model_module_version": "2.0.0",
1511
+ "state": {
1512
+ "_dom_classes": [],
1513
+ "_model_module": "@jupyter-widgets/controls",
1514
+ "_model_module_version": "2.0.0",
1515
+ "_model_name": "FloatProgressModel",
1516
+ "_view_count": null,
1517
+ "_view_module": "@jupyter-widgets/controls",
1518
+ "_view_module_version": "2.0.0",
1519
+ "_view_name": "ProgressView",
1520
+ "bar_style": "success",
1521
+ "description": "",
1522
+ "description_allow_html": false,
1523
+ "layout": "IPY_MODEL_10a3e841bc6f42e5ab6e96fdec6800e9",
1524
+ "max": 530,
1525
+ "min": 0,
1526
+ "orientation": "horizontal",
1527
+ "style": "IPY_MODEL_679734612bbc46d1a94ad8944d7158d1",
1528
+ "tabbable": null,
1529
+ "tooltip": null,
1530
+ "value": 530
1531
+ }
1532
+ },
1533
+ "a66eace1cf0c4c529a34567935d9d7de": {
1534
+ "model_module": "@jupyter-widgets/controls",
1535
+ "model_name": "HTMLModel",
1536
+ "model_module_version": "2.0.0",
1537
+ "state": {
1538
+ "_dom_classes": [],
1539
+ "_model_module": "@jupyter-widgets/controls",
1540
+ "_model_module_version": "2.0.0",
1541
+ "_model_name": "HTMLModel",
1542
+ "_view_count": null,
1543
+ "_view_module": "@jupyter-widgets/controls",
1544
+ "_view_module_version": "2.0.0",
1545
+ "_view_name": "HTMLView",
1546
+ "description": "",
1547
+ "description_allow_html": false,
1548
+ "layout": "IPY_MODEL_a9b4775a524b45af992076e1d0b900ea",
1549
+ "placeholder": "​",
1550
+ "style": "IPY_MODEL_ff3a2b61b32d476199c51c6936e2ce02",
1551
+ "tabbable": null,
1552
+ "tooltip": null,
1553
+ "value": " 530/530 [00:00<00:00, 1716.65 examples/s]"
1554
+ }
1555
+ },
1556
+ "eec262d909b049aca06661df39777912": {
1557
+ "model_module": "@jupyter-widgets/base",
1558
+ "model_name": "LayoutModel",
1559
+ "model_module_version": "2.0.0",
1560
+ "state": {
1561
+ "_model_module": "@jupyter-widgets/base",
1562
+ "_model_module_version": "2.0.0",
1563
+ "_model_name": "LayoutModel",
1564
+ "_view_count": null,
1565
+ "_view_module": "@jupyter-widgets/base",
1566
+ "_view_module_version": "2.0.0",
1567
+ "_view_name": "LayoutView",
1568
+ "align_content": null,
1569
+ "align_items": null,
1570
+ "align_self": null,
1571
+ "border_bottom": null,
1572
+ "border_left": null,
1573
+ "border_right": null,
1574
+ "border_top": null,
1575
+ "bottom": null,
1576
+ "display": null,
1577
+ "flex": null,
1578
+ "flex_flow": null,
1579
+ "grid_area": null,
1580
+ "grid_auto_columns": null,
1581
+ "grid_auto_flow": null,
1582
+ "grid_auto_rows": null,
1583
+ "grid_column": null,
1584
+ "grid_gap": null,
1585
+ "grid_row": null,
1586
+ "grid_template_areas": null,
1587
+ "grid_template_columns": null,
1588
+ "grid_template_rows": null,
1589
+ "height": null,
1590
+ "justify_content": null,
1591
+ "justify_items": null,
1592
+ "left": null,
1593
+ "margin": null,
1594
+ "max_height": null,
1595
+ "max_width": null,
1596
+ "min_height": null,
1597
+ "min_width": null,
1598
+ "object_fit": null,
1599
+ "object_position": null,
1600
+ "order": null,
1601
+ "overflow": null,
1602
+ "padding": null,
1603
+ "right": null,
1604
+ "top": null,
1605
+ "visibility": null,
1606
+ "width": null
1607
+ }
1608
+ },
1609
+ "1441df785c634d5fb604174c56ce6951": {
1610
+ "model_module": "@jupyter-widgets/base",
1611
+ "model_name": "LayoutModel",
1612
+ "model_module_version": "2.0.0",
1613
+ "state": {
1614
+ "_model_module": "@jupyter-widgets/base",
1615
+ "_model_module_version": "2.0.0",
1616
+ "_model_name": "LayoutModel",
1617
+ "_view_count": null,
1618
+ "_view_module": "@jupyter-widgets/base",
1619
+ "_view_module_version": "2.0.0",
1620
+ "_view_name": "LayoutView",
1621
+ "align_content": null,
1622
+ "align_items": null,
1623
+ "align_self": null,
1624
+ "border_bottom": null,
1625
+ "border_left": null,
1626
+ "border_right": null,
1627
+ "border_top": null,
1628
+ "bottom": null,
1629
+ "display": null,
1630
+ "flex": null,
1631
+ "flex_flow": null,
1632
+ "grid_area": null,
1633
+ "grid_auto_columns": null,
1634
+ "grid_auto_flow": null,
1635
+ "grid_auto_rows": null,
1636
+ "grid_column": null,
1637
+ "grid_gap": null,
1638
+ "grid_row": null,
1639
+ "grid_template_areas": null,
1640
+ "grid_template_columns": null,
1641
+ "grid_template_rows": null,
1642
+ "height": null,
1643
+ "justify_content": null,
1644
+ "justify_items": null,
1645
+ "left": null,
1646
+ "margin": null,
1647
+ "max_height": null,
1648
+ "max_width": null,
1649
+ "min_height": null,
1650
+ "min_width": null,
1651
+ "object_fit": null,
1652
+ "object_position": null,
1653
+ "order": null,
1654
+ "overflow": null,
1655
+ "padding": null,
1656
+ "right": null,
1657
+ "top": null,
1658
+ "visibility": null,
1659
+ "width": null
1660
+ }
1661
+ },
1662
+ "e61935e1917442b3b5878917c882c7c1": {
1663
+ "model_module": "@jupyter-widgets/controls",
1664
+ "model_name": "HTMLStyleModel",
1665
+ "model_module_version": "2.0.0",
1666
+ "state": {
1667
+ "_model_module": "@jupyter-widgets/controls",
1668
+ "_model_module_version": "2.0.0",
1669
+ "_model_name": "HTMLStyleModel",
1670
+ "_view_count": null,
1671
+ "_view_module": "@jupyter-widgets/base",
1672
+ "_view_module_version": "2.0.0",
1673
+ "_view_name": "StyleView",
1674
+ "background": null,
1675
+ "description_width": "",
1676
+ "font_size": null,
1677
+ "text_color": null
1678
+ }
1679
+ },
1680
+ "10a3e841bc6f42e5ab6e96fdec6800e9": {
1681
+ "model_module": "@jupyter-widgets/base",
1682
+ "model_name": "LayoutModel",
1683
+ "model_module_version": "2.0.0",
1684
+ "state": {
1685
+ "_model_module": "@jupyter-widgets/base",
1686
+ "_model_module_version": "2.0.0",
1687
+ "_model_name": "LayoutModel",
1688
+ "_view_count": null,
1689
+ "_view_module": "@jupyter-widgets/base",
1690
+ "_view_module_version": "2.0.0",
1691
+ "_view_name": "LayoutView",
1692
+ "align_content": null,
1693
+ "align_items": null,
1694
+ "align_self": null,
1695
+ "border_bottom": null,
1696
+ "border_left": null,
1697
+ "border_right": null,
1698
+ "border_top": null,
1699
+ "bottom": null,
1700
+ "display": null,
1701
+ "flex": null,
1702
+ "flex_flow": null,
1703
+ "grid_area": null,
1704
+ "grid_auto_columns": null,
1705
+ "grid_auto_flow": null,
1706
+ "grid_auto_rows": null,
1707
+ "grid_column": null,
1708
+ "grid_gap": null,
1709
+ "grid_row": null,
1710
+ "grid_template_areas": null,
1711
+ "grid_template_columns": null,
1712
+ "grid_template_rows": null,
1713
+ "height": null,
1714
+ "justify_content": null,
1715
+ "justify_items": null,
1716
+ "left": null,
1717
+ "margin": null,
1718
+ "max_height": null,
1719
+ "max_width": null,
1720
+ "min_height": null,
1721
+ "min_width": null,
1722
+ "object_fit": null,
1723
+ "object_position": null,
1724
+ "order": null,
1725
+ "overflow": null,
1726
+ "padding": null,
1727
+ "right": null,
1728
+ "top": null,
1729
+ "visibility": null,
1730
+ "width": null
1731
+ }
1732
+ },
1733
+ "679734612bbc46d1a94ad8944d7158d1": {
1734
+ "model_module": "@jupyter-widgets/controls",
1735
+ "model_name": "ProgressStyleModel",
1736
+ "model_module_version": "2.0.0",
1737
+ "state": {
1738
+ "_model_module": "@jupyter-widgets/controls",
1739
+ "_model_module_version": "2.0.0",
1740
+ "_model_name": "ProgressStyleModel",
1741
+ "_view_count": null,
1742
+ "_view_module": "@jupyter-widgets/base",
1743
+ "_view_module_version": "2.0.0",
1744
+ "_view_name": "StyleView",
1745
+ "bar_color": null,
1746
+ "description_width": ""
1747
+ }
1748
+ },
1749
+ "a9b4775a524b45af992076e1d0b900ea": {
1750
+ "model_module": "@jupyter-widgets/base",
1751
+ "model_name": "LayoutModel",
1752
+ "model_module_version": "2.0.0",
1753
+ "state": {
1754
+ "_model_module": "@jupyter-widgets/base",
1755
+ "_model_module_version": "2.0.0",
1756
+ "_model_name": "LayoutModel",
1757
+ "_view_count": null,
1758
+ "_view_module": "@jupyter-widgets/base",
1759
+ "_view_module_version": "2.0.0",
1760
+ "_view_name": "LayoutView",
1761
+ "align_content": null,
1762
+ "align_items": null,
1763
+ "align_self": null,
1764
+ "border_bottom": null,
1765
+ "border_left": null,
1766
+ "border_right": null,
1767
+ "border_top": null,
1768
+ "bottom": null,
1769
+ "display": null,
1770
+ "flex": null,
1771
+ "flex_flow": null,
1772
+ "grid_area": null,
1773
+ "grid_auto_columns": null,
1774
+ "grid_auto_flow": null,
1775
+ "grid_auto_rows": null,
1776
+ "grid_column": null,
1777
+ "grid_gap": null,
1778
+ "grid_row": null,
1779
+ "grid_template_areas": null,
1780
+ "grid_template_columns": null,
1781
+ "grid_template_rows": null,
1782
+ "height": null,
1783
+ "justify_content": null,
1784
+ "justify_items": null,
1785
+ "left": null,
1786
+ "margin": null,
1787
+ "max_height": null,
1788
+ "max_width": null,
1789
+ "min_height": null,
1790
+ "min_width": null,
1791
+ "object_fit": null,
1792
+ "object_position": null,
1793
+ "order": null,
1794
+ "overflow": null,
1795
+ "padding": null,
1796
+ "right": null,
1797
+ "top": null,
1798
+ "visibility": null,
1799
+ "width": null
1800
+ }
1801
+ },
1802
+ "ff3a2b61b32d476199c51c6936e2ce02": {
1803
+ "model_module": "@jupyter-widgets/controls",
1804
+ "model_name": "HTMLStyleModel",
1805
+ "model_module_version": "2.0.0",
1806
+ "state": {
1807
+ "_model_module": "@jupyter-widgets/controls",
1808
+ "_model_module_version": "2.0.0",
1809
+ "_model_name": "HTMLStyleModel",
1810
+ "_view_count": null,
1811
+ "_view_module": "@jupyter-widgets/base",
1812
+ "_view_module_version": "2.0.0",
1813
+ "_view_name": "StyleView",
1814
+ "background": null,
1815
+ "description_width": "",
1816
+ "font_size": null,
1817
+ "text_color": null
1818
+ }
1819
+ },
1820
+ "f64ba4bfafb047ca9cc98360df2e2c72": {
1821
+ "model_module": "@jupyter-widgets/controls",
1822
+ "model_name": "HBoxModel",
1823
+ "model_module_version": "2.0.0",
1824
+ "state": {
1825
+ "_dom_classes": [],
1826
+ "_model_module": "@jupyter-widgets/controls",
1827
+ "_model_module_version": "2.0.0",
1828
+ "_model_name": "HBoxModel",
1829
+ "_view_count": null,
1830
+ "_view_module": "@jupyter-widgets/controls",
1831
+ "_view_module_version": "2.0.0",
1832
+ "_view_name": "HBoxView",
1833
+ "box_style": "",
1834
+ "children": [
1835
+ "IPY_MODEL_42f9eff4fd8f42189aaad15a5728b1ff",
1836
+ "IPY_MODEL_f76e9a8b6da54b2dbe200f92daee05c6",
1837
+ "IPY_MODEL_ad11417520a44087b92aea02ac8b955f"
1838
+ ],
1839
+ "layout": "IPY_MODEL_7eb889ef96a44070b5a0d3cfa2ebce04",
1840
+ "tabbable": null,
1841
+ "tooltip": null
1842
+ }
1843
+ },
1844
+ "42f9eff4fd8f42189aaad15a5728b1ff": {
1845
+ "model_module": "@jupyter-widgets/controls",
1846
+ "model_name": "HTMLModel",
1847
+ "model_module_version": "2.0.0",
1848
+ "state": {
1849
+ "_dom_classes": [],
1850
+ "_model_module": "@jupyter-widgets/controls",
1851
+ "_model_module_version": "2.0.0",
1852
+ "_model_name": "HTMLModel",
1853
+ "_view_count": null,
1854
+ "_view_module": "@jupyter-widgets/controls",
1855
+ "_view_module_version": "2.0.0",
1856
+ "_view_name": "HTMLView",
1857
+ "description": "",
1858
+ "description_allow_html": false,
1859
+ "layout": "IPY_MODEL_2d4d12adb1b8445ebcc356b01b4dbfe0",
1860
+ "placeholder": "​",
1861
+ "style": "IPY_MODEL_21845f9ca1734e0cb81ee8a043298be9",
1862
+ "tabbable": null,
1863
+ "tooltip": null,
1864
+ "value": "Map: 100%"
1865
+ }
1866
+ },
1867
+ "f76e9a8b6da54b2dbe200f92daee05c6": {
1868
+ "model_module": "@jupyter-widgets/controls",
1869
+ "model_name": "FloatProgressModel",
1870
+ "model_module_version": "2.0.0",
1871
+ "state": {
1872
+ "_dom_classes": [],
1873
+ "_model_module": "@jupyter-widgets/controls",
1874
+ "_model_module_version": "2.0.0",
1875
+ "_model_name": "FloatProgressModel",
1876
+ "_view_count": null,
1877
+ "_view_module": "@jupyter-widgets/controls",
1878
+ "_view_module_version": "2.0.0",
1879
+ "_view_name": "ProgressView",
1880
+ "bar_style": "success",
1881
+ "description": "",
1882
+ "description_allow_html": false,
1883
+ "layout": "IPY_MODEL_eb4120bd86e2436584d13816072cedbf",
1884
+ "max": 578,
1885
+ "min": 0,
1886
+ "orientation": "horizontal",
1887
+ "style": "IPY_MODEL_129d1146903747dc8f5fd8573e378201",
1888
+ "tabbable": null,
1889
+ "tooltip": null,
1890
+ "value": 578
1891
+ }
1892
+ },
1893
+ "ad11417520a44087b92aea02ac8b955f": {
1894
+ "model_module": "@jupyter-widgets/controls",
1895
+ "model_name": "HTMLModel",
1896
+ "model_module_version": "2.0.0",
1897
+ "state": {
1898
+ "_dom_classes": [],
1899
+ "_model_module": "@jupyter-widgets/controls",
1900
+ "_model_module_version": "2.0.0",
1901
+ "_model_name": "HTMLModel",
1902
+ "_view_count": null,
1903
+ "_view_module": "@jupyter-widgets/controls",
1904
+ "_view_module_version": "2.0.0",
1905
+ "_view_name": "HTMLView",
1906
+ "description": "",
1907
+ "description_allow_html": false,
1908
+ "layout": "IPY_MODEL_c40c3f646e484aa3b82c4393a494c391",
1909
+ "placeholder": "​",
1910
+ "style": "IPY_MODEL_b9aa275928644a1bb7c844b50378c260",
1911
+ "tabbable": null,
1912
+ "tooltip": null,
1913
+ "value": " 578/578 [00:00<00:00, 3001.01 examples/s]"
1914
+ }
1915
+ },
1916
+ "7eb889ef96a44070b5a0d3cfa2ebce04": {
1917
+ "model_module": "@jupyter-widgets/base",
1918
+ "model_name": "LayoutModel",
1919
+ "model_module_version": "2.0.0",
1920
+ "state": {
1921
+ "_model_module": "@jupyter-widgets/base",
1922
+ "_model_module_version": "2.0.0",
1923
+ "_model_name": "LayoutModel",
1924
+ "_view_count": null,
1925
+ "_view_module": "@jupyter-widgets/base",
1926
+ "_view_module_version": "2.0.0",
1927
+ "_view_name": "LayoutView",
1928
+ "align_content": null,
1929
+ "align_items": null,
1930
+ "align_self": null,
1931
+ "border_bottom": null,
1932
+ "border_left": null,
1933
+ "border_right": null,
1934
+ "border_top": null,
1935
+ "bottom": null,
1936
+ "display": null,
1937
+ "flex": null,
1938
+ "flex_flow": null,
1939
+ "grid_area": null,
1940
+ "grid_auto_columns": null,
1941
+ "grid_auto_flow": null,
1942
+ "grid_auto_rows": null,
1943
+ "grid_column": null,
1944
+ "grid_gap": null,
1945
+ "grid_row": null,
1946
+ "grid_template_areas": null,
1947
+ "grid_template_columns": null,
1948
+ "grid_template_rows": null,
1949
+ "height": null,
1950
+ "justify_content": null,
1951
+ "justify_items": null,
1952
+ "left": null,
1953
+ "margin": null,
1954
+ "max_height": null,
1955
+ "max_width": null,
1956
+ "min_height": null,
1957
+ "min_width": null,
1958
+ "object_fit": null,
1959
+ "object_position": null,
1960
+ "order": null,
1961
+ "overflow": null,
1962
+ "padding": null,
1963
+ "right": null,
1964
+ "top": null,
1965
+ "visibility": null,
1966
+ "width": null
1967
+ }
1968
+ },
1969
+ "2d4d12adb1b8445ebcc356b01b4dbfe0": {
1970
+ "model_module": "@jupyter-widgets/base",
1971
+ "model_name": "LayoutModel",
1972
+ "model_module_version": "2.0.0",
1973
+ "state": {
1974
+ "_model_module": "@jupyter-widgets/base",
1975
+ "_model_module_version": "2.0.0",
1976
+ "_model_name": "LayoutModel",
1977
+ "_view_count": null,
1978
+ "_view_module": "@jupyter-widgets/base",
1979
+ "_view_module_version": "2.0.0",
1980
+ "_view_name": "LayoutView",
1981
+ "align_content": null,
1982
+ "align_items": null,
1983
+ "align_self": null,
1984
+ "border_bottom": null,
1985
+ "border_left": null,
1986
+ "border_right": null,
1987
+ "border_top": null,
1988
+ "bottom": null,
1989
+ "display": null,
1990
+ "flex": null,
1991
+ "flex_flow": null,
1992
+ "grid_area": null,
1993
+ "grid_auto_columns": null,
1994
+ "grid_auto_flow": null,
1995
+ "grid_auto_rows": null,
1996
+ "grid_column": null,
1997
+ "grid_gap": null,
1998
+ "grid_row": null,
1999
+ "grid_template_areas": null,
2000
+ "grid_template_columns": null,
2001
+ "grid_template_rows": null,
2002
+ "height": null,
2003
+ "justify_content": null,
2004
+ "justify_items": null,
2005
+ "left": null,
2006
+ "margin": null,
2007
+ "max_height": null,
2008
+ "max_width": null,
2009
+ "min_height": null,
2010
+ "min_width": null,
2011
+ "object_fit": null,
2012
+ "object_position": null,
2013
+ "order": null,
2014
+ "overflow": null,
2015
+ "padding": null,
2016
+ "right": null,
2017
+ "top": null,
2018
+ "visibility": null,
2019
+ "width": null
2020
+ }
2021
+ },
2022
+ "21845f9ca1734e0cb81ee8a043298be9": {
2023
+ "model_module": "@jupyter-widgets/controls",
2024
+ "model_name": "HTMLStyleModel",
2025
+ "model_module_version": "2.0.0",
2026
+ "state": {
2027
+ "_model_module": "@jupyter-widgets/controls",
2028
+ "_model_module_version": "2.0.0",
2029
+ "_model_name": "HTMLStyleModel",
2030
+ "_view_count": null,
2031
+ "_view_module": "@jupyter-widgets/base",
2032
+ "_view_module_version": "2.0.0",
2033
+ "_view_name": "StyleView",
2034
+ "background": null,
2035
+ "description_width": "",
2036
+ "font_size": null,
2037
+ "text_color": null
2038
+ }
2039
+ },
2040
+ "eb4120bd86e2436584d13816072cedbf": {
2041
+ "model_module": "@jupyter-widgets/base",
2042
+ "model_name": "LayoutModel",
2043
+ "model_module_version": "2.0.0",
2044
+ "state": {
2045
+ "_model_module": "@jupyter-widgets/base",
2046
+ "_model_module_version": "2.0.0",
2047
+ "_model_name": "LayoutModel",
2048
+ "_view_count": null,
2049
+ "_view_module": "@jupyter-widgets/base",
2050
+ "_view_module_version": "2.0.0",
2051
+ "_view_name": "LayoutView",
2052
+ "align_content": null,
2053
+ "align_items": null,
2054
+ "align_self": null,
2055
+ "border_bottom": null,
2056
+ "border_left": null,
2057
+ "border_right": null,
2058
+ "border_top": null,
2059
+ "bottom": null,
2060
+ "display": null,
2061
+ "flex": null,
2062
+ "flex_flow": null,
2063
+ "grid_area": null,
2064
+ "grid_auto_columns": null,
2065
+ "grid_auto_flow": null,
2066
+ "grid_auto_rows": null,
2067
+ "grid_column": null,
2068
+ "grid_gap": null,
2069
+ "grid_row": null,
2070
+ "grid_template_areas": null,
2071
+ "grid_template_columns": null,
2072
+ "grid_template_rows": null,
2073
+ "height": null,
2074
+ "justify_content": null,
2075
+ "justify_items": null,
2076
+ "left": null,
2077
+ "margin": null,
2078
+ "max_height": null,
2079
+ "max_width": null,
2080
+ "min_height": null,
2081
+ "min_width": null,
2082
+ "object_fit": null,
2083
+ "object_position": null,
2084
+ "order": null,
2085
+ "overflow": null,
2086
+ "padding": null,
2087
+ "right": null,
2088
+ "top": null,
2089
+ "visibility": null,
2090
+ "width": null
2091
+ }
2092
+ },
2093
+ "129d1146903747dc8f5fd8573e378201": {
2094
+ "model_module": "@jupyter-widgets/controls",
2095
+ "model_name": "ProgressStyleModel",
2096
+ "model_module_version": "2.0.0",
2097
+ "state": {
2098
+ "_model_module": "@jupyter-widgets/controls",
2099
+ "_model_module_version": "2.0.0",
2100
+ "_model_name": "ProgressStyleModel",
2101
+ "_view_count": null,
2102
+ "_view_module": "@jupyter-widgets/base",
2103
+ "_view_module_version": "2.0.0",
2104
+ "_view_name": "StyleView",
2105
+ "bar_color": null,
2106
+ "description_width": ""
2107
+ }
2108
+ },
2109
+ "c40c3f646e484aa3b82c4393a494c391": {
2110
+ "model_module": "@jupyter-widgets/base",
2111
+ "model_name": "LayoutModel",
2112
+ "model_module_version": "2.0.0",
2113
+ "state": {
2114
+ "_model_module": "@jupyter-widgets/base",
2115
+ "_model_module_version": "2.0.0",
2116
+ "_model_name": "LayoutModel",
2117
+ "_view_count": null,
2118
+ "_view_module": "@jupyter-widgets/base",
2119
+ "_view_module_version": "2.0.0",
2120
+ "_view_name": "LayoutView",
2121
+ "align_content": null,
2122
+ "align_items": null,
2123
+ "align_self": null,
2124
+ "border_bottom": null,
2125
+ "border_left": null,
2126
+ "border_right": null,
2127
+ "border_top": null,
2128
+ "bottom": null,
2129
+ "display": null,
2130
+ "flex": null,
2131
+ "flex_flow": null,
2132
+ "grid_area": null,
2133
+ "grid_auto_columns": null,
2134
+ "grid_auto_flow": null,
2135
+ "grid_auto_rows": null,
2136
+ "grid_column": null,
2137
+ "grid_gap": null,
2138
+ "grid_row": null,
2139
+ "grid_template_areas": null,
2140
+ "grid_template_columns": null,
2141
+ "grid_template_rows": null,
2142
+ "height": null,
2143
+ "justify_content": null,
2144
+ "justify_items": null,
2145
+ "left": null,
2146
+ "margin": null,
2147
+ "max_height": null,
2148
+ "max_width": null,
2149
+ "min_height": null,
2150
+ "min_width": null,
2151
+ "object_fit": null,
2152
+ "object_position": null,
2153
+ "order": null,
2154
+ "overflow": null,
2155
+ "padding": null,
2156
+ "right": null,
2157
+ "top": null,
2158
+ "visibility": null,
2159
+ "width": null
2160
+ }
2161
+ },
2162
+ "b9aa275928644a1bb7c844b50378c260": {
2163
+ "model_module": "@jupyter-widgets/controls",
2164
+ "model_name": "HTMLStyleModel",
2165
+ "model_module_version": "2.0.0",
2166
+ "state": {
2167
+ "_model_module": "@jupyter-widgets/controls",
2168
+ "_model_module_version": "2.0.0",
2169
+ "_model_name": "HTMLStyleModel",
2170
+ "_view_count": null,
2171
+ "_view_module": "@jupyter-widgets/base",
2172
+ "_view_module_version": "2.0.0",
2173
+ "_view_name": "StyleView",
2174
+ "background": null,
2175
+ "description_width": "",
2176
+ "font_size": null,
2177
+ "text_color": null
2178
+ }
2179
+ }
2180
+ }
2181
+ }
2182
+ },
2183
+ "cells": [
2184
+ {
2185
+ "cell_type": "code",
2186
+ "source": [
2187
+ "!pip install -q -U bitsandbytes\n",
2188
+ "!pip install -q -U git+https://github.com/huggingface/transformers.git\n",
2189
+ "!pip install -q -U git+https://github.com/huggingface/peft.git\n",
2190
+ "!pip install -q -U git+https://github.com/huggingface/accelerate.git\n",
2191
+ "!pip install -q -U datasets scipy ipywidgets matplotlib"
2192
+ ],
2193
+ "metadata": {
2194
+ "colab": {
2195
+ "base_uri": "https://localhost:8080/"
2196
+ },
2197
+ "id": "xtICe_5w79Oe",
2198
+ "outputId": "90289769-0df6-415f-a3d1-d4fc99197004"
2199
+ },
2200
+ "execution_count": null,
2201
+ "outputs": [
2202
+ {
2203
+ "output_type": "stream",
2204
+ "name": "stdout",
2205
+ "text": [
2206
+ " Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n",
2207
+ " Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n",
2208
+ " Preparing metadata (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n",
2209
+ " Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n",
2210
+ " Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n",
2211
+ " Preparing metadata (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n",
2212
+ " Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n",
2213
+ " Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n",
2214
+ " Preparing metadata (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n"
2215
+ ]
2216
+ }
2217
+ ]
2218
+ },
2219
+ {
2220
+ "cell_type": "code",
2221
+ "source": [
2222
+ "from datasets import load_dataset\n",
2223
+ "\n",
2224
+ "dataset = load_dataset(\"Devdeshitha/testdataset1\")\n"
2225
+ ],
2226
+ "metadata": {
2227
+ "id": "xLaZg8TS7bgw"
2228
+ },
2229
+ "execution_count": null,
2230
+ "outputs": []
2231
+ },
2232
+ {
2233
+ "cell_type": "code",
2234
+ "source": [
2235
+ "from datasets import load_dataset\n",
2236
+ "\n",
2237
+ "train_dataset = load_dataset('json', data_files='notes.jsonl', split='train')\n",
2238
+ "eval_dataset = load_dataset('json', data_files='notes_validation.jsonl', split='train')"
2239
+ ],
2240
+ "metadata": {
2241
+ "id": "A3zGMMinMs75"
2242
+ },
2243
+ "execution_count": null,
2244
+ "outputs": []
2245
+ },
2246
+ {
2247
+ "cell_type": "code",
2248
+ "source": [
2249
+ "def formatting_func(example):\n",
2250
+ " text = f\"### Question: {example['input']}\\n ### Answer: {example['output']}\"\n",
2251
+ " return text"
2252
+ ],
2253
+ "metadata": {
2254
+ "id": "QPaDjNP8OgQ2"
2255
+ },
2256
+ "execution_count": null,
2257
+ "outputs": []
2258
+ },
2259
+ {
2260
+ "cell_type": "code",
2261
+ "source": [
2262
+ "import torch\n",
2263
+ "from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig\n",
2264
+ "\n",
2265
+ "base_model_id = \"mistralai/Mistral-7B-v0.1\"\n",
2266
+ "bnb_config = BitsAndBytesConfig(\n",
2267
+ " load_in_4bit=True,\n",
2268
+ " bnb_4bit_use_double_quant=True,\n",
2269
+ " bnb_4bit_quant_type=\"nf4\",\n",
2270
+ " bnb_4bit_compute_dtype=torch.bfloat16\n",
2271
+ ")\n",
2272
+ "\n",
2273
+ "model = AutoModelForCausalLM.from_pretrained(base_model_id, quantization_config=bnb_config)"
2274
+ ],
2275
+ "metadata": {
2276
+ "id": "P1W3btN1-fos"
2277
+ },
2278
+ "execution_count": null,
2279
+ "outputs": []
2280
+ },
2281
+ {
2282
+ "cell_type": "code",
2283
+ "source": [
2284
+ "tokenizer = AutoTokenizer.from_pretrained(\n",
2285
+ " base_model_id,\n",
2286
+ " padding_side=\"left\",\n",
2287
+ " add_eos_token=True,\n",
2288
+ " add_bos_token=True,\n",
2289
+ ")\n",
2290
+ "tokenizer.pad_token = tokenizer.eos_token\n",
2291
+ "\n",
2292
+ "def generate_and_tokenize_prompt(prompt):\n",
2293
+ " return tokenizer(formatting_func(prompt))"
2294
+ ],
2295
+ "metadata": {
2296
+ "id": "uDe0t4ghOoKk",
2297
+ "colab": {
2298
+ "base_uri": "https://localhost:8080/",
2299
+ "height": 17,
2300
+ "referenced_widgets": [
2301
+ "83c67e9efb87414983dc54e57e0c4b13",
2302
+ "f0162e38dc704406b147b31b9f1af532",
2303
+ "68bd583e714f493f8813c4bbe23faaef",
2304
+ "cf14339119954f3e9dd5954e4560f4b2",
2305
+ "35ae0502bab148c596a841a2b684b542",
2306
+ "27a527b4f7f94b7b8f8387eea24799b9",
2307
+ "7a7286d9c0384f2c965ba484596b463e",
2308
+ "d1118f0fe0eb4ec4b3461a407d06222a",
2309
+ "1cb070393af445b89b073c80954508f7",
2310
+ "ed7ff4894e434a89998e697944723be4",
2311
+ "5362bd5ef8c746079b00cf312397a7f5",
2312
+ "f573d2932bbb430498a5751796a15a2b",
2313
+ "49bc64f61771490ca3d991474a58ae36",
2314
+ "4e5670cf294f4decb781c55d99238b60",
2315
+ "367579fa13224925aa6942fbb8ecadac",
2316
+ "f73df916fb79480a8eeb836e0e4845aa",
2317
+ "3457f1233d1d455cbae66f88b546ce60",
2318
+ "5762dcfb5b65495fb62c9558e62a11af",
2319
+ "ca42e3d65053412b8ce06297fa7b6402",
2320
+ "9809ba390eff464592c848051bdcf6af",
2321
+ "b34db1c3fda945b396d4d6d9f3f097f9",
2322
+ "439d21fcef0a40f3813517a5448a390d",
2323
+ "9836a802f41044d6896d5d52caddb5bd",
2324
+ "c0534dd8a2fc4abea8f45e303000e86d",
2325
+ "da0164bbfda54d63af5f400516c8e7b7",
2326
+ "d970719a8739466392d9538d3ab37561",
2327
+ "9121dcd4c9644a22a17fb230963885a9",
2328
+ "81eb6ea17da14145a727531a8f19f244",
2329
+ "1ddcfcb82fdd4743aae4c75d058b9ff7",
2330
+ "5203ead405ad45c29aaf50056ee2ba2e",
2331
+ "e3632137f852408499c5d5e9ca9b2d4b",
2332
+ "e26fd3cb659f4d04a65706bf39e921c4",
2333
+ "9ad3795caca1432981794a8e03877806",
2334
+ "2d421784fd6847e791f28750a60c06af",
2335
+ "a4f1864b89b346e588dabf93732a1429",
2336
+ "14a2e94389a14e5ebc82aace29494b65",
2337
+ "cb7c000530d54a83847179095bb4eb9a",
2338
+ "b2ff5d34fe294a4484294c574ab136ff",
2339
+ "7ef6e4cc76af4d009818401e3c528772",
2340
+ "00edc07d09fe4eb5be2ad9105c296c72",
2341
+ "f8a6508c56a34f48a4e4e6ca0d8619be",
2342
+ "26e9a7bb7e9d460c9926a3644cb688fb",
2343
+ "ff8460cb68ac40bf81ca4db8e12bc1b5",
2344
+ "425255b2692c4ce8a28bf1a28c36e84b"
2345
+ ]
2346
+ },
2347
+ "outputId": "99fca56d-a09e-4f8d-fe4d-f4f9777252c4"
2348
+ },
2349
+ "execution_count": null,
2350
+ "outputs": [
2351
+ {
2352
+ "output_type": "display_data",
2353
+ "data": {
2354
+ "text/plain": [
2355
+ "tokenizer_config.json: 0%| | 0.00/966 [00:00<?, ?B/s]"
2356
+ ],
2357
+ "application/vnd.jupyter.widget-view+json": {
2358
+ "version_major": 2,
2359
+ "version_minor": 0,
2360
+ "model_id": "83c67e9efb87414983dc54e57e0c4b13"
2361
+ }
2362
+ },
2363
+ "metadata": {}
2364
+ },
2365
+ {
2366
+ "output_type": "display_data",
2367
+ "data": {
2368
+ "text/plain": [
2369
+ "tokenizer.model: 0%| | 0.00/493k [00:00<?, ?B/s]"
2370
+ ],
2371
+ "application/vnd.jupyter.widget-view+json": {
2372
+ "version_major": 2,
2373
+ "version_minor": 0,
2374
+ "model_id": "f573d2932bbb430498a5751796a15a2b"
2375
+ }
2376
+ },
2377
+ "metadata": {}
2378
+ },
2379
+ {
2380
+ "output_type": "display_data",
2381
+ "data": {
2382
+ "text/plain": [
2383
+ "tokenizer.json: 0%| | 0.00/1.80M [00:00<?, ?B/s]"
2384
+ ],
2385
+ "application/vnd.jupyter.widget-view+json": {
2386
+ "version_major": 2,
2387
+ "version_minor": 0,
2388
+ "model_id": "9836a802f41044d6896d5d52caddb5bd"
2389
+ }
2390
+ },
2391
+ "metadata": {}
2392
+ },
2393
+ {
2394
+ "output_type": "display_data",
2395
+ "data": {
2396
+ "text/plain": [
2397
+ "special_tokens_map.json: 0%| | 0.00/72.0 [00:00<?, ?B/s]"
2398
+ ],
2399
+ "application/vnd.jupyter.widget-view+json": {
2400
+ "version_major": 2,
2401
+ "version_minor": 0,
2402
+ "model_id": "2d421784fd6847e791f28750a60c06af"
2403
+ }
2404
+ },
2405
+ "metadata": {}
2406
+ }
2407
+ ]
2408
+ },
2409
+ {
2410
+ "cell_type": "code",
2411
+ "source": [
2412
+ "tokenized_train_dataset = train_dataset.map(generate_and_tokenize_prompt)\n",
2413
+ "tokenized_val_dataset = eval_dataset.map(generate_and_tokenize_prompt)"
2414
+ ],
2415
+ "metadata": {
2416
+ "id": "w1qa04HLOsE7",
2417
+ "colab": {
2418
+ "base_uri": "https://localhost:8080/",
2419
+ "height": 17,
2420
+ "referenced_widgets": [
2421
+ "cc1e38e7d8814a3ab79b09b32e6f1900",
2422
+ "dbeac25369854887a3e23d56e7608d34",
2423
+ "33495679fe504a7f89021814b8379264",
2424
+ "a66eace1cf0c4c529a34567935d9d7de",
2425
+ "eec262d909b049aca06661df39777912",
2426
+ "1441df785c634d5fb604174c56ce6951",
2427
+ "e61935e1917442b3b5878917c882c7c1",
2428
+ "10a3e841bc6f42e5ab6e96fdec6800e9",
2429
+ "679734612bbc46d1a94ad8944d7158d1",
2430
+ "a9b4775a524b45af992076e1d0b900ea",
2431
+ "ff3a2b61b32d476199c51c6936e2ce02",
2432
+ "f64ba4bfafb047ca9cc98360df2e2c72",
2433
+ "42f9eff4fd8f42189aaad15a5728b1ff",
2434
+ "f76e9a8b6da54b2dbe200f92daee05c6",
2435
+ "ad11417520a44087b92aea02ac8b955f",
2436
+ "7eb889ef96a44070b5a0d3cfa2ebce04",
2437
+ "2d4d12adb1b8445ebcc356b01b4dbfe0",
2438
+ "21845f9ca1734e0cb81ee8a043298be9",
2439
+ "eb4120bd86e2436584d13816072cedbf",
2440
+ "129d1146903747dc8f5fd8573e378201",
2441
+ "c40c3f646e484aa3b82c4393a494c391",
2442
+ "b9aa275928644a1bb7c844b50378c260"
2443
+ ]
2444
+ },
2445
+ "outputId": "9d7fdd57-547c-40c5-dbe3-86cb963a0a1b"
2446
+ },
2447
+ "execution_count": null,
2448
+ "outputs": [
2449
+ {
2450
+ "output_type": "display_data",
2451
+ "data": {
2452
+ "text/plain": [
2453
+ "Map: 0%| | 0/530 [00:00<?, ? examples/s]"
2454
+ ],
2455
+ "application/vnd.jupyter.widget-view+json": {
2456
+ "version_major": 2,
2457
+ "version_minor": 0,
2458
+ "model_id": "cc1e38e7d8814a3ab79b09b32e6f1900"
2459
+ }
2460
+ },
2461
+ "metadata": {}
2462
+ },
2463
+ {
2464
+ "output_type": "display_data",
2465
+ "data": {
2466
+ "text/plain": [
2467
+ "Map: 0%| | 0/578 [00:00<?, ? examples/s]"
2468
+ ],
2469
+ "application/vnd.jupyter.widget-view+json": {
2470
+ "version_major": 2,
2471
+ "version_minor": 0,
2472
+ "model_id": "f64ba4bfafb047ca9cc98360df2e2c72"
2473
+ }
2474
+ },
2475
+ "metadata": {}
2476
+ }
2477
+ ]
2478
+ },
2479
+ {
2480
+ "cell_type": "code",
2481
+ "source": [
2482
+ "max_length = 1024 #This was an appropriate max length for my dataset\n",
2483
+ "\n",
2484
+ "def generate_and_tokenize_prompt2(prompt):\n",
2485
+ " result = tokenizer(\n",
2486
+ " formatting_func(prompt),\n",
2487
+ " truncation=True,\n",
2488
+ " max_length=max_length,\n",
2489
+ " padding=\"max_length\",\n",
2490
+ " )\n",
2491
+ " result[\"labels\"] = result[\"input_ids\"].copy()\n",
2492
+ " return result"
2493
+ ],
2494
+ "metadata": {
2495
+ "id": "ewVJhKk8O1AG"
2496
+ },
2497
+ "execution_count": null,
2498
+ "outputs": []
2499
+ },
2500
+ {
2501
+ "cell_type": "code",
2502
+ "source": [
2503
+ "tokenized_train_dataset = train_dataset.map(generate_and_tokenize_prompt2)\n",
2504
+ "tokenized_val_dataset = eval_dataset.map(generate_and_tokenize_prompt2)"
2505
+ ],
2506
+ "metadata": {
2507
+ "id": "Em2QofJhW6Uc"
2508
+ },
2509
+ "execution_count": null,
2510
+ "outputs": []
2511
+ },
2512
+ {
2513
+ "cell_type": "code",
2514
+ "source": [
2515
+ "print(tokenized_train_dataset[1]['input_ids'])\n",
2516
+ "\n"
2517
+ ],
2518
+ "metadata": {
2519
+ "id": "-FgVtHGaO_Np",
2520
+ "colab": {
2521
+ "base_uri": "https://localhost:8080/"
2522
+ },
2523
+ "outputId": "84147379-04bf-43fa-a58a-93fb001a167b"
2524
+ },
2525
+ "execution_count": null,
2526
+ "outputs": [
2527
+ {
2528
+ "output_type": "stream",
2529
+ "name": "stdout",
2530
+ "text": [
2531
+ "[2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 774, 22478, 28747, 1691, 736, 707, 2145, 4338, 5363, 395, 456, 633, 2623, 28804, 13, 774, 26307, 28747, 415, 633, 2623, 659, 264, 5543, 2145, 4338, 302, 2477, 28705, 28782, 28723, 28787, 28782, 28823, 442, 28705, 28784, 28723, 28750, 28782, 28823, 27359, 28725, 10085, 356, 574, 1665, 28725, 562, 378, 28742, 28713, 2141, 4658, 297, 272, 3102, 2434, 302, 429, 28781, 28774, 28725, 28750, 28781, 28783, 28723, 2]\n"
2532
+ ]
2533
+ }
2534
+ ]
2535
+ },
2536
+ {
2537
+ "cell_type": "code",
2538
+ "source": [
2539
+ "eval_prompt = \"How does consolidating credit cards into a loan work?: \""
2540
+ ],
2541
+ "metadata": {
2542
+ "id": "HJt8VN9NpyOV"
2543
+ },
2544
+ "execution_count": null,
2545
+ "outputs": []
2546
+ },
2547
+ {
2548
+ "cell_type": "code",
2549
+ "source": [
2550
+ "# Re-init the tokenizer so it doesn't add padding or eos token\n",
2551
+ "tokenizer = AutoTokenizer.from_pretrained(\n",
2552
+ " base_model_id,\n",
2553
+ " add_bos_token=True,\n",
2554
+ ")\n",
2555
+ "\n",
2556
+ "model_input = tokenizer(eval_prompt, return_tensors=\"pt\").to(\"cuda\")\n",
2557
+ "\n",
2558
+ "model.eval()\n",
2559
+ "with torch.no_grad():\n",
2560
+ " print(tokenizer.decode(model.generate(**model_input, max_new_tokens=512, repetition_penalty=1.15)[0], skip_special_tokens=True))"
2561
+ ],
2562
+ "metadata": {
2563
+ "id": "1vqHQ-QUW-EK"
2564
+ },
2565
+ "execution_count": null,
2566
+ "outputs": []
2567
+ },
2568
+ {
2569
+ "cell_type": "markdown",
2570
+ "source": [
2571
+ "Set Up LoRA\n",
2572
+ "\n",
2573
+ "Now, to start our fine-tuning, we have to apply some preprocessing to the model to prepare it for training. For that use the prepare_model_for_kbit_training method from PEFT.\n"
2574
+ ],
2575
+ "metadata": {
2576
+ "id": "PP4UdmIWr8LO"
2577
+ }
2578
+ }
2579
+ ]
2580
+ }