kevineen commited on
Commit
817ae4e
·
verified ·
1 Parent(s): 6376204

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +354 -5
README.md CHANGED
@@ -20,11 +20,360 @@ pipeline_tag: text-generation
20
 
21
  下記のversionで実行をしました。
22
  ```
23
- !pip install -U bitsandbytes
24
- !pip install -U transformers
25
- !pip install -U accelerate
26
- !pip install -U datasets
27
- !pip install -U peft
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
  ```
29
 
30
  下記のコードで実行をしました。
 
20
 
21
  下記のversionで実行をしました。
22
  ```
23
+ Package Version
24
+ --------------------------------------- --------------------
25
+ absl-py 1.4.0
26
+ accelerate 1.2.1
27
+ aiohappyeyeballs 2.4.3
28
+ aiohttp 3.11.7
29
+ aiosignal 1.3.1
30
+ annotated-types 0.7.0
31
+ antlr4-python3-runtime 4.9.3
32
+ anyio 4.6.2.post1
33
+ apex 0.1
34
+ argon2-cffi 21.3.0
35
+ argon2-cffi-bindings 21.2.0
36
+ asttokens 2.2.1
37
+ astunparse 1.6.3
38
+ async-timeout 4.0.2
39
+ attrs 24.2.0
40
+ audioread 3.0.0
41
+ backcall 0.2.0
42
+ beautifulsoup4 4.12.3
43
+ bitsandbytes 0.45.0
44
+ bleach 6.0.0
45
+ blis 0.7.9
46
+ cachetools 5.3.1
47
+ catalogue 2.0.8
48
+ certifi 2023.5.7
49
+ cffi 1.15.1
50
+ charset-normalizer 3.1.0
51
+ click 8.1.7
52
+ cloudpickle 2.2.1
53
+ cmake 3.26.4
54
+ comm 0.1.3
55
+ confection 0.1.0
56
+ contourpy 1.1.0
57
+ cubinlinker 0.3.0+2.g155b525
58
+ cuda-python 12.1.0rc5+1.g8659927
59
+ cudf 23.6.0
60
+ cugraph 23.6.0
61
+ cugraph-dgl 23.6.0
62
+ cugraph-service-client 23.6.0
63
+ cugraph-service-server 23.6.0
64
+ cuml 23.6.0
65
+ cupy-cuda12x 12.1.0
66
+ cut-cross-entropy 24.11.4
67
+ cycler 0.11.0
68
+ cymem 2.0.7
69
+ Cython 0.29.36
70
+ dask 2023.3.2
71
+ dask-cuda 23.6.0
72
+ dask-cudf 23.6.0
73
+ dataclasses-json 0.6.7
74
+ datasets 3.2.0
75
+ debugpy 1.6.7
76
+ decorator 5.1.1
77
+ deepspeed 0.15.4
78
+ defusedxml 0.7.1
79
+ Deprecated 1.2.15
80
+ dill 0.3.8
81
+ dirtyjson 1.0.8
82
+ distributed 2023.3.2.1
83
+ distro 1.9.0
84
+ dm-tree 0.1.8
85
+ docker-pycreds 0.4.0
86
+ docstring_parser 0.16
87
+ einops 0.6.1
88
+ exceptiongroup 1.1.2
89
+ execnet 1.9.0
90
+ executing 1.2.0
91
+ expecttest 0.1.3
92
+ fastjsonschema 2.17.1
93
+ fastrlock 0.8.1
94
+ filelock 3.12.2
95
+ filetype 1.2.0
96
+ fire 0.7.0
97
+ flash-attn 1.0.7
98
+ fonttools 4.40.0
99
+ frozenlist 1.3.3
100
+ fsspec 2023.6.0
101
+ gast 0.5.4
102
+ gitdb 4.0.11
103
+ GitPython 3.1.43
104
+ google-auth 2.21.0
105
+ google-auth-oauthlib 0.4.6
106
+ graphsurgeon 0.4.6
107
+ greenlet 3.1.1
108
+ grpcio 1.56.0
109
+ h11 0.14.0
110
+ h5py 3.11.0
111
+ hdf5plugin 4.4.0
112
+ hf_transfer 0.1.8
113
+ hjson 3.1.0
114
+ httpcore 1.0.7
115
+ httpx 0.27.2
116
+ huggingface-hub 0.26.2
117
+ hydra-core 1.3.2
118
+ hypothesis 5.35.1
119
+ idna 3.4
120
+ imageio 2.34.1
121
+ importlib-metadata 6.7.0
122
+ iniconfig 2.0.0
123
+ intel-openmp 2021.4.0
124
+ ipykernel 6.24.0
125
+ ipython 8.14.0
126
+ ipython-genutils 0.2.0
127
+ jedi 0.18.2
128
+ Jinja2 3.1.2
129
+ jiter 0.7.1
130
+ joblib 1.3.0
131
+ json5 0.9.14
132
+ jsonpatch 1.33
133
+ jsonpointer 3.0.0
134
+ jsonschema 4.18.0
135
+ jsonschema-specifications 2023.6.1
136
+ jupyter_client 8.3.0
137
+ jupyter_core 5.3.1
138
+ jupyter-tensorboard 0.2.0
139
+ jupyterlab 2.2.9
140
+ jupyterlab-pygments 0.2.2
141
+ jupyterlab-server 1.2.0
142
+ jupytext 1.14.7
143
+ kiwisolver 1.4.4
144
+ langchain 0.3.8
145
+ langchain-core 0.3.21
146
+ langchain-text-splitters 0.3.2
147
+ langcodes 3.3.0
148
+ langsmith 0.1.145
149
+ lazy_loader 0.4
150
+ librosa 0.9.2
151
+ lightning-utilities 0.11.9
152
+ llama-cloud 0.1.5
153
+ llama-index 0.12.1
154
+ llama-index-agent-openai 0.4.0
155
+ llama-index-cli 0.4.0
156
+ llama-index-core 0.12.1
157
+ llama-index-embeddings-openai 0.3.0
158
+ llama-index-indices-managed-llama-cloud 0.6.2
159
+ llama-index-legacy 0.9.48.post4
160
+ llama-index-llms-openai 0.3.1
161
+ llama-index-multi-modal-llms-openai 0.3.0
162
+ llama-index-program-openai 0.3.0
163
+ llama-index-question-gen-openai 0.3.0
164
+ llama-index-readers-file 0.4.0
165
+ llama-index-readers-llama-parse 0.4.0
166
+ llama-parse 0.5.15
167
+ llvmlite 0.40.1
168
+ locket 1.0.0
169
+ Markdown 3.4.3
170
+ markdown-it-py 3.0.0
171
+ MarkupSafe 2.1.3
172
+ marshmallow 3.23.1
173
+ matplotlib 3.7.2
174
+ matplotlib-inline 0.1.6
175
+ mdit-py-plugins 0.4.0
176
+ mdurl 0.1.2
177
+ mistune 3.0.1
178
+ mkl 2021.1.1
179
+ mkl-devel 2021.1.1
180
+ mkl-include 2021.1.1
181
+ mne 1.6.0
182
+ mock 5.0.2
183
+ mpmath 1.3.0
184
+ msgpack 1.0.5
185
+ multidict 6.0.4
186
+ multiprocess 0.70.16
187
+ murmurhash 1.0.9
188
+ mypy-extensions 1.0.0
189
+ nbclient 0.8.0
190
+ nbconvert 7.6.0
191
+ nbformat 5.9.0
192
+ nest-asyncio 1.6.0
193
+ networkx 3.4.2
194
+ ninja 1.11.1
195
+ nltk 3.9.1
196
+ notebook 6.4.10
197
+ numba 0.57.1+1.gf851d279c
198
+ numpy 1.26.4
199
+ nvidia-cublas-cu12 12.4.5.8
200
+ nvidia-cuda-cupti-cu12 12.4.127
201
+ nvidia-cuda-nvrtc-cu12 12.4.127
202
+ nvidia-cuda-runtime-cu12 12.4.127
203
+ nvidia-cudnn-cu12 9.1.0.70
204
+ nvidia-cufft-cu12 11.2.1.3
205
+ nvidia-curand-cu12 10.3.5.147
206
+ nvidia-cusolver-cu12 11.6.1.9
207
+ nvidia-cusparse-cu12 12.3.1.170
208
+ nvidia-dali-cuda120 1.27.0
209
+ nvidia-nccl-cu12 2.21.5
210
+ nvidia-nvjitlink-cu12 12.4.127
211
+ nvidia-nvtx-cu12 12.4.127
212
+ nvidia-pyindex 1.0.9
213
+ nvtx 0.2.5
214
+ oauthlib 3.2.2
215
+ omegaconf 2.3.0
216
+ onnx 1.14.0
217
+ openai 1.55.0
218
+ opencv 4.7.0
219
+ orjson 3.10.12
220
+ outcome 1.3.0.post0
221
+ packaging 24.2
222
+ pandas 1.5.2
223
+ pandocfilters 1.5.0
224
+ parso 0.8.3
225
+ partd 1.4.0
226
+ pathy 0.10.2
227
+ peft 0.14.0
228
+ pexpect 4.8.0
229
+ pickleshare 0.7.5
230
+ Pillow 9.2.0
231
+ pip 23.1.2
232
+ platformdirs 3.8.0
233
+ pluggy 1.2.0
234
+ ply 3.11
235
+ polygraphy 0.47.1
236
+ pooch 1.7.0
237
+ preshed 3.0.8
238
+ prettytable 3.8.0
239
+ prometheus-client 0.17.0
240
+ prompt-toolkit 3.0.39
241
+ propcache 0.2.0
242
+ protobuf 3.20.3
243
+ psutil 5.9.4
244
+ ptxcompiler 0.8.1+1.gb323413
245
+ ptyprocess 0.7.0
246
+ pure-eval 0.2.2
247
+ py-cpuinfo 9.0.0
248
+ pyarrow 18.0.0
249
+ pyasn1 0.5.0
250
+ pyasn1-modules 0.3.0
251
+ pybind11 2.10.4
252
+ pycocotools 2.0+nv0.7.3
253
+ pycparser 2.21
254
+ pydantic 2.9.2
255
+ pydantic_core 2.23.4
256
+ Pygments 2.15.1
257
+ pylibcugraph 23.6.0
258
+ pylibcugraphops 23.6.0
259
+ pylibraft 23.6.0
260
+ pynvml 11.4.1
261
+ pyparsing 3.0.9
262
+ pypdf 5.1.0
263
+ PySocks 1.7.1
264
+ pytest 7.4.0
265
+ pytest-flakefinder 1.1.0
266
+ pytest-rerunfailures 12.0
267
+ pytest-shard 0.1.2
268
+ pytest-xdist 3.3.1
269
+ python-dateutil 2.8.2
270
+ python-hostlist 1.23.0
271
+ pytorch-quantization 2.1.2
272
+ pytz 2023.3
273
+ PyYAML 6.0.2
274
+ pyzmq 25.1.0
275
+ raft-dask 23.6.0
276
+ referencing 0.29.1
277
+ regex 2023.6.3
278
+ requests 2.32.3
279
+ requests-oauthlib 1.3.1
280
+ requests-toolbelt 1.0.0
281
+ resampy 0.4.2
282
+ rich 13.9.4
283
+ rmm 23.6.0
284
+ rpds-py 0.8.8
285
+ rsa 4.9
286
+ safetensors 0.4.5
287
+ scikit-learn 1.2.0
288
+ scipy 1.11.0
289
+ selenium 4.26.1
290
+ Send2Trash 1.8.2
291
+ sentence-transformers 3.3.1
292
+ sentencepiece 0.2.0
293
+ sentry-sdk 2.19.0
294
+ setproctitle 1.3.4
295
+ setuptools 68.0.0
296
+ shtab 1.7.1
297
+ six 1.16.0
298
+ smart-open 6.3.0
299
+ smmap 5.0.1
300
+ sniffio 1.3.1
301
+ sortedcontainers 2.4.0
302
+ soundfile 0.12.1
303
+ soupsieve 2.4.1
304
+ spacy 3.5.4
305
+ spacy-legacy 3.0.12
306
+ spacy-loggers 1.0.4
307
+ sphinx-glpi-theme 0.3
308
+ SQLAlchemy 2.0.36
309
+ srsly 2.4.6
310
+ stack-data 0.6.2
311
+ striprtf 0.0.26
312
+ sympy 1.13.1
313
+ tabulate 0.9.0
314
+ tbb 2021.9.0
315
+ tblib 2.0.0
316
+ tenacity 8.5.0
317
+ tensorboard 2.9.0
318
+ tensorboard-data-server 0.6.1
319
+ tensorboard-plugin-wit 1.8.1
320
+ tensorrt 8.6.1
321
+ termcolor 2.5.0
322
+ terminado 0.17.1
323
+ thinc 8.1.10
324
+ threadpoolctl 3.1.0
325
+ thriftpy2 0.4.16
326
+ tiktoken 0.8.0
327
+ tinycss2 1.2.1
328
+ tokenizers 0.21.0
329
+ toml 0.10.2
330
+ tomli 2.0.1
331
+ toolz 0.12.0
332
+ torch 2.5.1
333
+ torch-tensorrt 1.5.0.dev0
334
+ torchaudio 2.5.1
335
+ torchdata 0.7.0a0
336
+ torchmetrics 1.6.0
337
+ torchtext 0.16.0a0
338
+ torchvision 0.20.1
339
+ tornado 6.3.2
340
+ tqdm 4.67.1
341
+ traitlets 5.9.0
342
+ transformer-engine 0.10.0+96ed6fc
343
+ transformers 4.47.0
344
+ treelite 3.2.0
345
+ treelite-runtime 3.2.0
346
+ trio 0.27.0
347
+ trio-websocket 0.11.1
348
+ triton 3.1.0
349
+ trl 0.12.1
350
+ typeguard 4.4.1
351
+ typer 0.9.0
352
+ types-dataclasses 0.6.6
353
+ typing_extensions 4.12.2
354
+ typing-inspect 0.9.0
355
+ tyro 0.9.2
356
+ ucx-py 0.32.0
357
+ uff 0.6.9
358
+ unsloth 2024.11.9
359
+ unsloth_zoo 2024.11.7
360
+ urllib3 1.26.16
361
+ wandb 0.18.7
362
+ wasabi 1.1.2
363
+ wcwidth 0.2.6
364
+ webencodings 0.5.1
365
+ websocket-client 1.8.0
366
+ Werkzeug 2.3.6
367
+ wheel 0.45.1
368
+ wrapt 1.17.0
369
+ wsproto 1.2.0
370
+ xdoctest 1.0.2
371
+ xformers 0.0.28.post3
372
+ xgboost 1.7.5
373
+ xxhash 3.5.0
374
+ yarl 1.18.0
375
+ zict 3.0.0
376
+ zipp 3.15.0
377
  ```
378
 
379
  下記のコードで実行をしました。