Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
vuiseng9
/
ov-opt-350m-8bit-85pc-sparse-kv-cache
like
0
Text Generation
Transformers
PyTorch
OpenVINO
wikitext
opt
Generated from Trainer
Eval Results
text-generation-inference
Inference Endpoints
License:
other
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
ov-opt-350m-8bit-85pc-sparse-kv-cache
2 contributors
History:
3 commits
vuiseng9
Add tld config and guide
7d6d1c1
10 months ago
.gitattributes
1.52 kB
initial commit
about 1 year ago
README.md
1.54 kB
Add content
about 1 year ago
all_results.json
430 Bytes
Add content
about 1 year ago
compressed_graph.dot
788 kB
Add content
about 1 year ago
config.json
749 Bytes
Add content
about 1 year ago
eval_results.json
260 Bytes
Add content
about 1 year ago
generation_config.json
132 Bytes
Add content
about 1 year ago
merges.txt
456 kB
Add content
about 1 year ago
nncf_output.log
190 kB
Add content
about 1 year ago
openvino_config.json
1.37 kB
Add content
about 1 year ago
openvino_model.bin
443 MB
LFS
Add content
about 1 year ago
openvino_model.xml
3.24 MB
Add content
about 1 year ago
original_graph.dot
466 kB
Add content
about 1 year ago
ov_rt_tld.json
79 Bytes
Add tld config and guide
10 months ago
pytorch_model.bin
pickle
Detected Pickle imports (4)
"torch.FloatStorage"
,
"torch.IntStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.54 GB
LFS
Add content
about 1 year ago
special_tokens_map.json
548 Bytes
Add content
about 1 year ago
tld-notes.txt
1.97 kB
Add tld config and guide
10 months ago
tokenizer.json
2.11 MB
Add content
about 1 year ago
tokenizer_config.json
870 Bytes
Add content
about 1 year ago
train_results.json
190 Bytes
Add content
about 1 year ago
trainer_state.json
596 Bytes
Add content
about 1 year ago
training_args.bin
pickle
Detected Pickle imports (8)
"transformers.trainer_utils.HubStrategy"
,
"transformers.trainer_utils.IntervalStrategy"
,
"accelerate.state.PartialState"
,
"transformers.training_args.OptimizerNames"
,
"transformers.training_args.TrainingArguments"
,
"transformers.trainer_utils.SchedulerType"
,
"accelerate.utils.dataclasses.DistributedType"
,
"torch.device"
How to fix it?
3.96 kB
LFS
Add content
about 1 year ago
vocab.json
798 kB
Add content
about 1 year ago