Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
PrunaAI
/
mistral-community-Mistral-7B-v0.2-QUANTO-int8bit-smashed
like
0
Follow
Pruna AI
136
Transformers
pruna-ai
Inference Endpoints
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
mistral-community-Mistral-7B-v0.2-QUANTO-int8bit-smashed
1 contributor
History:
3 commits
sharpenb
6f369974e50e65aaf0f36f303e35e8650eff78ab8551aa90e1d65a4e805920b8
cec65b1
verified
5 months ago
.gitattributes
Safe
1.52 kB
initial commit
5 months ago
README.md
Safe
5.37 kB
6f369974e50e65aaf0f36f303e35e8650eff78ab8551aa90e1d65a4e805920b8
5 months ago
model.pt
pickle
Detected Pickle imports (23)
"torch.nn.modules.sparse.Embedding"
,
"torch.FloatStorage"
,
"torch.bfloat16"
,
"collections.OrderedDict"
,
"transformers.models.mistral.modeling_mistral.MistralModel"
,
"torch.device"
,
"torch.nn.modules.container.ModuleList"
,
"transformers.models.mistral.configuration_mistral.MistralConfig"
,
"transformers.models.mistral.modeling_mistral.MistralMLP"
,
"transformers.models.mistral.modeling_mistral.MistralRotaryEmbedding"
,
"torch.BFloat16Storage"
,
"torch._utils._rebuild_tensor_v2"
,
"transformers.models.mistral.modeling_mistral.MistralRMSNorm"
,
"quanto.tensor.qtype.qtype"
,
"transformers.models.mistral.modeling_mistral.MistralForCausalLM"
,
"transformers.models.mistral.modeling_mistral.MistralSdpaAttention"
,
"transformers.models.mistral.modeling_mistral.MistralDecoderLayer"
,
"__builtin__.set"
,
"quanto.nn.qlinear.QLinear"
,
"transformers.generation.configuration_utils.GenerationConfig"
,
"torch._utils._rebuild_parameter"
,
"torch.int8"
,
"torch.nn.modules.activation.SiLU"
How to fix it?
14.5 GB
LFS
a4cf68f3b3344310fe36902d7d6e26e5d0dfbd31e61e405e949789d1962fd932
5 months ago
smash_config.json
Safe
1.03 kB
6f369974e50e65aaf0f36f303e35e8650eff78ab8551aa90e1d65a4e805920b8
5 months ago
special_tokens_map.json
Safe
414 Bytes
6f369974e50e65aaf0f36f303e35e8650eff78ab8551aa90e1d65a4e805920b8
5 months ago
tokenizer.json
Safe
1.8 MB
6f369974e50e65aaf0f36f303e35e8650eff78ab8551aa90e1d65a4e805920b8
5 months ago
tokenizer.model
Safe
493 kB
LFS
6f369974e50e65aaf0f36f303e35e8650eff78ab8551aa90e1d65a4e805920b8
5 months ago
tokenizer_config.json
Safe
961 Bytes
6f369974e50e65aaf0f36f303e35e8650eff78ab8551aa90e1d65a4e805920b8
5 months ago