Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
IEITYuan
/
Yuan2-M32-hf-int4
like
0
Follow
IEIT-Yuan
24
Text Generation
Transformers
yuan
custom_code
4-bit precision
gptq
arxiv:
2405.17976
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Use this model
main
Yuan2-M32-hf-int4
Ctrl+K
Ctrl+K
1 contributor
History:
4 commits
IEIT-Yuan
hugging
82d72f7
10 months ago
.gitattributes
Safe
1.68 kB
model scope
10 months ago
HF-inference.py
Safe
1.26 kB
model scope
10 months ago
README.md
Safe
8.86 kB
model scope
10 months ago
config.json
Safe
1.69 kB
model scope
10 months ago
configuration.json
Safe
40 Bytes
model scope
10 months ago
configuration_yuan.py
Safe
1.36 kB
model scope
10 months ago
generation_config.json
Safe
151 Bytes
model scope
10 months ago
gptq_model-4bit-128g.safetensors00
Safe
8.59 GB
LFS
model scope
10 months ago
gptq_model-4bit-128g.safetensors01
Safe
8.59 GB
LFS
hugging
10 months ago
gptq_model-4bit-128g.safetensors02
Safe
4.87 GB
LFS
hugging
10 months ago
quantize_config.json
Safe
326 Bytes
model scope
10 months ago
special_tokens_map.json
Safe
646 Bytes
model scope
10 months ago
test.py
Safe
1.22 kB
model scope
10 months ago
test_infer.py
Safe
1.49 kB
model scope
10 months ago
tokenizer.model
Safe
2.16 MB
LFS
model scope
10 months ago
tokenizer_config.json
Safe
566 Bytes
model scope
10 months ago
yuan_moe_hf_model.py
Safe
63.3 kB
model scope
10 months ago
