Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Abzu
/
mpt-30b-instruct-q8
like
5
Text Generation
Transformers
Safetensors
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
Inference Endpoints
8-bit precision
arxiv:
2205.14135
arxiv:
2108.12409
License:
cc-by-sa-3.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
849233c
mpt-30b-instruct-q8
2 contributors
History:
7 commits
Danivilanova
Update config.json
849233c
about 1 year ago
.gitattributes
1.52 kB
initial commit
about 1 year ago
adapt_tokenizer.py
1.75 kB
Upload 16 files
about 1 year ago
attention.py
17.7 kB
Upload 16 files
about 1 year ago
blocks.py
2.55 kB
Upload 16 files
about 1 year ago
config.json
1.63 kB
Update config.json
about 1 year ago
configuration_mpt.py
9.2 kB
Upload 16 files
about 1 year ago
custom_embedding.py
305 Bytes
Upload 16 files
about 1 year ago
flash_attn_triton.py
28.2 kB
Upload 16 files
about 1 year ago
generation_config.json
91 Bytes
Upload MPTForCausalLM
about 1 year ago
handler.py
1.4 kB
Upload 16 files
about 1 year ago
hf_prefixlm_converter.py
27.2 kB
Upload 16 files
about 1 year ago
meta_init_context.py
3.64 kB
Upload 16 files
about 1 year ago
model-00001-of-00004.safetensors
9.98 GB
LFS
Upload MPTForCausalLM
about 1 year ago
model-00002-of-00004.safetensors
9.87 GB
LFS
Upload MPTForCausalLM
about 1 year ago
model-00003-of-00004.safetensors
9.87 GB
LFS
Upload MPTForCausalLM
about 1 year ago
model-00004-of-00004.safetensors
617 MB
LFS
Upload MPTForCausalLM
about 1 year ago
model.safetensors.index.json
39.6 kB
Upload MPTForCausalLM
about 1 year ago
modeling_mpt.py
19.3 kB
Upload 16 files
about 1 year ago
norm.py
2.56 kB
Upload 16 files
about 1 year ago
param_init_fns.py
12.6 kB
Upload 16 files
about 1 year ago
pytorch_model-00001-of-00004.bin
9.98 GB
LFS
Upload MPTForCausalLM
about 1 year ago
pytorch_model-00002-of-00004.bin
9.87 GB
LFS
Upload MPTForCausalLM
about 1 year ago
pytorch_model-00003-of-00004.bin
9.87 GB
LFS
Upload MPTForCausalLM
about 1 year ago
pytorch_model-00004-of-00004.bin
617 MB
LFS
Upload MPTForCausalLM
about 1 year ago
pytorch_model.bin.index.json
39.6 kB
Upload MPTForCausalLM
about 1 year ago
requirements.txt
15 Bytes
Upload 16 files
about 1 year ago
special_tokens_map.json
99 Bytes
Upload 16 files
about 1 year ago
tokenizer.json
2.11 MB
Upload 16 files
about 1 year ago
tokenizer_config.json
264 Bytes
Upload 16 files
about 1 year ago
