Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Abzu
/
mpt-30b-instruct-q8
like
5
Follow
Abzu
7
Text Generation
Transformers
Safetensors
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
Inference Endpoints
8-bit precision
arxiv:
2205.14135
arxiv:
2108.12409
License:
cc-by-sa-3.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
12d0eab
mpt-30b-instruct-q8
2 contributors
History:
15 commits
Danivilanova
Update README.md
12d0eab
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
README.md
Safe
11 kB
Update README.md
over 1 year ago
adapt_tokenizer.py
Safe
1.75 kB
Upload 16 files
over 1 year ago
attention.py
Safe
17.7 kB
Upload 16 files
over 1 year ago
blocks.py
Safe
2.55 kB
Upload 16 files
over 1 year ago
config.json
Safe
1.58 kB
Update config.json
over 1 year ago
configuration_mpt.py
Safe
9.2 kB
Upload 16 files
over 1 year ago
custom_embedding.py
Safe
305 Bytes
Upload 16 files
over 1 year ago
flash_attn_triton.py
Safe
28.2 kB
Upload 16 files
over 1 year ago
generation_config.json
Safe
91 Bytes
Upload MPTForCausalLM
over 1 year ago
handler.py
Safe
1.4 kB
Upload 16 files
over 1 year ago
hf_prefixlm_converter.py
Safe
27.2 kB
Upload 16 files
over 1 year ago
meta_init_context.py
Safe
3.64 kB
Upload 16 files
over 1 year ago
model-00001-of-00004.safetensors
Safe
9.98 GB
LFS
Upload MPTForCausalLM
over 1 year ago
model-00002-of-00004.safetensors
Safe
9.87 GB
LFS
Upload MPTForCausalLM
over 1 year ago
model-00003-of-00004.safetensors
Safe
9.87 GB
LFS
Upload MPTForCausalLM
over 1 year ago
model-00004-of-00004.safetensors
Safe
617 MB
LFS
Upload MPTForCausalLM
over 1 year ago
model.safetensors.index.json
Safe
39.6 kB
Upload MPTForCausalLM
over 1 year ago
modeling_mpt.py
Safe
19.3 kB
Upload 16 files
over 1 year ago
norm.py
Safe
2.56 kB
Upload 16 files
over 1 year ago
param_init_fns.py
Safe
12.6 kB
Upload 16 files
over 1 year ago
requirements.txt
Safe
15 Bytes
Upload 16 files
over 1 year ago
special_tokens_map.json
Safe
99 Bytes
Upload 16 files
over 1 year ago
tokenizer.json
Safe
2.11 MB
Upload 16 files
over 1 year ago
tokenizer_config.json
Safe
264 Bytes
Upload 16 files
over 1 year ago
