Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Abzu
/
mpt-30b-instruct-q8
like
5
Text Generation
Transformers
Safetensors
mpt
Composer
MosaicML
llm-foundry
custom_code
Inference Endpoints
text-generation-inference
8-bit precision
arxiv:
2205.14135
arxiv:
2108.12409
License:
cc-by-sa-3.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
mpt-30b-instruct-q8
2 contributors
History:
15 commits
Danivilanova
Update README.md
12d0eab
11 months ago
.gitattributes
1.52 kB
initial commit
11 months ago
README.md
11 kB
Update README.md
11 months ago
adapt_tokenizer.py
1.75 kB
Upload 16 files
11 months ago
attention.py
17.7 kB
Upload 16 files
11 months ago
blocks.py
2.55 kB
Upload 16 files
11 months ago
config.json
1.58 kB
Update config.json
11 months ago
configuration_mpt.py
9.2 kB
Upload 16 files
11 months ago
custom_embedding.py
305 Bytes
Upload 16 files
11 months ago
flash_attn_triton.py
28.2 kB
Upload 16 files
11 months ago
generation_config.json
91 Bytes
Upload MPTForCausalLM
11 months ago
handler.py
1.4 kB
Upload 16 files
11 months ago
hf_prefixlm_converter.py
27.2 kB
Upload 16 files
11 months ago
meta_init_context.py
3.64 kB
Upload 16 files
11 months ago
model-00001-of-00004.safetensors
9.98 GB
LFS
Upload MPTForCausalLM
11 months ago
model-00002-of-00004.safetensors
9.87 GB
LFS
Upload MPTForCausalLM
11 months ago
model-00003-of-00004.safetensors
9.87 GB
LFS
Upload MPTForCausalLM
11 months ago
model-00004-of-00004.safetensors
617 MB
LFS
Upload MPTForCausalLM
11 months ago
model.safetensors.index.json
39.6 kB
Upload MPTForCausalLM
11 months ago
modeling_mpt.py
19.3 kB
Upload 16 files
11 months ago
norm.py
2.56 kB
Upload 16 files
11 months ago
param_init_fns.py
12.6 kB
Upload 16 files
11 months ago
requirements.txt
15 Bytes
Upload 16 files
11 months ago
special_tokens_map.json
99 Bytes
Upload 16 files
11 months ago
tokenizer.json
2.11 MB
Upload 16 files
11 months ago
tokenizer_config.json
264 Bytes
Upload 16 files
11 months ago
