Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Abzu
/
mpt-30b-instruct-q8
like
5
Text Generation
Transformers
Safetensors
mpt
Composer
MosaicML
llm-foundry
custom_code
Inference Endpoints
text-generation-inference
8-bit precision
arxiv:
2205.14135
arxiv:
2108.12409
License:
cc-by-sa-3.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
d5e87b0
mpt-30b-instruct-q8
2 contributors
History:
4 commits
Danivilanova
Upload 16 files
d5e87b0
12 months ago
.gitattributes
1.52 kB
initial commit
12 months ago
adapt_tokenizer.py
1.75 kB
Upload 16 files
12 months ago
attention.py
17.7 kB
Upload 16 files
12 months ago
blocks.py
2.55 kB
Upload 16 files
12 months ago
config.json
1.67 kB
Update config.json
12 months ago
configuration_mpt.py
9.2 kB
Upload 16 files
12 months ago
custom_embedding.py
305 Bytes
Upload 16 files
12 months ago
flash_attn_triton.py
28.2 kB
Upload 16 files
12 months ago
generation_config.json
91 Bytes
Upload MPTForCausalLM
12 months ago
handler.py
1.4 kB
Upload 16 files
12 months ago
hf_prefixlm_converter.py
27.2 kB
Upload 16 files
12 months ago
meta_init_context.py
3.64 kB
Upload 16 files
12 months ago
modeling_mpt.py
19.3 kB
Upload 16 files
12 months ago
norm.py
2.56 kB
Upload 16 files
12 months ago
param_init_fns.py
12.6 kB
Upload 16 files
12 months ago
pytorch_model-00001-of-00004.bin
9.98 GB
LFS
Upload MPTForCausalLM
12 months ago
pytorch_model-00002-of-00004.bin
9.87 GB
LFS
Upload MPTForCausalLM
12 months ago
pytorch_model-00003-of-00004.bin
9.87 GB
LFS
Upload MPTForCausalLM
12 months ago
pytorch_model-00004-of-00004.bin
617 MB
LFS
Upload MPTForCausalLM
12 months ago
pytorch_model.bin.index.json
39.6 kB
Upload MPTForCausalLM
12 months ago
requirements.txt
15 Bytes
Upload 16 files
12 months ago
special_tokens_map.json
99 Bytes
Upload 16 files
12 months ago
tokenizer.json
2.11 MB
Upload 16 files
12 months ago
tokenizer_config.json
264 Bytes
Upload 16 files
12 months ago
