Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mosaicml
/
mpt-1b-redpajama-200b
like
91
Follow
Mosaic ML, Inc.
360
Text Generation
Transformers
PyTorch
togethercomputer/RedPajama-Data-1T
mosaic_gpt
custom_code
arxiv:
2302.13971
arxiv:
2205.14135
arxiv:
2108.12409
License:
apache-2.0
Model card
Files
Files and versions
Community
11
Train
Use this model
refs/pr/1
mpt-1b-redpajama-200b
4 contributors
History:
6 commits
jfrankle
Create README.md
8065593
over 1 year ago
.gitattributes
Safe
1.48 kB
initial commit
over 1 year ago
README.md
Safe
3.03 kB
Create README.md
over 1 year ago
attention.py
Safe
13.8 kB
Upload MosaicGPT
over 1 year ago
config.json
Safe
1.14 kB
Upload MosaicGPT
over 1 year ago
configuration_mosaic_gpt.py
Safe
8.87 kB
Upload MosaicGPT
over 1 year ago
generation_config.json
Safe
91 Bytes
Upload MosaicGPT
over 1 year ago
gpt_blocks.py
Safe
3.11 kB
Upload MosaicGPT
over 1 year ago
low_precision_layernorm.py
Safe
1.27 kB
Upload MosaicGPT
over 1 year ago
mosaic_gpt.py
Safe
19.5 kB
Add explicit error for flash + alibi
over 1 year ago
param_init_fns.py
Safe
15.9 kB
Upload MosaicGPT
over 1 year ago
pytorch_model.bin
Safe
pickle
Detected Pickle imports (3)
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
What is a pickle import?
5.25 GB
LFS
Upload MosaicGPT
over 1 year ago
special_tokens_map.json
Safe
99 Bytes
Upload tokenizer
over 1 year ago
tokenizer.json
Safe
2.11 MB
Upload tokenizer
over 1 year ago
tokenizer_config.json
Safe
366 Bytes
Upload tokenizer
over 1 year ago
