File size: 757 Bytes
0ab2004 d44ab86 1489c9b 0ab2004 d44ab86 4e0bbf2 d44ab86 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
license: apache-2.0
datasets:
- togethercomputer/RedPajama-Data-1T
language:
- en
pipeline_tag: text-generation
tags:
- sharded
- bf16
- base
---
# RedPajama-INCITE-7B-Base-sharded-bf16
This is the `togethercomputer/RedPajama-INCITE-7B-Base` model, but the model file(s) have been sharded to ~2GB each to ensure it can be loaded on low-RAM runtimes (like Colab).
Please refer to the [original model card](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) for all details/issues w.r.t. to this model.
- inference examples are also available on the original model card linked above.
- [example colab notebook](https://colab.research.google.com/gist/pszemraj/d2f73ceaf4939bc55bdf5692cd0302d6/scratchpad.ipynb) covering the basics
---
|