metadata

license: apache-2.0
datasets:
  - togethercomputer/RedPajama-Data-1T
language:
  - en
pipeline_tag: text-generation
tags:
  - sharded
  - bf16
  - base

RedPajama-INCITE-7B-Base-sharded-bf16

This is the togethercomputer/RedPajama-INCITE-7B-Base model, but the model file(s) have been sharded to ~2GB each to ensure it can be loaded on low-RAM runtimes (like Colab).

Please refer to the original model card for all details/issues w.r.t. to this model. - inference examples are also available on the original model card linked above. - example colab notebook covering the basics