File size: 549 Bytes
325d462 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
# Falcon-40B-Instruct 8-bit Model
This repository is home to the Falcon-40B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit file.
# Usage
You can use this model directly with a pipeline for tasks such as text generation and instruction following:
```python
from transformers import pipeline
generator = pipeline('text-generation', model='tensorcat/falcon-40b-instruct-8bit')
print(generator("Generate a story about a spaceship traveling through space.", max_length=200))
```
|