File size: 438 Bytes
533b961 |
1 2 3 4 5 6 7 8 9 10 |
---
tags:
- endpoints-template
library_name: generic
duplicated_from: philschmid/gpt-j-6B-fp16-sharded
---
# Shareded fp16 copy of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B)
> This is fork of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) with shareded fp16 weights implementing a custom `handler.py` as an example for how to use `gpt-j` [inference-endpoints](https://hf.co/inference-endpoints) |