| tags: | |
| - endpoints-template | |
| library_name: generic | |
| duplicated_from: philschmid/gpt-j-6B-fp16-sharded | |
| # Shareded fp16 copy of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) | |
| > This is fork of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) with shareded fp16 weights implementing a custom `handler.py` as an example for how to use `gpt-j` [inference-endpoints](https://hf.co/inference-endpoints) |