philschmid
/

gpt-j-6B-fp16-sharded

PyTorch generic gptj endpoints-template Inference Endpoints

Model card Files Files and versions Community

Edit model card

Shareded fp16 copy of EleutherAI/gpt-j-6B

This is fork of EleutherAI/gpt-j-6B with shareded fp16 weights implementing a custom handler.py as an example for how to use gpt-j inference-endpoints

Downloads last month: 22

Unable to determine this model’s pipeline type. Check the docs .