PrunaAI
/

KoboldAI-GPT-J-6B-Janeway-bnb-4bit-smashed

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

KoboldAI-GPT-J-6B-Janeway-bnb-4bit-smashed / generation_config.json

sharpenb's picture

d9188aca231957e01367ddad88003f39c386563a7f77af64e764f55964175385

a80029c verified 4 months ago

No virus

119 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 50256,
	"eos_token_id": 50256,
	"transformers_version": "4.37.1"
	}