Text Generation
Transformers
PyTorch
English
llama
sft
Inference Endpoints
text-generation-inference
llama2-70b-oasst-sft-v10 / generation_config.json
Andreas Koepf
pad embeddings to multiple of 128
0319e91
{
"_from_model_config": true,
"bos_token_id": 32005,
"eos_token_id": 32006,
"pad_token_id": 0,
"transformers_version": "4.32.1"
}