Model for internal fast test on inf2, do not use in other scenarios.
To build the model:
optimum-cli export neuron --model hf-internal-testing/tiny-random-t5 --task text2text-generation --batch_size 1 --sequence_length 18 --num_beams 4 tiny_random_t5_neuronx/
- Downloads last month
- 74
Unable to determine this model’s pipeline type. Check the
docs
.