Update _decode method to accept integer element and convert it to sequence
#30
by
ramkrithiks
- opened
Why did I create this pull request?
When I tried to run this model over TGI, during model warm up step it fails by throwing cannot convert 'int' to 'sequence'.
What are the proposed changes?
Removed List[int] type mentioned in _decode function parameter and explicitly added a check to convert single element token_ids into list.
How did I test it?
I did changes over local repo in my machine and was able to successfully launch the model using TGI.
rooa
changed pull request status to
merged