Update examples in README to be compatible with soon-to-come ChatWidget
#68
by
Wauplin
HF staff
- opened
Aren't the control tokens still needed for users who do not use the ChatWidget?
@suryabhupa
special tokens are still necessary when running inference with gemma-7b-it. The only thing that ChatWidget is doing for you is to add those special tokens correctly for you and display things nicely in the UI. It doesn't change how the model should be used in local or remote inference.
osanseviero
changed pull request status to
merged
ah makes sense, thanks for clarifying!