Not supported with TGI
#92
by
abhishek3jangid
- opened
ValueError: Unsupported model type mixtral
rank=0
2024-01-15T05:46:51.125822Z ERROR text_generation_launcher: Shard 0 failed to start
2024-01-15T05:46:51.125859Z INFO text_generation_launcher: Shutting down shards
Error: ShardCannotStart
Make sure you install the latest transformers package using git.
I get the error : ValueError: Unsupported model type mixtral
pip install -U transformers