Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
baichuan-inc
/
Baichuan2-13B-Chat
like
426
Follow
Baichuan Intelligent Technology
277
Text Generation
Transformers
PyTorch
English
Chinese
baichuan
custom_code
text-generation-inference
Inference Endpoints
License:
other
Model card
Files
Files and versions
Community
41
Train
Deploy
Use this model
使用哪个加速推理框架比较好？
#38
by
daisr
- opened
Mar 22, 2024
Discussion
daisr
Mar 22, 2024
用原生的代码generate不是很快，
尝试使用VLLM搭建类似openai 的server，但是报错了。
其他的框架可以吗？
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
