Rong Shan
CyberDancer
AI & ML interests
Recommender System, Large Language Models
Recent Activity
new activity
2 days ago
tiiuae/falcon-mamba-7b:Error with quantization
new activity
5 months ago
tiiuae/falcon-mamba-7b:Sequential Prefilling
new activity
5 months ago
tiiuae/falcon-mamba-7b:RuntimeError: Tensor on device meta is not on the expected device cuda:0!
Organizations
None yet
CyberDancer's activity
Error with quantization
#16 opened 2 days ago
by
CyberDancer
Sequential Prefilling
#13 opened 5 months ago
by
CyberDancer
RuntimeError: Tensor on device meta is not on the expected device cuda:0!
5
#6 opened 8 months ago
by
abcdata
It seems that this project can only support a batch_size of 1 during inference?
1
#1 opened over 1 year ago
by
howard-hou
