New discussion

Recommanded hyperparameters?

1
#27 opened 18 days ago by zhilinw6

请问支持fp16推理吗?

2
#23 opened 25 days ago by DJCan

测试效果一般

2
#22 opened 25 days ago by dhajshdkajs

Parameters for peak performance

1
#21 opened about 1 month ago by cvdbdo

What languages are supported?

1
#20 opened about 1 month ago by jasonrayles

Running this model without flash-attn

2
#17 opened about 2 months ago by lisa-tse

输出的向量维度可以压缩吗?

1
#16 opened about 2 months ago by sen63

AWS Sagemaker Deployment error

2
#14 opened about 2 months ago by gauravsirola

question about quants

3
#12 opened about 2 months ago by prudant

need gguf q4km

#10 opened 2 months ago by windkkk

Training embadding Issues.

2
#8 opened 2 months ago by Imran1

跪求训练数据

1
#4 opened 2 months ago by infgrad