Noam

nsegev's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in TheBloke/Falcon-180B-Chat-GPTQ about 1 year ago

Can run on SageMaker g5 instance?

5

#4 opened over 1 year ago by

nsegev

3bit on single A100 good quality, poor speed

3

#3 opened over 1 year ago by

Gian-hf

New activity in tiiuae/falcon-180B-chat about 1 year ago

Error on num_kv_heads when using TGI

2

#5 opened over 1 year ago by

nsegev

New activity in TheBloke/Falcon-180B-Chat-GPTQ over 1 year ago

Can run on SageMaker g5 instance?

5

#4 opened over 1 year ago by

nsegev

New activity in tiiuae/falcon-180B-chat over 1 year ago

Error on num_kv_heads when using TGI

2

#5 opened over 1 year ago by

nsegev