MBZUAI
/

MobiLlama-05B

Text Generation

text-generation-inference

Model card Files Files and versions Community

num_key_value_heads bug?

#4

by cckm - opened Mar 1

cckm

Mar 1

num_key_value_heads seems to be unreferenced in https://huggingface.co/MBZUAI/MobiLlama-05B/blob/main/modelling_mobillama.py?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment