Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference

RuntimeError: The size of tensor a (2805) must match the size of tensor b (2048) at non-singleton dimension 3

#47
by dounykim - opened

I am getting RuntimeError: The size of tensor a (2805) must match the size of tensor b (2048) at non-singleton dimension 3.

I have no idea how to solve this problem because it works fine when I type English into the prompt but when I write in Korean, it returns error.

dounykim changed discussion status to closed

Sign up or log in to comment