microsoft

/

Phi-4-multimodal-instruct

like 1.23k

Follow

Microsoft 10.6k

Hello,

Sorry in advance, newbie here, first post on a HF forum, i couldn't find how to format the log below, so just copy-pasted.

Just trying to run the example code, i get the following log.
It looks like when calling model.generate() at line 45 of the example, modeling_phi4mm.py() is failing because num_logits_to_keep isn't defined.
I don't know if i'm doing something wrong.
Any help appreciated.

Just in case it helps:

• i'm running on a 3060 RTX with cuda 12.8
• I tried both flash-attn and eager modes to no avail.

Here's the full log:

--- IMAGE PROCESSING ---

Prompt
<|user|><|image_1|>What is shown in this image?<|end|><|assistant|>
Traceback (most recent call last):
File "E:\cursorAI\phi4multimodal\app.py", line 45, in
generate_ids = model.generate(
^^^^^^^^^^^^^^^
File "E:\cursorAI\phi4multimodal\p4venv\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "E:\cursorAI\phi4multimodal\p4venv\Lib\site-packages\transformers\generation\utils.py", line 2223, in generate
result = self._sample(
^^^^^^^^^^^^^
File "E:\cursorAI\phi4multimodal\p4venv\Lib\site-packages\transformers\generation\utils.py", line 3211, in _sample
outputs = self(**model_inputs, return_dict=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\cursorAI\phi4multimodal\p4venv\Lib\site-packages\torch\nn\modules\module.py", line 1739, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\cursorAI\phi4multimodal\p4venv\Lib\site-packages\torch\nn\modules\module.py", line 1750, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\cedri.cache\huggingface\modules\transformers_modules\microsoft\Phi-4-multimodal-instruct\985802b4e1db71df6d366368508d5b30bd743c42\modeling_phi4mm.py", line 2137, in forward
logits = self.lm_head(hidden_states[:, -num_logits_to_keep:, :])
^^^^^^^^^^^^^^^^^^^
TypeError: bad operand type for unary -: 'NoneType'

Thanks for any help
Cedric