mlboydaisuke

/

Gemma-4-12B-CoreAI

like 1

Issue: Shape mismatch error when running the model

Command used:

COREAI_CHUNK_THRESHOLD=1 swift run -c release llm-runner \
    --model <path_to_model>/gemma4_12b_qat_decode_int4linsym_msdpa_g8 \
    --prompt "What is the capital of France?" \
    --max-tokens 64 \
    --chunk-size 1

Building for production...
[Computing dependencies]

Build complete! (0.86 secs)

⏳ Preparing AI asset from source...CoreAIRuntime/NDArrayDescriptor.swift:139: Fatal error: Shape at dimension 1 of 256 is not a valid substitution for source shape 1
zsh: trace trap  COREAI_CHUNK_THRESHOLD=1 swift run -c release llm-runner --model  --prompt