Failed to load model in LM Studio, wrong number of tensors

#4
by mjcortejo - opened

Hi! I am trying to load this model in LM Studio in a Mac, but couldn't launch the model.

Anyone else experiencing this on a MacOS or in PC?

{
  "title": "Failed to load model",
  "cause": "llama.cpp error: 'done_getting_tensors: wrong number of tensors; expected 255, got 254'",
  "errorData": {
    "n_ctx": 2048,
    "n_batch": 512,
    "n_gpu_layers": 0
  },
  "data": {
    "memory": {
      "ram_capacity": "24.00 GB",
      "ram_unused": "10.00 GB"
    },
    "gpu": {
      "type": "Apple Metal",
      "vram_recommended_capacity": "16.00 GB",
      "vram_unused": "9.64 GB"
    },
    "os": {
      "platform": "darwin",
      "version": "14.5"
    },
    "app": {
      "version": "0.2.23",
      "downloadsDir": "/Users/mark.cortejo/.cache/lm-studio/models"
    },
    "model": {}
  }
}```

You likely need to update your lmstudio to 0.3.X from the website

You likely need to update your lmstudio to 0.3.X from the website

Thank you! This is actually the issue. Should've figured to update LM Studio first. Thanks @bartowski !

mjcortejo changed discussion status to closed

Sign up or log in to comment