Llama.cpp is LLM inference in C/C++.
Date: 2024-04
Affected: ggml/llama.cpp
Attack vector: rce
Category: vulnerability-disclosure
Severity: High
CVE: CVE-2024-32878
CWE: CWE-456
CVSS: 7.1 (CVSS:3.1/AV:N/AC:H/PR:N/UI:R/S:U/C:H/I:H/A:L)

Llama.cpp is LLM inference in C/C++. There is a use of uninitialized heap variable vulnerability in gguf_init_from_file, the code will free this uninitialized variable later. In a simple POC, it will directly cause a crash. If the file is carefully constructed, it may be possible to control this uninitialized value and cause arbitrary address free problems. This may further lead to be exploited. Causes llama.cpp to crash (DoS) and may even lead to arbitrary code execution (RCE). This vulnerability has been patched in commit b2740.


Mitigations:

Architectural layers (MAESTRO):