Repository: ggml-org/llama.cpp
Pull request: SYCL: upgraded default oneAPI version on Dockerfile

This Pull Request upgrades the default oneAPI version on the `.devops/intel.Dockerfile`. The latest `2025.3.2-0-devel-ubuntu24.04` brings more performance than the existing `2025.2.2-0-devel-ubuntu24.04`:

`2025.2.2-0-devel-ubuntu24.04`:
| Model Name | Parameters | Quantization | pp512 | tg128 |
| :--- | :--- | :--- | :--- | :--- |
| gpt-oss-20b | 20.91B | Q4_K_M | 639.33 ± 10.42 | 16.92 ± 0.27 |
| gpt-oss-20b | 20.91B | Q2_K | 628.51 ± 13.11 | 16.71 ± 0.02 |
| Qwen2.5-Coder-14B-Instruct | 14.77B | Q4_K_M | 416.67 ± 1.27 | 29.65 ± 0.02 |
| Qwen3-14B | 14.77B | Q4_K_M | 419.17 ± 4.08 | 29.45 ± 0.41 |
| Qwen3.5-9B | 8.95B | Q8_0 | 642.81 ± 4.91 | 10.03 ± 0.26 |
| Qwen3.5-9B | 8.95B | Q4_K_M | 645.83 ± 4.39 | 35.13 ± 0.39 |
| omnicoder-9b | 8.95B | Q4_K_M | 648.59 ± 4.63 | 36.63 ± 0.29 |
| Qwen3-8B | 8.19B | Q4_K_M | 756.69 ± 6.33 | 44.00 ± 0.42 |
| Qwen2.5-Coder-7B-Instruct | 7.62B | Q4_K_M | 846.67 ± 2.70 | 53.16 ± 0.48 |
| Qwen3.5-4B | 4.21B | BF16 | 71.20 ± 0.10 | 2.94 ± 0.12 |
| Qwen3.5-4B | 4.21B | F16 | 1152.81 ± 0.63 | 34.79 ± 0.08 |
| Qwen3.5-4B | 4.21B | Q8_0 | 1130.21 ± 7.72 | 18.62 ± 0.02 |
| Qwen3.5-4B | 4.21B | Q4_K_M | 1182.68 ± 9.14 | 55.50 ± 0.54 |
| Qwen3-4B-Instruct-2507 | 4.02B | Q4_K_M | 1371.27 ± 13.64 | 62.75 ± 0.26 |
| Qwen2.5-Coder-3B-Instruct | 3.09B | Q4_K_M | 1860.04 ± 5.46 | 76.70 ± 0.20 |
| Qwen3.5-2B | 1.88B | BF16 | 179.73 ± 0.61 | 6.97 ± 0.01 |
| Qwen3.5-2B | 1.88B | F16 | 2761.32 ± 1.47 | 62.53 ± 0.02 |
| Qwen3.5-2B | 1.88B | Q8_0 | 2811.70 ± 18.59 | 37.88 ± 0.01 |
| Qwen3.5-2B | 1.88B | Q4_K_M | 2938.89 ± 10.37 | 91.62 ± 0.09 |
| Qwen3.5-0.8B | 752.39M | BF16 | 418.93 ± 4.15 | 12.30 ± 0.04 |
| Qwen3.5-0.8B | 752.39M | F16 | 4997.78 ± 7.13 | 109.30 ± 0.16 |
| Qwen3.5-0.8B | 752.39M | Q8_0 | 5121.73 ± 6.20 | 73.47 ± 0.05 |
| Qwen3.5-0.8B | 752.39M | Q4_K_M | 5290.41 ± 2.60 | 115.96 ± 0.56 |
| Qwen3-Embedding-0.6B | 595.78M | Q8_0 | 7435.93 ± 22.01 | 80.41 ± 0.34 | 

[logs](https://github.com/user-attachments/files/26098898/message.1.txt)

<br>

`2025.2.2-0-devel-ubuntu24.04`:
| Model Name | Parameters | Quantization | pp512 | tg128 |
| :--- | :--- | :--- | :--- | :--- |
| gpt-oss-20b | 20.91B | Q4_K_M | 655.47 ± 11.24 | 18.17 ± 0.18 |
| gpt-oss-20b | 20.91B | Q2_K | 643.90 ± 14.37 | 17.46 ± 0.10 |
| Qwen2.5-Coder-14B-Instruct | 14.77B | Q4_K_M | 423.47 ± 0.46 | 31.78 ± 0.10 |
| Qwen3-14B | 14.77B | Q4_K_M | 424.14 ± 0.64 | 32.17 ± 0.04 |
| Qwen3.5-9B | 8.95B | Q8_0 | 659.36 ± 5.37 | 10.25 ± 0.26 |
| Qwen3.5-9B | 8.95B | Q4_K_M | 658.82 ± 3.81 | 37.34 ± 0.33 |
| omnicoder-9b | 8.95B | Q4_K_M | 631.66 ± 4.17 | 37.92 ± 0.24 |
| Qwen3-8B | 8.19B | Q4_K_M | 782.91 ± 1.78 | 48.61 ± 0.06 |
| Qwen2.5-Coder-7B-Instruct | 7.62B | Q4_K_M | 858.90 ± 1.96 | 57.45 ± 0.05 |
| Qwen3.5-4B | 4.21B | BF16 | 65.36 ± 1.32 | 3.30 ± 0.05 |
| Qwen3.5-4B | 4.21B | F16 | 1161.92 ± 1.06 | 36.61 ± 0.10 |
| Qwen3.5-4B | 4.21B | Q8_0 | 1144.74 ± 6.69 | 19.10 ± 0.02 |
| Qwen3.5-4B | 4.21B | Q4_K_M | 1190.39 ± 9.88 | 61.38 ± 0.35 |
| Qwen3-4B-Instruct-2507 | 4.02B | Q4_K_M | 1397.67 ± 3.08 | 73.83 ± 1.30 |
| Qwen2.5-Coder-3B-Instruct | 3.09B | Q4_K_M | 1909.79 ± 5.71 | 87.35 ± 1.17 |
| Qwen3.5-2B | 1.88B | BF16 | 178.57 ± 1.11 | 6.22 ± 0.54 |
| Qwen3.5-2B | 1.88B | F16 | 2784.97 ± 7.18 | 66.06 ± 0.59 |
| Qwen3.5-2B | 1.88B | Q8_0 | 2842.09 ± 20.04 | 39.19 ± 0.17 |
| Qwen3.5-2B | 1.88B | Q4_K_M | 2926.02 ± 105.98 | 100.04 ± 3.09 |
| Qwen3.5-0.8B | 752.39M | BF16 | 419.27 ± 7.09 | 12.43 ± 0.24 |
| Qwen3.5-0.8B | 752.39M | F16 | 5049.71 ± 13.14 | 124.01 ± 0.31 |
| Qwen3.5-0.8B | 752.39M | Q8_0 | 5178.23 ± 10.85 | 79.31 ± 0.04 |
| Qwen3.5-0.8B | 752.39M | Q4_K_M | 5329.33 ± 10.49 | 142.72 ± 1.14 |
| Qwen3-Embedding-0.6B | 595.78M | Q8_0 | 7644.21 ± 14.42 | 91.50 ± 0.66 |

[logs](https://github.com/user-attachments/files/26098910/message.2.txt)

<br>

I also realized that manually installing the latest compute-runtime (https://github.com/intel/compute-runtime/releases/tag/26.09.37435.1) brings even more optimization, but that would require another Pull Request. Let me know if I can do that.

Hardware used: Ryzen 7 5700X3D, x2 16GB at 4000MHz, B580

AI was used only to create those tables

Changed files:
filename: .devops/intel.Dockerfile
patch: @@ -1,4 +1,4 @@
-ARG ONEAPI_VERSION=2025.2.2-0-devel-ubuntu24.04
+ARG ONEAPI_VERSION=2025.3.2-0-devel-ubuntu24.04
 
 ## Build Image