Help is available by moving the cursor above any 
symbol or by checking MAQAO website.
| Metric | r0 | r1 | r2 | r3 | r4 | r5 | r6 | r7 | r8 | r9 | r10 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Total Time (s) | 22.13 | 12.47 | 7.62 | 5.20 | 4.01 | 3.71 | 3.53 | 3.44 | 3.36 | 3.30 | 3.30 | |
| Max (Thread Active Time) (s) | 20.20 | 10.64 | 5.77 | 3.43 | 2.23 | 1.90 | 1.65 | 1.59 | 1.52 | 1.49 | 1.45 | |
| Average Active Time (s) | 20.20 | 10.24 | 5.21 | 2.71 | 1.44 | 1.12 | 0.94 | 0.82 | 0.73 | 0.66 | 0.62 | |
| Activity Ratio (%) | 91.3 | 90.4 | 87.9 | 84.4 | 77.0 | 73.6 | 70.7 | 68.3 | 64.9 | 62.4 | 61.0 | |
| Average number of active threads | 0.913 | 1.643 | 2.733 | 4.176 | 5.766 | 7.269 | 8.490 | 9.571 | 10.374 | 11.202 | 11.972 | |
| Affinity Stability (%) | 61.9 | 88.6 | 86.7 | 83.1 | 79.4 | 77.1 | 75.0 | 73.2 | 71.1 | 69.6 | 69.9 | |
| Time in analyzed loops (%) | 98.2 | 97.0 | 95.6 | 92.0 | 86.2 | 82.5 | 78.3 | 74.7 | 71.7 | 67.8 | 68.1 | |
| Time in analyzed innermost loops (%) | 95.8 | 94.9 | 93.4 | 89.4 | 83.8 | 80.2 | 76.1 | 72.9 | 70.2 | 66.3 | 66.0 | |
| Time in user code (%) | 98.7 | 97.5 | 96.1 | 92.4 | 86.7 | 82.8 | 78.8 | 75.2 | 72.1 | 68.2 | 68.5 | |
| Compilation Options Score (%) | 99.8 | 99.7 | 99.7 | 99.7 | 99.6 | 99.6 | 99.7 | 99.6 | 99.6 | 99.5 | 99.5 | |
| Array Access Efficiency (%) | 73.3 | 73.2 | 73.3 | 73.2 | 73.2 | 73.6 | 73.2 | 73.5 | 73.6 | 73.5 | 73.3 | |
| Potential Speedups | | |||||||||||
| Perfect Flow Complexity | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | |
| Perfect OpenMP/MPI/Pthread/TBB | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.01 | 1.01 | 1.02 | 1.02 | 1.02 | 1.03 | |
| Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution | 1.00 | 1.05 | 1.13 | 1.35 | 1.75 | 2.02 | 2.21 | 2.53 | 2.86 | 3.25 | 3.37 | |
| Scalability - Gap | 1.00 | 1.13 | 1.38 | 1.88 | 2.90 | 4.02 | 5.10 | 6.21 | 7.30 | 8.36 | 9.53 | |
| No Scalar Integer | Potential Speedup | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 |
| Nb Loops to get 80% | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| FP Vectorised | Potential Speedup | 1.16 | 1.16 | 1.16 | 1.15 | 1.14 | 1.14 | 1.13 | 1.12 | 1.12 | 1.11 | 1.11 |
| Nb Loops to get 80% | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Fully Vectorised | Potential Speedup | 3.91 | 3.76 | 3.64 | 3.31 | 2.88 | 2.69 | 2.46 | 2.33 | 2.22 | 2.07 | 2.06 |
| Nb Loops to get 80% | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Only FP Arithmetic | Potential Speedup | 4.36 | 4.17 | 4.00 | 3.59 | 3.04 | 2.84 | 2.56 | 2.38 | 2.27 | 2.12 | 2.11 |
| Nb Loops to get 80% | 2 | 2 | 2 | 2 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Source Object | Issue |
|---|---|
| ▼libllama.so | |
| ▼hashtable.h | |
| ○ | -mcpu=native is missing. |
| ▼stl_tree.h | |
| ○ | -mcpu=native is missing. |
| ▼llama-kv-cache.cpp | |
| ○ | -mcpu=native is missing. |
| ▼llama-vocab.cpp | |
| ○ | -mcpu=native is missing. |
| ▼llama-impl.cpp | |
| ○ | -mcpu=native is missing. |
| ▼stl_vector.h | |
| ○ | -mcpu=native is missing. |
| ▼unicode.cpp | |
| ○ | -mcpu=native is missing. |
| ▼stl_pair.h | |
| ○ | -mcpu=native is missing. |
| ▼hashtable_policy.h | |
| ○ | -mcpu=native is missing. |
| ▼libggml-cpu.so | |
| ▼vec.cpp | |
| ○ | |
| ▼traits.cpp | |
| ○ | |
| ▼kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c | |
| ○ | |
| ▼kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c | |
| ○ | |
| ▼kleidiai.cpp | |
| ○ | |
| ▼ops.cpp | |
| ○ | |
| ▼kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c | |
| ○ | |
| ▼binary-ops.cpp | |
| ○ | |
| ▼ggml-cpu.c | |
| ○ | |
| ▼quants.c | |
| ○ | |
| ▼libggml-base.so | |
| ▼ggml-alloc.c | |
| ○ | -mcpu=native is missing. |
| ▼ggml-backend.cpp | |
| ○ | -mcpu=native is missing. |
| ▼gguf.cpp | |
| ○ | -mcpu=native is missing. |
| ▼ggml.c | |
| ○ | -mcpu=native is missing. |
| ▼[vdso] | |
| ▼ | |
| ○ | -g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target) |
| ○ | -O2, -O3 or -Ofast is missing. |
| ○ | -mcpu=native is missing. |
| ▼exec | |
| ▼basic_string.h | |
| ○ | -mcpu=native is missing. |
| ▼stl_uninitialized.h | |
| ○ | -mcpu=native is missing. |
| r0 | r1 | r2 | r3 | r4 | r5 | r6 | r7 | r8 | r9 | r10 | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Application | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/run/oneview_runs/defaults/orig/exec | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Timestamp | 2025-11-24 15:00:33 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Experiment Type | MPI; | MPI; OpenMP; | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 |
| Machine | ip-172-31-46-37.ec2.internal | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Architecture | aarch64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Micro Architecture | ARM_NEOVERSE_V1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Model Name | |||||||||||
| Cache Size | |||||||||||
| Number of Cores | |||||||||||
| Maximal Frequency | 0 GHz | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| OS Version | Linux 6.1.158-178.288.amzn2023.aarch64 #1 SMP Mon Nov 3 18:38:05 UTC 2025 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Architecture used during static analysis | aarch64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Micro Architecture used during static analysis | ARM_NEOVERSE_V1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Compilation Options | exec: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_SHARED -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/../vendor -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT common/CMakeFiles/common.dir/sampling.cpp.o -MF common/CMakeFiles/common.dir/sampling.cpp.o.d -o common/CMakeFiles/common.dir/sampling.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/sampling.cpp libggml-base.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BUILD -D GGML_COMMIT=\"unknown\" -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_VERSION=\"0.0.0\" -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_base_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o -MF ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o.d -o ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/gguf.cpp libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | + [vdso]: N/A exec: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_SHARED -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/../vendor -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT common/CMakeFiles/common.dir/sampling.cpp.o -MF common/CMakeFiles/common.dir/sampling.cpp.o.d -o common/CMakeFiles/common.dir/sampling.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/sampling.cpp libggml-base.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BUILD -D GGML_COMMIT=\"unknown\" -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_VERSION=\"0.0.0\" -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_base_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o -MF ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o.d -o ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/gguf.cpp libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | + [vdso]: N/A libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | + [vdso]: N/A libggml-base.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BUILD -D GGML_COMMIT=\"unknown\" -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_VERSION=\"0.0.0\" -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_base_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o -MF ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o.d -o ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-backend.cpp libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | same as r2 | same as r2 | + [vdso]: N/A libggml-base.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BUILD -D GGML_COMMIT=\"unknown\" -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_VERSION=\"0.0.0\" -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_base_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -MD -MT ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -MF ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o.d -o ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml.c libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | + [vdso]: N/A exec: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_SHARED -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/../vendor -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT common/CMakeFiles/common.dir/chat.cpp.o -MF common/CMakeFiles/common.dir/chat.cpp.o.d -o common/CMakeFiles/common.dir/chat.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/chat.cpp libggml-base.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BUILD -D GGML_COMMIT=\"unknown\" -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_VERSION=\"0.0.0\" -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_base_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -MD -MT ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o -MF ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o.d -o ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-alloc.c libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | + [vdso]: N/A exec: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_SHARED -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/../vendor -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT common/CMakeFiles/common.dir/sampling.cpp.o -MF common/CMakeFiles/common.dir/sampling.cpp.o.d -o common/CMakeFiles/common.dir/sampling.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/sampling.cpp libggml-base.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BUILD -D GGML_COMMIT=\"unknown\" -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_VERSION=\"0.0.0\" -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_base_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -MD -MT ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -MF ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o.d -o ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml.c libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | + [vdso]: N/A exec: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_SHARED -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/../vendor -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT common/CMakeFiles/common.dir/chat.cpp.o -MF common/CMakeFiles/common.dir/chat.cpp.o.d -o common/CMakeFiles/common.dir/chat.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/chat.cpp libggml-base.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BUILD -D GGML_COMMIT=\"unknown\" -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_VERSION=\"0.0.0\" -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_base_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -MD -MT ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -MF ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o.d -o ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml.c libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp | + [vdso]: N/A exec: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_SHARED -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/../vendor -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT common/CMakeFiles/common.dir/chat.cpp.o -MF common/CMakeFiles/common.dir/chat.cpp.o.d -o common/CMakeFiles/common.dir/chat.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/common/chat.cpp libggml-cpu.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so: Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-399-5586/llama.cpp/build/llama.cpp/src/unicode.cpp |
| Number of processes observed | 1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of threads observed | 1 | 2 | 4 | 8 | 16 | 24 | 32 | 40 | 48 | 56 | 64 |
| Frequency Driver | NA | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Frequency Governor | NA | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Huge Pages | madvise | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Hyperthreading | off | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of sockets | 1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of cores per socket | 64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| MAQAO version | 2025.1.3 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| MAQAO build | b489783858807c9a72e0923fd7b399a22c81991c::20251024-122946 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Comments | OV scalability run using armclang | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |