Theme: MAQAO_theme darkgrey cyan Chart Theme: Default_Chart_Theme grey
Help is available by moving the cursor above any symbol or by checking MAQAO website .
There is no filter information to display
Total Time (s) 2.60
Max (Thread Active Time) (s) 1.10
Average Active Time (s) 0.45
Activity Ratio (%) 57.2
Average number of active threads 16.790
Affinity Stability (%) 65.9
Time in analyzed loops (%) 53.4
Time in analyzed innermost loops (%) 52.1
Time in user code (%) 53.7
Compilation Options Score (%) 99.0
Array Access Efficiency (%) 74.1
Potential Speedups
Perfect Flow Complexity 1.00
Perfect OpenMP/MPI/Pthread/TBB 1.06
Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution 4.41
No Scalar Integer Potential Speedup 1.01
Nb Loops to get 80% 4
FP Vectorised Potential Speedup 1.00
Nb Loops to get 80% 2
Fully Vectorised Potential Speedup 1.32
Nb Loops to get 80% 1
FP Arithmetic Only Potential Speedup 1.70
Nb Loops to get 80% 1
Source Object Issue
▼ libllama.so–
○ hashtable.h-mcpu=native is missing.
○ stl_pair.h-mcpu=native is missing.
○ unicode.cpp-mcpu=native is missing.
○ hashtable_policy.h-mcpu=native is missing.
○ llama-vocab.cpp-mcpu=native is missing.
▼ libggml-cpu.so–
○ vec.cpp
○ binary-ops.cpp
○ kleidiai.cpp
○ kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c
○ kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c
○ ggml-cpu.c
○ kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c
○ ops.cpp
▼ [vdso]–
▼ –
○ -g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target)
○ -O2, -O3 or -Ofast is missing.
○ -mcpu=native is missing.
Application /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/run/oneview_runs/defaults/orig/exec
Timestamp 2025-11-24 14:47:56
Universal Timestamp 1763995676
Number of processes observed 1
Number of threads observed 96
Experiment Type MPI; OpenMP;
Machine ip-172-31-35-140.ec2.internal
Architecture aarch64
Micro Architecture ARM_NEOVERSE_V2
OS Version Linux 6.1.158-178.288.amzn2023.aarch64 #1 SMP Mon Nov 3 18:38:05 UTC 2025
Architecture used during static analysis aarch64
Micro Architecture used during static analysis ARM_NEOVERSE_V2
Frequency Driver NA
Frequency Governor NA
Huge Pages madvise
Hyperthreading off
Number of sockets 1
Number of cores per socket 96
Compilation Options + [vdso]: N/A libggml-cpu.so : Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_KLEIDIAI -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/ggml/src/.. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/ggml/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src/kai -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_fp32_bf16p_bf16p -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -mcpu=native+dotprod+i8mm+sve+nosme -fopenmp=libomp -mcpu=native+dotprod+i8mm+sve+nosme -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/__/__/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c libllama.so : Arm Toolchain for Linux 21.1 clang version 21.1.1 (https://github.com/arm/arm-toolchain.git 8406e267866a1511ab7f7d56ef7361208c0d44ae) /opt/arm/arm-toolchain-for-linux/bin/clang-21 -frtlib-add-rpath -fveclib=ArmPL -mllvm -gvn-add-phi-translation=1 -mllvm -store-to-load-forwarding-conflict-detection=0 --driver-mode=g++ -D GGML_BACKEND_SHARED -D GGML_SHARED -D GGML_USE_BLAS -D GGML_USE_CPU -D LLAMA_BUILD -D LLAMA_SHARED -D llama_EXPORTS -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/src/. -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/src/../include -I /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -MD -MT src/CMakeFiles/llama.dir/unicode.cpp.o -MF src/CMakeFiles/llama.dir/unicode.cpp.o.d -o src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-399-5611/llama.cpp/build/llama.cpp/src/unicode.cpp
Dataset
Run Command <executable> -m meta-llama-3.1-8b-instruct-Q4_0.gguf -t 96 -b 2048 -ub 512 -npp 128 -ntg 0 -npl 2 -c 16384 --seed 0 --output-format jsonl
MPI Command mpirun -n <number_processes> --bind-to none --report-bindings /usr/bin/numactl -C 0-95
Number Processes 1
Number Nodes 1
Filter Not Used
Profile Start Not Used
Profile Stop Not Used