Help is available by moving the cursor above any
symbol or by checking MAQAO website.
| Metric | r0 | r1 | r2 | r3 | r4 | r5 | r6 | r7 | r8 | r9 | r10 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Total Time (s) | 558.55 | 278.76 | 140.60 | 71.75 | 37.78 | 27.79 | 21.42 | 18.92 | 16.99 | 15.95 | 14.35 | |
| Max (Thread Active Time) (s) | 557.43 | 277.65 | 139.54 | 70.65 | 36.56 | 26.40 | 19.98 | 17.27 | 15.24 | 14.04 | 12.55 | |
| Average Active Time (s) | 557.43 | 277.46 | 139.23 | 70.29 | 36.15 | 26.03 | 19.60 | 16.91 | 14.87 | 13.65 | 12.04 | |
| Activity Ratio (%) | 99.8 | 99.7 | 99.6 | 99.2 | 98.3 | 97.2 | 96.1 | 94.6 | 93.3 | 91.7 | 90.6 | |
| Average number of active threads | 0.998 | 1.991 | 3.961 | 7.837 | 15.307 | 22.477 | 29.278 | 35.765 | 41.993 | 47.932 | 53.665 | |
| Affinity Stability (%) | 100.0 | 99.9 | 99.8 | 99.6 | 99.1 | 98.7 | 98.3 | 98.1 | 97.7 | 97.5 | 97.2 | |
| Time in analyzed loops (%) | 99.5 | 99.3 | 99.0 | 98.5 | 97.1 | 94.0 | 94.3 | 89.6 | 87.5 | 85.1 | 87.1 | |
| Time in analyzed innermost loops (%) | 98.3 | 98.1 | 97.9 | 97.3 | 95.8 | 92.7 | 93.1 | 88.4 | 86.4 | 83.9 | 86.0 | |
| Time in user code (%) | 99.7 | 99.5 | 99.3 | 98.8 | 97.4 | 94.7 | 94.6 | 90.0 | 88.0 | 85.8 | 87.6 | |
| Compilation Options Score (%) | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | |
| Array Access Efficiency (%) | 79.9 | 79.9 | 79.9 | 79.9 | 79.9 | 79.6 | 79.8 | 79.8 | 79.8 | 79.4 | 79.7 | |
| Potential Speedups | ||||||||||||
| Perfect Flow Complexity | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | |
| Perfect OpenMP/MPI/Pthread/TBB | 1.00 | 1.00 | 1.00 | 1.01 | 1.02 | 1.05 | 1.04 | 1.09 | 1.12 | 1.13 | 1.11 | |
| Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution | 1.00 | 1.00 | 1.01 | 1.01 | 1.03 | 1.06 | 1.07 | 1.13 | 1.16 | 1.19 | 1.18 | |
| Scalability - Gap | 1.00 | 1.00 | 1.01 | 1.03 | 1.08 | 1.19 | 1.23 | 1.35 | 1.46 | 1.60 | 1.64 | |
| No Scalar Integer | Potential Speedup | 1.46 | 1.46 | 1.46 | 1.46 | 1.45 | 1.39 | 1.43 | 1.40 | 1.38 | 1.34 | 1.38 |
| Nb Loops to get 80% | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| FP Vectorised | Potential Speedup | 1.19 | 1.19 | 1.19 | 1.19 | 1.19 | 1.17 | 1.18 | 1.17 | 1.17 | 1.15 | 1.17 |
| Nb Loops to get 80% | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Fully Vectorised | Potential Speedup | 5.20 | 5.16 | 5.10 | 4.98 | 4.71 | 3.56 | 4.24 | 3.65 | 3.44 | 2.84 | 3.40 |
| Nb Loops to get 80% | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Only FP Arithmetic | Potential Speedup | 3.11 | 3.10 | 3.08 | 3.04 | 2.96 | 2.62 | 2.79 | 2.56 | 2.47 | 2.26 | 2.45 |
| Nb Loops to get 80% | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Source Object | Issue |
|---|---|
| ▼libllama.so | |
| ▼ | |
| ○ | -g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target) |
| ○ | -O2, -O3 or -Ofast is missing. |
| ○ | -mcpu=native is missing. |
| ▼exec | |
| ▼ | |
| ○ | -g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target) |
| ○ | -O2, -O3 or -Ofast is missing. |
| ○ | -mcpu=native is missing. |
| ▼libggml-base.so | |
| ▼ggml.c | |
| ○ | |
| ▼libggml-cpu.so | |
| ▼binary-ops.cpp | |
| ○ | |
| ▼traits.cpp | |
| ○ | |
| ▼kernels.cpp | |
| ○ | |
| ▼vec.cpp | |
| ○ | |
| ▼kleidiai.cpp | |
| ○ | |
| ▼ops.cpp | |
| ○ | |
| ▼ggml-cpu.c | |
| ○ | |
| ▼quants.c | |
| ○ |
| r0 | r1 | r2 | r3 | r4 | r5 | r6 | r7 | r8 | r9 | r10 | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Application | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-415-3385/llama.cpp/run/binaries/gcc_5/exec | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Timestamp | 2025-11-26 16:50:35 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Experiment Type | MPI; | MPI; OpenMP; | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 | same as r1 |
| Machine | ip-172-31-46-37.ec2.internal | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Architecture | aarch64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Micro Architecture | ARM_NEOVERSE_V1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Model Name | |||||||||||
| Cache Size | |||||||||||
| Number of Cores | |||||||||||
| Maximal Frequency | 0 GHz | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| OS Version | Linux 6.1.158-178.288.amzn2023.aarch64 #1 SMP Mon Nov 3 18:38:05 UTC 2025 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Architecture used during static analysis | aarch64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Micro Architecture used during static analysis | ARM_NEOVERSE_V1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Compilation Options | libggml-base.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=neoverse-v1 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -fno-tree-vectorize -fno-openmp-simd -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC libggml-cpu.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=neoverse-v1 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -fno-tree-vectorize -fno-openmp-simd -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp libllama.so: N/A | same as r0 | same as r0 | same as r0 | same as r0 | exec: N/A libggml-base.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=neoverse-v1 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -fno-tree-vectorize -fno-openmp-simd -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC libggml-cpu.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=neoverse-v1 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -fno-tree-vectorize -fno-openmp-simd -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp libllama.so: N/A | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of processes observed | 1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of threads observed | 1 | 2 | 4 | 8 | 16 | 24 | 32 | 40 | 48 | 56 | 64 |
| Frequency Driver | NA | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Frequency Governor | NA | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Huge Pages | madvise | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Hyperthreading | off | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of sockets | 1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of cores per socket | 64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| MAQAO version | 2025.1.3 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| MAQAO build | b489783858807c9a72e0923fd7b399a22c81991c::20251024-122946 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Comments | OV scalability run using gcc_5 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |