options

Help is available by moving the cursor above any symbol or by checking MAQAO website.

Global Metrics

Metricr0r1r2r3r4r5r6r7r8r9r10
Total Time (s)64.3635.0418.5310.487.196.996.646.476.486.606.68
Max (Thread Active Time) (s)63.3233.9617.489.415.965.765.405.104.965.005.06
Average Active Time (s)63.3233.7817.219.075.665.404.974.704.594.574.62
Activity Ratio (%)98.497.997.094.991.290.488.686.684.482.482.2
Average number of active threads0.9841.9293.7156.92112.57818.53923.95529.06534.00338.81044.286
Affinity Stability (%)99.999.498.596.794.594.393.893.593.493.493.4
Time in analyzed loops (%)98.097.195.892.385.882.284.481.580.580.578.9
Time in analyzed innermost loops (%)96.395.694.390.684.781.483.680.979.979.978.3
Time in user code (%)99.598.797.493.886.983.085.282.381.381.279.6
Compilation Options Score (%)75.075.075.075.075.075.075.075.075.075.075.0
Array Access Efficiency (%)75.375.375.275.275.275.275.175.175.175.175.1
Potential Speedups
Perfect Flow Complexity1.001.001.001.001.001.001.001.001.001.001.00
Perfect OpenMP/MPI/Pthread/TBB1.001.011.011.041.111.121.121.171.191.151.25
Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution1.001.011.041.101.201.281.271.311.321.341.37
Scalability - Gap1.001.091.151.301.792.613.304.024.845.746.64
No Scalar IntegerPotential Speedup1.101.101.101.101.091.081.091.081.081.081.08
Nb Loops to get 80%11111111111
FP VectorisedPotential Speedup1.011.011.011.011.011.001.001.001.001.001.00
Nb Loops to get 80%11112222223
Fully VectorisedPotential Speedup1.171.161.161.151.131.111.111.111.101.101.10
Nb Loops to get 80%22222222222
Only FP ArithmeticPotential Speedup2.702.652.602.452.222.112.172.092.062.062.01
Nb Loops to get 80%22221111111

Scalability Speedup

Cumulated Speedup If No Scalar Integer

Cumulated Speedup If FP Vectorized

Cumulated Speedup If Fully Vectorized

Cumulated Speedup If Only FP Arithmetic

Loop Based Profiles

Innermost / Single Loops

Inbetween Loops

Outermost Loops

Cumulated Coverage With All Loops

Innermost Loop Based Profiles

Coverage

Count

Application Categorization

Time

Coverage

Compilation Options

Source ObjectIssue
▼libllama.so–
▼hashtable.h–
○-funroll-loops is missing.
▼basic_string.tcc–
○-funroll-loops is missing.
▼hashtable_policy.h–
○-funroll-loops is missing.
▼llama-impl.cpp–
○-funroll-loops is missing.
▼llama-vocab.cpp–
○-funroll-loops is missing.
▼libggml-cpu.so–
▼binary-ops.cpp–
○-funroll-loops is missing.
▼repack.cpp–
○-funroll-loops is missing.
▼kernels.cpp–
○-funroll-loops is missing.
▼kleidiai.cpp–
○-funroll-loops is missing.
▼ops.cpp–
○-funroll-loops is missing.
▼traits.cpp–
○-funroll-loops is missing.
▼vec.cpp–
○-funroll-loops is missing.
▼ggml-cpu.c–
○-funroll-loops is missing.
▼quants.c–
○-funroll-loops is missing.
▼libggml-base.so–
▼ggml.c–
○-funroll-loops is missing.

Path Count Profiles

Coverage

Count

Low Iteration Count Profiles

Coverage

Count

Average Number of Active Threads

Run 1 - 1x1

Run 2 - 1x2

Run 3 - 1x4

Run 4 - 1x8

Run 5 - 1x16

Run 6 - 1x24

Run 7 - 1x32

Run 8 - 1x40

Run 9 - 1x48

Run 10 - 1x56

Run 11 - 1x64

Experiment Summaries

r0r1r2r3r4r5r6r7r8r9r10
Application/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/run/base_runs/defaults/gcc/execsame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Timestamp2025-11-26 15:59:10same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Experiment TypeMPI; MPI; OpenMP; same as r1same as r1same as r1same as r1same as r1same as r1same as r1same as r1same as r1
Machineip-172-31-46-37.ec2.internalsame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Architectureaarch64same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Micro ArchitectureARM_NEOVERSE_V1same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Model Name
Cache Size
Number of Cores
Maximal Frequency0 GHzsame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
OS VersionLinux 6.1.158-178.288.amzn2023.aarch64 #1 SMP Mon Nov 3 18:38:05 UTC 2025same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Architecture used during static analysisaarch64same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Micro Architecture used during static analysisARM_NEOVERSE_V1same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Compilation Options libggml-base.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -march=armv8.2-a+crypto -mtune=neoverse-n1 -mlittle-endian -mabi=lp64 -g -O3 -O3 -std=gnu11 -fno-omit-frame-pointer -fcf-protection=none -fPIC
libggml-cpu.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=zeus+crypto+sha3+sm4+noprofile+nossbs+dotprod+i8mm+sve -mlittle-endian -mabi=lp64 -g -O3 -O3 -std=gnu11 -fno-omit-frame-pointer -fcf-protection=none -fPIC -fopenmp
libllama.so: GNU C++17 11.5.0 20240719 (Red Hat 11.5.0-5) -march=armv8.2-a+crypto -mtune=neoverse-n1 -mlittle-endian -mabi=lp64 -g -O3 -O3 -fno-omit-frame-pointer -fcf-protection=none -fPIC 		same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Number of processes observed1same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Number of threads observed124816243240485664
Frequency DriverNAsame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Frequency GovernorNAsame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Huge Pagesmadvisesame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Hyperthreadingoffsame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Number of sockets1same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
Number of cores per socket64same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
MAQAO version2025.1.3same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
MAQAO buildb489783858807c9a72e0923fd7b399a22c81991c::20251024-122946same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
CommentsOV scalability run using gccsame as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0same as r0
×