options

exec - 2025-11-24 11:01:41 - MAQAO 2025.1.3

Help is available by moving the cursor above any symbol or by checking MAQAO website.

Global Metrics

Total Time (s)4.70
Max (Thread Active Time) (s)3.03
Average Active Time (s)1.91
Activity Ratio (%)75.9
Average number of active threads39.051
Affinity Stability (%)81.5
Time in analyzed loops (%)92.0
Time in analyzed innermost loops (%)89.5
Time in user code (%)92.4
Compilation Options Score (%)100
Array Access Efficiency (%)74.3
Potential Speedups
Perfect Flow Complexity1.00
Perfect OpenMP/MPI/Pthread/TBB1.04
Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution1.70
No Scalar IntegerPotential Speedup1.02
Nb Loops to get 80%4
FP VectorisedPotential Speedup1.01
Nb Loops to get 80%2
Fully VectorisedPotential Speedup1.69
Nb Loops to get 80%1
FP Arithmetic OnlyPotential Speedup3.46
Nb Loops to get 80%1

CQA Potential Speedups Summary

Average Active Threads Count

Loop Based Profile

Innermost Loop Based Profile

Application Categorization

Compilation Options

Source ObjectIssue
libllama.so
hashtable.h
libggml-cpu.so
vec.cpp
traits.cpp
kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c
kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c
ops.cpp
kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c
binary-ops.cpp
ggml-cpu.c
quants.c
libggml-base.so
ggml.c

Loop Path Count Profile

Cumulated Speedup If No Scalar Integer

Cumulated Speedup If FP Vectorized

Cumulated Speedup If Fully Vectorized

Cumulated Speedup If FP Arithmetic Only

Experiment Summary

Application/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-35-140.ec2.internal/176-398-1667/llama.cpp/run/binaries/gcc_2/exec
Timestamp2025-11-24 11:01:41 Universal Timestamp1763982101
Number of processes observed1 Number of threads observed96
Experiment TypeMPI; OpenMP;
Machineip-172-31-35-140.ec2.internal
Architectureaarch64 Micro ArchitectureARM_NEOVERSE_V2
OS VersionLinux 6.1.158-178.288.amzn2023.aarch64 #1 SMP Mon Nov 3 18:38:05 UTC 2025
Architecture used during static analysisaarch64 Micro Architecture used during static analysisARM_NEOVERSE_V2
Frequency DriverNA Frequency GovernorNA
Huge Pagesmadvise Hyperthreadingoff
Number of sockets1 Number of cores per socket96
Compilation Optionslibggml-base.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=neoverse-v2 -msve-vector-bits=128 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC
libggml-cpu.so: GNU C11 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=neoverse-v2 -msve-vector-bits=128 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp
libllama.so: GNU C++17 11.5.0 20240719 (Red Hat 11.5.0-5) -mcpu=neoverse-v2 -msve-vector-bits=128 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC

Configuration Summary

Dataset
Run Command<executable> -m meta-llama-3.1-8b-instruct-Q4_0.gguf -t 96 -b 2048 -ub 512 -npp 128 -ntg 0 -npl 16 -c 16384 --seed 0 --output-format jsonl
MPI Commandmpirun -n <number_processes> --bind-to none --report-bindings /usr/bin/numactl -C 0-95
Number Processes1
Number Nodes1
FilterNot Used
Profile StartNot Used
Profile StopNot Used
×