options

exec - 2025-09-12 15:22:32 - MAQAO 2025.1.2

Help is available by moving the cursor above any symbol or by checking MAQAO website.

Global Metrics

Total Time (s)12.84
Max (Thread Active Time) (s)11.97
Average Active Time (s)11.72
Activity Ratio (%)95.9
Average number of active threads87.596
Affinity Stability (%)97.9
Time in analyzed loops (%)67.4
Time in analyzed innermost loops (%)66.9
Time in user code (%)70.6
Compilation Options Score (%)100
Array Access Efficiency (%)66.7
Potential Speedups
Perfect Flow Complexity1.00
Perfect OpenMP/MPI/Pthread/TBB1.27
Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution1.45
No Scalar IntegerPotential Speedup1.03
Nb Loops to get 80%1
FP VectorisedPotential Speedup1.53
Nb Loops to get 80%1
Fully VectorisedPotential Speedup1.28
Nb Loops to get 80%1
FP Arithmetic OnlyPotential Speedup1.04
Nb Loops to get 80%2

CQA Potential Speedups Summary

Average Active Threads Count

Loop Based Profile

Innermost Loop Based Profile

Application Categorization

Compilation Options

Source ObjectIssue
libllama.so
llama-vocab.cpp
llama-sampling.cpp
std_function.h
hashtable_policy.h
hashtable.h
unicode.cpp
llama-impl.cpp
llama-kv-cache.cpp
exec
regex_executor.tcc
sampling.cpp
vector.tcc
basic_string.h
main.cpp
libggml-base.so
ggml-quants.c
ggml.c
basic_string.tcc
gguf.cpp
ggml-backend.cpp
libggml-cpu.so
binary-ops.cpp
repack.cpp
ops.cpp
ggml-cpu.cpp
traits.cpp
vec.cpp
ggml-cpu.c
quants.c

Loop Path Count Profile

Cumulated Speedup If No Scalar Integer

Cumulated Speedup If FP Vectorized

Cumulated Speedup If Fully Vectorized

Cumulated Speedup If FP Arithmetic Only

Experiment Summary

Application/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/175-768-9528/llama.cpp/run/binaries/gcc_3/exec
Timestamp2025-09-12 15:22:32 Universal Timestamp1757690552
Number of processes observed1 Number of threads observed96
Experiment TypeMPI; OpenMP;
Machineip-172-31-47-249.ec2.internal
Architectureaarch64 Micro ArchitectureARM_NEOVERSE_V2
OS VersionLinux 6.1.109-118.189.amzn2023.aarch64 #1 SMP Tue Sep 10 08:58:40 UTC 2024
Architecture used during static analysisaarch64 Micro Architecture used during static analysisARM_NEOVERSE_V2
Frequency DriverNA Frequency GovernorNA
Huge Pagesmadvise Hyperthreadingoff
Number of sockets1 Number of cores per socket96
Compilation Optionsexec: GNU C++17 14.2.0 -mcpu=neoverse-v2+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC
libggml-base.so: GNU C11 14.2.0 -mcpu=neoverse-v2+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC
libggml-cpu.so: GNU C11 14.2.0 -mcpu=neoverse-v2+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp
libllama.so: GNU C++17 14.2.0 -mcpu=neoverse-v2+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC

Configuration Summary

Dataset
Run Command<executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 96 -n 512 -p "what is a LLM?" --seed 0
MPI Commandmpirun -n <number_processes> --bind-to none --report-bindings
Number Processes1
Number Nodes1
FilterNot Used
Profile StartNot Used
×