options

exec - 2025-11-24 17:34:53 - MAQAO 2025.1.3

Help is available by moving the cursor above any symbol or by checking MAQAO website.

Global Metrics

Total Time (s)21.14
Max (Thread Active Time) (s)4.81
Average Active Time (s)4.73
Activity Ratio (%)91.4
Average number of active threads21.478
Affinity Stability (%)97.2
GFLOPS301.725
Time in analyzed loops (%)5.00
Time in analyzed innermost loops (%)4.13
Time in user code (%)55.0
Compilation Options Score (%)99.9
Array Access Efficiency (%)89.7
Potential Speedups
Perfect Flow Complexity1.00
Perfect OpenMP/MPI/Pthread/TBB1.12
Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution1.80
No Scalar IntegerPotential Speedup1.01
Nb Loops to get 80%2
FP VectorisedPotential Speedup1.00
Nb Loops to get 80%3
Fully VectorisedPotential Speedup1.02
Nb Loops to get 80%6
FP Arithmetic OnlyPotential Speedup1.02
Nb Loops to get 80%4

CQA Potential Speedups Summary

Average Active Threads Count⏎

FLOPS Breakdown⏎

Loop Based Profile⏎

Innermost Loop Based Profile⏎

Application Categorization⏎

Compilation Options⏎

Source ObjectIssue
▼libllama.so–
▼–
○-g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target)
○-O2, -O3 or -Ofast is missing.
○-march=(target) is missing.
▼libggml-cpu.so–
○binary-ops.cpp
○vec.cpp
○mmq.cpp
○ops.cpp
○common.h
○ggml-cpu.c
○quants.c
▼libggml-base.so–
▼–
○-g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target)
○-O2, -O3 or -Ofast is missing.
○-march=(target) is missing.

Loop Path Count Profile⏎

Cumulated Speedup If No Scalar Integer⏎

Cumulated Speedup If FP Vectorized⏎

Cumulated Speedup If Fully Vectorized⏎

Cumulated Speedup If FP Arithmetic Only⏎

Experiment Summary

Application/beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/run/oneview_runs/defaults/orig/exec
Timestamp2025-11-24 17:34:53 Universal Timestamp1764002093
Number of processes observed1 Number of threads observed96
Experiment TypeMPI; OpenMP;
Machineisix06.benchmarkcenter.megware.com
Model NameIntel(R) Xeon(R) 6972P
Architecturex86_64 Micro ArchitectureGRANITE_RAPIDS
Cache Size491520 KB Number of Cores96
OS VersionLinux 5.14.0-570.39.1.el9_6.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 4 05:08:52 EDT 2025
Architecture used during static analysisx86_64 Micro Architecture used during static analysisGRANITE_RAPIDS
Frequency Driverintel_pstate Frequency Governorperformance
Huge Pagesalways Hyperthreadingon
Number of sockets2 Number of cores per socket96
Compilation Optionslibggml-base.so: N/A
libggml-cpu.so: AMD clang version 17.0.6 (CLANG: AOCC_5.0.0-Build#1377 2024_09_24) /home/eoseret/aocc-compiler-5.0.0/bin/clang-17 --driver-mode=g++ -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/.. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -nopie -grecord-command-line -O3 -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -march=native -fopenmp=libomp -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -c /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp
libllama.so: N/A

Configuration Summary

Dataset
Run Command<executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -t 96 -b 2048 -ub 512 -npp 128 -ntg 0 -npl 16 -c 16384 --seed 0 --output-format jsonl
MPI Commandmpirun -n <number_processes> /usr/bin/numactl -C 0-95
Number Processes1
Number Nodes1
FilterNot Used
Profile StartNot Used
Profile StopNot Used
×