Help is available by moving the cursor above any
symbol or by checking MAQAO website.
| Metric | r0 | r1 | r2 | r3 | r4 | r5 | |
|---|---|---|---|---|---|---|---|
| Total Time (s) | 21.14 | 21.45 | 21.57 | 21.61 | 21.40 | 21.75 | |
| Max (Thread Active Time) (s) | 4.81 | 4.91 | 4.83 | 4.89 | 4.79 | 4.90 | |
| Average Active Time (s) | 4.73 | 4.82 | 4.48 | 4.82 | 4.73 | 4.54 | |
| Activity Ratio (%) | 91.4 | 92.5 | 85.2 | 92.3 | 91.4 | 85.1 | |
| Average number of active threads | 21.478 | 21.572 | 19.946 | 21.407 | 21.240 | 20.019 | |
| Affinity Stability (%) | 97.2 | 97.4 | 95.1 | 95.2 | 95.1 | 94.8 | |
| GFLOPS | 301.725 | 294.750 | 299.307 | 295.654 | 301.005 | 295.038 | |
| Time in analyzed loops (%) | 5.00 | 38.9 | 5.24 | 4.84 | 13.9 | 14.0 | |
| Time in analyzed innermost loops (%) | 4.13 | 38.3 | 4.70 | 4.14 | 13.1 | 12.7 | |
| Time in user code (%) | 55.0 | 54.5 | 58.4 | 54.9 | 56.0 | 58.3 | |
| Compilation Options Score (%) | 99.9 | 97.8 | 74.9 | 98.0 | 99.9 | 87.4 | |
| Array Access Efficiency (%) | 89.7 | 95.6 | 85.7 | 94.8 | 64.3 | 55.6 | |
| Potential Speedups | |||||||
| Perfect Flow Complexity | 1.00 | 1.00 | 1.01 | 1.00 | 1.01 | 1.00 | |
| Perfect OpenMP/MPI/Pthread/TBB | 1.12 | 1.19 | 1.14 | 1.16 | 1.14 | 1.13 | |
| Perfect OpenMP/MPI/Pthread/TBB + Perfect Load Distribution | 1.80 | 1.84 | 1.81 | 1.83 | 1.78 | 1.83 | |
| No Scalar Integer | Potential Speedup | 1.01 | 1.00 | 1.00 | 1.00 | 1.01 | 1.01 |
| Nb Loops to get 80% | 2 | 3 | 3 | 2 | 3 | 4 | |
| FP Vectorised | Potential Speedup | 1.00 | 1.01 | 1.01 | 1.01 | 1.01 | 1.00 |
| Nb Loops to get 80% | 3 | 4 | 5 | 3 | 3 | 3 | |
| Fully Vectorised | Potential Speedup | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 |
| Nb Loops to get 80% | 6 | 6 | 7 | 6 | 5 | 6 | |
| Only FP Arithmetic | Potential Speedup | 1.02 | 1.01 | 1.02 | 1.01 | 1.05 | 1.05 |
| Nb Loops to get 80% | 4 | 4 | 5 | 4 | 6 | 8 | |
| Source Object | Issue |
|---|---|
| ▼libllama.so | |
| ▼ | |
| ○ | -g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target) |
| ○ | -O2, -O3 or -Ofast is missing. |
| ○ | -march=(target) is missing. |
| ▼libggml-cpu.so | |
| ▼binary-ops.cpp | |
| ○ | |
| ▼vec.cpp | |
| ○ | |
| ▼mmq.cpp | |
| ○ | |
| ▼ops.cpp | |
| ○ | |
| ▼common.h | |
| ○ | |
| ▼ggml-cpu.c | |
| ○ | |
| ▼quants.c | |
| ○ | |
| ▼libggml-base.so | |
| ▼ | |
| ○ | -g is missing for some functions (possibly ones added by the compiler), it is needed to have more accurate reports. Other recommended flags are: -O2/-O3, -march=(target) |
| ○ | -O2, -O3 or -Ofast is missing. |
| ○ | -march=(target) is missing. |
| r0 | r1 | r2 | r3 | r4 | r5 | |
|---|---|---|---|---|---|---|
| Experiment Name | ||||||
| Application | /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/run/oneview_runs/defaults/orig/exec | /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/run/base_runs/defaults/icx/exec | /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/run/base_runs/defaults/gcc/exec | /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/run/binaries/icx_5/exec | /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/run/binaries/aocc_10/exec | /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/run/binaries/gcc_6/exec |
| Timestamp | 2025-11-24 17:34:53 | 2025-11-24 17:37:31 | 2025-11-24 17:40:28 | 2025-11-24 18:39:21 | 2025-11-24 18:40:14 | 2025-11-24 18:41:02 |
| Experiment Type | MPI; OpenMP; | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Machine | isix06.benchmarkcenter.megware.com | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Architecture | x86_64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Micro Architecture | GRANITE_RAPIDS | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Model Name | Intel(R) Xeon(R) 6972P | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Cache Size | 491520 KB | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of Cores | 96 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Maximal Frequency | 3.9 GHz | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| OS Version | Linux 5.14.0-570.39.1.el9_6.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 4 05:08:52 EDT 2025 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Architecture used during static analysis | x86_64 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Micro Architecture used during static analysis | GRANITE_RAPIDS | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Compilation Options | libggml-base.so: N/A libggml-cpu.so: AMD clang version 17.0.6 (CLANG: AOCC_5.0.0-Build#1377 2024_09_24) /home/eoseret/aocc-compiler-5.0.0/bin/clang-17 --driver-mode=g++ -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/.. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -nopie -grecord-command-line -O3 -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -march=native -fopenmp=libomp -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -c /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp libllama.so: N/A | exec: N/A libggml-base.so: N/A libggml-cpu.so: clang based Intel(R) oneAPI DPC++/C++ Compiler 2025.1.0 (2025.1.0.20250317) /cluster/intel/oneapi/2025.1.0/compiler/2025.1/bin/compiler/clang --driver-mode=g++ --intel -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/.. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -O3 -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -march=native -fno-associative-math -fiopenmp -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -c /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp -fveclib=SVML libllama.so: N/A | libggml-base.so: N/A libggml-cpu.so: GNU C++17 14.2.0 -march=graniterapids -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -mno-sse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vpopcntdq -mavx512vbmi2 -mgfni -mvpclmulqdq -mavx512vnni -mavx512bitalg -mavx512bf16 -mno-avx512vp2intersect -mno-3dnow -madx -mabm -mcldemote -mclflushopt -mclwb -mno-clzero -mcx16 -menqcmd -mf16c -mfsgsbase -mfxsr -mno-hle -msahf -mno-lwp -mlzcnt -mmovbe -mmovdir64b -mmovdiri -mno-mwaitx -mpconfig -mpku -mprfchw -mptwrite -mrdpid -mrdrnd -mrdseed -mno-rtm -mserialize -msgx -msha -mshstk -mno-tbm -mtsxldtrk -mvaes -mwaitpkg -mwbnoinvd -mxsave -mxsavec -mxsaveopt -mxsaves -mamx-tile -mamx-int8 -mamx-bf16 -muintr -mhreset -mno-kl -mno-widekl -mavxvnni -mavx512fp16 -mno-avxifma -mno-avxvnniint8 -mno-avxneconvert -mno-cmpccxadd -mamx-fp16 -mprefetchi -mno-raoint -mno-amx-complex -mno-avxvnniint16 -mno-sm3 -mno-sha512 -mno-sm4 -mno-apxf -mno-usermsr -mavx10.1-256 -mavx10.1-512 --param=l1-cache-size=48 --param=l1-cache-line-size=64 --param=l2-cache-size=491520 -mtune=graniterapids -g -O3 -O3 -std=gnu++17 -fno-omit-frame-pointer -fcf-protection=none -fPIC -fopenmp libllama.so: N/A | exec: N/A libggml-base.so: N/A libggml-cpu.so: clang based Intel(R) oneAPI DPC++/C++ Compiler 2025.1.0 (2025.1.0.20250317) /cluster/intel/oneapi/2025.1.0/compiler/2025.1/bin/compiler/clang --driver-mode=g++ --intel -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/.. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/../include -O3 -O3 -x GRANITERAPIDS -fno-vectorize -fno-slp-vectorize -fno-iopenmp-simd -g -fno-omit-frame-pointer -fcf-protection=none -no-pie -grecord-command-line -fno-finite-math-only -O3 -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -fno-associative-math -fiopenmp -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -c /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp -fveclib=SVML libllama.so: N/A | exec: N/A libggml-base.so: N/A libggml-cpu.so: AMD clang version 17.0.6 (CLANG: AOCC_5.0.0-Build#1377 2024_09_24) /home/eoseret/aocc-compiler-5.0.0/bin/clang-17 --driver-mode=g++ -D GGML_BACKEND_BUILD -D GGML_BACKEND_SHARED -D GGML_SCHED_MAX_COPIES=4 -D GGML_SHARED -D GGML_USE_CPU_REPACK -D GGML_USE_LLAMAFILE -D GGML_USE_OPENMP -D _GNU_SOURCE -D _XOPEN_SOURCE=600 -D ggml_cpu_EXPORTS -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/.. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/. -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu -I /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/../include -O2 -march=graniterapids -fno-vectorize -fno-slp-vectorize -fno-openmp-simd -ffast-math -g -fno-omit-frame-pointer -fcf-protection=none -nopie -grecord-command-line -fno-finite-math-only -D NDEBUG -std=gnu++17 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wmissing-prototypes -Wextra-semi -fopenmp=libomp -MD -MT ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -MF ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o.d -o ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o -c /beegfs/hackathon/users/eoseret/qaas_runs_test/isix06.benchmarkcenter.megware.com/176-400-1862/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp libllama.so: N/A | exec: N/A libggml-base.so: N/A libggml-cpu.so: GNU C++17 14.2.0 -march=graniterapids -g -O2 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp libllama.so: N/A |
| Number of processes observed | 1 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of threads observed | 96 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Frequency Driver | intel_pstate | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Frequency Governor | performance | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Huge Pages | always | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Hyperthreading | on | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of sockets | 2 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Number of cores per socket | 96 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| MAQAO version | 2025.1.3 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| MAQAO build | b489783858807c9a72e0923fd7b399a22c81991c::20251024-122946 | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |
| Comments | same as r0 | same as r0 | same as r0 | same as r0 | same as r0 |