| Name | Module | Max Thread Time / Walltime gcc_4 (%) | Coverage gcc_4 (%) | Coverage Excluding Loops gcc_4 (%) | Max Inclusive Time Over Threads gcc_4 (s) | Max Exclusive Time Over Threads gcc_4 (s) | Inclusive Time w.r.t. Wall Time gcc_4 (s) | Exclusive Time w.r.t. Wall Time gcc_4 (s) | Nb Threads gcc_4 | Deviation (coverage) gcc_4 | Deviation (walltime) gcc_4 | Categories gcc_4 | Compilation Options |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ►kai_run_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm | libggml-cpu.so | 33.68 | 56.16 | 0.02 | 3.36 | 0.01 | 3.86 | 0.00 | 64 | 1.71 | 0.08 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 2240 - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 2239 - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 2238 - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 2243 - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 - libggml-cpu.so | 0.05 | 56.14 | 0.00 | 3.39 | 0.00 | 3.86 | 0.00 | 1 | 0.00 | 0.00 | |||
| ►Loop 2242 - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 - libggml-cpu.so | 0.40 | 56.14 | 0.28 | 3.38 | 0.04 | 3.86 | 0.02 | 64 | 0.16 | 0.01 | |||
| ○Loop 2241 - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 - libggml-cpu.so | 33.53 | 55.85 | 55.85 | 3.34 | 3.34 | 3.84 | 3.84 | 64 | 1.73 | 0.08 | |||
| ○gomp_team_barrier_wait_end | libgomp.so.1.0.0 | 14.78 | 19.92 | 19.92 | 1.48 | 1.48 | 1.37 | 1.37 | 64 | 2.02 | 0.11 | OMP (%): 100.00 | |
| ►ggml_vec_dot_q6_K_q8_K | libggml-cpu.so | 9.52 | 15.76 | 0.01 | 0.95 | 0.01 | 1.08 | 0.00 | 64 | 0.54 | 0.02 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 2113 - quants.c:2486-2923 - libggml-cpu.so [...] | 0.25 | 15.75 | 0.11 | 1.05 | 0.03 | 1.08 | 0.01 | 45 | 0.10 | 0.01 | |||
| ►Loop 2115 - quants.c:2492-2654 - libggml-cpu.so [...] | 2.46 | 15.64 | 3.28 | 1.02 | 0.25 | 1.07 | 0.23 | 64 | 0.43 | 0.02 | |||
| ○Loop 2114 - quants.c:2506-2575 - libggml-cpu.so [...] | 7.82 | 12.37 | 12.37 | 0.78 | 0.78 | 0.85 | 0.85 | 64 | 0.68 | 0.03 | |||
| ○Loop 2116 - quants.c:2835-2913 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►ggml_compute_forward_flash_attn_ext | libggml-cpu.so | 1.10 | 1.38 | 0.01 | 0.11 | 0.00 | 0.09 | 0.00 | 64 | 0.29 | 0.02 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 1612 - ops.cpp:8778-8939 - libggml-cpu.so [...] | 0.10 | 1.37 | 0.02 | 0.18 | 0.01 | 0.09 | 0.00 | 16 | 0.03 | 0.00 | |||
| ►Loop 1614 - ops.cpp:8778-8939 - libggml-cpu.so [...] | 0.70 | 1.34 | 0.74 | 0.17 | 0.07 | 0.09 | 0.05 | 64 | 0.24 | 0.01 | |||
| ○Loop 1627 - vec.h:375-375 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1630 - vec.h:687-688 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1626 - vec.h:386-387 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1624 - vec.h:750-751 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1625 - vec.h:740-740 - libggml-cpu.so [...] | 0.05 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0.00 | 0.00 | |||
| ○Loop 1613 - ops.cpp:8818-8826 - libggml-cpu.so [...] | 0.15 | 0.06 | 0.06 | 0.02 | 0.02 | 0.00 | 0.00 | 36 | 0.05 | 0.00 | |||
| ○Loop 1623 - vec.h:491-491 - libggml-cpu.so [...] | 0.45 | 0.43 | 0.43 | 0.05 | 0.05 | 0.03 | 0.03 | 64 | 0.19 | 0.01 | |||
| ○Loop 1629 - vec.h:375-375 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1622 - vec.h:502-503 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1628 - vec.h:386-387 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1631 - vec.h:677-677 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 1616 - ops.cpp:8778-8939 - libggml-cpu.so [...] | 0.10 | 0.10 | 0.04 | 0.04 | 0.01 | 0.01 | 0.00 | 24 | 0.04 | 0.00 | |||
| ►Loop 1615 - ops.cpp:8778-8939 - libggml-cpu.so [...] | 0.10 | 0.06 | 0.03 | 0.03 | 0.01 | 0.00 | 0.00 | 16 | 0.04 | 0.00 | |||
| ○Loop 1621 - ops.cpp:8885-8886 - libggml-cpu.so [...] | 0.05 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 7 | 0.01 | 0.00 | |||
| ○Loop 1620 - vec.h:677-677 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1618 - vec.h:677-677 - libggml-cpu.so [...] | 0.10 | 0.02 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 17 | 0.02 | 0.00 | |||
| ○Loop 1617 - vec.h:687-688 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1619 - vec.h:687-688 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | libggml-cpu.so | 1.00 | 0.94 | 0.01 | 0.10 | 0.01 | 0.06 | 0.00 | 64 | 0.28 | 0.02 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 821 - ops.cpp:6210-6490 - libggml-cpu.so [...] | 0.05 | 0.93 | 0.00 | 0.16 | 0.00 | 0.06 | 0.00 | 2 | 0.00 | 0.00 | |||
| ○Loop 829 - ops.cpp:6446-6457 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 830 - ops.cpp:6446-6457 - libggml-cpu.so [...] | 0.20 | 0.07 | 0.07 | 0.02 | 0.02 | 0.00 | 0.00 | 31 | 0.08 | 0.00 | |||
| ►Loop 822 - ops.cpp:6210-6484 - libggml-cpu.so [...] | 0.05 | 0.86 | 0.00 | 0.13 | 0.01 | 0.06 | 0.00 | 2 | 0.01 | 0.00 | |||
| ○Loop 827 - ops.cpp:6479-6484 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 815 - ops.cpp:6210-6475 - libggml-cpu.so [...] | 0.10 | 0.85 | 0.05 | 0.13 | 0.01 | 0.06 | 0.00 | 26 | 0.04 | 0.00 | |||
| ○Loop 824 - ops.cpp:6413-6426 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 817 - ops.cpp:6210-6439 - libggml-cpu.so [...] | 0.10 | 0.81 | 0.02 | 0.12 | 0.01 | 0.06 | 0.00 | 10 | 0.03 | 0.00 | |||
| ►Loop 816 - ops.cpp:6210-6407 - libggml-cpu.so [...] | 0.15 | 0.79 | 0.03 | 0.11 | 0.01 | 0.05 | 0.00 | 19 | 0.05 | 0.00 | |||
| ○Loop 820 - ops.cpp:6210-6245 - libggml-cpu.so [...] | 0.90 | 0.76 | 0.76 | 0.09 | 0.09 | 0.05 | 0.05 | 64 | 0.27 | 0.02 | |||
| ○Loop 819 - ops.cpp:6220-6245 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 818 - ops.cpp:6210-6245 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 823 - ops.cpp:6462-6475 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 828 - ops.cpp:6479-6484 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 825 - ops.cpp:6429-6479 - libggml-cpu.so [...] | 0.05 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0.00 | 0.00 | |||
| ○Loop 826 - ops.cpp:6429-6442 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○__aarch64_ldadd4_acq_rel | libgomp.so.1.0.0 | 0.95 | 0.92 | 0.92 | 0.09 | 0.09 | 0.06 | 0.06 | 64 | 0.33 | 0.02 | OMP (%): 100.00 | |
| ○$x | libc.so.6 | 0.90 | 0.83 | 0.83 | 0.09 | 0.09 | 0.06 | 0.06 | 64 | 0.30 | 0.02 | System (%): 100.00 | |
| ►ggml_vec_dot_f16 | libggml-cpu.so | 0.65 | 0.59 | 0.04 | 0.06 | 0.02 | 0.04 | 0.00 | 64 | 0.23 | 0.01 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 785 - vec.cpp:311-337 - libggml-cpu.so [...] | 0.20 | 0.08 | 0.08 | 0.02 | 0.02 | 0.01 | 0.01 | 38 | 0.07 | 0.00 | |||
| ○Loop 787 - vec.cpp:324-325 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 786 - vec.cpp:324-325 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 788 - vec.cpp:311-311 - libggml-cpu.so [...] | 0.55 | 0.48 | 0.48 | 0.06 | 0.06 | 0.03 | 0.03 | 64 | 0.21 | 0.01 | |||
| ○__pthread_mutex_lock | libc.so.6 | 0.70 | 0.56 | 0.56 | 0.07 | 0.07 | 0.04 | 0.04 | 63 | 0.25 | 0.01 | Pthread (%): 100.00 | |
| ►ggml_vec_swiglu_f32 | libggml-cpu.so | 1.15 | 0.38 | 0.00 | 0.12 | 0.00 | 0.03 | 0.00 | 16 | 0.34 | 0.02 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 796 - vec.cpp:370-405 - libggml-cpu.so [...] | 0.00 | 0.38 | 0.00 | 0.12 | 0.00 | 0.03 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 795 - vec.cpp:390-405 - libggml-cpu.so [...] | 0.00 | 0.38 | 0.00 | 0.12 | 0.00 | 0.03 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 793 - arm_neon.h:338-22099 - libggml-cpu.so [...] | 0.00 | 0.38 | 0.00 | 0.12 | 0.00 | 0.03 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 794 - vec.cpp:390-390 - libggml-cpu.so [...] | 1.15 | 0.38 | 0.38 | 0.12 | 0.12 | 0.03 | 0.03 | 16 | 0.34 | 0.02 | |||
| ○sincosf | libm.so.6 | 0.45 | 0.30 | 0.30 | 0.05 | 0.05 | 0.02 | 0.02 | 63 | 0.15 | 0.01 | Math (%): 100.00 | |
| ○gomp_barrier_wait_end | libgomp.so.1.0.0 | 0.40 | 0.27 | 0.27 | 0.04 | 0.04 | 0.02 | 0.02 | 58 | 0.13 | 0.01 | OMP (%): 100.00 | |
| ►kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | libggml-cpu.so | 7.92 | 0.22 | 0.00 | 0.79 | 0.00 | 0.01 | 0.00 | 1 | 0.00 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 2223 - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:107-158 - libggml-cpu.so | 0.00 | 0.22 | 0.00 | 0.79 | 0.00 | 0.01 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 2221 - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:107-154 - libggml-cpu.so [...] | 1.25 | 0.22 | 0.03 | 0.79 | 0.13 | 0.01 | 0.00 | 1 | 0.00 | 0.00 | |||
| ►Loop 2220 - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:107-154 - libggml-cpu.so [...] | 2.91 | 0.08 | 0.08 | 0.29 | 0.29 | 0.01 | 0.01 | 1 | 0.00 | 0.00 | |||
| ○Loop 2222 - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:115-118 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 2219 - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:127-134 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 2224 - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:127-139 - libggml-cpu.so [...] | 3.76 | 0.10 | 0.10 | 0.38 | 0.38 | 0.01 | 0.01 | 1 | 0.00 | 0.00 | |||
| ○Loop 2225 - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:135-141 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○__expf_finite | libm.so.6 | 0.30 | 0.19 | 0.19 | 0.03 | 0.03 | 0.01 | 0.01 | 61 | 0.10 | 0.01 | Math (%): 100.00 | |
| ►kai_run_lhs_quant_pack_qsi8d32p4x8sb_f32_neon | libggml-cpu.so | 2.05 | 0.18 | 0.00 | 0.20 | 0.00 | 0.01 | 0.00 | 4 | 0.22 | 0.03 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 2207 - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:90-340 - libggml-cpu.so [...] | 0.00 | 0.18 | 0.00 | 0.20 | 0.00 | 0.01 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 2210 - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:93-264 - libggml-cpu.so [...] | 0.00 | 0.18 | 0.00 | 0.20 | 0.00 | 0.01 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 2211 - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:96-262 - libggml-cpu.so [...] | 2.05 | 0.18 | 0.18 | 0.20 | 0.20 | 0.01 | 0.01 | 4 | 0.22 | 0.03 | |||
| ►Loop 2209 - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:268-336 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 2208 - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:271-332 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 2206 - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:267-340 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►ggml_graph_compute_thread | libggml-cpu.so | 0.30 | 0.13 | 0.02 | 0.03 | 0.01 | 0.01 | 0.00 | 50 | 0.09 | 0.01 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ○Loop 89 - ggml-cpu.c:2087-2088 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 84 - ggml-cpu.c:1572-1579 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 85 - ggml-cpu.c:1572-1579 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 75 - ggml-cpu.c:1664-2898 - libggml-cpu.so [...] | 0.20 | 0.12 | 0.10 | 0.03 | 0.02 | 0.01 | 0.01 | 48 | 0.07 | 0.00 | |||
| ○Loop 74 - ggml-cpu.c:2879-2898 - libggml-cpu.so [...] | 0.05 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 9 | 0.00 | 0.00 | |||
| ○Loop 76 - ggml-cpu.c:1585-1587 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 77 - ggml-cpu.c:1424-1642 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 78 - ggml-cpu.c:1436-1465 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 83 - ggml-cpu.c:1437-1465 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 82 - ggml-cpu.c:1438-1465 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 81 - ggml-cpu.c:1437-1465 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 80 - ggml-cpu.c:1438-1465 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 79 - ggml-cpu.c:1461-1462 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 88 - ggml-cpu.c:1552-1560 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 87 - ggml-cpu.c:1553-1560 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 86 - ggml-cpu.c:1554-1560 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►ggml_compute_forward_add_non_quantized | libggml-cpu.so | 0.50 | 0.12 | 0.01 | 0.05 | 0.01 | 0.01 | 0.00 | 23 | 0.26 | 0.02 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 410 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 415 - binary-ops.cpp:42-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 412 - binary-ops.cpp:31-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 411 - binary-ops.cpp:31-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 414 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 413 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 391 - binary-ops.cpp:10-146 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 399 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 401 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 400 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 403 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 402 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 404 - binary-ops.cpp:10-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 405 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 407 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 406 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 408 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 409 - binary-ops.cpp:10-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 392 - binary-ops.cpp:10-146 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 393 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 395 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 394 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 397 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 396 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 398 - binary-ops.cpp:10-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 416 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 418 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 417 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 420 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 419 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 421 - binary-ops.cpp:10-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 422 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 424 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 423 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 425 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 426 - binary-ops.cpp:10-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 427 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.05 | 0.10 | 0.00 | 0.06 | 0.01 | 0.01 | 0.00 | 1 | 0.00 | 0.00 | |||
| ○Loop 432 - binary-ops.cpp:10-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 429 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.10 | 0.00 | 0.05 | 0.00 | 0.01 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 430 - binary-ops.cpp:10-101 - libggml-cpu.so [...] | 0.00 | 0.10 | 0.00 | 0.05 | 0.00 | 0.01 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 431 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.50 | 0.10 | 0.10 | 0.05 | 0.05 | 0.01 | 0.01 | 15 | 0.24 | 0.01 | |||
| ○Loop 428 - binary-ops.cpp:10-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○$x | libc.so.6 | 0.35 | 0.10 | 0.10 | 0.04 | 0.04 | 0.01 | 0.01 | 36 | 0.13 | 0.01 | Pthread (%): 100.00 | |
| ►ggml_compute_forward_mul_mat | libggml-cpu.so | 0.20 | 0.10 | 0.00 | 0.02 | 0.00 | 0.01 | 0.00 | 43 | 0.07 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 65 - ggml-cpu.c:1125-1397 - libggml-cpu.so [...] | 0.00 | 0.10 | 0.00 | 0.04 | 0.00 | 0.01 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 67 - ggml-cpu.c:1132-1165 - libggml-cpu.so [...] | 0.05 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0.00 | 0.00 | |||
| ►Loop 64 - ggml-cpu.c:1162-1198 - libggml-cpu.so [...] | 0.15 | 0.07 | 0.05 | 0.03 | 0.02 | 0.00 | 0.00 | 25 | 0.05 | 0.00 | |||
| ○Loop 63 - ggml-cpu.c:1193-1194 - libggml-cpu.so | 0.10 | 0.02 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 15 | 0.02 | 0.00 | |||
| ►Loop 69 - ggml-cpu.c:1163-1198 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 68 - ggml-cpu.c:1164-1198 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 70 - ggml-cpu.c:1197-1198 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 61 - ggml-cpu.c:1197-1198 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 60 - ggml-cpu.c:1193-1194 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 66 - ggml-cpu.c:1125-1395 - libggml-cpu.so [...] | 0.10 | 0.03 | 0.03 | 0.01 | 0.01 | 0.00 | 0.00 | 18 | 0.02 | 0.00 | |||
| ○Loop 62 - ggml-cpu.c:1397-1397 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 73 - ggml-cpu.c:1289-1297 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 72 - ggml-cpu.c:1290-1297 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 71 - ggml-cpu.c:1291-1297 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○$x | libc.so.6 | 0.85 | 0.10 | 0.10 | 0.08 | 0.08 | 0.01 | 0.01 | 39 | 0.19 | 0.01 | System (%): 100.00 | |
| ►ggml_cpu_fp32_to_fp16 | libggml-cpu.so | 0.25 | 0.09 | 0.00 | 0.03 | 0.00 | 0.01 | 0.00 | 42 | 0.07 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ○Loop 0 - ggml-impl.h:354-404 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1 - ggml-cpu.c:3228-3229 - libggml-cpu.so [...] | 0.25 | 0.09 | 0.09 | 0.03 | 0.03 | 0.01 | 0.01 | 40 | 0.08 | 0.00 | |||
| ►ggml_compute_forward_mul | libggml-cpu.so | 0.25 | 0.07 | 0.02 | 0.03 | 0.01 | 0.01 | 0.00 | 25 | 0.13 | 0.01 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 475 - binary-ops.cpp:18-154 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 489 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 491 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 490 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 492 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 493 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 476 - binary-ops.cpp:18-154 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 477 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 479 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 478 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 481 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 480 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 482 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 483 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 488 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 485 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 487 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 486 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 484 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 500 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 502 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 501 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 504 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 503 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 505 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 511 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.05 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 516 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 513 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.05 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 512 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 514 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.05 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 515 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.20 | 0.05 | 0.05 | 0.02 | 0.02 | 0.00 | 0.00 | 16 | 0.12 | 0.01 | |||
| ►Loop 494 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 498 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 497 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 496 - binary-ops.cpp:31-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 495 - binary-ops.cpp:31-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 499 - binary-ops.cpp:42-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 506 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 508 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 509 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 507 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 510 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○unknown_function | libggml-cpu.so | 0.15 | 0.06 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 32 | 0.06 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | |
| ○__GI___lll_lock_wait | libc.so.6 | 0.15 | 0.05 | 0.05 | 0.01 | 0.01 | 0.00 | 0.00 | 31 | 0.05 | 0.00 | Pthread (%): 100.00 | |
| ►ggml::cpu::kleidiai::extra_buffer_type::get_tensor_traits(ggml_tensor const*) | libggml-cpu.so | 0.15 | 0.05 | 0.04 | 0.01 | 0.01 | 0.00 | 0.00 | 32 | 0.04 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ○Loop 2178 - kleidiai.cpp:535-547 - libggml-cpu.so [...] | 0.05 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 6 | 0.00 | 0.00 | |||
| ►ggml_compute_forward_rms_norm | libggml-cpu.so | 0.25 | 0.05 | 0.01 | 0.03 | 0.01 | 0.00 | 0.00 | 19 | 0.09 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 1196 - ops.cpp:4319-4365 - libggml-cpu.so [...] | 0.00 | 0.05 | 0.00 | 0.03 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 1193 - ops.cpp:4319-4351 - libggml-cpu.so [...] | 0.00 | 0.05 | 0.00 | 0.03 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1195 - ops.cpp:4325-4326 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 1192 - ops.cpp:4319-4351 - libggml-cpu.so [...] | 0.00 | 0.05 | 0.00 | 0.03 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1197 - vec.h:687-688 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 1194 - ops.cpp:4325-4326 - libggml-cpu.so | 0.20 | 0.03 | 0.03 | 0.02 | 0.02 | 0.00 | 0.00 | 12 | 0.07 | 0.00 | |||
| ○Loop 1198 - vec.h:677-677 - libggml-cpu.so [...] | 0.10 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 9 | 0.03 | 0.00 | |||
| ○__GI___lll_lock_wake | libc.so.6 | 0.15 | 0.05 | 0.05 | 0.02 | 0.02 | 0.00 | 0.00 | 27 | 0.06 | 0.00 | Pthread (%): 97.30 System (%): 2.70 | |
| ○$x | libc.so.6 | 0.20 | 0.04 | 0.04 | 0.02 | 0.02 | 0.00 | 0.00 | 22 | 0.06 | 0.00 | System (%): 100.00 | |
| ○ggml_is_empty | libggml-base.so | 0.15 | 0.03 | 0.03 | 0.01 | 0.01 | 0.00 | 0.00 | 17 | 0.06 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml-blas.so (%): 100.00 | GNU C11 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu11 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC |
| ►ggml_compute_forward_set_rows | libggml-cpu.so | 0.15 | 0.03 | 0.03 | 0.02 | 0.02 | 0.00 | 0.00 | 18 | 0.05 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ►Loop 1283 - ops.cpp:5550-5563 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►Loop 1282 - ops.cpp:5551-5563 - libggml-cpu.so | 0.05 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0.00 | 0.00 | |||
| ○Loop 1284 - ops.cpp:5552-5563 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►ggml_cpu_extra_compute_forward | libggml-cpu.so | 0.10 | 0.03 | 0.03 | 0.01 | 0.01 | 0.00 | 0.00 | 20 | 0.02 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ○Loop 389 - traits.cpp:13-17 - libggml-cpu.so | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ►ggml::cpu::kleidiai::tensor_traits::compute_forward_q4_0(ggml_compute_params*, ggml_tensor*) [clone .isra.0] | libggml-cpu.so | 0.05 | 0.02 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 17 | 0.00 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ○Loop 2168 - std_function.h:247-591 - libggml-cpu.so [...] | 0.05 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 3 | 0.01 | 0.00 | |||
| ○__log2_finite | libm.so.6 | 0.10 | 0.02 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 12 | 0.04 | 0.00 | Math (%): 100.00 | |
| ○unknown_function | libggml-base.so | 0.10 | 0.02 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 11 | 0.03 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml-blas.so (%): 100.00 | |
| ○$x | libc.so.6 | 0.60 | 0.02 | 0.02 | 0.06 | 0.06 | 0.00 | 0.00 | 1 | 0.00 | 0.00 | System (%): 100.00 | |
| ►ggml_backend_cpu_get_extra_buffer_types() | libggml-cpu.so | 0.10 | 0.02 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 11 | 0.03 | 0.00 | /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/build/llama.cpp/../gcc_4/bin/libggml.so (%): 100.00 | GNU C++17 14.2.0 -mcpu=neoverse-v1+nosve+nosve2 -mlittle-endian -mabi=lp64 -g -O3 -O3 -O3 -std=gnu++17 -funroll-loops -ffast-math -fno-omit-frame-pointer -fcf-protection=none -fno-finite-math-only -fPIC -fopenmp |
| ○Loop 104 - vector.tcc:123-123 - libggml-cpu.so [...] | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | |||
| ○Loop 103 - ggml-cpu.cpp:61-64 - libggml-cpu.so | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 2 | 0.00 | 0.00 | |||
| ○gomp_team_barrier_wait | libgomp.so.1.0.0 | 0.10 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 7 | 0.03 | 0.00 | OMP (%): 100.00 |