| Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime gcc_0 (%) | Exclusive Coverage gcc_0 (%) | Inclusive Coverage gcc_0 (%) | Max Exclusive Time Over Threads gcc_0 (s) | Max Inclusive Time Over Threads gcc_0 (s) | Exclusive Time w.r.t. Wall Time gcc_0 (s) | Inclusive Time w.r.t. Wall Time gcc_0 (s) | Nb Threads gcc_0 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing gcc_0 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
|---|
| 2189 | libggml-cpu.so - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 | kai_run_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm | Innermost | 37.51 | 84.23 | 84.23 | 1.71 | 1.71 | 2.46 | 2.46 | 95 | 28.14 | 55.37 | 1 | 1 | 1.85 | 1.06 | 0 | 0 | 5 | 0 | 0 | 75.00 |
| 775 | libggml-cpu.so - ops.cpp:6210-6245 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 1.75 | 1.82 | 1.82 | 0.08 | 0.08 | 0.05 | 0.05 | 96 | 1.83 | 20.42 | 1.81 | 1.57 | 5 | 2.3 | 1 | 0 | 0 | 0 | 1 | 50.00 |
| 1515 | libggml-cpu.so - vec.h:282-725 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.87 | 1.05 | 1.72 | 0.04 | 0.05 | 0.03 | 0.05 | 95 | 15.2 | 44.54 | 5.75 | 1.03 | 1.34 | 1.97 | NA | NA | NA | NA | NA | 0.00 |
| 2158 | libggml-cpu.so - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:96-262 [...] | kai_run_lhs_quant_pack_qsi8d32p4x8sb_f32_neon | Innermost | 1.09 | 0.78 | 0.78 | 0.05 | 0.05 | 0.02 | 0.02 | 62 | 76.21 | 96.75 | 1 | 1 | 1.03 | 2.17 | 0 | 0 | 6 | 0 | 0 | 75.00 |
| 756 | libggml-cpu.so - vec.cpp:385-387 [...] | ggml_vec_swiglu_f32 | Single | 0.66 | 0.70 | 0.70 | 0.03 | 0.03 | 0.02 | 0.02 | 82 | 80 | 97.68 | 1 | 1 | 1.03 | 1.92 | 0 | 0 | 0 | 3 | 0 | 50.00 |
| 2190 | libggml-cpu.so - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 | kai_run_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm | InBetween | 0.77 | 0.54 | 84.78 | 0.04 | 1.73 | 0.02 | 2.48 | 86 | 27.59 | 55.71 | 1 | 1 | 1.62 | 3.03 | NA | NA | NA | NA | NA | 0.00 |
| 1148 | libggml-cpu.so - ops.cpp:4325-4326 | ggml_compute_forward_rms_norm | Innermost | 0.66 | 0.53 | 0.53 | 0.03 | 0.03 | 0.02 | 0.02 | 88 | 0 | 26.56 | 1 | 1.96 | 4.17 | 2.71 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 1525 | libggml-cpu.so - vec.h:411-458 | ggml_compute_forward_flash_attn_ext | Innermost | 0.44 | 0.36 | 0.36 | 0.02 | 0.02 | 0.01 | 0.01 | 75 | 96.97 | 96.99 | 1.24 | 1 | 1 | 2.29 | 1 | 0 | 0 | 16 | 0 | 52.94 |
| 419 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.44 | 0.26 | 0.26 | 0.02 | 0.02 | 0.01 | 0.01 | 57 | 25 | 100 | 1 | 1 | 1 | 2.35 | 0 | 0 | 3 | 0 | 0 | 75.00 |
| 2056 | libggml-cpu.so - quants.c:2506-2575 [...] | ggml_vec_dot_q6_K_q8_K | Innermost | 0.11 | 0.21 | 0.21 | 0.01 | 0.01 | 0.01 | 0.01 | 78 | 49.72 | 67.11 | 1.06 | 1 | 1.26 | 1 | 3 | 4 | 2 | 0 | 0 | 94.44 |
| 1516 | libggml-cpu.so - ops.cpp:8817-8819 [...] | ggml_compute_forward_flash_attn_ext | Innermost | 0.33 | 0.21 | 0.21 | 0.02 | 0.02 | 0.01 | 0.01 | 54 | 0 | 27.08 | 1.22 | 1.63 | 5.2 | 2.08 | 1 | 1 | 0 | 0 | 0 | 100.00 |
| 493 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.33 | 0.21 | 0.21 | 0.02 | 0.02 | 0.01 | 0.01 | 56 | 25 | 100 | 1 | 1 | 1 | 2.18 | 0 | 0 | 3 | 0 | 0 | 75.00 |
| 754 | libggml-cpu.so - vec.cpp:231-262 | ggml_vec_dot_f16 | Single | 0.33 | 0.18 | 0.18 | 0.02 | 0.02 | 0.01 | 0.01 | 48 | 100 | 100 | 1 | 1 | 1 | 2.22 | 0 | 0 | 0 | 16 | 0 | 50.00 |
| 2172 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:127-139 [...] | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Innermost | 6.78 | 0.17 | 0.17 | 0.31 | 0.31 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 0 | 0 | 1 | 1 | 0 | 62.50 |
| 5 | libggml-cpu.so - ggml-cpu.c:3228-3229 [...] | ggml_cpu_fp32_to_fp16 | Single | 0.33 | 0.16 | 0.16 | 0.02 | 0.02 | 0.00 | 0.00 | 45 | 88.37 | 93.9 | 1 | 1 | 1 | 2.33 | 0 | 0 | 0 | 3 | 0 | 50.00 |
| 2170 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:115-118 | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Innermost | 4.81 | 0.12 | 0.12 | 0.22 | 0.22 | 0.00 | 0.00 | 1 | 0 | 31.25 | 1 | 1 | 4.33 | 1 | 0 | 0 | 0 | 0 | 1 | 0.00 |
| 2169 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:107-154 [...] | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | InBetween | 1.97 | 0.05 | 0.37 | 0.09 | 0.68 | 0.00 | 0.01 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 785 | libggml-cpu.so - ops.cpp:6446-6457 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.22 | 0.05 | 0.05 | 0.01 | 0.01 | 0.00 | 0.00 | 15 | 42.86 | 53.57 | 1 | 1 | 1.94 | 1.76 | 2 | 0 | 0 | 7 | 0 | 61.11 |
| 1147 | libggml-cpu.so - vec.h:646-653 | ggml_compute_forward_rms_norm | Innermost | 0.22 | 0.04 | 0.04 | 0.01 | 0.01 | 0.00 | 0.00 | 15 | 100 | 100 | 1 | 1 | 1 | 1.87 | 0 | 0 | 0 | 2 | 0 | 50.00 |
| 1517 | libggml-cpu.so - ops.cpp:8778-8920 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.22 | 0.04 | 0.05 | 0.01 | 0.01 | 0.00 | 0.00 | 13 | 15.6 | 45.89 | 8.06 | 1.01 | 1.46 | 1.86 | NA | NA | NA | NA | NA | 0.00 |
| 772 | libggml-cpu.so - ops.cpp:6210-6481 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.11 | 0.04 | 1.89 | 0.01 | 0.05 | 0.00 | 0.06 | 13 | 0 | 49.44 | 1 | 1 | 1.93 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1523 | libggml-cpu.so - ops.cpp:8825-8826 | ggml_compute_forward_flash_attn_ext | Innermost | 0.22 | 0.04 | 0.04 | 0.01 | 0.01 | 0.00 | 0.00 | 12 | NA | NA | NA | NA | NA | 1.85 | NA | NA | NA | NA | NA | 0.00 |
| 752 | libggml-cpu.so - vec.cpp:224-337 [...] | ggml_vec_dot_f16 | Outermost | 0.11 | 0.03 | 0.03 | 0.01 | 0.01 | 0.00 | 0.00 | 12 | 41.67 | 63.12 | 1.55 | 1 | 1.4 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 771 | libggml-cpu.so - ops.cpp:6210-6481 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.11 | 0.03 | 1.86 | 0.01 | 0.06 | 0.00 | 0.05 | 12 | 0 | 41.95 | 6.65 | 1.3 | 3 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2168 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:107-154 [...] | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | InBetween | 1.31 | 0.03 | 0.15 | 0.06 | 0.28 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2057 | libggml-cpu.so - quants.c:2492-2654 [...] | ggml_vec_dot_q6_K_q8_K | InBetween | 0.11 | 0.03 | 0.24 | 0.01 | 0.01 | 0.00 | 0.01 | 10 | 58.33 | 71.72 | 1.05 | 1 | 1.17 | 1 | 1 | 4 | 2 | 2 | 0 | 83.33 |
| 770 | libggml-cpu.so - ops.cpp:6210-6481 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.11 | 0.03 | 1.92 | 0.01 | 0.05 | 0.00 | 0.06 | 10 | 0 | 44.49 | 1 | 1 | 2.8 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 71 | libggml-cpu.so - ggml-cpu.c:1664-2898 [...] | ggml_graph_compute_thread | Outermost | 0.22 | 0.02 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 5 | 0 | 34.38 | 1 | 1 | 5.33 | 1.67 | NA | NA | NA | NA | NA | 0.00 |
| 1518 | libggml-cpu.so - ops.cpp:8778-8920 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.11 | 0.01 | 0.28 | 0.01 | 0.02 | 0.00 | 0.01 | 5 | 0 | 53.13 | 6 | 1 | 1.74 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1522 | libggml-cpu.so - ops.cpp:8885-8886 [...] | ggml_compute_forward_flash_attn_ext | Innermost | 0.11 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 4 | 0 | 56.25 | 1 | 1 | 1.2 | 1 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 1144 | libggml-cpu.so - ops.cpp:4321-4338 [...] | ggml_compute_forward_rms_norm | InBetween | 0.22 | 0.01 | 0.59 | 0.01 | 0.03 | 0.00 | 0.02 | 3 | 9.52 | 47.79 | 2.87 | 1.05 | 1.48 | 1.5 | NA | NA | NA | NA | NA | 0.00 |
| 3828 | libllama.so - hashtable_policy.h:387-2058 [...] | llama_vocab::~llama_vocab() | Single | 0.44 | 0.01 | 0.01 | 0.02 | 0.02 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 0 | 0 | 0 | 2 | 0 | 50.00 |
