| Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime armclang_3 (%) | Exclusive Coverage armclang_3 (%) | Inclusive Coverage armclang_3 (%) | Max Exclusive Time Over Threads armclang_3 (s) | Max Inclusive Time Over Threads armclang_3 (s) | Exclusive Time w.r.t. Wall Time armclang_3 (s) | Inclusive Time w.r.t. Wall Time armclang_3 (s) | Nb Threads armclang_3 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing armclang_3 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2528 | libggml-cpu.so - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 | kai_run_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm | Innermost | 39.26 | 76.85 | 76.85 | 1.70 | 1.70 | 2.07 | 2.07 | 95 | 28.14 | 55.37 | 1 | 1 | 1.85 | 1.05 | 0 | 0 | 5 | 0 | 0 | 75.00 |
| 1896 | libggml-cpu.so - ops.cpp:8793-8881 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.92 | 1.24 | 1.41 | 0.04 | 0.05 | 0.03 | 0.04 | 96 | 0 | 34.34 | 2.26 | 2.85 | 1.19 | 1.55 | NA | NA | NA | NA | NA | 0.00 |
| 1596 | libggml-cpu.so - ops.cpp:6220-6245 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 1.15 | 1.24 | 1.24 | 0.05 | 0.05 | 0.03 | 0.03 | 96 | 0 | 26.14 | 1 | 2 | 4.2 | 1.94 | 2 | 0 | 0 | 1 | 0 | 83.33 |
| 2496 | libggml-cpu.so - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:96-258 [...] | kai_run_lhs_quant_pack_qsi8d32p4x8sb_f32_neon | Innermost | 1.15 | 0.83 | 0.83 | 0.05 | 0.05 | 0.02 | 0.02 | 63 | 77.23 | 96.44 | 1 | 1 | 1.03 | 1.89 | 1 | 0 | 1 | 3 | 0 | 65.00 |
| 2529 | libggml-cpu.so - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 | kai_run_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm | InBetween | 0.69 | 0.52 | 77.37 | 0.03 | 1.71 | 0.01 | 2.09 | 86 | 27.59 | 55.71 | 1 | 1 | 1.62 | 2.48 | NA | NA | NA | NA | NA | 0.00 |
| 916 | libggml-cpu.so - vec.h:1045-1072 [...] | ggml_vec_swiglu_f32 | Innermost | 0.69 | 0.46 | 0.46 | 0.03 | 0.03 | 0.01 | 0.01 | 80 | 73.33 | 91.67 | 1.04 | 1 | 1 | 2.58 | NA | NA | NA | NA | NA | 0.00 |
| 1353 | libggml-cpu.so - ops.cpp:4325-4326 | ggml_compute_forward_rms_norm | Innermost | 0.69 | 0.42 | 0.42 | 0.03 | 0.03 | 0.01 | 0.01 | 85 | 16.67 | 54.17 | 1 | 1.25 | 2 | 3 | 0 | 0 | 1 | 0 | 0 | 75.00 |
| 437 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.58 | 0.31 | 0.31 | 0.02 | 0.02 | 0.01 | 0.01 | 72 | 0 | 25 | 1 | 1 | 5.33 | 2.88 | 0 | 0 | 0 | 3 | 0 | 50.00 |
| 541 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.46 | 0.26 | 0.26 | 0.02 | 0.02 | 0.01 | 0.01 | 64 | 0 | 23.68 | 1 | 1 | 5.33 | 2.42 | 0 | 0 | 0 | 3 | 0 | 50.00 |
| 2425 | libggml-cpu.so - quants.c:2506-2590 [...] | ggml_vec_dot_q6_K_q8_K | Innermost | 0.12 | 0.21 | 0.21 | 0.01 | 0.01 | 0.01 | 0.01 | 84 | 50.56 | 65.8 | 1 | 1 | 1.47 | 1 | 2 | 0 | 1 | 19 | 0 | 55.68 |
| 908 | libggml-cpu.so - vec.cpp:311-316 | ggml_vec_dot_f16 | Single | 0.35 | 0.20 | 0.20 | 0.01 | 0.01 | 0.01 | 0.01 | 61 | 50 | 100 | 1 | 1 | 1 | 2.26 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 1908 | libggml-cpu.so - vec.h:491-497 | ggml_compute_forward_flash_attn_ext | Innermost | 0.35 | 0.17 | 0.17 | 0.02 | 0.02 | 0.00 | 0.00 | 51 | 40 | 100 | 1 | 1 | 1 | 2.28 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 0 | libggml-cpu.so - ggml-cpu.c:3228-3229 [...] | ggml_cpu_fp32_to_fp16 | Single | 0.35 | 0.14 | 0.14 | 0.01 | 0.01 | 0.00 | 0.00 | 47 | 91.67 | 98.61 | 1 | 1 | 1 | 2.43 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 2511 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:127-139 [...] | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Innermost | 6.00 | 0.13 | 0.13 | 0.26 | 0.26 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 0 | 0 | 0 | 1 | 50.00 |
| 1591 | libggml-cpu.so - ops.cpp:6446-6456 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.23 | 0.08 | 0.08 | 0.01 | 0.01 | 0.00 | 0.00 | 32 | 55.56 | 43.75 | 1.07 | 1.58 | 2.35 | 1.88 | 0 | 0 | 1 | 2 | 0 | 58.33 |
| 2512 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:115-118 | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Innermost | 3.35 | 0.07 | 0.07 | 0.14 | 0.14 | 0.00 | 0.00 | 1 | 0 | 31.25 | 1 | 1 | 5.33 | 1 | 0 | 0 | 0 | 1 | 1 | 25.00 |
| 1354 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_rms_norm | Innermost | 0.12 | 0.05 | 0.05 | 0.01 | 0.01 | 0.00 | 0.00 | 21 | 50 | 100 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 73 | libggml-cpu.so - ggml-cpu.c:533-2897 [...] | ggml_graph_compute_thread | Outermost | 0.23 | 0.04 | 0.04 | 0.01 | 0.01 | 0.00 | 0.00 | 16 | 0 | 38.84 | 1 | 1 | 5.33 | 1.78 | NA | NA | NA | NA | NA | 0.00 |
| 1587 | libggml-cpu.so - ops.cpp:6210-6462 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.23 | 0.04 | 1.27 | 0.01 | 0.05 | 0.00 | 0.03 | 13 | 0 | 39.72 | 5.92 | 1.4 | 3.04 | 1.73 | NA | NA | NA | NA | NA | 0.00 |
| 1588 | libggml-cpu.so - ops.cpp:6210-6484 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Outermost | 0.12 | 0.03 | 1.39 | 0.01 | 0.05 | 0.00 | 0.04 | 13 | 0 | 41.88 | 1 | 1 | 3.01 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2426 | libggml-cpu.so - quants.c:2492-2660 [...] | ggml_vec_dot_q6_K_q8_K | Outermost | 0.12 | 0.03 | 0.24 | 0.01 | 0.01 | 0.00 | 0.01 | 12 | 19.23 | 39.9 | 1 | 1 | 2.32 | 1 | 0 | 0 | 0 | 22 | 0 | 50.00 |
| 1893 | libggml-cpu.so - vec.h:375-751 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.12 | 0.03 | 1.46 | 0.01 | 0.05 | 0.00 | 0.04 | 12 | 0 | 44.59 | 2.01 | 1.34 | 1.34 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2510 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:107-154 [...] | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Outermost | 1.39 | 0.03 | 0.23 | 0.06 | 0.46 | 0.00 | 0.01 | 1 | 0 | 46.25 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1914 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_flash_attn_ext | Innermost | 0.12 | 0.02 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 7 | 50 | 100 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 |