| Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime orig_0 (%) | Exclusive Coverage orig_0 (%) | Inclusive Coverage orig_0 (%) | Max Exclusive Time Over Threads orig_0 (s) | Max Inclusive Time Over Threads orig_0 (s) | Exclusive Time w.r.t. Wall Time orig_0 (s) | Inclusive Time w.r.t. Wall Time orig_0 (s) | Nb Threads orig_0 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing orig_0 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
|---|
| 310 | libggml-cpu.so - quants.c:322-329 [...] | ggml_vec_dot_q8_0_q8_0 | Single | 68.00 | 68.63 | 68.63 | 8.68 | 8.68 | 8.18 | 8.18 | 96 | 66.67 | 59.52 | 1.33 | 1.33 | 1.64 | 1.08 | 0 | 0 | 0 | 0 | 0 | 0.00 |
| 70 | libggml-cpu.so - ggml-cpu.c:533-2897 [...] | ggml_graph_compute_thread | Innermost | 1.25 | 0.58 | 0.58 | 0.16 | 0.16 | 0.07 | 0.07 | 85 | 0 | 51.92 | 1 | 1 | 1.13 | 2.08 | NA | NA | NA | NA | NA | 0.00 |
| 1694 | libggml-cpu.so - ops.cpp:8817-8881 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 2.00 | 0.52 | 0.68 | 0.25 | 0.32 | 0.06 | 0.08 | 33 | 9.52 | 38.81 | 2.51 | 2.46 | 1.19 | 1.43 | NA | NA | NA | NA | NA | 0.00 |
| 71 | libggml-cpu.so - ggml-cpu.c:533-2897 [...] | ggml_graph_compute_thread | Outermost | 0.67 | 0.31 | 0.89 | 0.09 | 0.22 | 0.04 | 0.11 | 92 | 0 | 40.38 | 1 | 1 | 4 | 2.2 | NA | NA | NA | NA | NA | 0.00 |
| 52 | libggml-cpu.so - ggml-cpu.c:1163-1198 [...] | ggml_compute_forward_mul_mat | InBetween | 0.35 | 0.16 | 0.25 | 0.05 | 0.06 | 0.02 | 0.03 | 92 | 0 | 52.21 | 1 | 1 | 1.33 | 2.26 | NA | NA | NA | NA | NA | 0.00 |
| 1706 | libggml-cpu.so - vec.h:491-497 | ggml_compute_forward_flash_attn_ext | Innermost | 0.74 | 0.16 | 0.16 | 0.09 | 0.09 | 0.02 | 0.02 | 32 | 100 | 81.82 | 1 | 1 | 1.5 | 1.71 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 301 | libggml-base.so - ggml-quants.c:203-219 [...] | quantize_row_q8_0_ref | Single | 0.39 | 0.11 | 0.11 | 0.05 | 0.05 | 0.01 | 0.01 | 91 | 14.02 | 35.29 | 2.86 | 1 | 1.85 | 3.53 | NA | NA | NA | NA | NA | 0.00 |
| 49 | libggml-cpu.so - ggml-cpu.c:1183-1194 [...] | ggml_compute_forward_mul_mat | Innermost | 0.24 | 0.08 | 0.08 | 0.03 | 0.03 | 0.01 | 0.01 | 79 | 0 | 47.22 | 1 | 1 | 2.5 | 2.53 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 760 | libggml-cpu.so - vec.cpp:311-316 | ggml_vec_dot_f16 | Single | 0.39 | 0.08 | 0.08 | 0.05 | 0.05 | 0.01 | 0.01 | 32 | 100 | 75 | 1 | 1 | 2 | 1.8 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 1395 | libggml-cpu.so - ops.cpp:6220-6245 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.20 | 0.08 | 0.08 | 0.03 | 0.03 | 0.01 | 0.01 | 84 | 14.29 | 32.14 | 1 | 1.38 | 3.3 | 2.47 | 2 | 0 | 0 | 1 | 0 | 83.33 |
| 59 | libggml-cpu.so - ggml-cpu.c:1249-1260 | ggml_compute_forward_mul_mat | Innermost | 0.12 | 0.02 | 0.02 | 0.02 | 0.02 | 0.00 | 0.00 | 32 | 0 | 46.77 | 1 | 1 | 1.11 | 2.23 | 5 | 0 | 0 | 0 | 0 | 100.00 |
| 767 | libggml-cpu.so - vec.h:1045-1073 [...] | ggml_vec_swiglu_f32 | Single | 1.45 | 0.02 | 0.02 | 0.19 | 0.19 | 0.00 | 0.00 | 2 | 85.13 | 92.56 | 1.04 | 1 | 1 | 1.95 | 2 | 1 | 0 | 0 | 0 | 100.00 |
| 48 | libggml-cpu.so - ggml-cpu.c:1125-1395 [...] | ggml_compute_forward_mul_mat | Outermost | 0.12 | 0.01 | 0.27 | 0.02 | 0.06 | 0.00 | 0.03 | 28 | 0 | 52.27 | 1 | 1 | 1 | 2.71 | NA | NA | NA | NA | NA | 0.00 |
| 1170 | libggml-cpu.so - ops.cpp:4325-4326 | ggml_compute_forward_rms_norm | Innermost | 0.86 | 0.01 | 0.01 | 0.11 | 0.11 | 0.00 | 0.00 | 1 | 35 | 62.5 | 1 | 1.22 | 1.33 | 1 | 0 | 1 | 0 | 0 | 0 | 100.00 |
| 343 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.82 | 0.01 | 0.01 | 0.11 | 0.11 | 0.00 | 0.00 | 2 | 0 | 30 | 1 | 1 | 4 | 1.91 | 3 | 0 | 0 | 0 | 0 | 100.00 |
| 1390 | libggml-cpu.so - ops.cpp:6446-6456 | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.12 | 0.01 | 0.01 | 0.02 | 0.02 | 0.00 | 0.00 | 14 | 40 | 45 | 1.3 | 1.3 | 2.48 | 2 | 1 | 0 | 0 | 2 | 0 | 66.67 |
| 0 | libggml-cpu.so - ggml-cpu.c:3228-3229 [...] | ggml_cpu_fp32_to_fp16 | Single | 0.12 | 0.01 | 0.01 | 0.02 | 0.02 | 0.00 | 0.00 | 15 | 97.5 | 98.75 | 1 | 1 | 1 | 2.37 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 429 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.67 | 0.01 | 0.01 | 0.09 | 0.09 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | 3 | 0 | 0 | 0 | 0 | 100.00 |
| 51 | libggml-cpu.so - ggml-cpu.c:1162-1198 [...] | ggml_compute_forward_mul_mat | InBetween | 0.08 | 0.01 | 0.25 | 0.01 | 0.07 | 0.00 | 0.03 | 12 | 0 | 50 | 1 | 1 | 2 | 1.85 | NA | NA | NA | NA | NA | 0.00 |
| 757 | libggml-cpu.so - vec.cpp:321-337 [...] | ggml_vec_dot_f16 | Single | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 9 | 20 | 50 | 1 | 1 | 1 | 1.8 | NA | NA | NA | NA | NA | 0.00 |
| 2221 | libllama.so - stl_heap.h:140-263 [...] | llama_token_data_array_partial_sort_inplace(llama_token_data_array*, int) | Outermost | 0.39 | 0.00 | 0.00 | 0.05 | 0.05 | 0.00 | 0.00 | 1 | 0 | 37.5 | 4.67 | 1 | 2.87 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1387 | libggml-cpu.so - ops.cpp:6407-6484 | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 9 | 0 | 42.59 | 1 | 1 | 2.68 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 338 | libggml-cpu.so - traits.cpp:13-17 [...] | ggml_cpu_extra_compute_forward | Single | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 7 | 0 | 50 | 1 | 1 | 2 | 1.75 | 0 | 1 | 0 | 2 | 0 | 74.38 |
| 1685 | libggml-cpu.so - vec.h:375-751 [...] | ggml_compute_forward_flash_attn_ext | Outermost | 0.08 | 0.00 | 0.68 | 0.01 | 0.32 | 0.00 | 0.08 | 6 | 0 | 48.98 | 4.03 | 1.34 | 1.34 | 1.71 | NA | NA | NA | NA | NA | 0.00 |
| 56 | libggml-cpu.so - ggml-cpu.c:1289-1297 | ggml_compute_forward_mul_mat | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 7 | 0 | 54.17 | 1 | 1 | 1.33 | 1 | 1 | 0 | 0 | 1 | 0 | 75.00 |
| 50 | libggml-cpu.so - ggml-cpu.c:1162-1198 [...] | ggml_compute_forward_mul_mat | InBetween | 0.04 | 0.00 | 0.26 | 0.01 | 0.06 | 0.00 | 0.03 | 7 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 3048 | exec - sampling.cpp:125-126 | common_sampler::set_logits(llama_context*, int) | Innermost | 0.20 | 0.00 | 0.00 | 0.03 | 0.03 | 0.00 | 0.00 | 1 | 75 | 87.5 | 1 | 1 | 1.1 | 1 | 0 | 1 | 0 | 1 | 0 | 75.00 |
| 1688 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_flash_attn_ext | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 5 | 100 | 100 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 53 | libggml-cpu.so - ggml-cpu.c:1197-1198 | ggml_compute_forward_mul_mat | Innermost | 0.04 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 5 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 57 | libggml-cpu.so - ggml-cpu.c:1289-1297 | ggml_compute_forward_mul_mat | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 5 | 0 | 60 | 1 | 1 | 1.43 | 1 | 1 | 0 | 0 | 1 | 0 | 75.00 |
| 1171 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_rms_norm | Innermost | 0.16 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 1 | 100 | 100 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 94 | libggml-cpu.so - ggml-cpu.cpp:39-63 [...] | ggml_backend_cpu_get_extra_buffer_types() | Single | 0.04 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 4 | 0 | 62.5 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 58 | libggml-cpu.so - ggml-cpu.c:1289-1297 | ggml_compute_forward_mul_mat | Outermost | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 4 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 75.00 |
| 1308 | libggml-cpu.so - ops.cpp:5352-5517 [...] | ggml_compute_forward_get_rows | Outermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 3 | 0 | 62.5 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 54 | libggml-cpu.so - ggml-cpu.c:1317-1328 | ggml_compute_forward_mul_mat | Innermost | 0.04 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0 | 46.09 | 1 | 1 | 1.43 | 1 | 4 | 0 | 0 | 0 | 0 | 100.00 |
| 1386 | libggml-cpu.so - ops.cpp:6210-6484 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.04 | 0.00 | 0.09 | 0.00 | 0.03 | 0.00 | 0.01 | 2 | 1.96 | 46.57 | 2.97 | 1 | 1.5 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2861 | libllama.so - new_allocator.h:172-172 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Single | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 46.35 | 1 | 1 | 2.53 | 1 | 0 | 0 | 0 | 2 | 0 | 50.00 |
| 1344 | exec - stl_algobase.h:401-405 [...] | std::vector<std::__cxx11::sub_match<__gnu_cxx::__normal_iterator<char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, std::allocator<std::__cxx11::sub_match<__gnu_cxx::__no... | Single | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 39.06 | 1 | 1 | 3.01 | 1 | 0 | 0 | 2 | 0 | 0 | 75.00 |
| 1347 | exec - regex_executor.tcc:180-513 [...] | std::__detail::_Executor<__gnu_cxx::__normal_iterator<char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::__cxx11::sub_match<__gnu_cxx::__normal_iterator<ch... | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 35.31 | 1 | 1 | 7.38 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2571 | libllama.so - basic_string.h:194-1084 [...] | llama_vocab::impl::load(llama_model_loader&, LLM_KV const&) | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 7.92 | 48.89 | 4.87 | 1 | 1.13 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2562 | libllama.so - llama-vocab.cpp:2298-2336 [...] | llama_vocab::impl::load(llama_model_loader&, LLM_KV const&) | InBetween | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 42.36 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1709 | libggml-cpu.so - vec.h:740-745 | ggml_compute_forward_flash_attn_ext | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 100 | 87.5 | 1 | 1 | 1.33 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 1527 | libllama.so - stl_tree.h:178-207 [...] | void std::vector<llama_kv_cells, std::allocator<llama_kv_cells> >::_M_realloc_append<llama_kv_cells>(llama_kv_cells&&) | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 12.14 | 53.57 | 3.13 | 1 | 1.5 | 1 | 0 | 0 | 0 | 6 | 0 | 50.00 |
| 2727 | libllama.so - hashtable.h:2077-2077 [...] | std::__detail::_Map_base<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const, int>, st... | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 0 | 0 | 0 | 2 | 0 | 50.00 |
| 2744 | libllama.so - hashtable.h:2627-2644 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 0.67 | 0 | 0 | 2 | 1 | 45.83 |
| 1385 | libggml-cpu.so - ops.cpp:6210-6484 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Outermost | 0.04 | 0.00 | 0.09 | 0.00 | 0.03 | 0.00 | 0.01 | 1 | 0 | 63.46 | 1 | 1 | 1.33 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1255 | libllama.so - ostream:578-673 [...] | gguf_kv_to_str[abi:cxx11](gguf_context const*, int) | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 42.38 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 881 | libggml-cpu.so - ops.cpp:711-713 | ggml_compute_forward_dup | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 1315 | libggml-cpu.so - vec.h:89-89 | ggml_compute_forward_get_rows | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 66.67 | 83.33 | 1 | 1 | 1.09 | 1 | 0 | 2 | 0 | 0 | 0 | 100.00 |
| 2876 | libllama.so - vector.tcc:114-694 [...] | unicode_cpts_from_utf8(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 1.15 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2743 | libllama.so - hashtable.h:2074-2077 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 2973 | libllama.so - char_traits.h:381-381 [...] | std::_Hashtable<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const, unsigned char>, s... | Outermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 75 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
