| Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime gcc_0 (%) | Exclusive Coverage gcc_0 (%) | Inclusive Coverage gcc_0 (%) | Max Exclusive Time Over Threads gcc_0 (s) | Max Inclusive Time Over Threads gcc_0 (s) | Exclusive Time w.r.t. Wall Time gcc_0 (s) | Inclusive Time w.r.t. Wall Time gcc_0 (s) | Nb Threads gcc_0 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing gcc_0 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
|---|
| 2059 | libggml-cpu.so - quants.c:1010-1026 [...] | ggml_vec_dot_q8_0_q8_0 | Single | 77.77 | 81.29 | 81.29 | 14.64 | 14.64 | 14.53 | 14.53 | 64 | NA | NA | NA | NA | NA | 1.03 | NA | NA | NA | NA | NA | 0.00 |
| 1530 | libggml-cpu.so - vec.h:282-725 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.56 | 0.18 | 0.36 | 0.10 | 0.19 | 0.03 | 0.06 | 32 | 15.2 | 37.13 | 3.13 | 1 | 1.53 | 1.66 | NA | NA | NA | NA | NA | 0.00 |
| 60 | libggml-cpu.so - ggml-cpu.c:1162-1198 [...] | ggml_compute_forward_mul_mat | InBetween | 0.40 | 0.18 | 0.18 | 0.07 | 0.07 | 0.03 | 0.03 | 64 | 0 | 28.82 | 1 | 1 | 2 | 2.43 | NA | NA | NA | NA | NA | 0.00 |
| 2058 | libggml-cpu.so - quants.c:910-929 [...] | ggml_vec_dot_q8_0_q8_0 | Innermost | 0.19 | 0.18 | 0.18 | 0.04 | 0.04 | 0.03 | 0.03 | 64 | 70 | 36.88 | 1.22 | 1.14 | 2.73 | 1.14 | 0 | 2 | 0 | 0 | 0 | 100.00 |
| 71 | libggml-cpu.so - ggml-cpu.c:1664-2898 [...] | ggml_graph_compute_thread | Outermost | 0.29 | 0.16 | 0.28 | 0.05 | 0.09 | 0.03 | 0.05 | 64 | 0 | 18.75 | 1 | 1 | 8 | 1.97 | NA | NA | NA | NA | NA | 0.00 |
| 1540 | libggml-cpu.so - vec.h:411-458 | ggml_compute_forward_flash_attn_ext | Innermost | 0.45 | 0.15 | 0.15 | 0.09 | 0.09 | 0.03 | 0.03 | 32 | 96.97 | 100 | 1 | 1 | 1 | 1.58 | 1 | 0 | 0 | 16 | 0 | 52.94 |
| 759 | libggml-cpu.so - vec.cpp:231-262 | ggml_vec_dot_f16 | Single | 0.42 | 0.14 | 0.14 | 0.08 | 0.08 | 0.03 | 0.03 | 32 | 100 | 100 | 1 | 1 | 1 | 1.58 | 0 | 0 | 0 | 16 | 0 | 50.00 |
| 70 | libggml-cpu.so - ggml-cpu.c:2879-2898 [...] | ggml_graph_compute_thread | Innermost | 0.37 | 0.12 | 0.12 | 0.07 | 0.07 | 0.02 | 0.02 | 59 | 0 | 31.25 | 1 | 1 | 3.75 | 2.99 | NA | NA | NA | NA | NA | 0.00 |
| 2038 | libggml-cpu.so - quants.c:49-75 [...] | quantize_row_q8_0 | Single | 0.21 | 0.12 | 0.12 | 0.04 | 0.04 | 0.02 | 0.02 | 63 | 32.69 | 23.7 | 1.07 | 1.29 | 2.12 | 1.87 | 1 | 2 | 0 | 0 | 0 | 100.00 |
| 61 | libggml-cpu.so - ggml-cpu.c:1125-1397 [...] | ggml_compute_forward_mul_mat | Outermost | 0.21 | 0.08 | 0.36 | 0.04 | 0.12 | 0.01 | 0.06 | 54 | 0 | 50 | 1 | 1 | 2 | 2.5 | NA | NA | NA | NA | NA | 0.00 |
| 2055 | libggml-cpu.so - quants.c:908-1128 [...] | ggml_vec_dot_q8_0_q8_0 | Outermost | 0.16 | 0.08 | 0.25 | 0.03 | 0.07 | 0.01 | 0.04 | 59 | 13.73 | 35.72 | 1.77 | 1 | 1.65 | 2.09 | NA | NA | NA | NA | NA | 0.00 |
| 780 | libggml-cpu.so - ops.cpp:6210-6245 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.19 | 0.07 | 0.07 | 0.04 | 0.04 | 0.01 | 0.01 | 56 | 1.79 | 13.13 | 1.8 | 1.42 | 7.75 | 2.48 | 1 | 0 | 0 | 0 | 1 | 50.00 |
| 56 | libggml-cpu.so - ggml-cpu.c:1193-1194 | ggml_compute_forward_mul_mat | Innermost | 0.19 | 0.05 | 0.05 | 0.04 | 0.04 | 0.01 | 0.01 | 50 | 0 | 22.5 | 1 | 1 | 5.65 | 3.1 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 62 | libggml-cpu.so - ggml-cpu.c:1125-1395 [...] | ggml_compute_forward_mul_mat | Innermost | 0.11 | 0.04 | 0.04 | 0.02 | 0.02 | 0.01 | 0.01 | 46 | 0 | 30.47 | 1 | 1 | 2 | 2.02 | NA | NA | NA | NA | NA | 0.00 |
| 761 | libggml-cpu.so - vec.cpp:385-387 [...] | ggml_vec_swiglu_f32 | Single | 1.38 | 0.02 | 0.02 | 0.26 | 0.26 | 0.00 | 0.00 | 2 | 80 | 97.58 | 1 | 1 | 1.03 | 1.96 | 0 | 0 | 0 | 3 | 0 | 50.00 |
| 67 | libggml-cpu.so - ggml-cpu.c:1291-1297 | ggml_compute_forward_mul_mat | Innermost | 0.05 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 21 | 0 | 25.63 | 1 | 1 | 2 | 1.62 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 1531 | libggml-cpu.so - ops.cpp:8817-8819 [...] | ggml_compute_forward_flash_attn_ext | Innermost | 0.08 | 0.01 | 0.01 | 0.02 | 0.02 | 0.00 | 0.00 | 18 | 0 | 14.58 | 1.22 | 1.63 | 9.9 | 2.08 | 1 | 1 | 0 | 0 | 0 | 100.00 |
| 1538 | libggml-cpu.so - ops.cpp:8825-8826 | ggml_compute_forward_flash_attn_ext | Innermost | 0.08 | 0.01 | 0.01 | 0.02 | 0.02 | 0.00 | 0.00 | 16 | NA | NA | NA | NA | NA | 2.29 | NA | NA | NA | NA | NA | 0.00 |
| 3 | libggml-cpu.so - ggml-cpu.c:3228-3229 [...] | ggml_cpu_fp32_to_fp16 | Single | 0.19 | 0.01 | 0.01 | 0.04 | 0.04 | 0.00 | 0.00 | 9 | 95.35 | 93.9 | 1 | 1 | 1 | 3.71 | 0 | 0 | 0 | 3 | 0 | 50.00 |
| 1151 | libggml-cpu.so - ops.cpp:4325-4326 | ggml_compute_forward_rms_norm | Innermost | 0.42 | 0.01 | 0.01 | 0.08 | 0.08 | 0.00 | 0.00 | 2 | 0 | 15.63 | 1 | 2.29 | 6.86 | 1.88 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 790 | libggml-cpu.so - ops.cpp:6446-6457 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.05 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 11 | 42.86 | 35.71 | 1 | 1 | 1.6 | 1.38 | 2 | 0 | 0 | 7 | 0 | 61.11 |
| 757 | libggml-cpu.so - vec.cpp:224-337 [...] | ggml_vec_dot_f16 | Outermost | 0.08 | 0.01 | 0.01 | 0.02 | 0.02 | 0.00 | 0.00 | 11 | 41.67 | 69.66 | 1 | 1 | 1.23 | 2.36 | NA | NA | NA | NA | NA | 0.00 |
| 58 | libggml-cpu.so - ggml-cpu.c:1193-1397 [...] | ggml_compute_forward_mul_mat | Innermost | 0.05 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 13 | NA | NA | NA | NA | NA | 1.86 | NA | NA | NA | NA | NA | 0.00 |
| 498 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.27 | 0.00 | 0.00 | 0.05 | 0.05 | 0.00 | 0.00 | 1 | 100 | 50 | 1 | 1 | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 100.00 |
| 387 | libggml-cpu.so - traits.cpp:13-17 | ggml_cpu_extra_compute_forward | Single | 0.08 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 8 | 0 | 23.96 | 1 | 1 | 5.04 | 2.4 | 0 | 1 | 0 | 2 | 0 | 74.38 |
| 424 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.24 | 0.00 | 0.00 | 0.05 | 0.05 | 0.00 | 0.00 | 1 | 100 | 50 | 1 | 1 | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 100.00 |
| 3488 | libllama.so - stl_algo.h:1594-1595 [...] | llama_token_data_array_partial_sort_inplace(llama_token_data_array*, int) | Innermost | 0.21 | 0.00 | 0.00 | 0.04 | 0.04 | 0.00 | 0.00 | 1 | 0 | 15.18 | 2.17 | 1 | 6.12 | 1 | 1.5 | 0.5 | 0.5 | 0 | 0 | 93.75 |
| 63 | libggml-cpu.so - ggml-cpu.c:1132-1165 [...] | ggml_compute_forward_mul_mat | Innermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 7 | 0 | 24.64 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 781 | libggml-cpu.so - ops.cpp:6210-6490 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Outermost | 0.05 | 0.00 | 0.08 | 0.01 | 0.04 | 0.00 | 0.02 | 5 | 24.49 | 26.02 | 2.11 | 1.59 | 4.51 | 1.43 | NA | NA | NA | NA | NA | 0.00 |
| 4137 | exec - sampling.cpp:125-126 [...] | common_sampler_sample(common_sampler*, llama_context*, int, bool) | Innermost | 0.16 | 0.00 | 0.00 | 0.03 | 0.03 | 0.00 | 0.00 | 1 | 25 | 18.75 | 1.5 | 1 | 8 | 1 | 0 | 1 | 1 | 3 | 0 | 65.00 |
| 68 | libggml-cpu.so - ggml-cpu.c:1290-1297 | ggml_compute_forward_mul_mat | InBetween | 0.03 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 5 | 0 | 33.33 | 1 | 1 | 2.58 | 1 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 1535 | libggml-cpu.so - vec.h:646-653 | ggml_compute_forward_flash_attn_ext | Innermost | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 3 | 100 | 100 | 1 | 1 | 1 | 1.8 | 0 | 0 | 0 | 2 | 0 | 50.00 |
| 776 | libggml-cpu.so - ops.cpp:6210-6481 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.03 | 0.00 | 0.07 | 0.00 | 0.04 | 0.00 | 0.01 | 5 | 0 | 24.81 | 6.77 | 1.31 | 4.65 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1150 | libggml-cpu.so - vec.h:646-653 | ggml_compute_forward_rms_norm | Innermost | 0.11 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 1 | 100 | 100 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 2 | 0 | 50.00 |
| 4534 | libllama.so - hashtable.h:824-2079 [...] | std::_Hashtable<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const, unsigned char>, s... | Outermost | 0.11 | 0.00 | 0.00 | 0.02 | 0.03 | 0.00 | 0.00 | 1 | 0 | 36.72 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 3833 | libllama.so - hashtable_policy.h:387-2058 [...] | llama_vocab::~llama_vocab() | Single | 0.11 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | 0 | 0 | 0 | 2 | 0 | 50.00 |
| 57 | libggml-cpu.so - ggml-cpu.c:1197-1198 | ggml_compute_forward_mul_mat | Innermost | 0.03 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 4 | 0 | 25 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 35 | libggml-base.so - ggml.c:1363-1388 [...] | ggml_is_contiguous_0 | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 4 | 0 | 24.04 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1211 | libggml-cpu.so - ops.cpp:5330-5517 [...] | ggml_compute_forward_get_rows | Outermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 4 | 0 | 39.15 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 4164 | libllama.so - hashtable.h:2627-2644 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Innermost | 0.08 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 2 | 1 | 0 | 0 | 0 | 4 | 1 | 40.00 |
| 1537 | libggml-cpu.so - ops.cpp:8885-8886 [...] | ggml_compute_forward_flash_attn_ext | Innermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 2 | 100 | 56.25 | 1 | 1 | 1.14 | 1 | 2 | 0 | 0 | 0 | 0 | 100.00 |
| 775 | libggml-cpu.so - ops.cpp:6210-6481 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.03 | 0.00 | 0.07 | 0.00 | 0.04 | 0.00 | 0.01 | 2 | 0 | 22.79 | 1 | 1 | 5.05 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 341 | exec - stl_algobase.h:401-405 [...] | std::vector<std::__cxx11::sub_match<__gnu_cxx::__normal_iterator<char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, std::allocator<std::__cxx11::sub_match<__gnu_cxx::__no... | Single | 0.05 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 18.75 | 1 | 1 | 6.03 | 1 | 0 | 0 | 2 | 0 | 0 | 75.00 |
| 777 | libggml-cpu.so - ops.cpp:6210-6481 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.03 | 0.00 | 0.07 | 0.01 | 0.04 | 0.00 | 0.01 | 2 | 0 | 29.65 | 1 | 1 | 2.94 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1532 | libggml-cpu.so - ops.cpp:8778-8920 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.03 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 15.6 | 35.32 | 8.06 | 1.01 | 1.46 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 234 | libggml-cpu.so - repack.cpp:1979-1982 | ggml_backend_cpu_repack_buffer_type() | Single | 0.03 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0 | 37.5 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 675 | libllama.so - llama-graph.h:396-396 [...] | llama_context::process_ubatch(llama_ubatch const&, llm_graph_type, llama_memory_context_i*, ggml_status&) | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 21.15 | 1 | 1 | 8 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 3982 | libllama.so - char_traits.h:381-381 [...] | llama_vocab::impl::load(llama_model_loader&, LLM_KV const&) | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 16.67 | 19.79 | 3 | 1 | 12.15 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1619 | libggml-cpu.so - ops.cpp:3433-9815 [...] | ggml_compute_forward_glu | Outermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 23.62 | 1 | 1 | 1.32 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 3981 | libllama.so - llama-vocab.cpp:2312-2336 [...] | llama_vocab::impl::load(llama_model_loader&, LLM_KV const&) | Outermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 10 | 18.75 | 2.67 | 1 | 8 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 639 | libllama.so - llama-context.cpp:420-433 | llama_context::synchronize() | Innermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 25.35 | 1 | 1 | 6.4 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 36 | libggml-base.so - ggml.c:1363-1392 [...] | ggml_is_contiguous_1 | Outermost | 0.03 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 28.57 | 1 | 1 | 3.56 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1902 | libllama.so - stl_tree.h:786-1948 [...] | llama_kv_cache::apply_ubatch(llama_kv_cache::slot_info const&, llama_ubatch const&) | Innermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | NA | NA | 1 | NA | NA | 1 | 0 | 0 | 0 | 1 | 0 | 50.00 |
| 1676 | libllama.so - llama-impl.cpp:145-157 [...] | gguf_kv_to_str[abi:cxx11](gguf_context const*, int) | Innermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 21.98 | 1 | 1 | 6.72 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 37 | libggml-base.so - ggml.c:1365-1392 [...] | ggml_is_contiguous_1 | Innermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 26.79 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1861 | libllama.so - stl_algobase.h:951-952 | llama_kv_cache::set_input_kq_mask(ggml_tensor*, llama_ubatch const*, bool) const | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 100 | 50 | 1 | 1 | 2 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 |
| 3988 | libllama.so - llama-vocab.cpp:2148-2289 [...] | llama_vocab::impl::load(llama_model_loader&, LLM_KV const&) | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 6.67 | 18.59 | 2.75 | 1 | 11.88 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1654 | libllama.so - basic_string.h:198-2708 [...] | replace_all(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<... | Outermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 30.89 | 1 | 1 | 3.97 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 3767 | libllama.so - basic_string.h:1077-3760 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 607 | libggml-base.so - ggml-impl.h:346-377 [...] | dequantize_row_q8_0 | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 84.35 | 41.42 | 1.09 | 1.38 | 2.06 | 1 | 0 | 2 | 0 | 0 | 0 | 100.00 |
| 206 | exec - stl_construct.h:162-162 [...] | std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >::~vector() | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | 0 | 0 | 0.5 | 1 | 0 | 56.25 |
| 243 | libggml-base.so - ggml-backend.cpp:643-1268 [...] | ggml_backend_sched_split_graph | InBetween | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 22.08 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1533 | libggml-cpu.so - ops.cpp:8778-8920 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.03 | 0.00 | 0.02 | 0.01 | 0.02 | 0.00 | 0.00 | 1 | 0 | 30.59 | 6 | 1 | 2.77 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 4337 | libllama.so - vector.tcc:95-695 [...] | unicode_cpts_from_utf8(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) | InBetween | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 24.34 | 1 | 1 | 5.58 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1193 | libggml-base.so - gguf.cpp:226-281 [...] | bool gguf_read_emplace_helper<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >(gguf_reader const&, std::vector<gguf_kv, std::allocator<gguf_kv> >&, std::__cxx11::basic_string<c... | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 25.89 | 1 | 1 | 5.6 | 1 | 2 | 0 | 1 | 0 | 0 | 91.67 |
| 98 | libggml-cpu.so - ggml-cpu.cpp:61-64 | ggml_backend_cpu_get_extra_buffer_types() | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 1192 | libggml-base.so - stl_uninitialized.h:642-642 [...] | bool gguf_read_emplace_helper<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >(gguf_reader const&, std::vector<gguf_kv, std::allocator<gguf_kv> >&, std::__cxx11::basic_string<c... | Single | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 26.04 | 1 | 1 | 3.76 | 1 | 0 | 0 | 0 | 0 | 0 | 0.00 |
| 1220 | libggml-cpu.so - ops.cpp:5550-5563 | ggml_compute_forward_set_rows | Outermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | NA | NA | NA | NA | NA | 1 | NA | NA | NA | NA | NA | 0.00 |
| 4535 | libllama.so - basic_string.h:1077-3760 [...] | std::_Hashtable<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const, unsigned char>, s... | Innermost | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 2 | 1 | 0.67 | 0 | 0 | 2 | 0 | 61.11 |
