| Detailed Application Categorization |
| Detailed Function Times |
| Function Based Profile |
| Libraries |
Detailed Application Categorization
| ID | Time(s) | Binary(%) | MPI(%) | OMP(%) | TBB(%) | Math(%) | System(%) | Pthread(%) | IO(%) | String(%) | Memory(%) | libggml-base.so (%) | libggml-blas.so (%) | libggml-cpu.so (%) | libggml.so (%) | libllama.so (%) | Others(%) |
| ▼gcc_5– | 8.48 | 0.00 | 0.00 | 14.40 | 0.00 | 0.22 | 0.14 | 1.05 | 0.01 | 0.00 | 0.26 | 0.05 | 0.00 | 83.83 | 0.00 | 0.03 | 0.01 |
| ▼Node ip-172-31-46-37.ec2.internal– | 8.48 | 0.00 | 0.00 | 14.40 | 0.00 | 0.22 | 0.14 | 1.05 | 0.01 | 0.00 | 0.26 | 0.05 | 0.00 | 83.83 | 0.00 | 0.03 | 0.01 |
| ▼Process 539356– | 8.48 | 0.00 | 0.00 | 14.40 | 0.00 | 0.22 | 0.14 | 1.05 | 0.01 | 0.00 | 0.26 | 0.05 | 0.00 | 83.83 | 0.00 | 0.03 | 0.01 |
| ○Thread 539356 | 8.48 | 0.06 | 0.00 | 10.56 | 0.00 | 0.06 | 0.24 | 1.18 | 0.53 | 0.00 | 2.18 | 0.24 | 0.00 | 82.54 | 0.00 | 1.65 | 0.77 |
| ○Thread 539423 | 8.04 | 0.00 | 0.00 | 13.63 | 0.00 | 0.25 | 0.06 | 1.87 | 0.00 | 0.00 | 0.19 | 0.06 | 0.00 | 83.95 | 0.00 | 0.00 | 0.00 |
| ○Thread 539424 | 8.08 | 0.00 | 0.00 | 13.24 | 0.00 | 0.25 | 0.25 | 0.74 | 0.00 | 0.00 | 0.31 | 0.00 | 0.00 | 85.21 | 0.00 | 0.00 | 0.00 |
| ○Thread 539425 | 7.86 | 0.00 | 0.00 | 11.64 | 0.00 | 0.06 | 0.19 | 1.65 | 0.00 | 0.00 | 0.51 | 0.00 | 0.00 | 85.94 | 0.00 | 0.00 | 0.00 |
| ○Thread 539426 | 8.05 | 0.00 | 0.00 | 13.55 | 0.00 | 0.31 | 0.06 | 0.93 | 0.00 | 0.00 | 0.06 | 0.19 | 0.00 | 84.90 | 0.00 | 0.00 | 0.00 |
| ○Thread 539427 | 8.09 | 0.00 | 0.00 | 13.85 | 0.00 | 0.31 | 0.12 | 0.93 | 0.00 | 0.00 | 0.31 | 0.12 | 0.00 | 84.35 | 0.00 | 0.00 | 0.00 |
| ○Thread 539428 | 8.13 | 0.00 | 0.00 | 12.61 | 0.00 | 0.49 | 0.12 | 1.11 | 0.00 | 0.00 | 0.18 | 0.06 | 0.00 | 85.42 | 0.00 | 0.00 | 0.00 |
| ○Thread 539429 | 7.98 | 0.00 | 0.00 | 14.11 | 0.00 | 0.63 | 0.19 | 0.63 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 84.26 | 0.00 | 0.00 | 0.00 |
| ○Thread 539430 | 8.02 | 0.00 | 0.00 | 15.78 | 0.00 | 0.31 | 0.06 | 1.37 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 82.35 | 0.00 | 0.00 | 0.00 |
| ○Thread 539431 | 8.16 | 0.00 | 0.00 | 16.79 | 0.00 | 0.12 | 0.31 | 0.43 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 82.23 | 0.00 | 0.00 | 0.00 |
| ○Thread 539432 | 8.07 | 0.00 | 0.00 | 12.39 | 0.00 | 0.25 | 0.06 | 0.68 | 0.00 | 0.00 | 0.50 | 0.12 | 0.00 | 86.00 | 0.00 | 0.00 | 0.00 |
| ○Thread 539433 | 7.99 | 0.00 | 0.00 | 13.84 | 0.00 | 0.31 | 0.06 | 1.00 | 0.00 | 0.00 | 0.25 | 0.00 | 0.00 | 84.53 | 0.00 | 0.00 | 0.00 |
| ○Thread 539434 | 8.08 | 0.00 | 0.00 | 15.85 | 0.00 | 0.31 | 0.19 | 1.05 | 0.00 | 0.00 | 0.00 | 0.06 | 0.00 | 82.54 | 0.00 | 0.00 | 0.00 |
| ○Thread 539435 | 8.04 | 0.00 | 0.00 | 13.74 | 0.00 | 0.12 | 0.12 | 1.74 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 84.14 | 0.00 | 0.00 | 0.00 |
| ○Thread 539436 | 8.16 | 0.00 | 0.00 | 15.99 | 0.00 | 0.43 | 0.06 | 0.80 | 0.00 | 0.00 | 0.12 | 0.06 | 0.00 | 82.54 | 0.00 | 0.00 | 0.00 |
| ○Thread 539437 | 8.11 | 0.00 | 0.00 | 15.11 | 0.00 | 0.06 | 0.12 | 0.68 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 83.84 | 0.00 | 0.00 | 0.00 |
| ○Thread 539438 | 7.98 | 0.00 | 0.00 | 15.49 | 0.00 | 0.19 | 0.06 | 0.94 | 0.00 | 0.00 | 0.38 | 0.00 | 0.00 | 82.95 | 0.00 | 0.00 | 0.00 |
| ○Thread 539439 | 8.04 | 0.00 | 0.00 | 15.05 | 0.00 | 0.06 | 0.06 | 1.43 | 0.00 | 0.00 | 0.19 | 0.19 | 0.00 | 83.02 | 0.00 | 0.00 | 0.00 |
| ○Thread 539440 | 8.06 | 0.00 | 0.00 | 13.84 | 0.00 | 0.25 | 0.19 | 1.06 | 0.00 | 0.00 | 0.31 | 0.25 | 0.00 | 84.11 | 0.00 | 0.00 | 0.00 |
| ○Thread 539441 | 8.14 | 0.00 | 0.00 | 14.57 | 0.00 | 0.00 | 0.31 | 0.49 | 0.00 | 0.00 | 0.37 | 0.00 | 0.00 | 84.27 | 0.00 | 0.00 | 0.00 |
| ○Thread 539442 | 7.99 | 0.00 | 0.00 | 15.77 | 0.00 | 0.13 | 0.31 | 0.75 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 82.85 | 0.00 | 0.00 | 0.00 |
| ○Thread 539443 | 7.96 | 0.00 | 0.00 | 14.26 | 0.00 | 0.31 | 0.13 | 0.94 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 84.17 | 0.00 | 0.00 | 0.00 |
| ○Thread 539444 | 8.03 | 0.00 | 0.00 | 16.50 | 0.00 | 0.12 | 0.12 | 0.62 | 0.00 | 0.00 | 0.44 | 0.00 | 0.00 | 82.19 | 0.00 | 0.00 | 0.00 |
| ○Thread 539445 | 8.10 | 0.00 | 0.00 | 15.63 | 0.00 | 0.06 | 0.19 | 1.54 | 0.00 | 0.00 | 0.19 | 0.06 | 0.00 | 82.33 | 0.00 | 0.00 | 0.00 |
| ○Thread 539446 | 8.13 | 0.00 | 0.00 | 16.80 | 0.00 | 0.12 | 0.00 | 0.68 | 0.00 | 0.00 | 0.25 | 0.12 | 0.00 | 82.03 | 0.00 | 0.00 | 0.00 |
| ○Thread 539447 | 8.06 | 0.00 | 0.00 | 17.06 | 0.00 | 0.19 | 0.19 | 0.87 | 0.00 | 0.00 | 0.43 | 0.06 | 0.00 | 81.20 | 0.00 | 0.00 | 0.00 |
| ○Thread 539448 | 8.17 | 0.00 | 0.00 | 15.19 | 0.00 | 0.18 | 0.00 | 1.41 | 0.00 | 0.00 | 0.18 | 0.06 | 0.00 | 82.98 | 0.00 | 0.00 | 0.00 |
| ○Thread 539449 | 8.01 | 0.00 | 0.00 | 13.12 | 0.00 | 0.00 | 0.06 | 0.62 | 0.00 | 0.00 | 0.44 | 0.00 | 0.00 | 85.76 | 0.00 | 0.00 | 0.00 |
| ○Thread 539450 | 8.07 | 0.00 | 0.00 | 14.51 | 0.00 | 0.19 | 0.25 | 1.12 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 83.76 | 0.00 | 0.00 | 0.00 |
| ○Thread 539451 | 8.16 | 0.00 | 0.00 | 13.66 | 0.00 | 0.55 | 0.12 | 0.37 | 0.00 | 0.00 | 0.25 | 0.00 | 0.00 | 85.05 | 0.00 | 0.00 | 0.00 |
| ○Thread 539452 | 8.01 | 0.00 | 0.00 | 15.11 | 0.00 | 0.25 | 0.19 | 0.94 | 0.00 | 0.00 | 0.19 | 0.06 | 0.00 | 83.27 | 0.00 | 0.00 | 0.00 |
| ○Thread 539453 | 8.06 | 0.00 | 0.00 | 15.15 | 0.00 | 0.12 | 0.12 | 1.06 | 0.00 | 0.00 | 0.31 | 0.00 | 0.00 | 83.24 | 0.00 | 0.00 | 0.00 |
| ○Thread 539454 | 8.16 | 0.00 | 0.00 | 13.36 | 0.00 | 0.49 | 0.18 | 0.67 | 0.00 | 0.00 | 0.06 | 0.12 | 0.00 | 85.11 | 0.00 | 0.00 | 0.00 |
| ○Thread 539455 | 7.93 | 0.00 | 0.00 | 14.89 | 0.00 | 0.19 | 0.19 | 1.14 | 0.00 | 0.00 | 0.38 | 0.00 | 0.00 | 83.22 | 0.00 | 0.00 | 0.00 |
| ○Thread 539456 | 8.03 | 0.00 | 0.00 | 14.76 | 0.00 | 0.19 | 0.06 | 1.31 | 0.00 | 0.00 | 0.25 | 0.12 | 0.00 | 83.31 | 0.00 | 0.00 | 0.00 |
| ○Thread 539457 | 7.95 | 0.00 | 0.00 | 15.17 | 0.00 | 0.25 | 0.13 | 0.76 | 0.00 | 0.00 | 0.25 | 0.00 | 0.00 | 83.45 | 0.00 | 0.00 | 0.00 |
| ○Thread 539458 | 8.01 | 0.00 | 0.00 | 13.55 | 0.00 | 0.19 | 0.12 | 1.69 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 84.32 | 0.00 | 0.00 | 0.00 |
| ○Thread 539459 | 8.14 | 0.00 | 0.00 | 15.37 | 0.00 | 0.37 | 0.31 | 0.98 | 0.00 | 0.00 | 0.43 | 0.06 | 0.00 | 82.48 | 0.00 | 0.00 | 0.00 |
| ○Thread 539460 | 8.15 | 0.00 | 0.00 | 15.78 | 0.00 | 0.12 | 0.18 | 1.35 | 0.00 | 0.00 | 0.18 | 0.06 | 0.00 | 82.32 | 0.00 | 0.00 | 0.00 |
| ○Thread 539461 | 8.20 | 0.00 | 0.00 | 13.79 | 0.00 | 0.18 | 0.00 | 1.22 | 0.00 | 0.00 | 0.00 | 0.06 | 0.00 | 84.75 | 0.00 | 0.00 | 0.00 |
| ○Thread 539462 | 8.13 | 0.00 | 0.00 | 12.49 | 0.00 | 0.18 | 0.00 | 1.17 | 0.00 | 0.00 | 0.18 | 0.00 | 0.00 | 85.97 | 0.00 | 0.00 | 0.00 |
| ○Thread 539463 | 8.03 | 0.00 | 0.00 | 14.57 | 0.00 | 0.19 | 0.12 | 1.43 | 0.00 | 0.00 | 0.12 | 0.06 | 0.00 | 83.50 | 0.00 | 0.00 | 0.00 |
| ○Thread 539464 | 8.11 | 0.00 | 0.00 | 16.16 | 0.00 | 0.19 | 0.12 | 0.49 | 0.00 | 0.00 | 0.25 | 0.00 | 0.00 | 82.79 | 0.00 | 0.00 | 0.00 |
| ○Thread 539465 | 8.09 | 0.00 | 0.00 | 14.47 | 0.00 | 0.19 | 0.06 | 0.93 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 84.17 | 0.00 | 0.00 | 0.00 |
| ○Thread 539466 | 8.05 | 0.00 | 0.00 | 14.41 | 0.00 | 0.12 | 0.12 | 1.06 | 0.00 | 0.00 | 0.31 | 0.06 | 0.00 | 83.91 | 0.00 | 0.00 | 0.00 |
| ○Thread 539467 | 7.96 | 0.00 | 0.00 | 14.71 | 0.00 | 0.38 | 0.25 | 1.38 | 0.00 | 0.00 | 0.31 | 0.19 | 0.00 | 82.78 | 0.00 | 0.00 | 0.00 |
| ○Thread 539468 | 8.09 | 0.00 | 0.00 | 13.40 | 0.00 | 0.12 | 0.00 | 1.42 | 0.00 | 0.00 | 0.37 | 0.00 | 0.00 | 84.68 | 0.00 | 0.00 | 0.00 |
| ○Thread 539469 | 8.09 | 0.00 | 0.00 | 14.84 | 0.00 | 0.25 | 0.12 | 1.05 | 0.00 | 0.00 | 0.12 | 0.06 | 0.00 | 83.55 | 0.00 | 0.00 | 0.00 |
| ○Thread 539470 | 8.09 | 0.00 | 0.00 | 14.46 | 0.00 | 0.37 | 0.12 | 1.17 | 0.00 | 0.00 | 0.37 | 0.12 | 0.00 | 83.37 | 0.00 | 0.00 | 0.00 |
| ○Thread 539471 | 7.95 | 0.00 | 0.00 | 13.97 | 0.00 | 0.19 | 0.19 | 1.01 | 0.00 | 0.00 | 0.13 | 0.06 | 0.00 | 84.46 | 0.00 | 0.00 | 0.00 |
| ○Thread 539472 | 8.14 | 0.00 | 0.00 | 14.26 | 0.00 | 0.18 | 0.25 | 1.17 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 84.02 | 0.00 | 0.00 | 0.00 |
| ○Thread 539473 | 8.12 | 0.00 | 0.00 | 14.54 | 0.00 | 0.25 | 0.18 | 1.42 | 0.00 | 0.00 | 0.18 | 0.00 | 0.00 | 83.43 | 0.00 | 0.00 | 0.00 |
| ○Thread 539474 | 8.09 | 0.00 | 0.00 | 15.70 | 0.00 | 0.19 | 0.19 | 0.43 | 0.00 | 0.00 | 0.31 | 0.37 | 0.00 | 82.82 | 0.00 | 0.00 | 0.00 |
| ○Thread 539475 | 8.05 | 0.00 | 0.00 | 14.61 | 0.00 | 0.00 | 0.06 | 1.18 | 0.00 | 0.00 | 0.19 | 0.06 | 0.00 | 83.90 | 0.00 | 0.00 | 0.00 |
| ○Thread 539476 | 8.12 | 0.00 | 0.00 | 12.63 | 0.00 | 0.31 | 0.18 | 1.11 | 0.00 | 0.00 | 0.25 | 0.12 | 0.00 | 85.40 | 0.00 | 0.00 | 0.00 |
| ○Thread 539477 | 8.08 | 0.00 | 0.00 | 15.23 | 0.00 | 0.50 | 0.00 | 1.55 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 82.54 | 0.00 | 0.00 | 0.00 |
| ○Thread 539478 | 8.10 | 0.00 | 0.00 | 12.90 | 0.00 | 0.12 | 0.00 | 1.60 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 85.25 | 0.00 | 0.00 | 0.00 |
| ○Thread 539479 | 8.09 | 0.00 | 0.00 | 14.10 | 0.00 | 0.31 | 0.12 | 1.18 | 0.00 | 0.00 | 0.00 | 0.06 | 0.00 | 84.23 | 0.00 | 0.00 | 0.00 |
| ○Thread 539480 | 8.07 | 0.00 | 0.00 | 14.68 | 0.00 | 0.06 | 0.06 | 0.87 | 0.00 | 0.00 | 0.19 | 0.00 | 0.00 | 84.14 | 0.00 | 0.00 | 0.00 |
| ○Thread 539481 | 8.07 | 0.00 | 0.00 | 14.88 | 0.00 | 0.25 | 0.31 | 1.36 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 83.07 | 0.00 | 0.00 | 0.00 |
| ○Thread 539482 | 8.13 | 0.00 | 0.00 | 14.83 | 0.00 | 0.12 | 0.18 | 0.43 | 0.00 | 0.00 | 0.06 | 0.12 | 0.00 | 84.25 | 0.00 | 0.00 | 0.00 |
| ○Thread 539483 | 8.13 | 0.00 | 0.00 | 11.44 | 0.00 | 0.37 | 0.18 | 1.23 | 0.00 | 0.00 | 0.18 | 0.00 | 0.00 | 86.59 | 0.00 | 0.00 | 0.00 |
| ○Thread 539484 | 8.11 | 0.00 | 0.00 | 14.68 | 0.00 | 0.43 | 0.06 | 1.11 | 0.00 | 0.00 | 0.37 | 0.00 | 0.00 | 83.34 | 0.00 | 0.00 | 0.00 |
| ○Thread 539485 | 8.13 | 0.00 | 0.00 | 12.79 | 0.00 | 0.06 | 0.18 | 0.80 | 0.00 | 0.00 | 0.18 | 0.00 | 0.00 | 85.98 | 0.00 | 0.00 | 0.00 |
Detailed Function Times
ggml_vec_dot_q8_0_q8...
omp_get_num_procs
__GI___pthread_mutex...
ggml_compute_forward...
ggml_compute_forward...
quantize_row_q8_0
ggml_compute_forward...
ggml_graph_compute_t...
__GI___memcpy_sve
ggml_vec_dot_f16
Other Functions
Libraries
- green cell: the library has been found during the run profiling
- red cell: the library does not appear in the run profiling
| Library | gcc_5 |
|---|
| /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-414-5784/llama.cpp/build/gcc_5/bin/libggml-base.so | |
| /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-414-5784/llama.cpp/build/gcc_5/bin/libggml-blas.so | |
| /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-414-5784/llama.cpp/build/gcc_5/bin/libggml-cpu.so | |
| /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-414-5784/llama.cpp/build/gcc_5/bin/libggml.so | |
| /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-414-5784/llama.cpp/build/gcc_5/bin/libllama.so | |
| /opt/arm/arm-performance-libraries/lib/libarmpl_lp64.so | |
| /opt/arm/arm-performance-libraries/lib/libarmpl_lp64_mp.so | |
| /usr/lib/ld-linux-aarch64.so.1 | |
| /usr/lib64/libc.so.6 | |
| /usr/lib64/libgcc_s-14-20250110.so.1 | |
| /usr/lib64/libgomp.so.1.0.0 | |
| /usr/lib64/libm.so.6 | |
| /usr/lib64/libstdc++.so.6.0.33 | |