OV - Compare Loops

Loops

▶kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c: 131 - 161.36 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c: 131-131					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c: 131-131					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc_4/_deps/kleidiai_download-src/kai/ukernels/matmul/matmul_clamp_f32_qsi8d32p_qsi4c32p/kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c: 131-131
2426	3.43	3.66	53.25	28.14	27.69	2092	3.33	3.82	54.05	28.14	27.69	2104	3.27	3.80	54.06	28.14	27.69

Sum on 1 analyzed binary loop (libggml-cpu.so - 2426)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2092)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2104)
Analysis					Count	Analysis					Count	Analysis					Count
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1

▶quants.c: 2506 - 43.39 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 2506-2558 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 2565-2590					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 2506-2506 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 2572-2575 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1614-1614 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1726-1726 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 7465-7465 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16103-16103 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16309-16309 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16589-16589 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 25465-25465 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 25803-25803 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30781-30781 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 31056-31056 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 34664-34664					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 2506-2506 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 2572-2575 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1614-1614 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1726-1726 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 7465-7465 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16103-16103 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16309-16309 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16589-16589 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 25465-25465 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 25803-25803 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30781-30781 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 31056-31056 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 34664-34664
2308	0.98	1.04	15.13	50.56	33.98	1968	0.93	1.05	14.82	49.18	36.04	1986	0.88	0.95	13.45	47.34	35.41

Sum on 1 analyzed binary loop (libggml-cpu.so - 2308)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1968)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1986)
Analysis					Count	Analysis					Count	Analysis					Count
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1

▶ops.cpp: 6210 - 1.05 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_4
Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6210-6211 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6230 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6413-6413					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6211-6211 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6223-6231
		789	0.08	0.05	0.73	2.33	10.1	814	0.05	0.02	0.32	0	12.76

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 789)						Sum on 1 analyzed binary loop (libggml-cpu.so - 814)
Analysis	Count	Analysis					Count	Analysis					Count
		Loop Computation Issues						Loop Computation Issues
		Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
		Presence of a large number of scalar integer instructions					1	Presence of a large number of scalar integer instructions					1
		Control Flow Issues						Control Flow Issues
		Presence of calls					1	Presence of calls					1
		Presence of more than 4 paths					1	Presence of more than 4 paths					0
		Vectorization Roadblocks						Vectorization Roadblocks
		Presence of calls					1	Presence of calls					1
		Presence of more than 4 paths					1	Presence of more than 4 paths					1

▶vec.cpp: 231 - 1.00 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 231-262					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 231-262					Loop Source Regions
901	0.06	0.04	0.57	96	97	763	0.05	0.03	0.43	100	100

Sum on 1 analyzed binary loop (libggml-cpu.so - 901)						Sum on 1 analyzed binary loop (libggml-cpu.so - 763)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count
Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1

▶vec.cpp: 385 - 0.89 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 385-387 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1008-1034					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 385-387 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1009-1023 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1031-1034					Loop Source Regions
908	0.20	0.04	0.56	68.18	79.76	766	0.10	0.02	0.33	80	97.59

Sum on 1 analyzed binary loop (libggml-cpu.so - 908)						Sum on 1 analyzed binary loop (libggml-cpu.so - 766)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues
Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1

▶vec.h: 411 - 0.69 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 411-458					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 411-458					Loop Source Regions
1753	0.04	0.02	0.24	100	100	1470	0.06	0.03	0.45	100	100

Sum on 1 analyzed binary loop (libggml-cpu.so - 1753)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1470)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count
Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1

▶ops.cpp: 6220 - 0.65 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default		Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions		Loop Source Regions
1432	0.08	0.04	0.65	0	13.17

Sum on 1 analyzed binary loop (libggml-cpu.so - 1432)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count
Loop Computation Issues
Presence of expensive FP instructions					1
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
Control Flow Issues
Presence of calls					1
Data Access Issues
Presence of constant non-unit stride data access					1
Vectorization Roadblocks
Presence of calls					1
Presence of constant non-unit stride data access					1

▶vec.h: 491 - 0.60 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_4
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-491 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16058-16058 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 26465-26465 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 31977-31977
				1518	0.05	0.04	0.60	27.59	50

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 1518)
Analysis	Count	Analysis	Count	Analysis					Count
				Data Access Issues
				Presence of constant non-unit stride data access					1
				Vectorization Roadblocks
				Presence of constant non-unit stride data access					1

▶kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 96 - 0.56 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 96-96 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 111-142 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 151-258					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 96-96 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 262-262 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1388-1388 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 6218-6218 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 10248-10248 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 10549-10549 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 11192-11192 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13324-13324 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13947-13947 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 14184-14184 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16065-16065 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 19789-19789 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 20386-20386 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 21569-21569 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 26440-26440 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 26510-26510 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30199-30199 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30211-30211					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc_4/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 96-96 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc_4/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 262-262 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1388-1388 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 6218-6218 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 10248-10248 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 10549-10549 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 11192-11192 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13324-13324 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13947-13947 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 14184-14184 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16065-16065 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 19789-19789 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 20386-20386 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 21569-21569 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 26440-26440 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 26510-26510 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30199-30199 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30211-30211
2389	0.17	0.01	0.15	77.23	48.22	2060	0.18	0.01	0.18	69.7	48.55	2073	0.22	0.02	0.23	69.7	48.55

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶ops.cpp: 6238 - 0.52 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_4
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245
				838	0.06	0.04	0.52	0	14.18

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 838)
Analysis	Count	Analysis	Count	Analysis					Count
				Loop Computation Issues
				Presence of expensive FP instructions					1
				Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
				Control Flow Issues
				Presence of calls					1
				Data Access Issues
				Presence of constant non-unit stride data access					1
				Presence of indirect access					1
				Vectorization Roadblocks
				Presence of calls					1
				Presence of constant non-unit stride data access					1
				Presence of indirect access					1

▶vec.cpp: 311 - 0.41 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_4
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-311 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16058-16058 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 31977-31977
				782	0.05	0.03	0.41	52.63	50

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 782)
Analysis	Count	Analysis	Count	Analysis					Count
				Control Flow Issues
				Vectorization Roadblocks
				Presence of more than 4 paths					1

▶vec.cpp: 390 - 0.37 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_4
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 390-390 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1057-1057 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 786-786 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 814-814 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1388-1388 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1487-1487 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1628-1628 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 2188-2188 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 2216-2216 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 10248-10248 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 10997-10997 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 12284-12284 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 15253-15253 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 15426-15426 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16065-16065 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 21933-21933 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 25479-25479 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 26472-26472
				790	0.12	0.03	0.37	85.29	48.53

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 790)
Analysis	Count	Analysis	Count	Analysis					Count
				Loop Computation Issues
				Presence of expensive FP instructions					1
				Data Access Issues
				Presence of constant non-unit stride data access					1
				Vectorization Roadblocks
				Presence of constant non-unit stride data access					1

▶ggml-cpu.c: 3228 - 0.26 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3228-3229 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3228-3229 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3228-3229 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404
0	0.03	0.01	0.08	86.36	95.61	4	0.03	0.01	0.08	93.18	94.03	1	0.04	0.01	0.10	72.6	41.78

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶ops.cpp: 4325 - 0.26 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326
1278	0.06	0.01	0.12	94.12	95.59	1132	0.04	0.01	0.11	0	13.28	1170	0.03	0.00	0.03	17.39	28.26

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶binary-ops.cpp: 10 - 0.26 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32
433	0.04	0.01	0.10	0	12.5	410	0.04	0.01	0.09	25	50	416	0.03	0.01	0.07	25	50

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶vec.h: 486 - 0.18 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_4
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 486-491 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 502-502 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8853-8853 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 14177-14177
				1526	0.03	0.01	0.18	10	19.69

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis	Count	Analysis					Count

▶binary-ops.cpp: 18 - 0.15 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32
538	0.03	0.00	0.06	0	11.84	494	0.03	0.00	0.05	25	50	502	0.02	0.00	0.04	25	50

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶<unknown>: 0 - 0.14 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions						Loop Source Regions						Loop Source Regions
2764	0.00	0.00	0.00	0	0	4180	0.01	0.00	0.00	0	0	3946	0.01	0.00	0.00	0	0
2480	0.00	0.00	0.00	0	0	3768	0.00	0.00	0.00	0	0	1677	0.01	0.00	0.00	0	0
2633	0.00	0.00	0.00	0	0	4472	0.01	0.00	0.00	0	0	4211	0.01	0.00	0.00	0	0
2458	0.00	0.00	0.00	0	0	3728	0.00	0.00	0.00	0	0	3801	0.02	0.00	0.01	0	0
2886	0.01	0.00	0.00	0	0	4140	0.00	0.00	0.00	0	0	4247	0.01	0.00	0.00	0	0
2649	0.01	0.00	0.00	0	0	1648	0.00	0.00	0.00	0	0	3973	0.01	0.00	0.00	0	0
2767	0.01	0.00	0.00	0	0	1795	0.00	0.00	0.00	0	0	4540	0.01	0.00	0.00	0	0
2650	0.01	0.00	0.00	0	0	4127	0.00	0.00	0.00	0	0	0	0.00	0.00	0.00	0	0
310	0.01	0.00	0.00	0	0	4141	0.00	0.00	0.00	0	0	1540	0.01	0.00	0.01	0	0
1744	0.01	0.00	0.00	0	0	3732	0.01	0.00	0.00	0	0	2037	0.00	0.00	0.00	0	0
64	0.01	0.00	0.00	0	0	2038	0.01	0.00	0.01	0	0	2048	0.01	0.00	0.01	0	0
1282	0.01	0.00	0.01	0	0	1471	0.00	0.00	0.00	0	0	33	0.01	0.00	0.00	0	0
83	0.00	0.00	0.00	0	0	2074	0.01	0.00	0.00	0	0
1754	0.00	0.00	0.00	0	0	1199	0.00	0.00	0.01	0	0
						1468	0.00	0.00	0.01	0	0
						1191	0.00	0.00	0.00	0	0
						89	0.01	0.00	0.00	0	0
						1131	0.01	0.00	0.01	0	0
						33	0.00	0.00	0.00	0	0
						766	0.00	0.00	0.00	0	0
						74	0.01	0.00	0.00	0	0
						32	0.00	0.00	0.00	0	0
						616	0.00	0.00	0.00	0	0

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶ops.cpp: 6446 - 0.13 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6447 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6453-6457					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6447 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6453-6456					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6447 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6453-6456
1437	0.02	0.00	0.06	0	12.5	799	0.01	0.00	0.03	37.5	40.63	848	0.01	0.00	0.04	37.5	40.63

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶ops.cpp: 8787 - 0.12 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_4
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 51-51 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 751-751 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8787-8787 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8817-8819 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8825-8826 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8841-8841
				1533	0.03	0.01	0.12	0	26.88

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis	Count	Analysis					Count

▶kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 115 - 0.11 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 115-118					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 115-118					Loop Source Regions
2410	0.23	0.00	0.06	0	15.63	2075	0.20	0.00	0.05	0	15.63

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count

▶kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 127 - 0.11 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 127-128 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/build/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 137-139					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc/_deps/kleidiai_download-src/kai/ukernels/matmul/pack/kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 127-134					Loop Source Regions
2409	0.39	0.01	0.10	0	25	2073	0.04	0.00	0.01	0	21.88

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count

▶ggml-cpu.c: 1183 - 0.06 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default		Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1183-1183 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1193-1194					Loop Source Regions		Loop Source Regions
66	0.01	0.00	0.06	0	25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count

▶ggml-cpu.c: 1193 - 0.05 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_4
Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1193-1194					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1193-1194
		56	0.01	0.00	0.03	0	23.26	63	0.01	0.00	0.02	0	22.4

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis					Count	Analysis					Count

▶kleidiai.cpp: 92 - 0.05 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_4
Loop Source Regions		Loop Source Regions	/usr/include/c++/11/variant: 1594-1594 /usr/include/c++/11/variant: 1726-1727 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/kleidiai/kleidiai.cpp: 92-92 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/kleidiai/kleidiai.cpp: 341-342 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/kleidiai/kleidiai.cpp: 348-382 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc/_deps/kleidiai_download-src/kai/kai_common.h: 143-143					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/gcc_4/_deps/kleidiai_download-src/kai/kai_common.h: 143-143 /usr/include/c++/11/variant: 1594-1594 /usr/include/c++/11/variant: 1726-1727 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/kleidiai/kleidiai.cpp: 92-92 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/kleidiai/kleidiai.cpp: 341-342 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/kleidiai/kleidiai.cpp: 348-382
		2034	0.01	0.00	0.02	0	22.86	2044	0.01	0.00	0.02	0	22.98

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis					Count	Analysis					Count

▶ggml-cpu.c: 1125 - 0.05 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1125-1130 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1142-1142 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1198-1198 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1371-1379 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1386-1395					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1126-1130 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1142-1142 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1371-1379 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1386-1395					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1126-1130 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1142-1142 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1371-1379 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1386-1395
65	0.01	0.00	0.02	0	23.77	48	0.01	0.00	0.01	0	24.36	55	0.01	0.00	0.01	0	23.99

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶vec.h: 677 - 0.04 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_4
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 677-677 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 1487-1487 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16065-16065 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 26472-26472
				1169	0.01	0.00	0.01	50	50
				1537	0.01	0.00	0.03	50	50

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis	Count	Analysis					Count

▶ops.cpp: 8825 - 0.04 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_4
Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8825-8826					Loop Source Regions
		1463	0.02	0.00	0.04	0	0

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis					Count	Analysis	Count

▶ggml-cpu.c: 2879 - 0.03 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_4
Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 2879-2898					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 2879-2898
		60	0.01	0.00	0.01	0	16.48	67	0.01	0.00	0.01	0	16.41

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis					Count	Analysis					Count

▶traits.cpp: 13 - 0.02 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/traits.cpp: 13-17 /usr/lib/gcc/aarch64-amazon-linux/14/../../../../include/c++/14/bits/stl_iterator.h: 1102-1102					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/traits.cpp: 13-17					Loop Source Regions
396	0.01	0.00	0.01	0	25	368	0.01	0.00	0.01	0	25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count

▶vec.h: 646 - 0.02 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 646-653					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 646-653					Loop Source Regions
1756	0.01	0.00	0.01	100	100	1466	0.01	0.00	0.01	100	100

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count

▶ggml-quants.c: 2563 - 0.01 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default		Run gcc_4
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-406-8838/llama.cpp/build/llama.cpp/ggml/src/ggml-quants.c: 2563-2565					Loop Source Regions		Loop Source Regions
461	0.03	0.00	0.01	0	9.38

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count

Report Configuration

Loops

▶kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c: 131 - 161.36 %

▶quants.c: 2506 - 43.39 %

▶ops.cpp: 6210 - 1.05 %

▶vec.cpp: 231 - 1.00 %

▶vec.cpp: 385 - 0.89 %

▶vec.h: 411 - 0.69 %

▶ops.cpp: 6220 - 0.65 %

▶vec.h: 491 - 0.60 %

▶kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c: 96 - 0.56 %

▶ops.cpp: 6238 - 0.52 %

▶vec.cpp: 311 - 0.41 %

▶vec.cpp: 390 - 0.37 %

▶ggml-cpu.c: 3228 - 0.26 %

▶ops.cpp: 4325 - 0.26 %

▶binary-ops.cpp: 10 - 0.26 %

▶vec.h: 486 - 0.18 %

▶binary-ops.cpp: 18 - 0.15 %

▶<unknown>: 0 - 0.14 %

▶ops.cpp: 6446 - 0.13 %

▶ops.cpp: 8787 - 0.12 %

▶kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 115 - 0.11 %

▶kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c: 127 - 0.11 %

▶ggml-cpu.c: 1183 - 0.06 %

▶ggml-cpu.c: 1193 - 0.05 %

▶kleidiai.cpp: 92 - 0.05 %

▶ggml-cpu.c: 1125 - 0.05 %

▶vec.h: 677 - 0.04 %

▶ops.cpp: 8825 - 0.04 %

▶ggml-cpu.c: 2879 - 0.03 %

▶traits.cpp: 13 - 0.02 %

▶vec.h: 646 - 0.02 %

▶ggml-quants.c: 2563 - 0.01 %