OV - Compare Loops

Loops

▶quants.c: 1010 - 224.84 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 1010-1027 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 51-51					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 1010-1010 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 1017-1026 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 51-51					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 1010-1010 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 1017-1026 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 51-51
2292	3.73	3.79	74.01	46.15	55.53	1956	3.65	3.83	76.75	48	59.13	1935	3.54	3.71	74.09	45.28	61.44

Sum on 1 analyzed binary loop (libggml-cpu.so - 2292)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1956)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1935)
Analysis					Count	Analysis					Count	Analysis					Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of a large number of scalar integer instructions					1	Presence of a large number of scalar integer instructions						Presence of a large number of scalar integer instructions
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1

▶quants.c: 910 - 4.45 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 910-948 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 51-51					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 910-910 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 928-929 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 51-51 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13617-13617 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16103-16103 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 20765-20765 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30781-30781 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 31056-31056 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 34664-34664					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 910-910 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 928-929 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 51-51 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13617-13617 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16103-16103 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 20765-20765 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 30781-30781 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 31056-31056 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 34664-34664
2293	0.09	0.08	1.54	10.53	24.67	1955	0.08	0.07	1.42	16.22	25.68	1934	0.09	0.07	1.49	16.22	25.68

Sum on 1 analyzed binary loop (libggml-cpu.so - 2293)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1955)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1934)
Analysis					Count	Analysis					Count	Analysis					Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of a large number of scalar integer instructions						Presence of a large number of scalar integer instructions					1	Presence of a large number of scalar integer instructions					1
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1

▶<unknown>: 0 - 0.21 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions						Loop Source Regions						Loop Source Regions
1151	0.01	0.00	0.00	0	0	4180	0.01	0.00	0.00	0	0	4205	0.01	0.00	0.00	0	0
1215	0.00	0.00	0.00	0	0	4472	0.01	0.00	0.00	0	0	4216	0.00	0.00	0.00	0	0
2634	0.00	0.00	0.00	0	0	3907	0.01	0.00	0.00	0	0	4261	0.00	0.00	0.00	0	0
2790	0.00	0.00	0.00	0	0	4320	0.01	0.00	0.00	0	0	4575	0.02	0.00	0.01	0	0
2649	0.01	0.00	0.00	0	0	1625	0.01	0.00	0.00	0	0	4215	0.00	0.00	0.00	0	0
2457	0.00	0.00	0.00	0	0	1626	0.01	0.00	0.00	0	0	3800	0.01	0.00	0.00	0	0
2782	0.00	0.00	0.00	0	0	4127	0.01	0.00	0.00	0	0	3947	0.00	0.00	0.00	0	0
2650	0.01	0.00	0.00	0	0	4141	0.01	0.00	0.00	0	0	3972	0.01	0.00	0.00	0	0
2767	0.00	0.00	0.00	0	0	3732	0.02	0.00	0.01	0	0	3945	0.00	0.00	0.00	0	0
2886	0.00	0.00	0.00	0	0	410	0.01	0.00	0.01	0	0	0	0.01	0.00	0.01	0	0
0	0.01	0.00	0.00	0	0	56	0.01	0.00	0.01	0	0	55	0.00	0.00	0.00	0	0
1744	0.00	0.00	0.00	0	0	494	0.02	0.00	0.01	0	0	61	0.01	0.00	0.00	0	0
1278	0.03	0.00	0.01	0	0	1463	0.01	0.00	0.00	0	0	416	0.02	0.00	0.01	0	0
83	0.01	0.00	0.00	0	0	1466	0.01	0.00	0.01	0	0	1494	0.02	0.00	0.01	0	0
396	0.01	0.00	0.01	0	0	368	0.01	0.00	0.01	0	0	2006	0.00	0.00	0.00	0	0
1282	0.00	0.00	0.00	0	0	4	0.01	0.00	0.01	0	0
433	0.03	0.00	0.01	0	0	50	0.00	0.00	0.00	0	0
106	0.01	0.00	0.00	0	0	1132	0.03	0.00	0.01	0	0
538	0.02	0.00	0.01	0	0	799	0.01	0.00	0.01	0	0
1756	0.00	0.00	0.00	0	0	57	0.00	0.00	0.01	0	0

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶quants.c: 49 - 0.18 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 49-72 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 355-355 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 49-49 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 63-66 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 72-75 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 354-354 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 3320-3320 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 10248-10248 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13947-13947 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 16065-16065 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 19789-19789 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 20386-20386 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 21569-21569					Loop Source Regions
2268	0.02	0.00	0.06	46.43	28.94	1932	0.02	0.01	0.12	26.25	19.83

Sum on 1 analyzed binary loop (libggml-cpu.so - 2268)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1932)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues
Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					0
Presence of a large number of scalar integer instructions					0	Presence of a large number of scalar integer instructions					1
Control Flow Issues						Control Flow Issues
Presence of 2 to 4 paths					0	Presence of 2 to 4 paths					1
Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access						Presence of constant non-unit stride data access					1
Vectorization Roadblocks						Vectorization Roadblocks
Presence of 2 to 4 paths					0	Presence of 2 to 4 paths					1
Presence of more than 4 paths					1	Presence of more than 4 paths					0
Presence of constant non-unit stride data access					0	Presence of constant non-unit stride data access					1

▶vec.cpp: 231 - 0.13 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 231-262					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 231-262					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 231-262
901	0.01	0.00	0.04	96	97	763	0.02	0.00	0.04	100	100	780	0.02	0.00	0.05	100	100

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						Sum on 1 analyzed binary loop (libggml-cpu.so - 780)
Analysis					Count	Analysis					Count	Analysis					Count
												Data Access Issues
												Presence of constant non-unit stride data access					1
												Vectorization Roadblocks
												Presence of constant non-unit stride data access					1

▶vec.h: 411 - 0.13 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 411-458					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 411-458					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 411-458
1753	0.03	0.00	0.04	100	100	1470	0.01	0.00	0.05	100	100	1499	0.02	0.00	0.04	100	100

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						Sum on 1 analyzed binary loop (libggml-cpu.so - 1470)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count
						Data Access Issues
						Presence of constant non-unit stride data access					1
						Vectorization Roadblocks
						Presence of constant non-unit stride data access					1

▶ggml-cpu.c: 1125 - 0.12 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1125-1130 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1142-1142 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1198-1198 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1371-1379 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1386-1395					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1126-1130 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1142-1142 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1371-1379 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1386-1395					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1126-1130 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1142-1142 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1371-1379 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1386-1395
65	0.01	0.00	0.05	0	23.77	48	0.01	0.00	0.03	0	24.36	53	0.01	0.00	0.04	0	23.99

Sum on 1 analyzed binary loop (libggml-cpu.so - 65)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count
Control Flow Issues
Presence of calls					1
Vectorization Roadblocks
Presence of calls					1
Presence of more than 4 paths					1

▶ggml-cpu.c: 1183 - 0.12 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default		Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1183-1183 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1193-1194					Loop Source Regions		Loop Source Regions
66	0.02	0.01	0.12	0	25

Sum on 1 analyzed binary loop (libggml-cpu.so - 66)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count
Control Flow Issues
Presence of calls					1
Vectorization Roadblocks
Presence of calls					1

▶ggml-cpu.c: 1193 - 0.11 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_1
Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1193-1194					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1193-1194
		52	0.01	0.00	0.06	0	23.44	57	0.01	0.00	0.05	0	23.44

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 52)						Sum on 1 analyzed binary loop (libggml-cpu.so - 57)
Analysis	Count	Analysis					Count	Analysis					Count
		Control Flow Issues						Control Flow Issues
		Presence of calls					1	Presence of calls					1
		Vectorization Roadblocks						Vectorization Roadblocks
		Presence of calls					1	Presence of calls					1

▶vec.cpp: 385 - 0.09 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default						Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1008-1034 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 385-387					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1009-1023 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1031-1034 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 385-387					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1009-1023 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1031-1034 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 385-387
908	0.13	0.00	0.04	68.18	79.76	766	0.08	0.00	0.03	80	97.59	783	0.06	0.00	0.03	88.89	97.32

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count

▶ops.cpp: 6210 - 0.09 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_1
Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6210-6211 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6230 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6413-6413					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6211-6211 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6223-6231
		789	0.01	0.00	0.07	2.33	10.1	798	0.01	0.00	0.02	0	12.76

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 789)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis					Count	Analysis					Count
		Loop Computation Issues
		Presence of expensive FP instructions					1
		Presence of a large number of scalar integer instructions					1
		Control Flow Issues
		Presence of calls					1
		Presence of more than 4 paths					1
		Vectorization Roadblocks
		Presence of calls					1
		Presence of more than 4 paths					1

▶ggml-impl.h: 354 - 0.05 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_1
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 49-49 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 64-66 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 72-75 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/arm/quants.c: 83-83 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 354-354 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 3320-3320 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 13947-13947 /usr/lib/gcc/aarch64-amazon-linux/11/include/arm_neon.h: 21569-21569
				1910	0.01	0.00	0.05	15.24	14.64

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 1910)
Analysis	Count	Analysis	Count	Analysis					Count
				Loop Computation Issues
				Presence of expensive FP instructions					1
				Presence of a large number of scalar integer instructions					1
				Control Flow Issues
				Vectorization Roadblocks
				Presence of more than 4 paths					1

▶ops.cpp: 6220 - 0.05 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default		Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions		Loop Source Regions
1432	0.01	0.00	0.05	0	13.17

Sum on 1 analyzed binary loop (libggml-cpu.so - 1432)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count
Loop Computation Issues
Presence of expensive FP instructions					1
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
Control Flow Issues
Presence of calls					1
Data Access Issues
Presence of constant non-unit stride data access					1
Vectorization Roadblocks
Presence of calls					1
Presence of constant non-unit stride data access					1

▶ops.cpp: 6446 - 0.03 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run gcc_default		Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6447 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6453-6457					Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6447 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6453-6456
1437	0.01	0.00	0.02	0	12.5			832	0.01	0.00	0.01	37.5	40.63

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis					Count

▶ggml-cpu.c: 2879 - 0.03 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default						Run gcc_1
Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 2879-2898					Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 2879-2898
		60	0.01	0.00	0.02	0	16.48	65	0.01	0.00	0.01	0	16.41

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis					Count	Analysis					Count

▶ops.cpp: 6238 - 0.03 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_1
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245
				822	0.01	0.00	0.03	0	14.18

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis	Count	Analysis					Count

▶ggml-cpu.c: 1289 - 0.02 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run gcc_default		Run gcc_1
Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1289-1297					Loop Source Regions		Loop Source Regions
70	0.01	0.00	0.02	0	25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count

▶binary-ops.cpp: 18 - 0.01 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run gcc_default		Run gcc_1
Loop Source Regions		Loop Source Regions		Loop Source Regions	/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-46-37.ec2.internal/176-409-1084/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32
				502	0.04	0.00	0.01	25	50

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis	Count	Analysis					Count

Report Configuration

Loops

▶quants.c: 1010 - 224.84 %

▶quants.c: 910 - 4.45 %

▶<unknown>: 0 - 0.21 %

▶quants.c: 49 - 0.18 %

▶vec.cpp: 231 - 0.13 %

▶vec.h: 411 - 0.13 %

▶ggml-cpu.c: 1125 - 0.12 %

▶ggml-cpu.c: 1183 - 0.12 %

▶ggml-cpu.c: 1193 - 0.11 %

▶vec.cpp: 385 - 0.09 %

▶ops.cpp: 6210 - 0.09 %

▶ggml-impl.h: 354 - 0.05 %

▶ops.cpp: 6220 - 0.05 %

▶ops.cpp: 6446 - 0.03 %

▶ggml-cpu.c: 2879 - 0.03 %

▶ops.cpp: 6238 - 0.03 %

▶ggml-cpu.c: 1289 - 0.02 %

▶binary-ops.cpp: 18 - 0.01 %