OV - Compare Loops

Loops

▶attention.cpp: 30 - 324.82 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run mavx512							Run xGRANITERAPIDS							Run xGRANITERAPIDS mprefer-vector-width=512							Run xGRANITERAPIDS mprefer-vector-width=512 fp-model fast=2
Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 30-31						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 30-31						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 30-31						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 30-31
31	1.06	1.06	20.54	87.5	41.41	2.66	51	0.38	0.38	8.03	0	8.1	6.61	52	0.41	0.41	8.24	68.75	41.41	5.89	56	0.33	0.33	9.21	96.43	51.56	6.86
47	0.23	0.23	4.55	87.5	41.41	3.66	24	1.53	1.53	32.42	0	8.1	6.74	28	1.68	1.68	33.87	68.75	41.41	6.11	30	1.08	1.08	29.99	97.83	53.4	9.39
39	0.28	0.28	5.52	87.5	41.41	2.9	35	1.58	1.58	33.26	0	8.1	6.3	64	0.40	0.40	8.14	68.75	41.41	6.06	70	0.31	0.31	8.65	96	51.75	7.26
21	1.03	1.03	19.96	90.91	46.02	8.19	46	0.39	0.38	8.13	0	8.1	6.46	40	1.67	1.67	33.57	68.75	41.41	5.82	43	1.14	1.14	31.80	96.08	51.72	7.77
43	0.19	0.19	3.68	87.5	41.41	4.64	56	0.39	0.38	8.13	0	8.1	6.48	58	0.41	0.41	8.34	68.75	41.41	5.9	63	0.31	0.31	8.79	96	51.75	7.11

Sum on 5 analyzed binary loops (attention-avx512 - 31, attention-avx512 - 47, attention-avx512 - 39, attention-avx512 - 21, attention-avx512 - 43)							Sum on 5 analyzed binary loops (attention-avx512 - 51, attention-avx512 - 24, attention-avx512 - 35, attention-avx512 - 46, attention-avx512 - 56)							Sum on 5 analyzed binary loops (attention-avx512 - 52, attention-avx512 - 28, attention-avx512 - 64, attention-avx512 - 40, attention-avx512 - 58)							Sum on 5 analyzed binary loops (attention-avx512 - 56, attention-avx512 - 30, attention-avx512 - 70, attention-avx512 - 43, attention-avx512 - 63)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
Loop Computation Issues							Loop Computation Issues							Loop Computation Issues							Loop Computation Issues
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA							Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA							Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						0
Presence of a large number of scalar integer instructions							Presence of a large number of scalar integer instructions							Presence of a large number of scalar integer instructions						0	Presence of a large number of scalar integer instructions						1
Data Access Issues							Data Access Issues							Data Access Issues							Data Access Issues
Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1
Presence of indirect access						1	Presence of indirect access						0	Presence of indirect access						1	Presence of indirect access						1
Presence of expensive instructions: scatter/gather						1	Presence of expensive instructions: scatter/gather						0	Presence of expensive instructions: scatter/gather						1	Presence of expensive instructions: scatter/gather						1
Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						0	Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1
Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks
Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1
Presence of indirect access						1	Presence of indirect access						0	Presence of indirect access						1	Presence of indirect access						1
Inefficient Vectorization							Inefficient Vectorization							Inefficient Vectorization							Inefficient Vectorization
Presence of expensive instructions: scatter/gather						1	Presence of expensive instructions: scatter/gather							Presence of expensive instructions: scatter/gather						1	Presence of expensive instructions: scatter/gather						1
Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port							Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1

▶attention.cpp: 47 - 5.86 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run mavx512							Run xGRANITERAPIDS							Run xGRANITERAPIDS mprefer-vector-width=512							Run xGRANITERAPIDS mprefer-vector-width=512 fp-model fast=2
Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 47-48						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 47-48						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 47-48						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 47-48
26	0.00	0.00	0.10	0	6.25	2.6	31	0.08	0.08	1.58	0	6.25	1.8	34	0.05	0.05	1.11	0	6.25	8.32	36	0.06	0.06	1.81	0	6.25	7.04
27	0.06	0.06	1.26	0	6.25	7.15

No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							Sum on 1 analyzed binary loop (attention-avx512 - 31)							Sum on 1 analyzed binary loop (attention-avx512 - 34)							Sum on 1 analyzed binary loop (attention-avx512 - 36)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count

▶attention.cpp: 55 - 0.83 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run mavx512							Run xGRANITERAPIDS							Run xGRANITERAPIDS mprefer-vector-width=512							Run xGRANITERAPIDS mprefer-vector-width=512 fp-model fast=2
Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 55-56						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 55-56						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 55-56						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 55-56
24	0.00	0.00	0.10	100	100	38.8	28	0.01	0.01	0.21	100	50	0.7	31	0.00	0.00	0.10	100	100	32.4	34	0.02	0.02	0.42	100	100	10.67

No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count

▶attention.cpp: 52 - 0.21 %

ASM Loop ID	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	GFLOP/s
Run mavx512		Run xGRANITERAPIDS							Run xGRANITERAPIDS mprefer-vector-width=512							Run xGRANITERAPIDS mprefer-vector-width=512 fp-model fast=2
Loop Source Regions		Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 52-53						Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 52-53						Loop Source Regions
		29	0.00	0.00	0.11	100	50	3.5	32	0.00	0.00	0.10	100	100	11.5

No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.		No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.
Analysis	Count	Analysis						Count	Analysis						Count	Analysis	Count

▶attention.cpp: 240 - 0.19 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s
Run mavx512							Run xGRANITERAPIDS		Run xGRANITERAPIDS mprefer-vector-width=512		Run xGRANITERAPIDS mprefer-vector-width=512 fp-model fast=2
Loop Source Regions	/home/eoseret/llm-attention/attention.cpp: 240-241						Loop Source Regions		Loop Source Regions		Loop Source Regions
35	0.01	0.01	0.19	92.31	66.35	0

No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.		No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.		No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.
Analysis						Count	Analysis	Count	Analysis	Count	Analysis	Count

▶<unknown>: 0 - 0.11 %

ASM Loop ID	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s
Run mavx512		Run xGRANITERAPIDS							Run xGRANITERAPIDS mprefer-vector-width=512		Run xGRANITERAPIDS mprefer-vector-width=512 fp-model fast=2
Loop Source Regions		Loop Source Regions							Loop Source Regions		Loop Source Regions
		83	0.00	0.00	0.11	100	50	0

No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.		No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.							No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.		No Loops Overview analysis found for any assembly loop. More loops can be analyzed using option --summary-loop-count.
Analysis	Count	Analysis						Count	Analysis	Count	Analysis	Count

Report Configuration

Loops

▶attention.cpp: 30 - 324.82 %

▶attention.cpp: 47 - 5.86 %

▶attention.cpp: 55 - 0.83 %

▶attention.cpp: 52 - 0.21 %

▶attention.cpp: 240 - 0.19 %

▶<unknown>: 0 - 0.11 %