gemv: add optional fused RMSNorm/LayerNorm prologue by atassis · Pull Request #167 · amd/IRON

atassis · 2026-08-29T08:47:28Z

Problem

GEMV has no way to fuse a norm ahead of the matvec. A decode-time
RMSNorm/LayerNorm on the input vector currently has to run as its own pass
before the GEMV dispatch, even though the vector is already resident on the
core that is about to consume it.

Fix

Adds an opt-in prologue parameter to GEMV. prologue="none" (default) is
byte-identical to before. prologue="rms"/"ln" normalizes the shared B
vector once per acquire in core_body, before it feeds every matvec call in
that batch, so the cost is O(K) per batch rather than O(M) if it were reapplied
per output tile.

Both rms_norm_bf16_vector and layer_norm take separate restrict-qualified
input/output pointers, so calling them in place on the acquired B tile would
violate their aliasing contract (the same issue #135 hit for gelu, fixed there
with a new in-place kernel entry point). I did not want to touch two kernel
files for one call site, so instead each core gets a second L1 Buffer for
the normalized vector, and matvec reads from that. No changes to
rms_norm.cc/layer_norm.cc.

Both kernels exist under aie2 and aie2p with the same extern-C signature, so
unlike the gelu epilogue this prologue is not NPU2-only.

Affine-free: gamma/beta fold into the weight matrix host-side, the same
convention rms_norm.cc/layer_norm.cc already use (fixed gamma=1, beta=0).

Test/Evidence

test_gemv_norm_prologue compares the fused output against an A @ norm(B)
golden across three shapes for each of rms/ln, with the standard
latency/bandwidth metrics test_gemv_gelu also reports.

rms_norm_ref/layer_norm_ref reproduce the kernels' f32 reduction math.
Checked standalone against a hand-derived formula, pure numpy:
rel-L2 4.4e-08 (rms), 8.6e-08 (ln), on a 1024-element vector with nonzero mean.

Known limitations

Not device-verified. The IRON test suite opens the accelerator through the
aie_context fixture, so this stops at the CPU-only checks above plus a
py_compile of the four changed files. rel_tol=0.05, abs_tol=1e-2 in the
test follow the gelu epilogue's precedent tolerances, not a measurement on
this shape.

Adds an opt-in `prologue` parameter to GEMV. `prologue="none"` (default) is byte-identical to before; `prologue="rms"`/`"ln"` normalizes the shared B vector once per acquire, before it feeds every matvec call in that batch, so a decode-time norm+GEMV becomes one dispatch instead of a separate elementwise pass. Affine-free (gamma/beta fold into the weight matrix host-side), matching the existing rms_norm.cc/layer_norm.cc kernels' own convention. Both kernels take separate restrict-qualified in/out pointers, so normalizing b in place would violate their aliasing contract (the fix amd#135 used for gelu, an in-place wrapper, isn't available here without touching two kernel files for one call site). Instead each core gets a second L1 Buffer for the normalized vector; matvec reads from that instead of the raw acquire. Reuses rms_norm.cc/layer_norm.cc as-is, no kernel changes. rms_norm.cc and layer_norm.cc exist under both aie2 and aie2p with the same extern-C signature, so unlike the gelu epilogue this prologue is not NPU2-only. Test: test_gemv_norm_prologue compares against an A @ norm(B) golden across three shapes for each of rms/ln, with the standard latency/bandwidth metrics. rms_norm_ref/layer_norm_ref reproduce the kernels' f32 reduction math; checked against a hand-derived formula at rel-L2 < 1e-7 (pure numpy, no device). Not device-verified: I don't have hardware access in this session. Tolerances (rel_tol=0.05, abs_tol=1e-2) follow the gelu epilogue's precedent, not a measurement.

andrej

A nicer "Kernel" abstraction that encodes (i) the function name (extern C), (ii) the argument specification expected (MLIR func.func signature), (iii) how to compile and link it in would be good at some point in the future. If we have to list every single activation function in every GEMV and GEMM kernel as a custom prologue/epilogue, it will get old quick.

But for now this is good. Thanks!

andrej · 2026-09-08T21:17:24Z

+    # per output tile would be. Both kernels take separate in/out pointers (restrict on
+    # both), so normalizing needs a second L1 buffer rather than an in-place call.


Should we add an in-place activation kernel in the future? Seems wasteful ...

github-actions · 2026-09-08T21:24:04Z

CI Test Results

22b7d95 (2026_09_08_22_01_00)

IRON - CI Summary

Examples

iron/applications/llama_3.2_1b

Test	Krackan Status	Krackan	Phoenix Status	Phoenix
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]	✅	-	-	-

Small

iron/operators/axpy

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]	-	-	✅	435.06
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]	-	-	✅	436.58
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]	-	-	✅	400.68

iron/operators/dequant

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]	-	-	✅	345.40
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]	-	-	✅	289.82
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]	-	-	✅	397.52
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]	-	-	✅	357.62
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]	-	-	✅	340.96
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]	-	-	✅	418.36

iron/operators/elementwise_add

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]	-	-	✅	304.18
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]	-	-	✅	333.36
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]	-	-	✅	400.86

iron/operators/elementwise_mul

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]	-	-	✅	323.16
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]	-	-	✅	434.38
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]	-	-	✅	426.16

iron/operators/gelu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	354.48
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	344.70
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	333.96
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	365.32
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	299.00
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	479.00

iron/operators/gemm

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]	-	-	✅	539.72
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]	-	-	✅	513.78
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	-	-	✅	82835.20
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	-	-	✅	25393.86
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]	-	-	✅	3760.14
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]	-	-	✅	6686.10

iron/operators/gemv

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	-	-	✅	0.08
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	-	-	✅	3.76
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]	-	-	✅	6.59
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]	-	-	✅	11.80
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	-	-	✅	3.76
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]	-	-	✅	6.74
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]	-	-	✅	10.95
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]	-	-	✅	2.23
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]	-	-	✅	0.38
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]	-	-	✅	0.43
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]	-	-	✅	1.43
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	-	-	❌	-
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	-	-	❌	-
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	-	-	❌	-
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]	-	-	❌	0.07
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]	-	-	✅	0.11
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]	-	-	❌	-
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]	-	-	❌	-
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]	-	-	❌	3.52
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]	-	-	❌	3.54

iron/operators/layer_norm

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	406.88
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	427.10
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	384.58
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	544.76
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	406.34
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	450.72

iron/operators/leaky_relu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]	-	-	✅	362.92
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]	-	-	✅	304.70
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]	-	-	✅	431.70
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]	-	-	✅	334.86
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]	-	-	✅	808.66
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]	-	-	✅	635.06
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]	-	-	✅	433.34
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]	-	-	✅	564.80

iron/operators/mem_copy

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]	-	-	✅	314.58
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]	-	-	✅	280.38
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]	-	-	✅	313.32
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]	-	-	✅	402.84
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]	-	-	✅	401.74
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]	-	-	✅	626.20

iron/operators/relu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	388.36
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	469.70
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	447.66
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	440.48
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	419.50
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	567.50

iron/operators/repeat

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]	-	-	✅	-
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]	-	-	✅	-
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]	-	-	✅	-
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]	-	-	✅	338.50
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]	-	-	✅	374.32
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]	-	-	✅	290.70

iron/operators/rms_norm

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]	-	-	✅	819.10
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]	-	-	✅	438.36
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]	-	-	✅	479.54
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]	-	-	✅	427.18
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]	-	-	✅	527.28
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]	-	-	✅	541.16
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]	-	-	✅	497.66
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]	-	-	✅	466.44
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]	-	-	✅	476.34
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]	-	-	✅	433.28
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]	-	-	✅	550.22

iron/operators/rope

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]	-	-	✅	349.06
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]	-	-	✅	525.72
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]	-	-	✅	479.66
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]	-	-	✅	389.46
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]	-	-	✅	717.82
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]	-	-	✅	420.02

iron/operators/sigmoid

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	362.62
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	407.14
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	365.50
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	397.44
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	435.06
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	435.68

iron/operators/silu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	317.64
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	425.36
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	488.00

iron/operators/softmax

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]	-	-	✅	458.24
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]	-	-	✅	456.30
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	776.90

iron/operators/strided_copy

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_strided_copy[chunked_transfer]	-	-	✅	384.06
test_strided_copy[contiguous]	-	-	✅	436.42
test_strided_copy[four_channels]	-	-	✅	455.08
test_strided_copy[kv_slot0]	-	-	✅	401.06
test_strided_copy[kv_slot5]	-	-	✅	322.46
test_strided_copy[kv_slot5_four_channels]	-	-	✅	812.18
test_strided_copy[kv_slot5_two_channels]	-	-	✅	456.38
test_strided_copy[kv_slot_last]	-	-	✅	388.24
test_strided_copy[two_channels]	-	-	✅	351.74
test_strided_copy[two_channels_chunked]	-	-	✅	347.84
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]	-	-	✅	-

iron/operators/swiglu_decode

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]	-	-	✅	13638.91
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]	-	-	✅	14488.81

iron/operators/swiglu_prefill

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]	-	-	✅	23758.56

iron/operators/tanh

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	383.74
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	362.38
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	426.74
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	368.92
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	454.02
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	481.32

iron/operators/transpose

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]	-	-	✅	466.90
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]	-	-	✅	1145.68
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]	-	-	✅	403.52

Krackan - Examples

IRON

Tested on 2026_09_08_22_01_00 at commit 22b7d95.

iron/applications/llama_3.2_1b

Test	Checks	TTFT (mean)	TPS (mean)
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]	✅ 5/5	2.06	n/a
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]	✅ 5/5	2.10	7.80
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]	✅ 5/5	2.01	n/a
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]	✅ 5/5	2.01	7.59

Trends:

IRON Trends

iron/applications/llama_3.2_1b

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`22b7d95` — 2026-09-08 21:55:43	2.07 (-0.62%)	2.06 (-0.16%)	2.06 (-0.15%)	2.04 (-0.24%)	0.01 (-22.35%)
`deb6e1e` — 2026-09-03 22:57:17	2.09 (n/a)	2.07 (n/a)	2.07 (n/a)	2.05 (n/a)	0.02 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`22b7d95` — 2026-09-08 21:55:43	7.82 (-0.45%)	7.80 (-0.22%)	7.80 (-0.31%)	7.79 (+0.13%)	0.01 (-62.91%)	2.21 (+1.99%)	2.10 (+0.37%)	2.08 (-0.67%)	2.06 (+0.39%)	0.06 (+36.55%)
`deb6e1e` — 2026-09-03 22:57:17	7.85 (n/a)	7.82 (n/a)	7.83 (n/a)	7.79 (n/a)	0.02 (n/a)	2.17 (n/a)	2.09 (n/a)	2.09 (n/a)	2.05 (n/a)	0.05 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`22b7d95` — 2026-09-08 21:55:43	2.05 (+0.44%)	2.01 (-0.76%)	2.00 (-1.38%)	2.00 (-0.89%)	0.02 (+124.89%)
`deb6e1e` — 2026-09-03 22:57:17	2.04 (n/a)	2.03 (n/a)	2.03 (n/a)	2.01 (n/a)	0.01 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`22b7d95` — 2026-09-08 21:55:43	7.62 (-0.05%)	7.59 (-0.21%)	7.59 (-0.25%)	7.57 (-0.20%)	0.02 (+49.46%)	2.03 (-1.32%)	2.01 (-0.92%)	2.01 (-0.89%)	1.99 (-0.50%)	0.01 (-18.00%)
`deb6e1e` — 2026-09-03 22:57:17	7.63 (n/a)	7.61 (n/a)	7.61 (n/a)	7.58 (n/a)	0.02 (n/a)	2.05 (n/a)	2.03 (n/a)	2.03 (n/a)	2.00 (n/a)	0.02 (n/a)

Phoenix - Small

IRON

Tested on 2026_09_08_21_42_23 at commit 22b7d95.

iron/operators/axpy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]	✅ 5/5	435.06	0.03	n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]	✅ 5/5	436.58	0.03	n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]	✅ 5/5	400.68	0.03	n/a

iron/operators/dequant

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]	✅ 5/5	345.40	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]	✅ 5/5	289.82	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]	✅ 5/5	397.52	0.01	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]	✅ 5/5	357.62	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]	✅ 5/5	340.96	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]	✅ 5/5	418.36	0.01	n/a

iron/operators/elementwise_add

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	304.18	0.04	n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	333.36	0.05	n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	400.86	0.04	n/a

iron/operators/elementwise_mul

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	323.16	0.04	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	434.38	0.03	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	426.16	0.03	n/a

iron/operators/gelu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	354.48	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	344.70	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	333.96	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	365.32	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	299.00	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	479.00	0.02	n/a

iron/operators/gemm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	539.72	0.42	18.12
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	513.78	0.44	18.88
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	82835.20	0.30	207.47
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	25393.86	0.99	677.62
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]	✅ 5/5	3760.14	2.29	601.70
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]	✅ 5/5	6686.10	0.19	10.05

iron/operators/gemv

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	✅ 5/5	n/a	0.08	0.08
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	✅ 5/5	n/a	3.76	3.76
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]	✅ 5/5	n/a	6.59	6.58
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]	✅ 5/5	n/a	11.80	11.79
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	3.76	3.76
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	6.74	6.73
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	10.95	10.94
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]	✅ 5/5	n/a	2.23	2.23
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]	✅ 5/5	n/a	0.38	0.37
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]	✅ 5/5	n/a	0.43	0.42
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]	✅ 5/5	n/a	1.43	1.40
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	❌ 0/5	n/a	n/a	n/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	❌ 0/5	n/a	n/a	n/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	❌ 0/5	n/a	n/a	n/a
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_ln-norm_ref_]	❌ 0/5	n/a	0.07	0.07
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_rms-norm_ref_]	✅ 5/5	n/a	0.11	0.11
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_ln-norm_ref_]	❌ 0/5	n/a	n/a	n/a
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_rms-norm_ref_]	❌ 0/5	n/a	n/a	n/a
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_ln-norm_ref_]	❌ 0/5	n/a	3.52	3.52
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_rms-norm_ref_]	❌ 0/5	n/a	3.54	3.54

iron/operators/layer_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	406.88	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	427.10	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	384.58	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	544.76	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	406.34	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	450.72	0.02	n/a

iron/operators/leaky_relu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]	✅ 5/5	362.92	0.03	n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]	✅ 5/5	304.70	0.03	n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]	✅ 5/5	431.70	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]	✅ 5/5	334.86	0.03	n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]	✅ 5/5	808.66	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]	✅ 5/5	635.06	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]	✅ 5/5	433.34	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]	✅ 5/5	564.80	0.02	n/a

iron/operators/mem_copy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]	✅ 5/5	314.58	0.03	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]	✅ 5/5	280.38	0.03	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]	✅ 5/5	313.32	0.03	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]	✅ 5/5	402.84	0.03	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]	✅ 5/5	401.74	0.02	n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]	✅ 5/5	626.20	0.02	n/a

iron/operators/relu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	388.36	0.02	n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	469.70	0.02	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	447.66	0.02	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	440.48	0.02	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	419.50	0.02	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	567.50	0.02	n/a

iron/operators/repeat

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]	✅ 5/5	n/a	n/a	n/a
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]	✅ 5/5	n/a	n/a	n/a
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]	✅ 5/5	n/a	n/a	n/a
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]	✅ 5/5	338.50	0.08	n/a
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]	✅ 5/5	374.32	0.12	n/a
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]	✅ 5/5	290.70	0.02	n/a

iron/operators/rms_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]	✅ 5/5	819.10	0.01	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]	✅ 5/5	438.36	0.03	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]	✅ 5/5	479.54	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]	✅ 5/5	427.18	0.03	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]	✅ 5/5	527.28	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]	✅ 5/5	541.16	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]	✅ 5/5	497.66	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]	✅ 5/5	466.44	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]	✅ 5/5	476.34	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]	✅ 5/5	433.28	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]	✅ 5/5	550.22	0.02	n/a

iron/operators/rope

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]	✅ 5/5	349.06	0.30	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]	✅ 5/5	525.72	0.21	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]	✅ 5/5	479.66	0.22	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]	✅ 5/5	389.46	0.20	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]	✅ 5/5	717.82	0.17	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]	✅ 5/5	420.02	0.20	n/a

iron/operators/sigmoid

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	362.62	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	407.14	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	365.50	0.03	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	397.44	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	435.06	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	435.68	0.02	n/a

iron/operators/silu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	317.64	0.03	n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	425.36	0.02	n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	488.00	0.02	n/a

iron/operators/softmax

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]	✅ 5/5	458.24	0.34	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]	✅ 5/5	456.30	0.30	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	776.90	0.26	n/a

iron/operators/strided_copy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_strided_copy[chunked_transfer]	✅ 5/5	384.06	0.01	n/a
test_strided_copy[contiguous]	✅ 5/5	436.42	0.01	n/a
test_strided_copy[four_channels]	✅ 5/5	455.08	0.01	n/a
test_strided_copy[kv_slot0]	✅ 5/5	401.06	0.35	n/a
test_strided_copy[kv_slot5]	✅ 5/5	322.46	0.42	n/a
test_strided_copy[kv_slot5_four_channels]	✅ 5/5	812.18	0.29	n/a
test_strided_copy[kv_slot5_two_channels]	✅ 5/5	456.38	0.37	n/a
test_strided_copy[kv_slot_last]	✅ 5/5	388.24	0.39	n/a
test_strided_copy[two_channels]	✅ 5/5	351.74	0.01	n/a
test_strided_copy[two_channels_chunked]	✅ 5/5	347.84	0.01	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]	✅ 1/1	n/a	n/a	n/a

iron/operators/swiglu_decode

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]	✅ 5/5	13638.91	0.00	n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]	✅ 5/5	14488.81	0.00	n/a

iron/operators/swiglu_prefill

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]	✅ 5/5	23758.56	0.09	n/a

iron/operators/tanh

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	383.74	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	362.38	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	426.74	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	368.92	0.03	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	454.02	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	481.32	0.02	n/a

iron/operators/transpose

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]	✅ 5/5	466.90	1.17	n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]	✅ 5/5	1145.68	1.70	n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]	✅ 5/5	403.52	1.43	n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (-15.88%)	0.03 (-9.81%)	0.03 (-6.61%)	0.02 (+0.72%)	0.01 (-25.85%)	555.50 (-0.71%)	435.06 (+7.14%)	451.80 (+7.06%)	301.90 (+18.91%)	124.72 (-11.03%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	559.50 (n/a)	406.08 (n/a)	422.00 (n/a)	253.90 (n/a)	140.18 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.05 (-22.47%)	0.03 (-14.13%)	0.03 (+18.54%)	0.02 (+92.23%)	0.01 (-56.86%)	545.90 (-47.98%)	436.58 (-15.50%)	456.90 (-15.64%)	259.30 (+29.00%)	108.04 (-68.88%)
`deb6e1e` — 2026-09-03 22:38:33	0.06 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	0.02 (n/a)	1049.40 (n/a)	516.68 (n/a)	541.60 (n/a)	201.00 (n/a)	347.21 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.06 (+19.86%)	0.03 (+1.58%)	0.03 (-11.20%)	0.03 (+26.35%)	0.01 (+14.18%)	464.60 (-20.85%)	400.68 (-3.29%)	433.20 (+12.61%)	212.40 (-16.58%)	106.38 (-28.69%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	587.00 (n/a)	414.30 (n/a)	384.70 (n/a)	254.60 (n/a)	149.17 (n/a)

iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (-37.66%)	0.02 (-29.32%)	0.02 (-15.88%)	0.01 (-32.10%)	0.00 (-28.13%)	470.10 (+47.27%)	345.40 (+44.30%)	288.70 (+18.90%)	244.80 (+60.42%)	112.79 (+81.26%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	319.20 (n/a)	239.36 (n/a)	242.80 (n/a)	152.60 (n/a)	62.22 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (+2.63%)	0.02 (+11.50%)	0.02 (+2.02%)	0.01 (+1.17%)	0.01 (-13.29%)	484.90 (-1.16%)	289.82 (-13.15%)	264.40 (-2.00%)	202.00 (-2.56%)	112.18 (-15.31%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	490.60 (n/a)	333.72 (n/a)	269.80 (n/a)	207.30 (n/a)	132.45 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (-9.99%)	0.01 (-28.58%)	0.01 (-36.49%)	0.01 (-35.44%)	0.00 (+49.48%)	512.50 (+54.88%)	397.52 (+44.66%)	411.00 (+57.47%)	266.50 (+11.13%)	88.40 (+144.88%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.00 (n/a)	330.90 (n/a)	274.80 (n/a)	261.00 (n/a)	239.80 (n/a)	36.10 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (+8.49%)	0.02 (+46.28%)	0.02 (+98.48%)	0.01 (+227.05%)	0.01 (-23.71%)	577.80 (-69.42%)	357.62 (-55.32%)	284.60 (-49.61%)	224.40 (-7.84%)	154.93 (-77.36%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	0.01 (n/a)	1889.60 (n/a)	800.34 (n/a)	564.80 (n/a)	243.50 (n/a)	684.35 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (+13.60%)	0.02 (+20.08%)	0.02 (+74.48%)	0.01 (+0.23%)	0.01 (+11.66%)	515.00 (-0.23%)	340.96 (-16.05%)	277.20 (-42.68%)	224.40 (-11.97%)	125.12 (-0.98%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	516.20 (n/a)	406.14 (n/a)	483.60 (n/a)	254.90 (n/a)	126.36 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (+7.76%)	0.01 (-9.01%)	0.01 (-20.75%)	0.01 (+28.82%)	0.01 (-6.20%)	548.30 (-22.37%)	418.36 (+4.03%)	417.20 (+26.19%)	227.90 (-7.21%)	121.01 (-35.93%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	706.30 (n/a)	402.16 (n/a)	330.60 (n/a)	245.60 (n/a)	188.89 (n/a)

iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.02 (n/a)	0.01 (n/a)	510.60 (n/a)	304.18 (n/a)	267.30 (n/a)	230.30 (n/a)	116.78 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.02 (n/a)	0.02 (n/a)	745.30 (n/a)	333.36 (n/a)	241.00 (n/a)	213.90 (n/a)	230.83 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.06 (n/a)	0.04 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	576.70 (n/a)	400.86 (n/a)	437.80 (n/a)	198.70 (n/a)	153.43 (n/a)

iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	482.70 (n/a)	323.16 (n/a)	274.00 (n/a)	222.70 (n/a)	104.57 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	613.40 (n/a)	434.38 (n/a)	483.30 (n/a)	261.40 (n/a)	161.86 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	668.40 (n/a)	426.16 (n/a)	429.30 (n/a)	244.80 (n/a)	166.68 (n/a)

iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	563.30 (n/a)	354.48 (n/a)	300.30 (n/a)	239.50 (n/a)	126.36 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	537.70 (n/a)	344.70 (n/a)	293.70 (n/a)	237.90 (n/a)	119.35 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	460.40 (n/a)	333.96 (n/a)	295.90 (n/a)	209.00 (n/a)	108.50 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	563.20 (n/a)	365.32 (n/a)	279.50 (n/a)	193.10 (n/a)	175.39 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	487.50 (n/a)	299.00 (n/a)	253.80 (n/a)	239.00 (n/a)	106.27 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	1029.70 (n/a)	479.00 (n/a)	327.90 (n/a)	259.40 (n/a)	321.19 (n/a)

iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.56 (-15.48%)	0.42 (-8.42%)	0.43 (+1.21%)	0.33 (-9.96%)	0.09 (-19.84%)	665.60 (+11.06%)	539.72 (+8.80%)	511.00 (-1.20%)	396.10 (+18.31%)	111.40 (+13.03%)	23.83 (-15.48%)	18.12 (-8.42%)	18.47 (+1.21%)	14.18 (-9.96%)	3.90 (-19.84%)
`deb6e1e` — 2026-09-03 22:38:33	0.66 (n/a)	0.46 (n/a)	0.43 (n/a)	0.37 (n/a)	0.11 (n/a)	599.30 (n/a)	496.08 (n/a)	517.20 (n/a)	334.80 (n/a)	98.56 (n/a)	28.19 (n/a)	19.79 (n/a)	18.25 (n/a)	15.75 (n/a)	4.86 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.53 (-5.45%)	0.44 (+5.41%)	0.48 (+13.08%)	0.35 (+3.62%)	0.08 (-11.11%)	632.60 (-3.49%)	513.78 (-5.75%)	463.70 (-11.56%)	420.30 (+5.76%)	97.64 (-10.16%)	22.45 (-5.45%)	18.88 (+5.41%)	20.35 (+13.08%)	14.92 (+3.62%)	3.40 (-11.11%)
`deb6e1e` — 2026-09-03 22:38:33	0.56 (n/a)	0.42 (n/a)	0.42 (n/a)	0.34 (n/a)	0.09 (n/a)	655.50 (n/a)	545.14 (n/a)	524.30 (n/a)	397.40 (n/a)	108.69 (n/a)	23.74 (n/a)	17.91 (n/a)	18.00 (n/a)	14.40 (n/a)	3.83 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.31 (-0.00%)	0.30 (+0.19%)	0.31 (+1.07%)	0.29 (-1.49%)	0.01 (+32.02%)	85717.30 (+1.51%)	82835.20 (-0.18%)	81868.50 (-1.06%)	81684.90 (+0.00%)	1699.67 (+34.04%)	210.32 (-0.00%)	207.47 (+0.19%)	209.85 (+1.07%)	200.42 (-1.49%)	4.17 (+32.02%)
`deb6e1e` — 2026-09-03 22:38:33	0.31 (n/a)	0.30 (n/a)	0.30 (n/a)	0.30 (n/a)	0.00 (n/a)	84441.40 (n/a)	82982.52 (n/a)	82742.70 (n/a)	81682.30 (n/a)	1268.00 (n/a)	210.33 (n/a)	207.07 (n/a)	207.63 (n/a)	203.45 (n/a)	3.16 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	1.03 (+0.44%)	0.99 (-2.01%)	1.00 (-1.27%)	0.92 (-7.89%)	0.04 (+318.62%)	27414.50 (+8.57%)	25393.86 (+2.20%)	25118.40 (+1.29%)	24436.30 (-0.44%)	1163.60 (+356.32%)	703.05 (+0.44%)	677.62 (-2.01%)	683.96 (-1.27%)	626.67 (-7.89%)	29.53 (+318.61%)
`deb6e1e` — 2026-09-03 22:38:33	1.03 (n/a)	1.01 (n/a)	1.01 (n/a)	1.00 (n/a)	0.01 (n/a)	25251.20 (n/a)	24846.02 (n/a)	24799.50 (n/a)	24544.40 (n/a)	255.00 (n/a)	699.95 (n/a)	691.51 (n/a)	692.75 (n/a)	680.36 (n/a)	7.06 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	3.65 (-0.25%)	2.29 (-18.87%)	2.02 (-30.95%)	1.79 (-8.39%)	0.77 (-7.99%)	4501.50 (+9.15%)	3760.14 (+22.18%)	3991.60 (+44.82%)	2208.80 (+0.25%)	926.33 (-3.71%)	957.03 (-0.25%)	601.70 (-18.87%)	529.59 (-30.95%)	469.61 (-8.39%)	202.88 (-7.99%)
`deb6e1e` — 2026-09-03 22:38:33	3.66 (n/a)	2.83 (n/a)	2.92 (n/a)	1.95 (n/a)	0.84 (n/a)	4124.00 (n/a)	3077.52 (n/a)	2756.20 (n/a)	2203.30 (n/a)	962.01 (n/a)	959.42 (n/a)	741.61 (n/a)	766.98 (n/a)	512.59 (n/a)	220.50 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.19 (-20.05%)	0.19 (-9.74%)	0.19 (-10.57%)	0.18 (-0.65%)	0.01 (-74.82%)	7044.90 (+0.65%)	6686.10 (+9.48%)	6626.10 (+11.82%)	6423.90 (+25.08%)	241.38 (-68.66%)	10.45 (-20.05%)	10.05 (-9.74%)	10.13 (-10.57%)	9.53 (-0.65%)	0.36 (-74.82%)
`deb6e1e` — 2026-09-03 22:38:33	0.24 (n/a)	0.21 (n/a)	0.21 (n/a)	0.18 (n/a)	0.03 (n/a)	6999.10 (n/a)	6106.98 (n/a)	5925.70 (n/a)	5135.70 (n/a)	770.08 (n/a)	13.07 (n/a)	11.13 (n/a)	11.33 (n/a)	9.59 (n/a)	1.42 (n/a)

iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	3.99 (n/a)	3.76 (n/a)	3.77 (n/a)	3.46 (n/a)	0.22 (n/a)	3.99 (n/a)	3.76 (n/a)	3.77 (n/a)	3.46 (n/a)	0.22 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	7.59 (+2.42%)	6.59 (+2.14%)	6.98 (+4.19%)	5.16 (-8.84%)	1.00 (+31.35%)	7.58 (+2.42%)	6.58 (+2.14%)	6.97 (+4.19%)	5.16 (-8.84%)	1.00 (+31.35%)
`deb6e1e` — 2026-09-03 22:38:33	7.41 (n/a)	6.45 (n/a)	6.69 (n/a)	5.66 (n/a)	0.76 (n/a)	7.40 (n/a)	6.44 (n/a)	6.69 (n/a)	5.66 (n/a)	0.76 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	13.85 (+36.47%)	11.80 (+34.70%)	13.67 (+60.88%)	7.98 (-2.75%)	2.73 (+247.46%)	13.84 (+36.47%)	11.79 (+34.70%)	13.66 (+60.88%)	7.97 (-2.75%)	2.72 (+247.45%)
`deb6e1e` — 2026-09-03 22:38:33	10.15 (n/a)	8.76 (n/a)	8.50 (n/a)	8.20 (n/a)	0.78 (n/a)	10.14 (n/a)	8.75 (n/a)	8.49 (n/a)	8.20 (n/a)	0.78 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	3.90 (n/a)	3.76 (n/a)	3.78 (n/a)	3.52 (n/a)	0.15 (n/a)	3.90 (n/a)	3.76 (n/a)	3.78 (n/a)	3.52 (n/a)	0.15 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	7.67 (+2.37%)	6.74 (+1.74%)	7.44 (+14.09%)	4.71 (-18.37%)	1.24 (+88.88%)	7.66 (+2.37%)	6.73 (+1.74%)	7.44 (+14.09%)	4.71 (-18.37%)	1.24 (+88.88%)
`deb6e1e` — 2026-09-03 22:38:33	7.49 (n/a)	6.62 (n/a)	6.52 (n/a)	5.77 (n/a)	0.66 (n/a)	7.49 (n/a)	6.62 (n/a)	6.52 (n/a)	5.77 (n/a)	0.66 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	13.92 (-0.99%)	10.95 (-12.71%)	10.97 (-20.12%)	7.65 (+1.94%)	2.52 (-10.76%)	13.91 (-0.99%)	10.94 (-12.71%)	10.96 (-20.12%)	7.65 (+1.94%)	2.51 (-10.76%)
`deb6e1e` — 2026-09-03 22:38:33	14.05 (n/a)	12.54 (n/a)	13.73 (n/a)	7.51 (n/a)	2.82 (n/a)	14.05 (n/a)	12.54 (n/a)	13.72 (n/a)	7.50 (n/a)	2.82 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	2.87 (-8.94%)	2.23 (-11.28%)	2.78 (-8.54%)	1.02 (-5.84%)	0.83 (-6.47%)	2.86 (-8.94%)	2.23 (-11.28%)	2.77 (-8.54%)	1.02 (-5.84%)	0.83 (-6.47%)
`deb6e1e` — 2026-09-03 22:38:33	3.15 (n/a)	2.52 (n/a)	3.04 (n/a)	1.09 (n/a)	0.89 (n/a)	3.14 (n/a)	2.51 (n/a)	3.03 (n/a)	1.09 (n/a)	0.89 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.57 (-0.77%)	0.38 (+1.28%)	0.35 (-0.16%)	0.07 (-2.26%)	0.20 (+1.82%)	0.56 (-0.77%)	0.37 (+1.28%)	0.34 (-0.16%)	0.07 (-2.26%)	0.20 (+1.82%)
`deb6e1e` — 2026-09-03 22:38:33	0.57 (n/a)	0.37 (n/a)	0.35 (n/a)	0.08 (n/a)	0.20 (n/a)	0.56 (n/a)	0.37 (n/a)	0.34 (n/a)	0.08 (n/a)	0.20 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.73 (+0.57%)	0.43 (+4.53%)	0.49 (+5.13%)	0.08 (+3.67%)	0.25 (+3.69%)	0.72 (+0.57%)	0.42 (+4.53%)	0.48 (+5.13%)	0.08 (+3.67%)	0.24 (+3.69%)
`deb6e1e` — 2026-09-03 22:38:33	0.73 (n/a)	0.41 (n/a)	0.46 (n/a)	0.08 (n/a)	0.24 (n/a)	0.72 (n/a)	0.41 (n/a)	0.46 (n/a)	0.08 (n/a)	0.24 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	2.05 (-16.81%)	1.43 (-9.63%)	1.68 (-5.18%)	0.66 (+48.54%)	0.64 (-15.83%)	2.02 (-16.81%)	1.40 (-9.63%)	1.66 (-5.18%)	0.65 (+48.54%)	0.63 (-15.83%)
`deb6e1e` — 2026-09-03 22:38:33	2.47 (n/a)	1.58 (n/a)	1.78 (n/a)	0.44 (n/a)	0.76 (n/a)	2.43 (n/a)	1.55 (n/a)	1.75 (n/a)	0.43 (n/a)	0.75 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.12 (n/a)	0.07 (n/a)	0.07 (n/a)	0.03 (n/a)	0.04 (n/a)	0.12 (n/a)	0.07 (n/a)	0.07 (n/a)	0.03 (n/a)	0.03 (n/a)

test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.14 (n/a)	0.11 (n/a)	0.12 (n/a)	0.07 (n/a)	0.03 (n/a)	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.07 (n/a)	0.03 (n/a)

test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]

No metrics available.

test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]

No metrics available.

test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	3.72 (n/a)	3.52 (n/a)	3.41 (n/a)	3.37 (n/a)	0.17 (n/a)	3.72 (n/a)	3.52 (n/a)	3.41 (n/a)	3.36 (n/a)	0.17 (n/a)

test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`22b7d95` — 2026-09-08 21:37:29	3.74 (n/a)	3.54 (n/a)	3.51 (n/a)	3.42 (n/a)	0.13 (n/a)	3.74 (n/a)	3.54 (n/a)	3.51 (n/a)	3.42 (n/a)	0.13 (n/a)

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	543.70 (n/a)	406.88 (n/a)	385.10 (n/a)	254.10 (n/a)	126.16 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	554.00 (n/a)	427.10 (n/a)	431.20 (n/a)	311.90 (n/a)	96.19 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.02 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	564.20 (n/a)	384.58 (n/a)	294.60 (n/a)	237.40 (n/a)	151.60 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	660.70 (n/a)	544.76 (n/a)	514.50 (n/a)	404.10 (n/a)	104.62 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	577.00 (n/a)	406.34 (n/a)	476.30 (n/a)	232.30 (n/a)	151.21 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	645.40 (n/a)	450.72 (n/a)	480.60 (n/a)	295.90 (n/a)	147.28 (n/a)

iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (+36.34%)	0.03 (+26.86%)	0.02 (+45.38%)	0.01 (-0.52%)	0.01 (+32.87%)	595.80 (+0.52%)	362.92 (-19.69%)	357.20 (-31.22%)	185.70 (-26.63%)	151.95 (-6.44%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	592.70 (n/a)	451.90 (n/a)	519.30 (n/a)	253.10 (n/a)	162.42 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (+28.43%)	0.03 (+36.67%)	0.03 (+84.58%)	0.02 (+14.17%)	0.01 (+4.30%)	510.30 (-12.41%)	304.70 (-28.42%)	268.10 (-45.82%)	202.00 (-22.13%)	119.75 (-20.33%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	582.60 (n/a)	425.66 (n/a)	494.80 (n/a)	259.40 (n/a)	150.31 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (-2.03%)	0.02 (-14.03%)	0.02 (-33.66%)	0.01 (-20.35%)	0.01 (+18.54%)	610.40 (+25.55%)	431.70 (+24.34%)	458.20 (+50.72%)	222.50 (+2.06%)	178.03 (+48.08%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	486.20 (n/a)	347.18 (n/a)	304.00 (n/a)	218.00 (n/a)	120.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (+15.88%)	0.03 (+26.91%)	0.03 (+39.79%)	0.02 (+10.74%)	0.01 (+39.13%)	443.40 (-9.69%)	334.86 (-18.89%)	315.50 (-28.47%)	228.00 (-13.70%)	103.99 (+15.53%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	491.00 (n/a)	412.84 (n/a)	441.10 (n/a)	264.20 (n/a)	90.01 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-48.34%)	0.02 (-26.72%)	0.02 (+18.48%)	0.00 (-77.46%)	0.01 (-42.60%)	2441.50 (+343.59%)	808.66 (+94.38%)	387.70 (-15.61%)	297.20 (+93.62%)	917.82 (+491.62%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.02 (n/a)	550.40 (n/a)	416.02 (n/a)	459.40 (n/a)	153.50 (n/a)	155.14 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (+51.63%)	0.02 (-4.85%)	0.02 (-11.98%)	0.01 (-54.25%)	0.01 (+343.66%)	1283.30 (+118.58%)	635.06 (+29.54%)	537.50 (+13.61%)	296.90 (-34.04%)	376.57 (+575.18%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	587.10 (n/a)	490.24 (n/a)	473.10 (n/a)	450.10 (n/a)	55.77 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-15.19%)	0.02 (+15.99%)	0.02 (+19.29%)	0.02 (+273.64%)	0.00 (-51.92%)	540.30 (-73.24%)	433.34 (-43.00%)	425.10 (-16.17%)	294.90 (+17.91%)	94.84 (-86.70%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.00 (n/a)	0.01 (n/a)	2018.90 (n/a)	760.24 (n/a)	507.10 (n/a)	250.10 (n/a)	713.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (-16.01%)	0.02 (-7.66%)	0.01 (-9.87%)	0.01 (-22.70%)	0.01 (-8.19%)	808.90 (+29.38%)	564.80 (+10.08%)	595.30 (+10.96%)	368.30 (+19.08%)	179.21 (+36.72%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	625.20 (n/a)	513.10 (n/a)	536.50 (n/a)	309.30 (n/a)	131.08 (n/a)

iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.05 (+28.50%)	0.03 (+13.07%)	0.03 (+6.38%)	0.02 (+9.54%)	0.01 (+52.22%)	497.10 (-8.71%)	314.58 (-7.63%)	292.30 (-6.01%)	172.90 (-22.19%)	124.49 (+2.79%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	544.50 (n/a)	340.56 (n/a)	311.00 (n/a)	222.20 (n/a)	121.11 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-0.61%)	0.03 (+18.29%)	0.03 (+26.13%)	0.02 (+53.65%)	0.00 (-55.79%)	350.70 (-34.92%)	280.38 (-23.86%)	267.10 (-20.72%)	235.00 (+0.64%)	43.14 (-69.73%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	538.90 (n/a)	368.22 (n/a)	336.90 (n/a)	233.50 (n/a)	142.52 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (+11.38%)	0.03 (+20.33%)	0.03 (+77.80%)	0.02 (+35.86%)	0.01 (-18.42%)	432.00 (-26.39%)	313.32 (-24.16%)	281.90 (-43.74%)	192.90 (-10.20%)	96.85 (-43.55%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	586.90 (n/a)	413.14 (n/a)	501.10 (n/a)	214.80 (n/a)	171.55 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.05 (+39.04%)	0.03 (-20.40%)	0.02 (-49.77%)	0.01 (-24.27%)	0.02 (+103.63%)	579.20 (+32.03%)	402.84 (+47.53%)	465.90 (+99.10%)	161.10 (-28.11%)	177.43 (+90.93%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	438.70 (n/a)	273.06 (n/a)	234.00 (n/a)	224.10 (n/a)	92.93 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (+12.23%)	0.02 (-6.27%)	0.02 (-23.93%)	0.01 (+5.25%)	0.01 (+13.67%)	578.80 (-4.97%)	401.74 (+6.46%)	410.10 (+31.44%)	215.50 (-10.91%)	128.79 (-12.09%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	609.10 (n/a)	377.36 (n/a)	312.00 (n/a)	241.90 (n/a)	146.51 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-1.93%)	0.02 (-10.48%)	0.01 (-16.01%)	0.01 (+69.48%)	0.01 (-11.76%)	1077.80 (-41.00%)	626.20 (-10.98%)	612.10 (+19.06%)	264.30 (+1.97%)	291.24 (-54.40%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.00 (n/a)	0.01 (n/a)	1826.80 (n/a)	703.40 (n/a)	514.10 (n/a)	259.20 (n/a)	638.71 (n/a)

iron/operators/repeat

test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]

No metrics available.

test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.11 (-2.71%)	0.08 (-4.20%)	0.08 (-1.37%)	0.05 (+0.84%)	0.02 (-4.92%)	527.10 (-0.83%)	338.50 (+3.57%)	298.60 (+1.39%)	232.50 (+2.79%)	111.82 (-5.21%)
`deb6e1e` — 2026-09-03 22:38:33	0.11 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	531.50 (n/a)	326.84 (n/a)	294.50 (n/a)	226.20 (n/a)	117.97 (n/a)

test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.16 (-10.37%)	0.12 (-15.95%)	0.13 (-7.53%)	0.08 (-18.14%)	0.03 (+11.01%)	537.40 (+22.19%)	374.32 (+22.71%)	315.00 (+8.14%)	260.30 (+11.57%)	120.97 (+49.83%)
`deb6e1e` — 2026-09-03 22:38:33	0.18 (n/a)	0.14 (n/a)	0.14 (n/a)	0.09 (n/a)	0.03 (n/a)	439.80 (n/a)	305.04 (n/a)	291.30 (n/a)	233.30 (n/a)	80.73 (n/a)

test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (+11.75%)	0.02 (+40.06%)	0.02 (+61.67%)	0.01 (+61.23%)	0.00 (-24.79%)	359.60 (-37.98%)	290.70 (-33.80%)	281.70 (-38.14%)	205.90 (-10.52%)	59.60 (-58.51%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	579.80 (n/a)	439.12 (n/a)	455.40 (n/a)	230.10 (n/a)	143.64 (n/a)

iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (-49.38%)	0.01 (-49.52%)	0.02 (-48.88%)	0.00 (-77.02%)	0.01 (-34.03%)	2084.90 (+335.17%)	819.10 (+151.32%)	530.20 (+95.65%)	440.80 (+97.49%)	708.68 (+520.38%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	479.10 (n/a)	325.92 (n/a)	271.00 (n/a)	223.20 (n/a)	114.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (-7.79%)	0.03 (-18.48%)	0.03 (-35.46%)	0.02 (+9.45%)	0.01 (-30.52%)	504.30 (-8.62%)	438.36 (+18.06%)	461.10 (+54.94%)	298.90 (+8.45%)	81.33 (-32.49%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	551.90 (n/a)	371.30 (n/a)	297.60 (n/a)	275.60 (n/a)	120.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (+2.42%)	0.02 (-6.98%)	0.02 (-20.71%)	0.01 (+4.84%)	0.01 (+14.63%)	554.40 (-4.61%)	479.54 (+9.17%)	540.20 (+26.10%)	274.30 (-2.35%)	118.64 (+9.07%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	581.20 (n/a)	439.26 (n/a)	428.40 (n/a)	280.90 (n/a)	108.78 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.04 (-33.31%)	0.03 (-10.54%)	0.02 (+6.13%)	0.02 (+32.95%)	0.01 (-54.57%)	565.80 (-24.78%)	427.18 (-8.06%)	463.80 (-5.77%)	281.50 (+49.89%)	120.59 (-49.17%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	0.02 (n/a)	752.20 (n/a)	464.64 (n/a)	492.20 (n/a)	187.80 (n/a)	237.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (+9.13%)	0.02 (-6.34%)	0.01 (-15.93%)	0.01 (-8.63%)	0.01 (+41.34%)	618.00 (+9.46%)	527.28 (+10.61%)	585.90 (+18.94%)	300.30 (-8.36%)	129.75 (+39.72%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	564.60 (n/a)	476.72 (n/a)	492.60 (n/a)	327.70 (n/a)	92.86 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-45.56%)	0.02 (-36.95%)	0.02 (-46.44%)	0.02 (-9.76%)	0.00 (-70.60%)	675.40 (+10.81%)	541.16 (+38.47%)	522.20 (+86.70%)	409.40 (+83.67%)	102.11 (-43.80%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	609.50 (n/a)	390.82 (n/a)	279.70 (n/a)	222.90 (n/a)	181.70 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (-53.81%)	0.02 (-44.88%)	0.02 (-44.82%)	0.01 (-13.33%)	0.00 (-74.47%)	577.20 (+15.37%)	497.66 (+56.32%)	503.80 (+81.22%)	353.50 (+116.61%)	89.26 (-39.36%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	500.30 (n/a)	318.36 (n/a)	278.00 (n/a)	163.20 (n/a)	147.20 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-17.18%)	0.02 (+2.56%)	0.02 (-3.56%)	0.01 (+58.25%)	0.01 (-25.56%)	655.10 (-36.80%)	466.44 (-12.69%)	483.80 (+3.69%)	293.70 (+20.76%)	157.73 (-46.84%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	1036.60 (n/a)	534.22 (n/a)	466.60 (n/a)	243.20 (n/a)	296.73 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-38.38%)	0.02 (-37.76%)	0.02 (-47.21%)	0.01 (-5.05%)	0.01 (-48.24%)	593.20 (+5.31%)	476.34 (+47.21%)	492.20 (+89.45%)	268.90 (+62.28%)	129.61 (-15.85%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	563.30 (n/a)	323.58 (n/a)	259.80 (n/a)	165.70 (n/a)	154.03 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (-23.89%)	0.02 (+15.95%)	0.02 (+18.31%)	0.02 (+169.46%)	0.01 (-46.69%)	612.30 (-62.89%)	433.28 (-37.67%)	450.10 (-15.49%)	293.90 (+31.38%)	131.04 (-76.24%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	1649.90 (n/a)	695.12 (n/a)	532.60 (n/a)	223.70 (n/a)	551.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.03 (+26.19%)	0.02 (-5.81%)	0.01 (-19.94%)	0.01 (-13.77%)	0.01 (+88.46%)	734.40 (+15.96%)	550.22 (+16.08%)	594.40 (+24.90%)	256.10 (-20.76%)	179.62 (+63.23%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	633.30 (n/a)	474.00 (n/a)	475.90 (n/a)	323.20 (n/a)	110.04 (n/a)

iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.39 (+11.05%)	0.30 (+4.91%)	0.33 (-2.87%)	0.17 (-7.50%)	0.08 (+7.57%)	567.50 (+8.12%)	349.06 (-3.36%)	300.10 (+2.95%)	253.70 (-9.97%)	126.11 (+14.77%)
`deb6e1e` — 2026-09-03 22:38:33	0.35 (n/a)	0.29 (n/a)	0.34 (n/a)	0.19 (n/a)	0.08 (n/a)	524.90 (n/a)	361.20 (n/a)	291.50 (n/a)	281.80 (n/a)	109.88 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.34 (+14.80%)	0.21 (-4.87%)	0.19 (-4.27%)	0.13 (-29.43%)	0.08 (+71.34%)	760.90 (+41.69%)	525.72 (+12.99%)	505.50 (+4.46%)	287.90 (-12.89%)	175.28 (+104.51%)
`deb6e1e` — 2026-09-03 22:38:33	0.30 (n/a)	0.22 (n/a)	0.20 (n/a)	0.18 (n/a)	0.05 (n/a)	537.00 (n/a)	465.30 (n/a)	483.90 (n/a)	330.50 (n/a)	85.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.34 (-5.86%)	0.22 (+5.30%)	0.22 (+13.07%)	0.15 (+271.24%)	0.07 (-37.12%)	652.60 (-73.06%)	479.66 (-41.17%)	441.80 (-11.55%)	291.60 (+6.23%)	141.03 (-84.39%)
`deb6e1e` — 2026-09-03 22:38:33	0.36 (n/a)	0.21 (n/a)	0.20 (n/a)	0.04 (n/a)	0.12 (n/a)	2422.70 (n/a)	815.30 (n/a)	499.50 (n/a)	274.50 (n/a)	903.57 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.30 (+1.23%)	0.20 (-9.52%)	0.18 (-24.71%)	0.15 (+1.96%)	0.06 (-0.92%)	494.40 (-1.92%)	389.46 (+10.15%)	404.80 (+32.81%)	247.40 (-1.20%)	104.37 (-3.65%)
`deb6e1e` — 2026-09-03 22:38:33	0.29 (n/a)	0.22 (n/a)	0.24 (n/a)	0.15 (n/a)	0.06 (n/a)	504.10 (n/a)	353.58 (n/a)	304.80 (n/a)	250.40 (n/a)	108.32 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.30 (-13.16%)	0.17 (-22.97%)	0.13 (-16.36%)	0.04 (-67.24%)	0.11 (-2.94%)	1825.40 (+205.20%)	717.82 (+73.76%)	583.50 (+19.55%)	243.30 (+15.14%)	643.42 (+254.10%)
`deb6e1e` — 2026-09-03 22:38:33	0.35 (n/a)	0.22 (n/a)	0.15 (n/a)	0.12 (n/a)	0.11 (n/a)	598.10 (n/a)	413.10 (n/a)	488.10 (n/a)	211.30 (n/a)	181.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.36 (+26.45%)	0.20 (+42.17%)	0.17 (+31.36%)	0.12 (+64.78%)	0.09 (+13.24%)	633.90 (-39.31%)	420.02 (-34.50%)	438.60 (-23.87%)	205.10 (-20.90%)	158.90 (-45.38%)
`deb6e1e` — 2026-09-03 22:38:33	0.28 (n/a)	0.14 (n/a)	0.13 (n/a)	0.07 (n/a)	0.08 (n/a)	1044.50 (n/a)	641.28 (n/a)	576.10 (n/a)	259.30 (n/a)	290.93 (n/a)

iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.57 (+15.52%)	0.34 (-1.19%)	0.28 (-1.57%)	0.16 (-22.13%)	0.15 (+12.37%)	795.60 (+28.41%)	458.24 (+5.68%)	461.50 (+1.58%)	231.60 (-13.45%)	212.83 (+32.38%)
`deb6e1e` — 2026-09-03 22:38:33	0.49 (n/a)	0.34 (n/a)	0.29 (n/a)	0.21 (n/a)	0.13 (n/a)	619.60 (n/a)	433.62 (n/a)	454.30 (n/a)	267.60 (n/a)	160.77 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.39 (-18.03%)	0.30 (-12.37%)	0.30 (-12.82%)	0.22 (+2.83%)	0.06 (-37.10%)	601.30 (-2.77%)	456.30 (+9.48%)	434.90 (+14.72%)	337.30 (+21.99%)	101.17 (-25.61%)
`deb6e1e` — 2026-09-03 22:38:33	0.47 (n/a)	0.34 (n/a)	0.35 (n/a)	0.21 (n/a)	0.10 (n/a)	618.40 (n/a)	416.80 (n/a)	379.10 (n/a)	276.50 (n/a)	135.99 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.46 (-17.29%)	0.26 (-33.42%)	0.22 (-41.66%)	0.07 (-73.22%)	0.16 (+46.60%)	1886.20 (+273.43%)	776.90 (+117.42%)	597.40 (+71.42%)	287.00 (+20.89%)	650.09 (+561.74%)
`deb6e1e` — 2026-09-03 22:38:33	0.55 (n/a)	0.39 (n/a)	0.38 (n/a)	0.26 (n/a)	0.11 (n/a)	505.10 (n/a)	357.32 (n/a)	348.50 (n/a)	237.40 (n/a)	98.24 (n/a)

iron/operators/strided_copy

test_strided_copy[chunked_transfer]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (-5.15%)	0.01 (+1.28%)	0.01 (+17.10%)	0.01 (-23.05%)	0.00 (+3.53%)	636.60 (+29.94%)	384.06 (+1.68%)	321.90 (-14.59%)	269.20 (+5.44%)	146.05 (+49.02%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	489.90 (n/a)	377.72 (n/a)	376.90 (n/a)	255.30 (n/a)	98.01 (n/a)

test_strided_copy[contiguous]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (+4.56%)	0.01 (+6.56%)	0.01 (+1.79%)	0.01 (+6.30%)	0.00 (+1.28%)	527.40 (-5.92%)	436.42 (-6.62%)	476.40 (-1.75%)	272.80 (-4.35%)	98.88 (-9.82%)
`deb6e1e` — 2026-09-03 22:38:33	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	560.60 (n/a)	467.36 (n/a)	484.90 (n/a)	285.20 (n/a)	109.64 (n/a)

test_strided_copy[four_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.01 (-8.92%)	0.01 (-7.03%)	0.01 (-4.20%)	0.01 (-29.99%)	0.00 (+5.67%)	790.90 (+42.84%)	455.08 (+13.53%)	381.80 (+4.40%)	275.70 (+9.80%)	209.26 (+59.97%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	553.70 (n/a)	400.84 (n/a)	365.70 (n/a)	251.10 (n/a)	130.81 (n/a)

test_strided_copy[kv_slot0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.49 (-21.22%)	0.35 (-28.75%)	0.34 (-30.82%)	0.24 (-24.01%)	0.10 (-8.30%)	549.80 (+31.59%)	401.06 (+42.84%)	384.80 (+44.55%)	272.00 (+26.98%)	117.13 (+46.82%)
`deb6e1e` — 2026-09-03 22:38:33	0.62 (n/a)	0.50 (n/a)	0.50 (n/a)	0.32 (n/a)	0.11 (n/a)	417.80 (n/a)	280.78 (n/a)	266.20 (n/a)	214.20 (n/a)	79.78 (n/a)

test_strided_copy[kv_slot5]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.54 (+5.11%)	0.42 (+13.29%)	0.43 (+46.26%)	0.33 (+26.00%)	0.09 (-30.65%)	401.40 (-20.64%)	322.46 (-16.11%)	306.60 (-31.62%)	242.60 (-4.86%)	64.73 (-44.42%)
`deb6e1e` — 2026-09-03 22:38:33	0.52 (n/a)	0.37 (n/a)	0.29 (n/a)	0.26 (n/a)	0.12 (n/a)	505.80 (n/a)	384.38 (n/a)	448.40 (n/a)	255.00 (n/a)	116.45 (n/a)

test_strided_copy[kv_slot5_four_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.43 (-24.82%)	0.29 (-35.99%)	0.29 (-40.02%)	0.05 (-80.84%)	0.15 (+40.32%)	2498.10 (+421.85%)	812.18 (+164.95%)	457.50 (+66.73%)	308.70 (+33.00%)	946.06 (+863.64%)
`deb6e1e` — 2026-09-03 22:38:33	0.57 (n/a)	0.46 (n/a)	0.48 (n/a)	0.28 (n/a)	0.11 (n/a)	478.70 (n/a)	306.54 (n/a)	274.40 (n/a)	232.10 (n/a)	98.18 (n/a)

test_strided_copy[kv_slot5_two_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.67 (+48.34%)	0.37 (-5.67%)	0.32 (-25.66%)	0.16 (-48.36%)	0.21 (+230.02%)	829.10 (+93.67%)	456.38 (+34.21%)	414.90 (+34.53%)	196.00 (-32.60%)	253.57 (+329.25%)
`deb6e1e` — 2026-09-03 22:38:33	0.45 (n/a)	0.40 (n/a)	0.43 (n/a)	0.31 (n/a)	0.06 (n/a)	428.10 (n/a)	340.06 (n/a)	308.40 (n/a)	290.80 (n/a)	59.07 (n/a)

test_strided_copy[kv_slot_last]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.57 (+1.40%)	0.39 (-14.92%)	0.44 (-11.19%)	0.22 (-12.35%)	0.15 (+26.37%)	589.80 (+14.08%)	388.24 (+24.17%)	303.60 (+12.61%)	233.40 (-1.35%)	161.27 (+39.91%)
`deb6e1e` — 2026-09-03 22:38:33	0.56 (n/a)	0.46 (n/a)	0.49 (n/a)	0.26 (n/a)	0.12 (n/a)	517.00 (n/a)	312.68 (n/a)	269.60 (n/a)	236.60 (n/a)	115.27 (n/a)

test_strided_copy[two_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.02 (+16.66%)	0.01 (+22.28%)	0.01 (+16.32%)	0.01 (+20.47%)	0.00 (+16.82%)	476.10 (-16.98%)	351.74 (-18.43%)	339.30 (-14.04%)	241.40 (-14.28%)	97.44 (-18.52%)
`deb6e1e` — 2026-09-03 22:38:33	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	573.50 (n/a)	431.22 (n/a)	394.70 (n/a)	281.60 (n/a)	119.59 (n/a)

test_strided_copy[two_channels_chunked]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.01 (+8.94%)	0.01 (+20.88%)	0.01 (+29.53%)	0.01 (-0.18%)	0.00 (+21.29%)	463.80 (+0.17%)	347.84 (-16.53%)	335.10 (-22.79%)	276.70 (-8.20%)	75.24 (+13.08%)
`deb6e1e` — 2026-09-03 22:38:33	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	463.00 (n/a)	416.70 (n/a)	434.00 (n/a)	301.40 (n/a)	66.54 (n/a)

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]

No metrics available.

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.00 (-28.57%)	0.00 (-26.09%)	0.00 (-40.00%)	0.00 (+0.00%)	0.00 (-39.58%)	19199.81 (-10.35%)	13638.91 (+15.69%)	16379.01 (+110.52%)	7590.75 (+32.83%)	5519.28 (-26.41%)
`deb6e1e` — 2026-09-03 22:38:33	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	21415.50 (n/a)	11789.16 (n/a)	7780.39 (n/a)	5714.62 (n/a)	7500.24 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.00 (-15.38%)	0.00 (-15.00%)	0.00 (-16.67%)	0.00 (-20.00%)	0.00 (-8.58%)	20343.10 (+14.40%)	14488.81 (+15.10%)	17229.45 (+15.75%)	7629.34 (+25.54%)	6058.65 (+11.81%)
`deb6e1e` — 2026-09-03 22:38:33	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	17782.76 (n/a)	12587.83 (n/a)	14885.21 (n/a)	6077.00 (n/a)	5418.64 (n/a)

iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	0.11 (-23.76%)	0.09 (-0.22%)	0.09 (+17.49%)	0.07 (+0.42%)	0.01 (-49.79%)	29300.93 (-0.33%)	23758.56 (-3.76%)	22617.68 (-14.90%)	19171.47 (+31.15%)	4045.03 (-29.91%)
`deb6e1e` — 2026-09-03 22:38:33	0.14 (n/a)	0.09 (n/a)	0.08 (n/a)	0.07 (n/a)	0.03 (n/a)	29397.45 (n/a)	24686.08 (n/a)	26578.49 (n/a)	14617.47 (n/a)	5771.46 (n/a)

iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	1.49 (-19.42%)	1.17 (-13.87%)	1.00 (-39.90%)	0.94 (+32.94%)	0.27 (-47.87%)	557.00 (-24.78%)	466.90 (+4.25%)	525.60 (+66.43%)	352.30 (+24.09%)	99.71 (-51.29%)
`deb6e1e` — 2026-09-03 22:38:33	1.85 (n/a)	1.36 (n/a)	1.66 (n/a)	0.71 (n/a)	0.52 (n/a)	740.50 (n/a)	447.88 (n/a)	315.80 (n/a)	283.90 (n/a)	204.70 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	2.72 (-11.23%)	1.70 (-13.15%)	1.72 (+23.56%)	0.30 (-77.96%)	0.98 (+20.56%)	3485.30 (+353.82%)	1145.68 (+89.16%)	609.20 (-19.06%)	385.50 (+12.65%)	1319.70 (+519.57%)
`deb6e1e` — 2026-09-03 22:38:33	3.06 (n/a)	1.96 (n/a)	1.39 (n/a)	1.37 (n/a)	0.81 (n/a)	768.00 (n/a)	605.68 (n/a)	752.70 (n/a)	342.20 (n/a)	213.00 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`4bb8427` — 2026-06-25 20:01:37	1.58 (-2.67%)	1.21 (+5.65%)	1.29 (+41.89%)	0.66 (-20.05%)	0.38 (-2.53%)	792.90 (+25.08%)	479.12 (-3.80%)	406.80 (-29.52%)	331.10 (+2.76%)	189.18 (+26.62%)
`4bb8427` — 2026-06-23 22:46:49	1.63 (n/a)	1.14 (n/a)	0.91 (n/a)	0.83 (n/a)	0.38 (n/a)	633.90 (n/a)	498.02 (n/a)	577.20 (n/a)	322.20 (n/a)	149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`22b7d95` — 2026-09-08 21:37:29	1.96 (+0.27%)	1.43 (+7.89%)	1.60 (+18.11%)	0.87 (+8.00%)	0.46 (+8.16%)	600.50 (-7.40%)	403.52 (-6.34%)	327.50 (-15.33%)	267.10 (-0.26%)	143.44 (+1.14%)
`deb6e1e` — 2026-09-03 22:38:33	1.96 (n/a)	1.32 (n/a)	1.36 (n/a)	0.81 (n/a)	0.42 (n/a)	648.50 (n/a)	430.84 (n/a)	386.80 (n/a)	267.80 (n/a)	141.82 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`4bb8427` — 2026-06-25 20:01:37	1.75 (-15.44%)	1.32 (-0.50%)	1.36 (+22.47%)	0.77 (-19.20%)	0.36 (-21.75%)	678.10 (+23.76%)	430.02 (-0.09%)	385.10 (-18.34%)	300.10 (+18.29%)	146.96 (+19.46%)
`4bb8427` — 2026-06-23 22:46:49	2.07 (n/a)	1.32 (n/a)	1.11 (n/a)	0.96 (n/a)	0.46 (n/a)	547.90 (n/a)	430.40 (n/a)	471.60 (n/a)	253.70 (n/a)	123.02 (n/a)

Phoenix - Examples

IRON

Tested on 2026_09_08_21_51_33 at commit 22b7d95.

Trends:

IRON Trends

github-actions · 2026-09-08T21:24:04Z

CI Test Results

b9b371d (2026_09_08_21_23_32)

IRON - CI Summary

Examples

iron/applications/llama_3.2_1b

Test	Krackan Status	Krackan	Phoenix Status	Phoenix
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]	✅	-	-	-

Small

iron/operators/axpy

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]	-	-	✅	282.98
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]	-	-	✅	357.14
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]	-	-	✅	489.32

iron/operators/dequant

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]	-	-	✅	418.34
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]	-	-	✅	401.00
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]	-	-	✅	360.38
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]	-	-	✅	403.52
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]	-	-	✅	455.92
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]	-	-	✅	450.70

iron/operators/elementwise_add

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]	-	-	✅	293.86
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]	-	-	✅	428.18
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]	-	-	✅	463.88

iron/operators/elementwise_mul

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]	-	-	✅	414.00
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]	-	-	✅	787.04
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]	-	-	✅	435.90

iron/operators/gelu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	464.42
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	427.82
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	312.28
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	388.94
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	331.38
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	432.04

iron/operators/gemm

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]	-	-	✅	630.02
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]	-	-	✅	949.74
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	-	-	✅	82870.96
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	-	-	✅	25109.82
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]	-	-	✅	3787.04
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]	-	-	✅	6204.66

iron/operators/gemv

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	-	-	✅	0.08
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	-	-	✅	3.67
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]	-	-	✅	6.61
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]	-	-	✅	12.57
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	-	-	✅	3.63
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]	-	-	✅	6.60
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]	-	-	✅	12.15
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]	-	-	✅	2.06
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]	-	-	✅	0.33
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]	-	-	✅	0.54
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]	-	-	✅	1.28
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	-	-	❌	-
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	-	-	❌	-
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	-	-	❌	-
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_ln-norm_ref_<function layer_norm_ref at 0x796408e4ab60>]	-	-	❌	0.08
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_rms-norm_ref_<function rms_norm_ref at 0x796408e4aac0>]	-	-	✅	0.07
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_ln-norm_ref_<function layer_norm_ref at 0x796408e4ab60>]	-	-	❌	-
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_rms-norm_ref_<function rms_norm_ref at 0x796408e4aac0>]	-	-	❌	-
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_ln-norm_ref_<function layer_norm_ref at 0x796408e4ab60>]	-	-	❌	3.64
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_rms-norm_ref_<function rms_norm_ref at 0x796408e4aac0>]	-	-	❌	3.74

iron/operators/layer_norm

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	363.96
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	419.74
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	605.68
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	377.76
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	416.30
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	450.78

iron/operators/leaky_relu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]	-	-	✅	324.62
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]	-	-	✅	394.08
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]	-	-	✅	411.20
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]	-	-	✅	458.16
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]	-	-	✅	414.64
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]	-	-	✅	428.10
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]	-	-	✅	722.34
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]	-	-	✅	847.00

iron/operators/mem_copy

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]	-	-	✅	332.72
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]	-	-	✅	799.04
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]	-	-	✅	439.14
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]	-	-	✅	655.78
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]	-	-	✅	501.10
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]	-	-	✅	467.42

iron/operators/relu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	313.86
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	471.26
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	313.18
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	695.50
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	604.24
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	495.24

iron/operators/repeat

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]	-	-	✅	-
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]	-	-	✅	-
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]	-	-	✅	-
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]	-	-	✅	322.48
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]	-	-	✅	639.80
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]	-	-	✅	313.56

iron/operators/rms_norm

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]	-	-	✅	407.88
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]	-	-	✅	397.82
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]	-	-	✅	522.60
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]	-	-	✅	501.66
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]	-	-	✅	410.88
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]	-	-	✅	823.08
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]	-	-	✅	490.82
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]	-	-	✅	495.94
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]	-	-	✅	318.64
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]	-	-	✅	486.64
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]	-	-	✅	751.92

iron/operators/rope

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]	-	-	✅	673.20
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]	-	-	✅	670.78
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]	-	-	✅	464.12
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]	-	-	✅	345.18
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]	-	-	✅	486.28
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]	-	-	✅	722.46

iron/operators/sigmoid

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	479.90
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	425.02
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	446.18
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	462.40
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	391.76
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	554.66

iron/operators/silu

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	325.98
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	487.80
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	680.70

iron/operators/softmax

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]	-	-	✅	421.34
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]	-	-	✅	379.66
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	441.24

iron/operators/strided_copy

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_strided_copy[chunked_transfer]	-	-	✅	314.70
test_strided_copy[contiguous]	-	-	✅	401.74
test_strided_copy[four_channels]	-	-	✅	315.26
test_strided_copy[kv_slot0]	-	-	✅	300.46
test_strided_copy[kv_slot5]	-	-	✅	352.72
test_strided_copy[kv_slot5_four_channels]	-	-	✅	429.38
test_strided_copy[kv_slot5_two_channels]	-	-	✅	465.10
test_strided_copy[kv_slot_last]	-	-	✅	387.38
test_strided_copy[two_channels]	-	-	✅	303.42
test_strided_copy[two_channels_chunked]	-	-	✅	660.72
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]	-	-	✅	-
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]	-	-	✅	-

iron/operators/swiglu_decode

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]	-	-	✅	16817.51
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]	-	-	✅	15050.28

iron/operators/swiglu_prefill

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]	-	-	✅	18639.80

iron/operators/tanh

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	-	-	✅	373.98
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	-	-	✅	506.12
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	-	-	✅	472.00
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	-	-	✅	510.92
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	-	-	✅	478.82
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	-	-	✅	451.46

iron/operators/transpose

Test	Krackan Status	Krackan	Phoenix Status	Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]	-	-	✅	408.98
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]	-	-	✅	1114.96
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]	-	-	✅	513.74

Krackan - Examples

IRON

Tested on 2026_09_08_21_23_32 at commit b9b371d.

iron/applications/llama_3.2_1b

Test	Checks	TTFT (mean)	TPS (mean)
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]	✅ 5/5	2.07	n/a
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]	✅ 5/5	2.11	7.82
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]	✅ 5/5	2.02	n/a
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]	✅ 5/5	2.02	7.60

Trends:

IRON Trends

iron/applications/llama_3.2_1b

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`b9b371d` — 2026-09-08 21:18:16	2.09 (+0.38%)	2.07 (+0.32%)	2.07 (+0.29%)	2.06 (+0.34%)	0.02 (-0.87%)
`deb6e1e` — 2026-09-03 22:57:17	2.09 (n/a)	2.07 (n/a)	2.07 (n/a)	2.05 (n/a)	0.02 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`b9b371d` — 2026-09-08 21:18:16	7.87 (+0.19%)	7.82 (+0.02%)	7.82 (-0.10%)	7.78 (-0.12%)	0.04 (+56.62%)	2.20 (+1.57%)	2.11 (+0.73%)	2.09 (+0.00%)	2.07 (+0.98%)	0.05 (+16.56%)
`deb6e1e` — 2026-09-03 22:57:17	7.85 (n/a)	7.82 (n/a)	7.83 (n/a)	7.79 (n/a)	0.02 (n/a)	2.17 (n/a)	2.09 (n/a)	2.09 (n/a)	2.05 (n/a)	0.05 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`b9b371d` — 2026-09-08 21:18:16	2.05 (+0.34%)	2.02 (-0.35%)	2.02 (-0.44%)	2.00 (-0.50%)	0.02 (+79.49%)
`deb6e1e` — 2026-09-03 22:57:17	2.04 (n/a)	2.03 (n/a)	2.03 (n/a)	2.01 (n/a)	0.01 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`b9b371d` — 2026-09-08 21:18:16	7.61 (-0.21%)	7.60 (-0.15%)	7.60 (-0.09%)	7.57 (-0.20%)	0.02 (+9.28%)	2.05 (-0.24%)	2.02 (-0.41%)	2.04 (+0.34%)	1.99 (-0.70%)	0.03 (+63.95%)
`deb6e1e` — 2026-09-03 22:57:17	7.63 (n/a)	7.61 (n/a)	7.61 (n/a)	7.58 (n/a)	0.02 (n/a)	2.05 (n/a)	2.03 (n/a)	2.03 (n/a)	2.00 (n/a)	0.02 (n/a)

Phoenix - Small

IRON

Tested on 2026_09_08_21_23_04 at commit b9b371d.

iron/operators/axpy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]	✅ 5/5	282.98	0.04	n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]	✅ 5/5	357.14	0.04	n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]	✅ 5/5	489.32	0.03	n/a

iron/operators/dequant

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]	✅ 5/5	418.34	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]	✅ 5/5	401.00	0.01	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]	✅ 5/5	360.38	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]	✅ 5/5	403.52	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]	✅ 5/5	455.92	0.01	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]	✅ 5/5	450.70	0.01	n/a

iron/operators/elementwise_add

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	293.86	0.04	n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	428.18	0.03	n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	463.88	0.03	n/a

iron/operators/elementwise_mul

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	414.00	0.03	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	787.04	0.02	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	435.90	0.03	n/a

iron/operators/gelu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	464.42	0.02	n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	427.82	0.02	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	312.28	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	388.94	0.02	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	331.38	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	432.04	0.02	n/a

iron/operators/gemm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	630.02	0.47	19.94
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	949.74	0.31	13.24
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	82870.96	0.30	207.36
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	25109.82	1.00	684.32
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]	✅ 5/5	3787.04	2.32	608.66
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]	✅ 5/5	6204.66	0.21	11.15

iron/operators/gemv

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	✅ 5/5	n/a	0.08	0.08
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	✅ 5/5	n/a	3.67	3.66
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]	✅ 5/5	n/a	6.61	6.60
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]	✅ 5/5	n/a	12.57	12.56
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	3.63	3.63
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	6.60	6.59
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	12.15	12.14
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]	✅ 5/5	n/a	2.06	2.06
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]	✅ 5/5	n/a	0.33	0.33
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]	✅ 5/5	n/a	0.54	0.54
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]	✅ 5/5	n/a	1.28	1.26
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	❌ 0/5	n/a	n/a	n/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	❌ 0/5	n/a	n/a	n/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	❌ 0/5	n/a	n/a	n/a
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_ln-norm_ref_]	❌ 0/5	n/a	0.08	0.08
test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_rms-norm_ref_]	✅ 5/5	n/a	0.07	0.07
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_ln-norm_ref_]	❌ 0/5	n/a	n/a	n/a
test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_rms-norm_ref_]	❌ 0/5	n/a	n/a	n/a
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_ln-norm_ref_]	❌ 0/5	n/a	3.64	3.64
test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_rms-norm_ref_]	❌ 0/5	n/a	3.74	3.74

iron/operators/layer_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	363.96	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	419.74	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	605.68	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	377.76	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	416.30	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	450.78	0.02	n/a

iron/operators/leaky_relu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]	✅ 5/5	324.62	0.03	n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]	✅ 5/5	394.08	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]	✅ 5/5	411.20	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]	✅ 5/5	458.16	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]	✅ 5/5	414.64	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]	✅ 5/5	428.10	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]	✅ 5/5	722.34	0.02	n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]	✅ 5/5	847.00	0.01	n/a

iron/operators/mem_copy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]	✅ 5/5	332.72	0.03	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]	✅ 5/5	799.04	0.01	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]	✅ 5/5	439.14	0.02	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]	✅ 5/5	655.78	0.02	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]	✅ 5/5	501.10	0.02	n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]	✅ 5/5	467.42	0.02	n/a

iron/operators/relu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	313.86	0.03	n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	471.26	0.02	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	313.18	0.03	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	695.50	0.02	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	604.24	0.02	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	495.24	0.02	n/a

iron/operators/repeat

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]	✅ 5/5	n/a	n/a	n/a
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]	✅ 5/5	n/a	n/a	n/a
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]	✅ 5/5	n/a	n/a	n/a
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]	✅ 5/5	322.48	0.08	n/a
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]	✅ 5/5	639.80	0.12	n/a
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]	✅ 5/5	313.56	0.02	n/a

iron/operators/rms_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]	✅ 5/5	407.88	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]	✅ 5/5	397.82	0.03	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]	✅ 5/5	522.60	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]	✅ 5/5	501.66	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]	✅ 5/5	410.88	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]	✅ 5/5	823.08	0.03	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]	✅ 5/5	490.82	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]	✅ 5/5	495.94	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]	✅ 5/5	318.64	0.03	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]	✅ 5/5	486.64	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]	✅ 5/5	751.92	0.02	n/a

iron/operators/rope

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]	✅ 5/5	673.20	0.25	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]	✅ 5/5	670.78	0.23	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]	✅ 5/5	464.12	0.23	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]	✅ 5/5	345.18	0.23	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]	✅ 5/5	486.28	0.17	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]	✅ 5/5	722.46	0.15	n/a

iron/operators/sigmoid

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	479.90	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	425.02	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	446.18	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	462.40	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	391.76	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	554.66	0.02	n/a

iron/operators/silu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	325.98	0.03	n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	487.80	0.02	n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	680.70	0.02	n/a

iron/operators/softmax

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]	✅ 5/5	421.34	0.34	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]	✅ 5/5	379.66	0.38	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	441.24	0.35	n/a

iron/operators/strided_copy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_strided_copy[chunked_transfer]	✅ 5/5	314.70	0.01	n/a
test_strided_copy[contiguous]	✅ 5/5	401.74	0.01	n/a
test_strided_copy[four_channels]	✅ 5/5	315.26	0.01	n/a
test_strided_copy[kv_slot0]	✅ 5/5	300.46	0.48	n/a
test_strided_copy[kv_slot5]	✅ 5/5	352.72	0.40	n/a
test_strided_copy[kv_slot5_four_channels]	✅ 5/5	429.38	0.33	n/a
test_strided_copy[kv_slot5_two_channels]	✅ 5/5	465.10	0.33	n/a
test_strided_copy[kv_slot_last]	✅ 5/5	387.38	0.35	n/a
test_strided_copy[two_channels]	✅ 5/5	303.42	0.01	n/a
test_strided_copy[two_channels_chunked]	✅ 5/5	660.72	0.01	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]	✅ 1/1	n/a	n/a	n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]	✅ 1/1	n/a	n/a	n/a

iron/operators/swiglu_decode

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]	✅ 5/5	16817.51	0.00	n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]	✅ 5/5	15050.28	0.00	n/a

iron/operators/swiglu_prefill

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]	✅ 5/5	18639.80	0.12	n/a

iron/operators/tanh

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	373.98	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	506.12	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	472.00	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	510.92	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	478.82	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	451.46	0.02	n/a

iron/operators/transpose

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]	✅ 5/5	408.98	1.38	n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]	✅ 5/5	1114.96	1.68	n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]	✅ 5/5	513.74	1.16	n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.05 (-2.46%)	0.04 (+29.64%)	0.04 (+51.78%)	0.04 (+80.19%)	0.00 (-75.49%)	310.50 (-44.50%)	282.98 (-30.31%)	278.00 (-34.12%)	260.40 (+2.56%)	19.97 (-85.76%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	559.50 (n/a)	406.08 (n/a)	422.00 (n/a)	253.90 (n/a)	140.18 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.05 (-19.94%)	0.04 (+8.31%)	0.04 (+96.59%)	0.02 (+93.17%)	0.01 (-47.59%)	543.20 (-48.24%)	357.14 (-30.88%)	275.50 (-49.13%)	251.10 (+24.93%)	131.86 (-62.02%)
`deb6e1e` — 2026-09-03 22:38:33	0.06 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	0.02 (n/a)	1049.40 (n/a)	516.68 (n/a)	541.60 (n/a)	201.00 (n/a)	347.21 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.06 (+22.88%)	0.03 (-9.39%)	0.02 (-28.51%)	0.02 (-11.15%)	0.02 (+41.70%)	660.60 (+12.54%)	489.32 (+18.11%)	538.10 (+39.88%)	207.20 (-18.62%)	181.47 (+21.65%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	587.00 (n/a)	414.30 (n/a)	384.70 (n/a)	254.60 (n/a)	149.17 (n/a)

iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-29.39%)	0.02 (-33.23%)	0.01 (-40.33%)	0.01 (-58.74%)	0.01 (+9.39%)	773.60 (+142.36%)	418.34 (+74.77%)	406.90 (+67.59%)	216.10 (+41.61%)	225.53 (+262.45%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	319.20 (n/a)	239.36 (n/a)	242.80 (n/a)	152.60 (n/a)	62.22 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-36.23%)	0.01 (-23.68%)	0.01 (-24.69%)	0.01 (-7.01%)	0.00 (-58.54%)	527.60 (+7.54%)	401.00 (+20.16%)	358.20 (+32.77%)	325.10 (+56.83%)	87.47 (-33.96%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	490.60 (n/a)	333.72 (n/a)	269.80 (n/a)	207.30 (n/a)	132.45 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-15.34%)	0.02 (-22.43%)	0.02 (-24.56%)	0.01 (-26.78%)	0.00 (+21.18%)	451.90 (+36.57%)	360.38 (+31.14%)	346.00 (+32.57%)	283.30 (+18.14%)	70.28 (+94.69%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.00 (n/a)	330.90 (n/a)	274.80 (n/a)	261.00 (n/a)	239.80 (n/a)	36.10 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (+28.17%)	0.02 (+41.42%)	0.01 (+11.26%)	0.01 (+241.02%)	0.01 (+8.02%)	554.10 (-70.68%)	403.52 (-49.58%)	507.60 (-10.13%)	189.90 (-22.01%)	184.55 (-73.03%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	0.01 (n/a)	1889.60 (n/a)	800.34 (n/a)	564.80 (n/a)	243.50 (n/a)	684.35 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-5.85%)	0.01 (-12.40%)	0.01 (+4.42%)	0.01 (-18.47%)	0.00 (-17.17%)	633.20 (+22.67%)	455.92 (+12.26%)	463.10 (-4.24%)	270.80 (+6.24%)	128.65 (+1.82%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	516.20 (n/a)	406.14 (n/a)	483.60 (n/a)	254.90 (n/a)	126.36 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (+4.83%)	0.01 (-13.51%)	0.01 (-24.51%)	0.01 (+5.60%)	0.01 (-3.67%)	668.80 (-5.31%)	450.70 (+12.07%)	438.00 (+32.49%)	234.30 (-4.60%)	155.35 (-17.75%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	706.30 (n/a)	402.16 (n/a)	330.60 (n/a)	245.60 (n/a)	188.89 (n/a)

iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.06 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	416.30 (n/a)	293.86 (n/a)	269.10 (n/a)	201.80 (n/a)	79.42 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	625.30 (n/a)	428.18 (n/a)	436.10 (n/a)	274.20 (n/a)	135.58 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	655.40 (n/a)	463.88 (n/a)	453.00 (n/a)	293.00 (n/a)	129.25 (n/a)

iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.06 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	523.80 (n/a)	414.00 (n/a)	507.90 (n/a)	211.20 (n/a)	144.44 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	1950.90 (n/a)	787.04 (n/a)	591.90 (n/a)	291.00 (n/a)	663.06 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	717.80 (n/a)	435.90 (n/a)	374.70 (n/a)	249.40 (n/a)	188.12 (n/a)

iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	631.80 (n/a)	464.42 (n/a)	445.90 (n/a)	300.10 (n/a)	122.83 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	553.20 (n/a)	427.82 (n/a)	441.60 (n/a)	242.60 (n/a)	117.28 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	478.70 (n/a)	312.28 (n/a)	281.60 (n/a)	234.50 (n/a)	95.82 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	504.50 (n/a)	388.94 (n/a)	362.60 (n/a)	264.00 (n/a)	105.93 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	470.80 (n/a)	331.38 (n/a)	290.00 (n/a)	204.00 (n/a)	124.93 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	608.10 (n/a)	432.04 (n/a)	401.30 (n/a)	303.90 (n/a)	111.67 (n/a)

iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.93 (+41.41%)	0.47 (+0.76%)	0.41 (-4.00%)	0.17 (-53.14%)	0.28 (+147.84%)	1279.00 (+113.42%)	630.02 (+27.00%)	538.70 (+4.16%)	236.80 (-29.27%)	389.21 (+294.89%)	39.86 (+41.41%)	19.94 (+0.76%)	17.52 (-4.00%)	7.38 (-53.14%)	12.05 (+147.84%)
`deb6e1e` — 2026-09-03 22:38:33	0.66 (n/a)	0.46 (n/a)	0.43 (n/a)	0.37 (n/a)	0.11 (n/a)	599.30 (n/a)	496.08 (n/a)	517.20 (n/a)	334.80 (n/a)	98.56 (n/a)	28.19 (n/a)	19.79 (n/a)	18.25 (n/a)	15.75 (n/a)	4.86 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.47 (-16.39%)	0.31 (-26.10%)	0.35 (-16.24%)	0.12 (-64.86%)	0.16 (+75.14%)	1865.60 (+184.61%)	949.74 (+74.22%)	626.00 (+19.40%)	475.30 (+19.60%)	608.27 (+459.66%)	19.85 (-16.39%)	13.24 (-26.10%)	15.08 (-16.24%)	5.06 (-64.86%)	6.71 (+75.14%)
`deb6e1e` — 2026-09-03 22:38:33	0.56 (n/a)	0.42 (n/a)	0.42 (n/a)	0.34 (n/a)	0.09 (n/a)	655.50 (n/a)	545.14 (n/a)	524.30 (n/a)	397.40 (n/a)	108.69 (n/a)	23.74 (n/a)	17.91 (n/a)	18.00 (n/a)	14.40 (n/a)	3.83 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.31 (+1.04%)	0.30 (+0.14%)	0.30 (-0.26%)	0.30 (-0.68%)	0.01 (+19.37%)	85022.30 (+0.69%)	82870.96 (-0.13%)	82961.50 (+0.26%)	80840.50 (-1.03%)	1508.32 (+18.95%)	212.52 (+1.04%)	207.36 (+0.14%)	207.08 (-0.26%)	202.06 (-0.68%)	3.77 (+19.37%)
`deb6e1e` — 2026-09-03 22:38:33	0.31 (n/a)	0.30 (n/a)	0.30 (n/a)	0.30 (n/a)	0.00 (n/a)	84441.40 (n/a)	82982.52 (n/a)	82742.70 (n/a)	81682.30 (n/a)	1268.00 (n/a)	210.33 (n/a)	207.07 (n/a)	207.63 (n/a)	203.45 (n/a)	3.16 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	1.02 (-0.43%)	1.00 (-1.04%)	1.00 (-1.65%)	0.98 (-1.45%)	0.02 (+49.09%)	25622.60 (+1.47%)	25109.82 (+1.06%)	25214.60 (+1.67%)	24649.40 (+0.43%)	386.26 (+51.47%)	696.97 (-0.43%)	684.32 (-1.04%)	681.35 (-1.65%)	670.50 (-1.45%)	10.52 (+49.09%)
`deb6e1e` — 2026-09-03 22:38:33	1.03 (n/a)	1.01 (n/a)	1.01 (n/a)	1.00 (n/a)	0.01 (n/a)	25251.20 (n/a)	24846.02 (n/a)	24799.50 (n/a)	24544.40 (n/a)	255.00 (n/a)	699.95 (n/a)	691.51 (n/a)	692.75 (n/a)	680.36 (n/a)	7.06 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	3.69 (+0.98%)	2.32 (-17.93%)	2.18 (-25.57%)	1.50 (-23.21%)	0.83 (-1.65%)	5370.60 (+30.23%)	3787.04 (+23.05%)	3703.00 (+34.35%)	2181.90 (-0.97%)	1154.81 (+20.04%)	968.83 (+0.98%)	608.66 (-17.93%)	570.87 (-25.57%)	393.61 (-23.21%)	216.86 (-1.65%)
`deb6e1e` — 2026-09-03 22:38:33	3.66 (n/a)	2.83 (n/a)	2.92 (n/a)	1.95 (n/a)	0.84 (n/a)	4124.00 (n/a)	3077.52 (n/a)	2756.20 (n/a)	2203.30 (n/a)	962.01 (n/a)	959.42 (n/a)	741.61 (n/a)	766.98 (n/a)	512.59 (n/a)	220.50 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.28 (+15.14%)	0.21 (+0.12%)	0.19 (-7.32%)	0.17 (-6.08%)	0.04 (+63.79%)	7451.90 (+6.47%)	6204.66 (+1.60%)	6393.70 (+7.90%)	4460.40 (-13.15%)	1112.93 (+44.52%)	15.05 (+15.14%)	11.15 (+0.12%)	10.50 (-7.32%)	9.01 (-6.08%)	2.32 (+63.79%)
`deb6e1e` — 2026-09-03 22:38:33	0.24 (n/a)	0.21 (n/a)	0.21 (n/a)	0.18 (n/a)	0.03 (n/a)	6999.10 (n/a)	6106.98 (n/a)	5925.70 (n/a)	5135.70 (n/a)	770.08 (n/a)	13.07 (n/a)	11.13 (n/a)	11.33 (n/a)	9.59 (n/a)	1.42 (n/a)

iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.12 (n/a)	0.08 (n/a)	0.08 (n/a)	0.03 (n/a)	0.03 (n/a)	0.12 (n/a)	0.08 (n/a)	0.07 (n/a)	0.03 (n/a)	0.03 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	3.86 (n/a)	3.67 (n/a)	3.70 (n/a)	3.38 (n/a)	0.18 (n/a)	3.86 (n/a)	3.66 (n/a)	3.70 (n/a)	3.37 (n/a)	0.18 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	7.46 (+0.69%)	6.61 (+2.51%)	7.09 (+5.84%)	5.65 (-0.19%)	0.86 (+12.73%)	7.45 (+0.69%)	6.60 (+2.51%)	7.08 (+5.84%)	5.65 (-0.19%)	0.86 (+12.73%)
`deb6e1e` — 2026-09-03 22:38:33	7.41 (n/a)	6.45 (n/a)	6.69 (n/a)	5.66 (n/a)	0.76 (n/a)	7.40 (n/a)	6.44 (n/a)	6.69 (n/a)	5.66 (n/a)	0.76 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	14.00 (+38.00%)	12.57 (+43.47%)	13.51 (+59.01%)	8.25 (+0.61%)	2.42 (+208.52%)	13.99 (+38.00%)	12.56 (+43.47%)	13.50 (+59.01%)	8.25 (+0.61%)	2.42 (+208.52%)
`deb6e1e` — 2026-09-03 22:38:33	10.15 (n/a)	8.76 (n/a)	8.50 (n/a)	8.20 (n/a)	0.78 (n/a)	10.14 (n/a)	8.75 (n/a)	8.49 (n/a)	8.20 (n/a)	0.78 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	3.79 (n/a)	3.63 (n/a)	3.66 (n/a)	3.33 (n/a)	0.18 (n/a)	3.79 (n/a)	3.63 (n/a)	3.66 (n/a)	3.32 (n/a)	0.18 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	7.60 (+1.43%)	6.60 (-0.36%)	7.06 (+8.17%)	5.27 (-8.65%)	0.99 (+49.83%)	7.59 (+1.43%)	6.59 (-0.36%)	7.05 (+8.17%)	5.27 (-8.65%)	0.99 (+49.83%)
`deb6e1e` — 2026-09-03 22:38:33	7.49 (n/a)	6.62 (n/a)	6.52 (n/a)	5.77 (n/a)	0.66 (n/a)	7.49 (n/a)	6.62 (n/a)	6.52 (n/a)	5.77 (n/a)	0.66 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	14.12 (+0.50%)	12.15 (-3.12%)	14.05 (+2.33%)	9.18 (+22.26%)	2.66 (-5.71%)	14.12 (+0.50%)	12.14 (-3.12%)	14.04 (+2.33%)	9.17 (+22.26%)	2.66 (-5.71%)
`deb6e1e` — 2026-09-03 22:38:33	14.05 (n/a)	12.54 (n/a)	13.73 (n/a)	7.51 (n/a)	2.82 (n/a)	14.05 (n/a)	12.54 (n/a)	13.72 (n/a)	7.50 (n/a)	2.82 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	3.00 (-4.83%)	2.06 (-18.10%)	1.69 (-44.44%)	1.04 (-4.41%)	0.85 (-3.76%)	2.99 (-4.83%)	2.06 (-18.10%)	1.68 (-44.44%)	1.04 (-4.41%)	0.85 (-3.76%)
`deb6e1e` — 2026-09-03 22:38:33	3.15 (n/a)	2.52 (n/a)	3.04 (n/a)	1.09 (n/a)	0.89 (n/a)	3.14 (n/a)	2.51 (n/a)	3.03 (n/a)	1.09 (n/a)	0.89 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.57 (+0.20%)	0.33 (-10.03%)	0.36 (+2.10%)	0.08 (-1.82%)	0.18 (-9.09%)	0.56 (+0.20%)	0.33 (-10.03%)	0.35 (+2.10%)	0.07 (-1.82%)	0.18 (-9.09%)
`deb6e1e` — 2026-09-03 22:38:33	0.57 (n/a)	0.37 (n/a)	0.35 (n/a)	0.08 (n/a)	0.20 (n/a)	0.56 (n/a)	0.37 (n/a)	0.34 (n/a)	0.08 (n/a)	0.20 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.67 (-8.26%)	0.54 (+32.74%)	0.53 (+14.20%)	0.39 (+404.28%)	0.12 (-50.74%)	0.66 (-8.26%)	0.54 (+32.74%)	0.52 (+14.20%)	0.39 (+404.28%)	0.12 (-50.74%)
`deb6e1e` — 2026-09-03 22:38:33	0.73 (n/a)	0.41 (n/a)	0.46 (n/a)	0.08 (n/a)	0.24 (n/a)	0.72 (n/a)	0.41 (n/a)	0.46 (n/a)	0.08 (n/a)	0.24 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	2.50 (+1.36%)	1.28 (-19.24%)	0.79 (-55.37%)	0.44 (-0.61%)	0.98 (+27.79%)	2.46 (+1.36%)	1.26 (-19.24%)	0.78 (-55.37%)	0.43 (-0.61%)	0.96 (+27.79%)
`deb6e1e` — 2026-09-03 22:38:33	2.47 (n/a)	1.58 (n/a)	1.78 (n/a)	0.44 (n/a)	0.76 (n/a)	2.43 (n/a)	1.55 (n/a)	1.75 (n/a)	0.43 (n/a)	0.75 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_ln-norm_ref_<function layer_norm_ref at 0x796408e4ab60>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.14 (n/a)	0.08 (n/a)	0.07 (n/a)	0.05 (n/a)	0.03 (n/a)	0.13 (n/a)	0.08 (n/a)	0.07 (n/a)	0.05 (n/a)	0.03 (n/a)

test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_rms-norm_ref_<function rms_norm_ref at 0x796408e4aac0>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)

test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_ln-norm_ref_<function layer_norm_ref at 0x796408e4ab60>]

No metrics available.

test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_rms-norm_ref_<function rms_norm_ref at 0x796408e4aac0>]

No metrics available.

test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_ln-norm_ref_<function layer_norm_ref at 0x796408e4ab60>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	3.81 (n/a)	3.64 (n/a)	3.65 (n/a)	3.44 (n/a)	0.15 (n/a)	3.81 (n/a)	3.64 (n/a)	3.65 (n/a)	3.44 (n/a)	0.15 (n/a)

test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_rms-norm_ref_<function rms_norm_ref at 0x796408e4aac0>]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`b9b371d` — 2026-09-08 21:18:10	3.88 (n/a)	3.74 (n/a)	3.77 (n/a)	3.60 (n/a)	0.12 (n/a)	3.88 (n/a)	3.74 (n/a)	3.77 (n/a)	3.59 (n/a)	0.12 (n/a)

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	477.50 (n/a)	363.96 (n/a)	336.80 (n/a)	263.30 (n/a)	88.99 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	531.70 (n/a)	419.74 (n/a)	494.40 (n/a)	271.80 (n/a)	124.79 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (n/a)	0.02 (n/a)	0.03 (n/a)	0.00 (n/a)	0.01 (n/a)	1881.90 (n/a)	605.68 (n/a)	268.40 (n/a)	227.80 (n/a)	716.04 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	565.60 (n/a)	377.76 (n/a)	404.30 (n/a)	201.50 (n/a)	146.91 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	522.40 (n/a)	416.30 (n/a)	462.60 (n/a)	283.20 (n/a)	111.87 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.05 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	659.30 (n/a)	450.78 (n/a)	456.80 (n/a)	172.50 (n/a)	176.68 (n/a)

iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (+13.68%)	0.03 (+31.71%)	0.03 (+76.24%)	0.02 (+18.04%)	0.01 (-14.00%)	502.10 (-15.29%)	324.62 (-28.17%)	294.70 (-43.25%)	222.70 (-12.01%)	105.70 (-34.92%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	592.70 (n/a)	451.90 (n/a)	519.30 (n/a)	253.10 (n/a)	162.42 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-9.77%)	0.02 (+5.77%)	0.03 (+60.63%)	0.01 (-7.77%)	0.01 (-17.80%)	631.70 (+8.43%)	394.08 (-7.42%)	308.10 (-37.73%)	287.50 (+10.83%)	150.05 (-0.17%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	582.60 (n/a)	425.66 (n/a)	494.80 (n/a)	259.40 (n/a)	150.31 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-14.74%)	0.02 (-13.26%)	0.02 (-13.73%)	0.01 (-21.53%)	0.01 (-4.93%)	619.60 (+27.44%)	411.20 (+18.44%)	352.30 (+15.89%)	255.70 (+17.29%)	163.77 (+36.21%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	486.20 (n/a)	347.18 (n/a)	304.00 (n/a)	218.00 (n/a)	120.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-11.09%)	0.02 (-8.74%)	0.02 (-2.83%)	0.01 (-23.90%)	0.01 (-7.04%)	645.20 (+31.41%)	458.16 (+10.98%)	453.90 (+2.90%)	297.20 (+12.49%)	125.96 (+39.95%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	491.00 (n/a)	412.84 (n/a)	441.10 (n/a)	264.20 (n/a)	90.01 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-42.22%)	0.02 (-10.84%)	0.02 (-8.42%)	0.02 (+6.48%)	0.01 (-51.44%)	516.80 (-6.10%)	414.64 (-0.33%)	501.60 (+9.19%)	265.80 (+73.16%)	132.84 (-14.37%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.02 (n/a)	550.40 (n/a)	416.02 (n/a)	459.40 (n/a)	153.50 (n/a)	155.14 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (+88.11%)	0.02 (+22.97%)	0.02 (+0.12%)	0.02 (+10.15%)	0.01 (+351.61%)	533.00 (-9.21%)	428.10 (-12.68%)	472.60 (-0.11%)	239.30 (-46.83%)	113.12 (+102.81%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	587.10 (n/a)	490.24 (n/a)	473.10 (n/a)	450.10 (n/a)	55.77 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (+4.17%)	0.02 (+14.55%)	0.02 (-1.22%)	0.00 (+6.42%)	0.01 (+25.19%)	1897.10 (-6.03%)	722.34 (-4.99%)	513.30 (+1.22%)	240.10 (-4.00%)	683.77 (-4.13%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.00 (n/a)	0.01 (n/a)	2018.90 (n/a)	760.24 (n/a)	507.10 (n/a)	250.10 (n/a)	713.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-36.38%)	0.01 (-22.28%)	0.02 (+0.64%)	0.00 (-70.63%)	0.01 (-3.22%)	2128.70 (+240.48%)	847.00 (+65.08%)	533.10 (-0.63%)	486.10 (+57.16%)	717.43 (+447.31%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	625.20 (n/a)	513.10 (n/a)	536.50 (n/a)	309.30 (n/a)	131.08 (n/a)

iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (-2.05%)	0.03 (+2.02%)	0.03 (+5.71%)	0.02 (+20.44%)	0.01 (+4.86%)	452.10 (-16.97%)	332.72 (-2.30%)	294.20 (-5.40%)	226.80 (+2.07%)	106.73 (-11.87%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	544.50 (n/a)	340.56 (n/a)	311.00 (n/a)	222.20 (n/a)	121.11 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-48.94%)	0.01 (-45.92%)	0.01 (-39.20%)	0.00 (-71.88%)	0.01 (-42.53%)	1916.30 (+255.59%)	799.04 (+117.00%)	554.20 (+64.50%)	457.40 (+95.89%)	626.71 (+339.74%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	538.90 (n/a)	368.22 (n/a)	336.90 (n/a)	233.50 (n/a)	142.52 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-18.69%)	0.02 (-10.76%)	0.02 (+3.56%)	0.01 (+0.20%)	0.01 (-26.51%)	585.70 (-0.20%)	439.14 (+6.29%)	483.90 (-3.43%)	264.20 (+23.00%)	157.85 (-7.99%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	586.90 (n/a)	413.14 (n/a)	501.10 (n/a)	214.80 (n/a)	171.55 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-16.98%)	0.02 (-36.29%)	0.02 (-41.22%)	0.00 (-76.18%)	0.01 (+42.82%)	1841.60 (+319.79%)	655.78 (+140.16%)	398.10 (+70.13%)	269.90 (+20.44%)	669.85 (+620.78%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	438.70 (n/a)	273.06 (n/a)	234.00 (n/a)	224.10 (n/a)	92.93 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-37.65%)	0.02 (-29.64%)	0.01 (-44.61%)	0.01 (+4.24%)	0.00 (-53.19%)	584.40 (-4.06%)	501.10 (+32.79%)	563.20 (+80.51%)	388.00 (+60.40%)	101.95 (-30.42%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	609.10 (n/a)	377.36 (n/a)	312.00 (n/a)	241.90 (n/a)	146.51 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-5.62%)	0.02 (+16.29%)	0.02 (+27.49%)	0.01 (+124.89%)	0.01 (-12.81%)	812.30 (-55.53%)	467.42 (-33.55%)	403.20 (-21.57%)	274.60 (+5.94%)	225.88 (-64.63%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.00 (n/a)	0.01 (n/a)	1826.80 (n/a)	703.40 (n/a)	514.10 (n/a)	259.20 (n/a)	638.71 (n/a)

iron/operators/repeat

test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]

No metrics available.

test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.11 (-3.10%)	0.08 (+0.97%)	0.08 (-5.39%)	0.05 (+4.55%)	0.02 (+1.08%)	508.40 (-4.35%)	322.48 (-1.33%)	311.30 (+5.70%)	233.40 (+3.18%)	110.48 (-6.35%)
`deb6e1e` — 2026-09-03 22:38:33	0.11 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	531.50 (n/a)	326.84 (n/a)	294.50 (n/a)	226.20 (n/a)	117.97 (n/a)

test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.17 (-2.78%)	0.12 (-16.59%)	0.15 (+3.93%)	0.02 (-77.31%)	0.06 (+104.75%)	1938.10 (+340.68%)	639.80 (+109.74%)	280.30 (-3.78%)	240.00 (+2.87%)	733.27 (+808.24%)
`deb6e1e` — 2026-09-03 22:38:33	0.18 (n/a)	0.14 (n/a)	0.14 (n/a)	0.09 (n/a)	0.03 (n/a)	439.80 (n/a)	305.04 (n/a)	291.30 (n/a)	233.30 (n/a)	80.73 (n/a)

test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (-4.11%)	0.02 (+33.05%)	0.02 (+62.90%)	0.01 (+23.07%)	0.00 (-21.26%)	471.10 (-18.75%)	313.56 (-28.59%)	279.60 (-38.60%)	239.90 (+4.26%)	95.48 (-33.53%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	579.80 (n/a)	439.12 (n/a)	455.40 (n/a)	230.10 (n/a)	143.64 (n/a)

iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-13.95%)	0.02 (-19.36%)	0.02 (-32.80%)	0.01 (-21.58%)	0.01 (-11.30%)	610.90 (+27.51%)	407.88 (+25.15%)	403.30 (+48.82%)	259.30 (+16.17%)	144.63 (+26.61%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	479.10 (n/a)	325.92 (n/a)	271.00 (n/a)	223.20 (n/a)	114.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.05 (+19.16%)	0.03 (-4.52%)	0.03 (-37.77%)	0.02 (+10.10%)	0.01 (+28.66%)	501.30 (-9.17%)	397.82 (+7.14%)	478.20 (+60.69%)	231.30 (-16.07%)	123.94 (+2.89%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	551.90 (n/a)	371.30 (n/a)	297.60 (n/a)	275.60 (n/a)	120.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (+32.95%)	0.02 (+6.58%)	0.02 (-10.76%)	0.01 (-43.93%)	0.01 (+115.03%)	1036.60 (+78.36%)	522.60 (+18.97%)	480.00 (+12.04%)	211.30 (-24.78%)	323.10 (+197.04%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	581.20 (n/a)	439.26 (n/a)	428.40 (n/a)	280.90 (n/a)	108.78 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-48.09%)	0.02 (-27.22%)	0.02 (-7.63%)	0.02 (+35.80%)	0.00 (-76.14%)	553.90 (-26.36%)	501.66 (+7.97%)	532.80 (+8.25%)	361.70 (+92.60%)	78.95 (-66.72%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	0.02 (n/a)	752.20 (n/a)	464.64 (n/a)	492.20 (n/a)	187.80 (n/a)	237.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (+25.47%)	0.02 (+24.20%)	0.02 (+10.00%)	0.01 (-0.55%)	0.01 (+94.28%)	567.80 (+0.57%)	410.88 (-13.81%)	447.80 (-9.09%)	261.20 (-20.29%)	140.22 (+51.00%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	564.60 (n/a)	476.72 (n/a)	492.60 (n/a)	327.70 (n/a)	92.86 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.07 (+54.10%)	0.03 (-4.59%)	0.02 (-39.72%)	0.00 (-75.09%)	0.03 (+103.61%)	2446.90 (+301.46%)	823.08 (+110.60%)	464.00 (+65.89%)	144.70 (-35.08%)	939.23 (+416.90%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	609.50 (n/a)	390.82 (n/a)	279.70 (n/a)	222.90 (n/a)	181.70 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.04 (-27.27%)	0.02 (-27.47%)	0.02 (-33.31%)	0.01 (-53.00%)	0.01 (-19.67%)	1064.40 (+112.75%)	490.82 (+54.17%)	416.90 (+49.96%)	224.50 (+37.56%)	337.80 (+129.48%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	500.30 (n/a)	318.36 (n/a)	278.00 (n/a)	163.20 (n/a)	147.20 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-24.47%)	0.02 (-8.66%)	0.02 (-12.11%)	0.02 (+80.18%)	0.01 (-49.83%)	575.30 (-44.50%)	495.94 (-7.17%)	530.90 (+13.78%)	322.00 (+32.40%)	102.35 (-65.51%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	1036.60 (n/a)	534.22 (n/a)	466.60 (n/a)	243.20 (n/a)	296.73 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-37.27%)	0.03 (-10.80%)	0.03 (-11.06%)	0.02 (+22.78%)	0.01 (-60.80%)	458.80 (-18.55%)	318.64 (-1.53%)	292.10 (+12.43%)	264.20 (+59.44%)	79.61 (-48.32%)
`deb6e1e` — 2026-09-03 22:38:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	563.30 (n/a)	323.58 (n/a)	259.80 (n/a)	165.70 (n/a)	154.03 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (-34.30%)	0.02 (+3.99%)	0.02 (+24.17%)	0.01 (+144.38%)	0.01 (-51.86%)	675.10 (-59.08%)	486.64 (-29.99%)	428.90 (-19.47%)	340.50 (+52.21%)	158.25 (-71.30%)
`deb6e1e` — 2026-09-03 22:38:33	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	1649.90 (n/a)	695.12 (n/a)	532.60 (n/a)	223.70 (n/a)	551.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.03 (+24.84%)	0.02 (-9.63%)	0.02 (-9.97%)	0.00 (-66.24%)	0.01 (+118.30%)	1876.00 (+196.23%)	751.92 (+58.63%)	528.60 (+11.07%)	258.90 (-19.89%)	641.60 (+483.03%)
`deb6e1e` — 2026-09-03 22:38:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	633.30 (n/a)	474.00 (n/a)	475.90 (n/a)	323.20 (n/a)	110.04 (n/a)

iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.40 (+15.02%)	0.25 (-14.68%)	0.23 (-32.58%)	0.05 (-72.19%)	0.14 (+89.84%)	1887.20 (+259.54%)	673.20 (+86.38%)	432.40 (+48.34%)	245.00 (-13.06%)	689.69 (+527.70%)
`deb6e1e` — 2026-09-03 22:38:33	0.35 (n/a)	0.29 (n/a)	0.34 (n/a)	0.19 (n/a)	0.08 (n/a)	524.90 (n/a)	361.20 (n/a)	291.50 (n/a)	281.80 (n/a)	109.88 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.35 (+16.33%)	0.23 (+5.67%)	0.23 (+12.02%)	0.05 (-70.68%)	0.12 (+151.07%)	1831.50 (+241.06%)	670.78 (+44.16%)	432.00 (-10.73%)	284.10 (-14.04%)	655.84 (+665.22%)
`deb6e1e` — 2026-09-03 22:38:33	0.30 (n/a)	0.22 (n/a)	0.20 (n/a)	0.18 (n/a)	0.05 (n/a)	537.00 (n/a)	465.30 (n/a)	483.90 (n/a)	330.50 (n/a)	85.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.35 (-2.92%)	0.23 (+8.48%)	0.20 (+3.31%)	0.15 (+278.25%)	0.07 (-35.88%)	640.50 (-73.56%)	464.12 (-43.07%)	483.50 (-3.20%)	282.80 (+3.02%)	132.77 (-85.31%)
`deb6e1e` — 2026-09-03 22:38:33	0.36 (n/a)	0.21 (n/a)	0.20 (n/a)	0.04 (n/a)	0.12 (n/a)	2422.70 (n/a)	815.30 (n/a)	499.50 (n/a)	274.50 (n/a)	903.57 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.27 (-8.74%)	0.23 (+0.85%)	0.25 (+5.07%)	0.14 (-2.15%)	0.05 (-17.01%)	515.20 (+2.20%)	345.18 (-2.38%)	290.10 (-4.82%)	274.40 (+9.58%)	100.47 (-7.25%)
`deb6e1e` — 2026-09-03 22:38:33	0.29 (n/a)	0.22 (n/a)	0.24 (n/a)	0.15 (n/a)	0.06 (n/a)	504.10 (n/a)	353.58 (n/a)	304.80 (n/a)	250.40 (n/a)	108.32 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.31 (-10.07%)	0.17 (-21.33%)	0.14 (-9.27%)	0.12 (-1.11%)	0.08 (-27.14%)	604.80 (+1.12%)	486.28 (+17.71%)	537.90 (+10.20%)	234.90 (+11.17%)	146.29 (-19.49%)
`deb6e1e` — 2026-09-03 22:38:33	0.35 (n/a)	0.22 (n/a)	0.15 (n/a)	0.12 (n/a)	0.11 (n/a)	598.10 (n/a)	413.10 (n/a)	488.10 (n/a)	211.30 (n/a)	181.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.20 (-31.01%)	0.15 (+5.94%)	0.18 (+37.82%)	0.04 (-46.57%)	0.06 (-22.39%)	1954.80 (+87.15%)	722.46 (+12.66%)	418.00 (-27.44%)	375.90 (+44.97%)	689.71 (+137.07%)
`deb6e1e` — 2026-09-03 22:38:33	0.28 (n/a)	0.14 (n/a)	0.13 (n/a)	0.07 (n/a)	0.08 (n/a)	1044.50 (n/a)	641.28 (n/a)	576.10 (n/a)	259.30 (n/a)	290.93 (n/a)

iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.51 (+3.89%)	0.34 (+0.11%)	0.30 (+5.00%)	0.24 (+11.48%)	0.12 (-10.16%)	555.70 (-10.31%)	421.34 (-2.83%)	432.70 (-4.75%)	257.50 (-3.77%)	136.89 (-14.85%)
`deb6e1e` — 2026-09-03 22:38:33	0.49 (n/a)	0.34 (n/a)	0.29 (n/a)	0.21 (n/a)	0.13 (n/a)	619.60 (n/a)	433.62 (n/a)	454.30 (n/a)	267.60 (n/a)	160.77 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.54 (+13.14%)	0.38 (+10.48%)	0.31 (-11.33%)	0.26 (+23.12%)	0.13 (+23.61%)	502.20 (-18.79%)	379.66 (-8.91%)	427.60 (+12.79%)	244.40 (-11.61%)	116.67 (-14.21%)
`deb6e1e` — 2026-09-03 22:38:33	0.47 (n/a)	0.34 (n/a)	0.35 (n/a)	0.21 (n/a)	0.10 (n/a)	618.40 (n/a)	416.80 (n/a)	379.10 (n/a)	276.50 (n/a)	135.99 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.53 (-3.36%)	0.35 (-11.42%)	0.30 (-19.20%)	0.20 (-24.37%)	0.15 (+38.06%)	667.90 (+32.23%)	441.24 (+23.49%)	431.40 (+23.79%)	245.60 (+3.45%)	183.43 (+86.71%)
`deb6e1e` — 2026-09-03 22:38:33	0.55 (n/a)	0.39 (n/a)	0.38 (n/a)	0.26 (n/a)	0.11 (n/a)	505.10 (n/a)	357.32 (n/a)	348.50 (n/a)	237.40 (n/a)	98.24 (n/a)

iron/operators/strided_copy

test_strided_copy[chunked_transfer]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (+5.80%)	0.01 (+17.11%)	0.01 (+26.52%)	0.01 (+24.32%)	0.00 (-14.04%)	394.00 (-19.58%)	314.70 (-16.68%)	297.90 (-20.96%)	241.30 (-5.48%)	64.41 (-34.28%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	489.90 (n/a)	377.72 (n/a)	376.90 (n/a)	255.30 (n/a)	98.01 (n/a)

test_strided_copy[contiguous]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.01 (-4.53%)	0.01 (+16.83%)	0.01 (+40.38%)	0.01 (+3.24%)	0.00 (+0.25%)	543.00 (-3.14%)	401.74 (-14.04%)	345.40 (-28.77%)	298.70 (+4.73%)	116.44 (+6.20%)
`deb6e1e` — 2026-09-03 22:38:33	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	560.60 (n/a)	467.36 (n/a)	484.90 (n/a)	285.20 (n/a)	109.64 (n/a)

test_strided_copy[four_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (+18.64%)	0.01 (+25.21%)	0.01 (+17.05%)	0.01 (+29.17%)	0.00 (+14.14%)	428.70 (-22.58%)	315.26 (-21.35%)	312.50 (-14.55%)	211.70 (-15.69%)	93.22 (-28.74%)
`deb6e1e` — 2026-09-03 22:38:33	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	553.70 (n/a)	400.84 (n/a)	365.70 (n/a)	251.10 (n/a)	130.81 (n/a)

test_strided_copy[kv_slot0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.66 (+7.26%)	0.48 (-2.88%)	0.49 (-0.40%)	0.27 (-15.75%)	0.14 (+26.92%)	495.90 (+18.69%)	300.46 (+7.01%)	267.30 (+0.41%)	199.70 (-6.77%)	114.08 (+43.00%)
`deb6e1e` — 2026-09-03 22:38:33	0.62 (n/a)	0.50 (n/a)	0.50 (n/a)	0.32 (n/a)	0.11 (n/a)	417.80 (n/a)	280.78 (n/a)	266.20 (n/a)	214.20 (n/a)	79.78 (n/a)

test_strided_copy[kv_slot5]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.46 (-10.57%)	0.40 (+6.10%)	0.45 (+53.79%)	0.25 (-5.12%)	0.09 (-25.62%)	533.00 (+5.38%)	352.72 (-8.24%)	291.60 (-34.97%)	285.10 (+11.80%)	105.91 (-9.05%)
`deb6e1e` — 2026-09-03 22:38:33	0.52 (n/a)	0.37 (n/a)	0.29 (n/a)	0.26 (n/a)	0.12 (n/a)	505.80 (n/a)	384.38 (n/a)	448.40 (n/a)	255.00 (n/a)	116.45 (n/a)

test_strided_copy[kv_slot5_four_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.45 (-20.80%)	0.33 (-28.07%)	0.31 (-36.37%)	0.23 (-16.34%)	0.10 (-10.73%)	572.30 (+19.55%)	429.38 (+40.07%)	431.20 (+57.14%)	293.00 (+26.24%)	123.39 (+25.69%)
`deb6e1e` — 2026-09-03 22:38:33	0.57 (n/a)	0.46 (n/a)	0.48 (n/a)	0.28 (n/a)	0.11 (n/a)	478.70 (n/a)	306.54 (n/a)	274.40 (n/a)	232.10 (n/a)	98.18 (n/a)

test_strided_copy[kv_slot5_two_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.54 (+19.57%)	0.33 (-17.82%)	0.24 (-43.53%)	0.21 (-31.20%)	0.15 (+131.42%)	622.20 (+45.34%)	465.10 (+36.77%)	546.20 (+77.11%)	243.20 (-16.37%)	171.62 (+190.52%)
`deb6e1e` — 2026-09-03 22:38:33	0.45 (n/a)	0.40 (n/a)	0.43 (n/a)	0.31 (n/a)	0.06 (n/a)	428.10 (n/a)	340.06 (n/a)	308.40 (n/a)	290.80 (n/a)	59.07 (n/a)

test_strided_copy[kv_slot_last]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.45 (-18.86%)	0.35 (-22.55%)	0.36 (-26.53%)	0.25 (-1.67%)	0.07 (-37.90%)	525.80 (+1.70%)	387.38 (+23.89%)	366.90 (+36.09%)	291.60 (+23.25%)	86.19 (-25.23%)
`deb6e1e` — 2026-09-03 22:38:33	0.56 (n/a)	0.46 (n/a)	0.49 (n/a)	0.26 (n/a)	0.12 (n/a)	517.00 (n/a)	312.68 (n/a)	269.60 (n/a)	236.60 (n/a)	115.27 (n/a)

test_strided_copy[two_channels]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (+37.86%)	0.01 (+45.46%)	0.02 (+46.23%)	0.01 (+13.83%)	0.00 (+43.97%)	503.80 (-12.15%)	303.42 (-29.64%)	269.90 (-31.62%)	204.30 (-27.45%)	115.54 (-3.38%)
`deb6e1e` — 2026-09-03 22:38:33	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	573.50 (n/a)	431.22 (n/a)	394.70 (n/a)	281.60 (n/a)	119.59 (n/a)

test_strided_copy[two_channels_chunked]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.02 (+15.06%)	0.01 (+0.67%)	0.01 (+17.21%)	0.00 (-75.31%)	0.01 (+163.30%)	1875.00 (+304.97%)	660.72 (+58.56%)	370.30 (-14.68%)	261.90 (-13.11%)	684.57 (+928.80%)
`deb6e1e` — 2026-09-03 22:38:33	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	463.00 (n/a)	416.70 (n/a)	434.00 (n/a)	301.40 (n/a)	66.54 (n/a)

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]

No metrics available.

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.00 (+0.00%)	0.00 (-30.43%)	0.00 (-60.00%)	0.00 (+0.00%)	0.00 (-13.63%)	21201.99 (-1.00%)	16817.51 (+42.65%)	20204.76 (+159.69%)	5770.81 (+0.98%)	6487.42 (-13.50%)
`deb6e1e` — 2026-09-03 22:38:33	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	21415.50 (n/a)	11789.16 (n/a)	7780.39 (n/a)	5714.62 (n/a)	7500.24 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.00 (-7.69%)	0.00 (-7.50%)	0.00 (-16.67%)	0.00 (-20.00%)	0.00 (+12.76%)	22179.53 (+24.72%)	15050.28 (+19.56%)	17841.27 (+19.86%)	6719.17 (+10.57%)	7685.71 (+41.84%)
`deb6e1e` — 2026-09-03 22:38:33	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	17782.76 (n/a)	12587.83 (n/a)	14885.21 (n/a)	6077.00 (n/a)	5418.64 (n/a)

iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	0.14 (-0.70%)	0.12 (+30.08%)	0.13 (+68.31%)	0.08 (+16.13%)	0.03 (-11.80%)	25315.24 (-13.89%)	18639.80 (-24.49%)	15794.92 (-40.57%)	14712.81 (+0.65%)	4647.91 (-19.47%)
`deb6e1e` — 2026-09-03 22:38:33	0.14 (n/a)	0.09 (n/a)	0.08 (n/a)	0.07 (n/a)	0.03 (n/a)	29397.45 (n/a)	24686.08 (n/a)	26578.49 (n/a)	14617.47 (n/a)	5771.46 (n/a)

iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	1.63 (-11.77%)	1.38 (+1.68%)	1.49 (-10.12%)	0.78 (+10.57%)	0.34 (-33.64%)	669.70 (-9.56%)	408.98 (-8.69%)	351.40 (+11.27%)	321.80 (+13.35%)	146.88 (-28.25%)
`deb6e1e` — 2026-09-03 22:38:33	1.85 (n/a)	1.36 (n/a)	1.66 (n/a)	0.71 (n/a)	0.52 (n/a)	740.50 (n/a)	447.88 (n/a)	315.80 (n/a)	283.90 (n/a)	204.70 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	2.44 (-20.41%)	1.68 (-14.10%)	1.86 (+33.75%)	0.30 (-77.90%)	0.81 (+0.31%)	3474.70 (+352.43%)	1114.96 (+84.08%)	562.80 (-25.23%)	429.90 (+25.63%)	1320.56 (+519.97%)
`deb6e1e` — 2026-09-03 22:38:33	3.06 (n/a)	1.96 (n/a)	1.39 (n/a)	1.37 (n/a)	0.81 (n/a)	768.00 (n/a)	605.68 (n/a)	752.70 (n/a)	342.20 (n/a)	213.00 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`4bb8427` — 2026-06-25 20:01:37	1.58 (-2.67%)	1.21 (+5.65%)	1.29 (+41.89%)	0.66 (-20.05%)	0.38 (-2.53%)	792.90 (+25.08%)	479.12 (-3.80%)	406.80 (-29.52%)	331.10 (+2.76%)	189.18 (+26.62%)
`4bb8427` — 2026-06-23 22:46:49	1.63 (n/a)	1.14 (n/a)	0.91 (n/a)	0.83 (n/a)	0.38 (n/a)	633.90 (n/a)	498.02 (n/a)	577.20 (n/a)	322.20 (n/a)	149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`b9b371d` — 2026-09-08 21:18:10	1.76 (-9.87%)	1.16 (-12.09%)	0.98 (-27.50%)	0.63 (-21.89%)	0.46 (+7.97%)	830.30 (+28.03%)	513.74 (+19.24%)	533.50 (+37.93%)	297.20 (+10.98%)	209.85 (+47.97%)
`deb6e1e` — 2026-09-03 22:38:33	1.96 (n/a)	1.32 (n/a)	1.36 (n/a)	0.81 (n/a)	0.42 (n/a)	648.50 (n/a)	430.84 (n/a)	386.80 (n/a)	267.80 (n/a)	141.82 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`4bb8427` — 2026-06-25 20:01:37	1.75 (-15.44%)	1.32 (-0.50%)	1.36 (+22.47%)	0.77 (-19.20%)	0.36 (-21.75%)	678.10 (+23.76%)	430.02 (-0.09%)	385.10 (-18.34%)	300.10 (+18.29%)	146.96 (+19.46%)
`4bb8427` — 2026-06-23 22:46:49	2.07 (n/a)	1.32 (n/a)	1.11 (n/a)	0.96 (n/a)	0.46 (n/a)	547.90 (n/a)	430.40 (n/a)	471.60 (n/a)	253.70 (n/a)	123.02 (n/a)

atassis requested review from andrej, hunhoffe and jgmelber as code owners August 29, 2026 08:47

andrej approved these changes Sep 8, 2026

View reviewed changes

Update iron/operators/gemv/op.py

1b7d479

andrej enabled auto-merge September 8, 2026 21:20

		# per output tile would be. Both kernels take separate in/out pointers (restrict on
		# both), so normalizing needs a second L1 buffer rather than an in-place call.

Uh oh!

Conversation

atassis commented Aug 29, 2026

Problem

Fix

Test/Evidence

Known limitations

Uh oh!

andrej left a comment

Choose a reason for hiding this comment

Uh oh!

andrej Sep 8, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions Bot commented Sep 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CI Test Results

IRON - CI Summary

Examples

Small

IRON

IRON Trends

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]

IRON

IRON Trends

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]

test_gemv_norm_prologue[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]

test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]

test_gemv_norm_prologue[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]

test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_ln-norm_ref_<function layer_norm_ref at 0x7667fa50eac0>]

test_gemv_norm_prologue[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024-prologue_rms-norm_ref_<function rms_norm_ref at 0x7667fa50ea20>]

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

github-actions Bot commented Sep 8, 2026 •

edited

Loading