Add decode dataflow fusion operators by jgmelber · Pull Request #79 · amd/IRON

jgmelber · 2026-03-07T18:27:54Z

Summary

Implements 4 new fused operators for the decode dataflow pipeline: swiglu_fused_decode (Phase 3), fused_qkv_proj (Phase 1), flowkv_decode (Phase 2), and fused_dequant_gemv (Phase 5)
Eliminates DDR round-trips for intermediate activations by keeping data on-chip via inter-tile ObjectFIFOs
Fixes static buffer overflow in dual_gemv_silu_mul kernels (1024 → 2048 elements) and adds production-scale test parameters

Test plan

dual_gemv_silu_mul — 5/5 passed (buffer overflow fix verified on hardware)
fused_qkv_proj — 5/5 passed (reuses mv.o, Llama dims M=3072 K=2048)
flowkv_decode — 5/5 passed (online softmax, 2-tile pipeline per KV head group)
fused_dequant_gemv — 5/5 passed (INT4→bf16 fused dequant+GEMV)
swiglu_fused_decode — 5/5 passed (2-stage pipeline, 1.32x speedup at Llama dims)
Run black --check . and reuse lint
Run extensive tests at Llama 3.2 1B production dimensions (2048×8192)

Hardware: AMD Ryzen AI 9 HX 370 (RyzenAI-npu4), XRT 2.21.75

Benchmark: `swiglu_fused_decode` vs `swiglu_decode` (Llama 3.2 1B dims)

Metric	Baseline (2 runlists)	Fused (1 runlist)	Improvement
Median latency	5410 µs	4103 µs	1.32x
Effective bandwidth	18.61 GB/s	24.54 GB/s	1.32x
DDR intermediate	32 KB round-trip	0 KB (on-chip)	Eliminated
16-layer MLP tok/s	11.6	15.2	+31%

🤖 Generated with Claude Code

Eliminates a full DRAM round-trip for the intermediate left_swished buffer in the SwiGLU pipeline by computing silu(x) * y in a single vectorized kernel loop. Reduces SwiGLU prefill from 5 to 4 runlist entries. New operator: AIESiLUMul with fused C++ kernels for both AIE2 (LUT tanh) and AIE2+ (hardware tanh). Integrated into swiglu_prefill. Also fixes a pre-existing bug in swiglu_prefill/test.py (errors_2 -> errors_3). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Collapses three separate NPU designs (GEMV W1, GEMV W2, SiLU+Mul) into a single fused operator. Each AIE core loads vector x once, processes both W1 and W2 rows through a shared A FIFO with pre-interleaved weights, then computes silu(left)*right entirely in L1 via kernel-local static buffers. The intermediate vectors never touch DRAM. Reduces SwiGLU decode from 4 to 2 runlist entries and eliminates the left/right buffer allocations. Uses 4 AIE columns (DMA channel limit: 2 input + 1 output per tile). Note: swiglu_prefill unchanged — uses GEMM (not GEMV) so dual-GEMV fusion does not apply. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

…on, INT4 dequant-GEMV Implements Phases 1-3 and 5 from the decode dataflow optimization plan: Phase 1 - fused_qkv_proj: Concatenates Wq+Wk+Wv into single GEMV (M=3072, K=2048), eliminating 3 redundant input vector loads. Reuses existing mv.o. Phase 2 - flowkv_decode: Streaming decode attention with online softmax. 2-tile pipeline per KV head group (score tile + value tile). Intermediates flow tile-to-tile via on-chip ObjectFIFOs. Uses aie::exp2 for safe exp. Phase 3 - swiglu_fused_decode: Complete SwiGLU fusion with 2-stage tile pipeline. Dual-GEMV+SiLU+Mul feeds directly into down-projection GEMV via inter-tile ObjectFIFO. The 32 KB intermediate never touches DDR. Host reduces 4 column partials. Benchmarked 1.32x speedup at Llama dims (5410 us -> 4103 us, 24.5 GB/s effective bandwidth). Phase 5 - fused_dequant_gemv: Fused INT4 weight dequantization + GEMV in single kernel pass. Uses proven aie::unpack chain from expand.cc for INT4->bf16 conversion. 4x DDR bandwidth reduction. Also fixes: - Static buffer overflow in dual_gemv_silu_mul (1024 -> 2048 elements) - Production-scale test params for swiglu_decode (2048, 8192) All operators verified on AMD Ryzen AI 9 HX 370 (RyzenAI-npu4) hardware. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

github-actions · 2026-03-07T18:40:58Z

📊 Test Results for Small Benchmark/Test Suite

04bb5c6 (2026_03_07_18_40_14)

IRONCLAD

Tested on 2026_03_07_18_40_14 at commit 04bb5c6.

Test	Checks	Latency (mean)	Bandwidth (mean)	GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0_0	✅ 5/5	115.78	0.12	n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0_0	✅ 5/5	105.98	0.12	n/a
axpy_4_cols_2_channels_2048_tile_512_3.0_0	✅ 5/5	114.54	0.11	n/a
axpy_8_cols_2_channels_2048_tile_256_3.0_0	✅ 5/5	128.72	0.10	n/a
dequant_1_cols_1_channels_2048_tile_2048_0	✅ 5/5	115.44	0.05	n/a
dequant_1_cols_2_channels_2048_tile_1024_0	✅ 5/5	122.18	0.04	n/a
dequant_2_cols_1_channels_2048_tile_1024_0	✅ 5/5	117.36	0.05	n/a
dequant_2_cols_2_channels_2048_tile_512_0	✅ 5/5	138.32	0.04	n/a
dequant_4_cols_1_channels_2048_tile_512_0	✅ 5/5	119.80	0.05	n/a
dequant_4_cols_2_channels_2048_tile_256_0	✅ 5/5	126.26	0.04	n/a
dequant_8_cols_1_channels_2048_tile_256_0	✅ 5/5	117.06	0.05	n/a
dequant_8_cols_2_channels_2048_tile_128_0	✅ 5/5	152.82	0.04	n/a
dual_gemv_silu_mul_2048x2048_4tsi_512tso_4col0	✅ 5/5	468.92	35.82	n/a
eltwise_add_1_cols_2_channels_2048_tile_2048	✅ 5/5	121.14	0.10	n/a
eltwise_add_2_cols_2_channels_2048_tile_1024	✅ 5/5	110.76	0.11	n/a
eltwise_add_4_cols_2_channels_2048_tile_512	✅ 5/5	111.44	0.11	n/a
eltwise_add_8_cols_2_channels_2048_tile_256	✅ 5/5	119.88	0.11	n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048	✅ 5/5	107.30	0.12	n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024	✅ 5/5	105.70	0.12	n/a
eltwise_mul_4_cols_2_channels_2048_tile_512	✅ 5/5	114.60	0.11	n/a
eltwise_mul_8_cols_2_channels_2048_tile_256	✅ 5/5	128.68	0.10	n/a
flowkv_decode_32h_8kv_64d_128s_32cs_4col0	✅ 5/5	344.74	0.78	n/a
fused_dequant_gemv_2048x2048_1tsi_512tso_4col_g32_0	✅ 5/5	1252.74	1.89	n/a
fused_qkv_proj_3072x2048_4tsi_768tso_4col0	✅ 5/5	386.02	32.73	n/a
gelu_1_cols_1_channels_2048_tile_2048	✅ 5/5	105.08	0.08	n/a
gelu_1_cols_2_channels_2048_tile_1024	✅ 5/5	105.94	0.08	n/a
gelu_2_cols_1_channels_2048_tile_1024	✅ 5/5	103.24	0.08	n/a
gelu_2_cols_2_channels_2048_tile_512	✅ 5/5	94.86	0.09	n/a
gelu_4_cols_1_channels_2048_tile_512	✅ 5/5	99.86	0.09	n/a
gelu_4_cols_2_channels_2048_tile_256	✅ 5/5	98.26	0.09	n/a
gelu_8_cols_1_channels_2048_tile_256	✅ 5/5	114.94	0.07	n/a
gelu_8_cols_2_channels_2048_tile_128	✅ 5/5	116.62	0.07	n/a
gemm_1792x896x1152_64x32x48_8cols_ccolmaj	✅ 5/5	1975.02	4.79	n/a
gemm_192x384x64_48x96x16_4cols	✅ 5/5	132.38	1.72	n/a
gemm_192x384x64_48x96x16_4cols_bcolmaj_ccolmaj	✅ 5/5	127.04	1.80	n/a
gemm_2048x2048x2048_64x64x64_1cols	✅ 5/5	48420.78	0.52	n/a
gemm_2048x2048x2048_64x64x64_2cols_bcolmaj	✅ 5/5	27629.00	0.91	n/a
gemm_2048x2048x2048_64x64x64_8cols_bcolmaj_ccolmaj	✅ 5/5	7398.82	3.41	n/a
gemm_384x1536x1792_32x48x64_4cols_bcolmaj	✅ 5/5	1877.86	4.30	n/a
gemm_896x1792x640_32x64x80_8cols_ccolmaj	✅ 5/5	1200.86	6.11	n/a
layer_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	111.54	0.08	n/a
layer_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	115.04	0.08	n/a
layer_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	88.58	0.10	n/a
layer_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	93.42	0.09	n/a
layer_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	88.88	0.10	n/a
layer_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	110.04	0.09	n/a
layer_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	94.98	0.09	n/a
layer_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	124.04	0.07	n/a
matrix_vector_mul_128x128_32tsi_128tso_1col0	✅ 5/5	n/a	0.31	n/a
matrix_vector_mul_2048x8192_1tsi_1024tso_2col0	✅ 5/5	n/a	22.81	n/a
matrix_vector_mul_2048x8192_1tsi_2048tso_1col0	✅ 5/5	n/a	13.24	n/a
matrix_vector_mul_2048x8192_1tsi_256tso_8col0	✅ 5/5	n/a	44.91	n/a
matrix_vector_mul_2048x8192_1tsi_512tso_4col0	✅ 5/5	n/a	40.70	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_1col0	✅ 5/5	n/a	12.79	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_2col0	✅ 5/5	n/a	24.37	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_4col0	✅ 5/5	n/a	40.93	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_8col0	✅ 5/5	n/a	46.45	n/a
mem_copy_16_cores_2_chans_2048_tile_128_False0	✅ 5/5	138.62	0.06	n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False0	✅ 5/5	93.54	0.09	n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False0	✅ 5/5	90.58	0.10	n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False0	✅ 5/5	92.80	0.09	n/a
mem_copy_4_cores_1_chans_2048_tile_512_False0	✅ 5/5	113.92	0.08	n/a
mem_copy_4_cores_2_chans_2048_tile_512_False0	✅ 5/5	119.06	0.07	n/a
mem_copy_8_cores_1_chans_2048_tile_256_False0	✅ 5/5	119.26	0.07	n/a
mem_copy_8_cores_2_chans_2048_tile_256_False0	✅ 5/5	123.20	0.07	n/a
mha_16384_64_1_8_0_0	✅ 5/5	47304.70	0.18	n/a
relu_1_cols_1_channels_2048_tile_2048	✅ 5/5	111.48	0.08	n/a
relu_2_cols_1_channels_2048_tile_1024	✅ 5/5	111.66	0.08	n/a
relu_4_cols_1_channels_2048_tile_512	✅ 5/5	103.74	0.08	n/a
relu_8_cols_1_channels_2048_tile_256	✅ 5/5	118.08	0.07	n/a
rms_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	105.54	0.08	n/a
rms_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	107.34	0.08	n/a
rms_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	114.80	0.08	n/a
rms_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	128.96	0.07	n/a
rms_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	115.92	0.07	n/a
rms_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	112.24	0.08	n/a
rms_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	119.40	0.07	n/a
rms_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	101.12	0.09	n/a
rope_1c_32rows_512cols_32arows_0m	✅ 5/5	113.02	0.90	n/a
rope_1c_32rows_512cols_8arows_0m	✅ 5/5	146.68	0.51	n/a
rope_2c_32rows_512cols_32arows_0m	✅ 5/5	99.58	1.01	n/a
rope_2c_32rows_512cols_8arows_0m	✅ 5/5	128.46	0.61	n/a
rope_8c_32rows_512cols_32arows_0m	✅ 5/5	109.10	0.95	n/a
rope_8c_32rows_512cols_8arows_0m	✅ 5/5	137.60	0.54	n/a
sigmoid_1_cols_1_channels_2048_tile_2048	✅ 5/5	125.16	0.07	n/a
sigmoid_2_cols_1_channels_2048_tile_1024	✅ 5/5	113.18	0.08	n/a
sigmoid_4_cols_1_channels_2048_tile_512	✅ 5/5	110.80	0.08	n/a
sigmoid_8_cols_1_channels_2048_tile_256	✅ 5/5	139.78	0.06	n/a
silu_1_cols_1_channels_2048_tile_2048	✅ 5/5	103.38	0.09	n/a
silu_2_cols_1_channels_2048_tile_1024	✅ 5/5	101.10	0.08	n/a
silu_4_cols_1_channels_2048_tile_512	✅ 5/5	108.72	0.08	n/a
silu_8_cols_1_channels_2048_tile_256	✅ 5/5	128.02	0.07	n/a
silu_mul_1_cols_2_channels_2048_tile_2048	✅ 5/5	93.60	0.13	n/a
silu_mul_2_cols_2_channels_2048_tile_1024	✅ 5/5	117.30	0.11	n/a
silu_mul_4_cols_2_channels_2048_tile_512	✅ 5/5	95.00	0.13	n/a
silu_mul_8_cols_2_channels_2048_tile_256	✅ 5/5	123.80	0.10	n/a
softmax_1_cols_2_channels_4096_tile_2048	✅ 5/5	95.78	0.18	n/a
softmax_2_cols_2_channels_4096_tile_1024	✅ 5/5	91.96	0.18	n/a
softmax_2_cols_2_channels_4096_tile_512	✅ 5/5	105.36	0.17	n/a
swiglu_decode_1x2048x2048_0	✅ 5/5	1691.58	0.00	n/a
swiglu_fused_decode_2048x2048_0	✅ 5/5	681.90	0.01	n/a
tanh_1_cols_1_channels_2048_tile_2048	✅ 5/5	117.10	0.07	n/a
tanh_2_cols_1_channels_2048_tile_1024	✅ 5/5	106.78	0.08	n/a
tanh_4_cols_1_channels_2048_tile_512	✅ 5/5	95.98	0.09	n/a
tanh_8_cols_1_channels_2048_tile_256	✅ 5/5	127.48	0.07	n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0	✅ 5/5	132.08	4.14	n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0	✅ 5/5	126.60	4.22	n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048	✅ 5/5	93.06	0.09	n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024	✅ 5/5	86.96	0.10	n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512	✅ 5/5	100.54	0.08	n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256	✅ 5/5	118.96	0.07	n/a

📈 Trends (vs main branch) for Small Benchmark/Test Suite

04bb5c6 (2026_03_07_18_40_14)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.13 (-1.96%)	0.11 (+2.52%)	0.10 (+1.86%)	0.08 (-1.91%)	0.02 (-1.72%)	162.40 (+1.95%)	120.96 (-2.36%)	117.00 (-1.85%)	94.40 (+2.05%)	23.11 (+4.09%)
`0a6c11c` — 2025-12-04 00:39:10	0.13 (n/a)	0.10 (n/a)	0.10 (n/a)	0.08 (n/a)	0.02 (n/a)	159.30 (n/a)	123.88 (n/a)	119.20 (n/a)	92.50 (n/a)	22.21 (n/a)

axpy_1_cols_2_channels_2048_tile_2048_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.17 (+2.80%)	0.12 (-9.00%)	0.15 (+2.36%)	0.07 (-30.81%)	0.05 (+67.69%)	181.70 (+44.55%)	115.78 (+23.75%)	81.60 (-2.28%)	72.90 (-2.80%)	54.02 (+141.40%)
`897d04e` — 2026-03-06 22:12:25	0.16 (n/a)	0.14 (n/a)	0.15 (n/a)	0.10 (n/a)	0.03 (n/a)	125.70 (n/a)	93.56 (n/a)	83.50 (n/a)	75.00 (n/a)	22.38 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.11 (-26.77%)	0.09 (-9.09%)	0.09 (-10.81%)	0.08 (+8.25%)	0.01 (-55.42%)	152.00 (-7.60%)	135.46 (+6.28%)	142.80 (+12.18%)	115.00 (+36.58%)	15.03 (-41.36%)
`0a6c11c` — 2025-12-04 00:39:10	0.15 (n/a)	0.10 (n/a)	0.10 (n/a)	0.07 (n/a)	0.02 (n/a)	164.50 (n/a)	127.46 (n/a)	127.30 (n/a)	84.20 (n/a)	25.64 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.13 (-0.18%)	0.12 (+8.75%)	0.12 (+5.56%)	0.10 (+55.16%)	0.01 (-63.63%)	117.80 (-35.52%)	105.98 (-12.31%)	105.00 (-5.23%)	96.20 (+0.10%)	7.92 (-77.47%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	182.70 (n/a)	120.86 (n/a)	110.80 (n/a)	96.10 (n/a)	35.16 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.12 (-10.21%)	0.10 (-8.41%)	0.10 (-6.20%)	0.07 (+3.52%)	0.02 (-23.48%)	166.70 (-3.36%)	128.78 (+7.33%)	121.80 (+6.65%)	103.90 (+11.36%)	22.95 (-18.82%)
`0a6c11c` — 2025-12-04 00:39:10	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	172.50 (n/a)	119.98 (n/a)	114.20 (n/a)	93.30 (n/a)	28.27 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.12 (-4.90%)	0.11 (+4.94%)	0.12 (-0.91%)	0.08 (+22.72%)	0.02 (-28.59%)	158.20 (-18.50%)	114.54 (-8.01%)	104.30 (+0.97%)	102.30 (+5.25%)	24.42 (-39.43%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.12 (n/a)	0.06 (n/a)	0.03 (n/a)	194.10 (n/a)	124.52 (n/a)	103.30 (n/a)	97.20 (n/a)	40.32 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (-16.19%)	0.08 (-10.40%)	0.09 (-2.09%)	0.07 (-17.38%)	0.01 (-10.61%)	184.40 (+21.00%)	153.18 (+11.99%)	144.10 (+2.20%)	127.10 (+19.34%)	21.26 (+34.76%)
`0a6c11c` — 2025-12-04 00:39:10	0.12 (n/a)	0.09 (n/a)	0.09 (n/a)	0.08 (n/a)	0.01 (n/a)	152.40 (n/a)	136.78 (n/a)	141.00 (n/a)	106.50 (n/a)	15.78 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-13.68%)	0.10 (-8.70%)	0.11 (+0.87%)	0.06 (-20.21%)	0.02 (+6.71%)	195.90 (+25.34%)	128.72 (+11.68%)	111.70 (-0.89%)	110.60 (+15.81%)	37.57 (+54.38%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.08 (n/a)	0.02 (n/a)	156.30 (n/a)	115.26 (n/a)	112.70 (n/a)	95.50 (n/a)	24.34 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (-18.83%)	0.04 (-5.21%)	0.04 (-2.69%)	0.03 (+37.10%)	0.00 (-53.98%)	160.40 (-27.06%)	141.12 (-0.91%)	136.40 (+2.79%)	114.30 (+23.17%)	17.37 (-59.06%)
`0a6c11c` — 2025-12-04 00:39:10	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	219.90 (n/a)	142.42 (n/a)	132.70 (n/a)	92.80 (n/a)	42.43 (n/a)

dequant_1_cols_1_channels_2048_tile_2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.05 (+8.56%)	0.05 (+10.84%)	0.05 (+12.25%)	0.04 (+17.21%)	0.01 (+9.50%)	135.20 (-14.65%)	115.44 (-9.90%)	110.20 (-10.99%)	101.70 (-7.88%)	15.35 (-16.40%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	158.40 (n/a)	128.12 (n/a)	123.80 (n/a)	110.40 (n/a)	18.36 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.06 (-13.28%)	0.05 (-8.93%)	0.06 (-13.59%)	0.04 (+4.63%)	0.01 (-39.10%)	133.60 (-4.43%)	106.08 (+5.85%)	95.10 (+15.69%)	87.90 (+15.35%)	17.90 (-31.97%)
`0a6c11c` — 2025-12-04 00:39:10	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	139.80 (n/a)	100.22 (n/a)	82.20 (n/a)	76.20 (n/a)	26.31 (n/a)

dequant_1_cols_2_channels_2048_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.06 (+0.17%)	0.04 (-10.49%)	0.04 (-25.81%)	0.04 (+17.26%)	0.01 (-4.30%)	138.70 (-14.75%)	122.18 (+10.23%)	133.20 (+34.82%)	81.30 (-0.25%)	23.69 (-23.61%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	162.70 (n/a)	110.84 (n/a)	98.80 (n/a)	81.50 (n/a)	31.02 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.07 (+5.66%)	0.05 (+1.21%)	0.05 (+0.61%)	0.04 (-15.02%)	0.01 (+58.42%)	143.40 (+17.64%)	101.02 (+1.49%)	97.60 (-0.61%)	78.90 (-5.40%)	22.56 (+78.52%)
`0a6c11c` — 2025-12-04 00:39:10	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	121.90 (n/a)	99.54 (n/a)	98.20 (n/a)	83.40 (n/a)	12.64 (n/a)

dequant_2_cols_1_channels_2048_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.06 (-3.82%)	0.05 (-4.37%)	0.04 (-18.27%)	0.04 (+14.64%)	0.01 (-32.26%)	132.80 (-12.80%)	117.36 (+1.98%)	123.30 (+22.32%)	91.60 (+3.97%)	16.19 (-40.46%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	152.30 (n/a)	115.08 (n/a)	100.80 (n/a)	88.10 (n/a)	27.20 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (+17.06%)	0.04 (+8.98%)	0.05 (+21.37%)	0.03 (-11.65%)	0.01 (+301.89%)	159.70 (+13.18%)	126.32 (-5.68%)	109.00 (-17.67%)	106.80 (-14.56%)	22.48 (+280.15%)
`0a6c11c` — 2025-12-04 00:39:10	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	141.10 (n/a)	133.92 (n/a)	132.40 (n/a)	125.00 (n/a)	5.91 (n/a)

dequant_2_cols_2_channels_2048_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.04 (-38.37%)	0.04 (-18.19%)	0.04 (-8.74%)	0.03 (+3.37%)	0.00 (-68.98%)	159.40 (-3.22%)	138.32 (+16.12%)	131.70 (+9.57%)	122.60 (+62.17%)	15.98 (-49.44%)
`897d04e` — 2026-03-06 22:12:25	0.07 (n/a)	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	164.70 (n/a)	119.12 (n/a)	120.20 (n/a)	75.60 (n/a)	31.61 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.06 (+20.24%)	0.05 (-3.19%)	0.05 (-6.73%)	0.03 (-20.69%)	0.01 (+194.26%)	156.10 (+26.09%)	120.86 (+7.15%)	114.90 (+7.18%)	88.30 (-16.85%)	24.40 (+214.82%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	123.80 (n/a)	112.80 (n/a)	107.20 (n/a)	106.20 (n/a)	7.75 (n/a)

dequant_4_cols_1_channels_2048_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.06 (+20.62%)	0.05 (+5.36%)	0.04 (-2.36%)	0.03 (-1.95%)	0.01 (+64.81%)	167.80 (+1.94%)	119.80 (-1.92%)	118.70 (+2.42%)	80.80 (-17.13%)	33.36 (+33.01%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	164.60 (n/a)	122.14 (n/a)	115.90 (n/a)	97.50 (n/a)	25.08 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (-6.09%)	0.04 (-8.04%)	0.04 (-12.46%)	0.03 (-0.41%)	0.01 (-20.19%)	168.10 (+0.42%)	135.74 (+7.44%)	132.20 (+14.26%)	107.40 (+6.44%)	22.91 (-12.67%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	167.40 (n/a)	126.34 (n/a)	115.70 (n/a)	100.90 (n/a)	26.23 (n/a)

dequant_4_cols_2_channels_2048_tile_256_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.05 (-15.06%)	0.04 (-5.06%)	0.04 (-1.14%)	0.03 (+5.36%)	0.01 (-27.67%)	157.90 (-5.11%)	126.26 (+3.20%)	129.20 (+1.17%)	99.60 (+17.73%)	24.31 (-20.21%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	166.40 (n/a)	122.34 (n/a)	127.70 (n/a)	84.60 (n/a)	30.47 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.04 (-13.65%)	0.04 (-13.67%)	0.04 (-18.56%)	0.03 (-13.52%)	0.00 (-23.88%)	170.40 (+15.68%)	140.12 (+15.33%)	135.80 (+22.78%)	119.60 (+15.78%)	17.94 (+1.87%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	147.30 (n/a)	121.50 (n/a)	110.60 (n/a)	103.30 (n/a)	17.61 (n/a)

dequant_8_cols_1_channels_2048_tile_256_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.05 (+14.37%)	0.05 (+8.59%)	0.05 (+9.95%)	0.04 (+3.65%)	0.01 (+52.82%)	137.60 (-3.57%)	117.06 (-7.42%)	114.40 (-8.99%)	101.00 (-12.55%)	13.71 (+29.27%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	142.70 (n/a)	126.44 (n/a)	125.70 (n/a)	115.50 (n/a)	10.61 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (+17.21%)	0.03 (-1.70%)	0.03 (-3.04%)	0.03 (-16.20%)	0.01 (+95.59%)	198.20 (+19.33%)	160.00 (+4.92%)	166.20 (+3.17%)	106.50 (-14.66%)	29.86 (+87.19%)
`0a6c11c` — 2025-12-04 00:39:10	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.00 (n/a)	166.10 (n/a)	152.50 (n/a)	161.10 (n/a)	124.80 (n/a)	15.95 (n/a)

dequant_8_cols_2_channels_2048_tile_128_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.05 (+18.80%)	0.04 (+1.27%)	0.04 (+0.30%)	0.02 (-20.19%)	0.01 (+77.52%)	241.90 (+25.27%)	152.82 (+3.48%)	135.70 (-0.29%)	114.00 (-15.81%)	50.71 (+99.61%)
`897d04e` — 2026-03-06 22:12:25	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	193.10 (n/a)	147.68 (n/a)	136.10 (n/a)	135.40 (n/a)	25.41 (n/a)

dual_gemv_silu_mul_2048x2048_4tsi_512tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	36.96 (n/a)	35.82 (n/a)	36.05 (n/a)	34.47 (n/a)	0.98 (n/a)	486.90 (n/a)	468.92 (n/a)	465.60 (n/a)	454.10 (n/a)	12.88 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.12 (-26.25%)	0.10 (-20.35%)	0.11 (-25.91%)	0.07 (-11.77%)	0.02 (-44.83%)	165.20 (+13.38%)	121.14 (+22.02%)	112.60 (+35.01%)	105.20 (+35.57%)	25.03 (-12.80%)
`897d04e` — 2026-03-06 22:12:25	0.16 (n/a)	0.13 (n/a)	0.15 (n/a)	0.08 (n/a)	0.03 (n/a)	145.70 (n/a)	99.28 (n/a)	83.40 (n/a)	77.60 (n/a)	28.70 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.13 (+3.88%)	0.11 (+7.81%)	0.12 (-1.35%)	0.09 (+19.66%)	0.01 (-37.47%)	132.10 (-16.45%)	110.76 (-9.60%)	106.40 (+1.33%)	97.60 (-3.75%)	14.09 (-48.81%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.12 (n/a)	0.08 (n/a)	0.02 (n/a)	158.10 (n/a)	122.52 (n/a)	105.00 (n/a)	101.40 (n/a)	27.53 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-26.44%)	0.11 (-7.88%)	0.11 (-20.97%)	0.10 (+63.96%)	0.01 (-87.13%)	121.20 (-39.00%)	111.44 (-3.72%)	109.40 (+26.47%)	107.80 (+35.94%)	5.55 (-89.06%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.12 (n/a)	0.14 (n/a)	0.06 (n/a)	0.04 (n/a)	198.70 (n/a)	115.74 (n/a)	86.50 (n/a)	79.30 (n/a)	50.70 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.12 (+7.94%)	0.11 (+3.76%)	0.11 (+1.46%)	0.08 (+8.22%)	0.02 (-3.84%)	162.70 (-7.61%)	119.88 (-4.20%)	111.10 (-1.42%)	103.20 (-7.36%)	24.19 (-15.12%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	176.10 (n/a)	125.14 (n/a)	112.70 (n/a)	111.40 (n/a)	28.50 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.16 (+10.91%)	0.12 (-2.60%)	0.14 (+3.45%)	0.07 (-1.95%)	0.04 (+19.13%)	169.40 (+1.99%)	107.30 (+4.50%)	86.20 (-3.36%)	75.50 (-9.80%)	38.51 (+8.27%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.13 (n/a)	0.14 (n/a)	0.07 (n/a)	0.03 (n/a)	166.10 (n/a)	102.68 (n/a)	89.20 (n/a)	83.70 (n/a)	35.57 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.12 (-17.69%)	0.12 (-12.21%)	0.12 (-21.54%)	0.11 (+16.61%)	0.01 (-73.68%)	115.30 (-14.21%)	105.70 (+10.01%)	105.00 (+27.43%)	99.00 (+21.47%)	6.36 (-72.16%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.13 (n/a)	0.15 (n/a)	0.09 (n/a)	0.03 (n/a)	134.40 (n/a)	96.08 (n/a)	82.40 (n/a)	81.50 (n/a)	22.84 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.12 (+4.25%)	0.11 (+10.14%)	0.12 (+13.09%)	0.08 (+20.52%)	0.02 (-9.62%)	163.00 (-17.01%)	114.60 (-10.89%)	102.10 (-11.53%)	101.60 (-4.06%)	27.08 (-29.33%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.11 (n/a)	0.06 (n/a)	0.02 (n/a)	196.40 (n/a)	128.60 (n/a)	115.40 (n/a)	105.90 (n/a)	38.33 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+0.41%)	0.10 (-1.31%)	0.11 (+0.59%)	0.06 (-18.72%)	0.02 (+54.14%)	191.00 (+23.07%)	128.68 (+4.33%)	113.10 (-0.53%)	111.80 (-0.36%)	34.87 (+89.99%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.08 (n/a)	0.01 (n/a)	155.20 (n/a)	123.34 (n/a)	113.70 (n/a)	112.20 (n/a)	18.35 (n/a)

flowkv_decode_32h_8kv_64d_128s_32cs_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.79 (n/a)	0.78 (n/a)	0.79 (n/a)	0.77 (n/a)	0.01 (n/a)	352.40 (n/a)	344.74 (n/a)	343.80 (n/a)	340.40 (n/a)	4.56 (n/a)

fused_dequant_gemv_2048x2048_1tsi_512tso_4col_g32_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	1.95 (n/a)	1.89 (n/a)	1.88 (n/a)	1.85 (n/a)	0.04 (n/a)	1282.80 (n/a)	1252.74 (n/a)	1258.20 (n/a)	1213.60 (n/a)	25.71 (n/a)	6.91 (n/a)	6.70 (n/a)	6.67 (n/a)	6.54 (n/a)	0.14 (n/a)

fused_qkv_proj_3072x2048_4tsi_768tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	34.96 (n/a)	32.73 (n/a)	32.90 (n/a)	29.63 (n/a)	2.08 (n/a)	425.00 (n/a)	386.02 (n/a)	382.70 (n/a)	360.30 (n/a)	25.31 (n/a)	34.93 (n/a)	32.71 (n/a)	32.88 (n/a)	29.61 (n/a)	2.08 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (-3.19%)	0.08 (-7.64%)	0.09 (-2.05%)	0.06 (-6.80%)	0.02 (+21.78%)	144.80 (+7.34%)	105.08 (+10.75%)	89.70 (+2.05%)	80.20 (+3.35%)	30.28 (+29.99%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.02 (n/a)	134.90 (n/a)	94.88 (n/a)	87.90 (n/a)	77.60 (n/a)	23.30 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-6.77%)	0.08 (-18.61%)	0.08 (-26.66%)	0.06 (-17.73%)	0.02 (+20.05%)	135.40 (+21.54%)	105.94 (+25.22%)	105.30 (+36.40%)	78.00 (+7.29%)	23.97 (+53.06%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	111.40 (n/a)	84.60 (n/a)	77.20 (n/a)	72.70 (n/a)	15.66 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-1.64%)	0.08 (-8.89%)	0.10 (-6.27%)	0.06 (+7.97%)	0.02 (-3.80%)	144.40 (-7.38%)	103.24 (+8.56%)	84.70 (+6.68%)	77.90 (+1.56%)	30.14 (-11.81%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	155.90 (n/a)	95.10 (n/a)	79.40 (n/a)	76.70 (n/a)	34.18 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-3.00%)	0.09 (-2.36%)	0.10 (-3.04%)	0.05 (-2.42%)	0.02 (-2.93%)	155.50 (+2.50%)	94.86 (+2.40%)	79.00 (+3.13%)	77.20 (+3.07%)	34.05 (+2.46%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.05 (n/a)	0.02 (n/a)	151.70 (n/a)	92.64 (n/a)	76.60 (n/a)	74.90 (n/a)	33.24 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+4.05%)	0.09 (-0.11%)	0.10 (+6.02%)	0.05 (-16.03%)	0.03 (+22.79%)	180.20 (+19.10%)	99.86 (+4.94%)	79.00 (-5.73%)	71.80 (-3.88%)	45.54 (+42.47%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	151.30 (n/a)	95.16 (n/a)	83.80 (n/a)	74.70 (n/a)	31.97 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (-0.70%)	0.09 (-0.71%)	0.09 (-8.17%)	0.06 (+42.38%)	0.01 (-38.52%)	127.50 (-29.75%)	98.26 (-5.88%)	92.40 (+8.83%)	83.50 (+0.72%)	18.27 (-57.68%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	181.50 (n/a)	104.40 (n/a)	84.90 (n/a)	82.90 (n/a)	43.16 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (-13.39%)	0.07 (-14.82%)	0.07 (-20.32%)	0.06 (-1.01%)	0.01 (-32.37%)	144.70 (+0.98%)	114.94 (+15.19%)	114.60 (+25.52%)	94.20 (+15.44%)	19.11 (-23.45%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.02 (n/a)	143.30 (n/a)	99.78 (n/a)	91.30 (n/a)	81.60 (n/a)	24.96 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (+4.05%)	0.07 (+0.57%)	0.08 (+3.85%)	0.05 (-0.49%)	0.02 (+4.80%)	174.50 (+0.46%)	116.62 (-0.22%)	102.30 (-3.67%)	94.40 (-3.87%)	32.89 (+2.72%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.05 (n/a)	0.01 (n/a)	173.70 (n/a)	116.88 (n/a)	106.20 (n/a)	98.20 (n/a)	32.02 (n/a)

gemm_1792x896x1152_64x32x48_8cols_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	5.16 (+3.23%)	4.79 (-2.02%)	4.96 (-0.03%)	4.35 (-3.62%)	0.37 (+79.28%)	2161.90 (+3.76%)	1975.02 (+2.41%)	1894.20 (+0.03%)	1823.40 (-3.13%)	157.05 (+80.99%)	2028.85 (+3.23%)	1882.40 (-2.02%)	1953.05 (-0.03%)	1711.19 (-3.62%)	146.24 (+79.28%)
`897d04e` — 2026-03-06 22:12:25	5.00 (n/a)	4.88 (n/a)	4.97 (n/a)	4.51 (n/a)	0.21 (n/a)	2083.60 (n/a)	1928.60 (n/a)	1893.70 (n/a)	1882.30 (n/a)	86.77 (n/a)	1965.38 (n/a)	1921.12 (n/a)	1953.55 (n/a)	1775.47 (n/a)	81.57 (n/a)

gemm_192x384x64_48x96x16_4cols

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	2.14 (+4.21%)	1.72 (+3.78%)	1.83 (-1.97%)	1.38 (+75.52%)	0.33 (-37.57%)	160.40 (-43.04%)	132.38 (-12.75%)	121.00 (+2.02%)	103.60 (-3.99%)	25.79 (-65.10%)	91.10 (+4.21%)	73.46 (+3.78%)	77.99 (-1.97%)	58.83 (+75.52%)	14.04 (-37.57%)
`897d04e` — 2026-03-06 22:12:25	2.05 (n/a)	1.66 (n/a)	1.86 (n/a)	0.79 (n/a)	0.53 (n/a)	281.60 (n/a)	151.72 (n/a)	118.60 (n/a)	107.90 (n/a)	73.91 (n/a)	87.43 (n/a)	70.78 (n/a)	79.55 (n/a)	33.52 (n/a)	22.49 (n/a)

gemm_192x384x64_48x96x16_4cols_bcolmaj_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	2.09 (-6.39%)	1.80 (-1.63%)	1.88 (+0.67%)	1.26 (-4.29%)	0.31 (-4.43%)	175.40 (+4.53%)	127.04 (+1.78%)	117.50 (-0.68%)	105.80 (+6.76%)	27.56 (+7.74%)	89.16 (-6.39%)	76.59 (-1.63%)	80.30 (+0.67%)	53.82 (-4.29%)	13.35 (-4.43%)
`897d04e` — 2026-03-06 22:12:25	2.23 (n/a)	1.82 (n/a)	1.87 (n/a)	1.32 (n/a)	0.33 (n/a)	167.80 (n/a)	124.82 (n/a)	118.30 (n/a)	99.10 (n/a)	25.58 (n/a)	95.25 (n/a)	77.86 (n/a)	79.77 (n/a)	56.23 (n/a)	13.96 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.72 (-0.11%)	3.55 (-2.75%)	3.56 (-2.75%)	3.36 (-5.33%)	0.12 (+76.10%)	2725.23 (-0.11%)	2602.52 (-2.75%)	2612.11 (-2.75%)	2459.89 (-5.33%)	86.27 (+76.10%)	6984.00 (+5.63%)	6608.60 (+2.91%)	6577.00 (+2.83%)	6304.00 (+0.11%)	221.87 (+87.15%)
`9e98049` — 2025-11-25 20:50:55	3.72 (n/a)	3.65 (n/a)	3.66 (n/a)	3.54 (n/a)	0.07 (n/a)	2728.26 (n/a)	2676.06 (n/a)	2686.03 (n/a)	2598.29 (n/a)	48.99 (n/a)	6612.00 (n/a)	6422.00 (n/a)	6396.00 (n/a)	6297.00 (n/a)	118.55 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.40 (-3.14%)	3.38 (-0.82%)	3.38 (-0.82%)	3.35 (+4.93%)	0.02 (-84.51%)	2493.81 (-3.14%)	2475.27 (-0.82%)	2479.06 (-0.82%)	2453.92 (+4.93%)	13.33 (-84.51%)	7001.00 (-4.70%)	6940.80 (+0.71%)	6930.00 (+0.83%)	6889.00 (+3.24%)	37.43 (-84.76%)
`9e98049` — 2025-11-25 20:50:55	3.51 (n/a)	3.40 (n/a)	3.41 (n/a)	3.19 (n/a)	0.12 (n/a)	2574.53 (n/a)	2495.72 (n/a)	2499.62 (n/a)	2338.67 (n/a)	86.02 (n/a)	7346.00 (n/a)	6892.20 (n/a)	6873.00 (n/a)	6673.00 (n/a)	245.57 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.02 (+0.52%)	2.87 (-2.05%)	2.86 (-2.24%)	2.70 (-6.16%)	0.11 (+131.66%)	2216.19 (+0.52%)	2104.44 (-2.05%)	2094.08 (-2.24%)	1980.84 (-6.16%)	80.25 (+131.67%)	8673.00 (+6.56%)	8175.60 (+2.21%)	8204.00 (+2.29%)	7752.00 (-0.51%)	314.03 (+145.36%)
`9e98049` — 2025-11-25 20:50:55	3.01 (n/a)	2.93 (n/a)	2.92 (n/a)	2.88 (n/a)	0.05 (n/a)	2204.81 (n/a)	2148.41 (n/a)	2142.13 (n/a)	2110.81 (n/a)	34.64 (n/a)	8139.00 (n/a)	7998.60 (n/a)	8020.00 (n/a)	7792.00 (n/a)	127.99 (n/a)

gemm_2048x2048x2048_64x64x64_1cols

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.52 (-0.77%)	0.52 (-0.21%)	0.52 (-0.05%)	0.52 (-0.18%)	0.00 (-75.92%)	48486.70 (+0.18%)	48420.78 (+0.21%)	48413.40 (+0.05%)	48384.80 (+0.77%)	41.51 (-75.70%)	355.07 (-0.77%)	354.80 (-0.21%)	354.86 (-0.05%)	354.32 (-0.18%)	0.30 (-75.92%)
`897d04e` — 2026-03-06 22:12:25	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.00 (n/a)	48401.80 (n/a)	48318.62 (n/a)	48391.10 (n/a)	48013.20 (n/a)	170.80 (n/a)	357.82 (n/a)	355.56 (n/a)	355.02 (n/a)	354.94 (n/a)	1.26 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	1.04 (+0.94%)	1.03 (+0.23%)	1.03 (+0.09%)	1.02 (+0.07%)	0.00 (+197.51%)	24576.00 (-0.07%)	24485.82 (-0.23%)	24530.40 (-0.09%)	24266.40 (-0.94%)	111.26 (+194.35%)
`0a6c11c` — 2025-12-04 00:39:10	1.03 (n/a)	1.03 (n/a)	1.03 (n/a)	1.02 (n/a)	0.00 (n/a)	24594.30 (n/a)	24542.14 (n/a)	24551.90 (n/a)	24495.50 (n/a)	37.80 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	1.04 (+0.28%)	1.03 (-0.15%)	1.03 (+0.05%)	1.02 (-0.52%)	0.01 (+42.72%)	24719.80 (+0.52%)	24512.42 (+0.16%)	24529.20 (-0.05%)	24092.60 (-0.28%)	252.92 (+43.15%)	713.08 (+0.28%)	700.92 (-0.15%)	700.38 (+0.05%)	694.98 (-0.52%)	7.30 (+42.71%)
`50ad37c` — 2025-12-29 20:35:53	1.04 (n/a)	1.03 (n/a)	1.03 (n/a)	1.02 (n/a)	0.01 (n/a)	24592.30 (n/a)	24473.70 (n/a)	24540.90 (n/a)	24160.80 (n/a)	176.68 (n/a)	711.06 (n/a)	702.00 (n/a)	700.05 (n/a)	698.59 (n/a)	5.12 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.99 (+1.69%)	0.97 (+0.29%)	0.97 (-0.04%)	0.97 (-0.15%)	0.01 (+434.92%)	26025.30 (+0.15%)	25839.34 (-0.29%)	25916.70 (+0.04%)	25446.00 (-1.67%)	202.05 (+425.44%)
`0a6c11c` — 2025-12-04 00:39:10	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.00 (n/a)	25986.90 (n/a)	25913.52 (n/a)	25905.70 (n/a)	25877.00 (n/a)	38.45 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	0.97 (-0.01%)	0.97 (+0.03%)	0.97 (+0.04%)	0.97 (+0.00%)	0.00 (-6.43%)	25927.90 (-0.00%)	25903.20 (-0.03%)	25898.60 (-0.04%)	25892.80 (+0.01%)	14.05 (-6.56%)	663.50 (-0.01%)	663.23 (+0.03%)	663.35 (+0.04%)	662.60 (+0.00%)	0.36 (-6.43%)
`50ad37c` — 2025-12-29 20:35:53	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.00 (n/a)	25928.10 (n/a)	25910.14 (n/a)	25908.10 (n/a)	25891.20 (n/a)	15.04 (n/a)	663.54 (n/a)	663.06 (n/a)	663.11 (n/a)	662.60 (n/a)	0.38 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.92 (-1.02%)	0.92 (-0.66%)	0.92 (-0.10%)	0.91 (-0.78%)	0.01 (-4.54%)	27751.40 (+0.79%)	27480.74 (+0.66%)	27354.80 (+0.10%)	27320.50 (+1.03%)	182.69 (-2.84%)
`0a6c11c` — 2025-12-04 00:39:10	0.93 (n/a)	0.92 (n/a)	0.92 (n/a)	0.91 (n/a)	0.01 (n/a)	27534.80 (n/a)	27299.32 (n/a)	27326.70 (n/a)	27042.30 (n/a)	188.04 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	0.92 (+0.11%)	0.91 (-0.12%)	0.91 (-0.21%)	0.91 (-0.24%)	0.00 (+30.34%)	27723.50 (+0.24%)	27548.94 (+0.12%)	27522.90 (+0.21%)	27403.60 (-0.11%)	124.26 (+30.58%)	626.92 (+0.11%)	623.62 (-0.12%)	624.20 (-0.21%)	619.69 (-0.24%)	2.81 (+30.34%)
`50ad37c` — 2025-12-29 20:35:53	0.92 (n/a)	0.91 (n/a)	0.92 (n/a)	0.91 (n/a)	0.00 (n/a)	27657.10 (n/a)	27515.58 (n/a)	27464.70 (n/a)	27434.60 (n/a)	95.16 (n/a)	626.21 (n/a)	624.37 (n/a)	625.52 (n/a)	621.17 (n/a)	2.16 (n/a)

gemm_2048x2048x2048_64x64x64_2cols_bcolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.92 (+1.06%)	0.91 (+0.97%)	0.91 (+0.43%)	0.90 (+2.02%)	0.01 (-21.39%)	27883.70 (-1.98%)	27629.00 (-0.97%)	27654.90 (-0.43%)	27232.10 (-1.04%)	274.22 (-23.75%)	630.87 (+1.06%)	621.85 (+0.97%)	621.22 (+0.43%)	616.13 (+2.02%)	6.20 (-21.39%)
`897d04e` — 2026-03-06 22:12:25	0.91 (n/a)	0.90 (n/a)	0.91 (n/a)	0.88 (n/a)	0.01 (n/a)	28447.10 (n/a)	27899.18 (n/a)	27774.40 (n/a)	27519.50 (n/a)	359.64 (n/a)	624.28 (n/a)	615.87 (n/a)	618.55 (n/a)	603.92 (n/a)	7.88 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`31ab24e` — 2025-11-22 02:01:56	3.65 (-1.06%)	3.59 (+0.83%)	3.63 (-0.26%)	3.45 (+2.66%)	0.07 (-44.71%)	2678.08 (-1.06%)	2632.13 (+0.83%)	2658.60 (-0.26%)	2528.31 (+2.66%)	53.86 (-44.71%)	6795.00 (-2.59%)	6529.80 (-0.92%)	6462.00 (+0.26%)	6415.00 (+1.07%)	137.14 (-45.27%)
`d9a64c5` — 2025-11-21 20:49:35	3.69 (n/a)	3.56 (n/a)	3.64 (n/a)	3.36 (n/a)	0.13 (n/a)	2706.77 (n/a)	2610.50 (n/a)	2665.61 (n/a)	2462.71 (n/a)	97.41 (n/a)	6976.00 (n/a)	6590.40 (n/a)	6445.00 (n/a)	6347.00 (n/a)	250.58 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.98 (+0.20%)	3.84 (-2.95%)	3.76 (-5.27%)	3.72 (-4.97%)	0.13 (+473.97%)	6760.00 (+5.23%)	6559.50 (+3.13%)	6697.10 (+5.56%)	6321.00 (-0.20%)	218.68 (+499.40%)	2717.91 (+0.20%)	2621.44 (-2.95%)	2565.27 (-5.27%)	2541.40 (-4.97%)	88.37 (+473.97%)
`331dcca` — 2026-01-08 18:34:10	3.97 (n/a)	3.96 (n/a)	3.97 (n/a)	3.92 (n/a)	0.02 (n/a)	6423.80 (n/a)	6360.32 (n/a)	6344.30 (n/a)	6333.90 (n/a)	36.48 (n/a)	2712.39 (n/a)	2701.17 (n/a)	2707.91 (n/a)	2674.40 (n/a)	15.40 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.75 (+0.28%)	3.70 (+1.25%)	3.71 (-0.21%)	3.65 (+4.77%)	0.04 (-66.90%)	6901.80 (-4.56%)	6795.46 (-1.30%)	6790.20 (+0.21%)	6715.90 (-0.28%)	67.05 (-68.40%)	2558.08 (+0.28%)	2528.33 (+1.25%)	2530.10 (-0.21%)	2489.18 (+4.77%)	24.81 (-66.90%)
`331dcca` — 2026-01-08 18:34:10	3.74 (n/a)	3.66 (n/a)	3.71 (n/a)	3.48 (n/a)	0.11 (n/a)	7231.20 (n/a)	6885.18 (n/a)	6775.70 (n/a)	6734.90 (n/a)	212.21 (n/a)	2550.87 (n/a)	2497.04 (n/a)	2535.50 (n/a)	2375.78 (n/a)	74.96 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.62 (-0.77%)	3.54 (+0.14%)	3.60 (-0.04%)	3.44 (+2.17%)	0.09 (-25.77%)	7307.40 (-2.13%)	7103.46 (-0.18%)	6982.50 (+0.04%)	6948.20 (+0.77%)	182.95 (-26.55%)	2472.55 (-0.77%)	2419.80 (+0.14%)	2460.41 (-0.04%)	2351.04 (+2.17%)	61.76 (-25.77%)
`331dcca` — 2026-01-08 18:34:10	3.65 (n/a)	3.54 (n/a)	3.61 (n/a)	3.37 (n/a)	0.12 (n/a)	7466.20 (n/a)	7116.40 (n/a)	6979.60 (n/a)	6895.10 (n/a)	249.09 (n/a)	2491.61 (n/a)	2416.45 (n/a)	2461.45 (n/a)	2301.00 (n/a)	83.20 (n/a)

gemm_2048x2048x2048_64x64x64_8cols_bcolmaj_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	3.51 (-0.10%)	3.41 (-2.35%)	3.47 (-0.26%)	3.18 (-8.64%)	0.14 (+1015.75%)	7919.30 (+9.45%)	7398.82 (+2.55%)	7245.80 (+0.26%)	7179.20 (+0.10%)	311.94 (+1122.64%)	2393.00 (-0.10%)	2325.15 (-2.35%)	2371.00 (-0.26%)	2169.36 (-8.64%)	94.25 (+1015.73%)
`897d04e` — 2026-03-06 22:12:25	3.51 (n/a)	3.49 (n/a)	3.48 (n/a)	3.48 (n/a)	0.01 (n/a)	7235.40 (n/a)	7215.10 (n/a)	7227.20 (n/a)	7171.80 (n/a)	25.51 (n/a)	2395.46 (n/a)	2381.12 (n/a)	2377.13 (n/a)	2374.41 (n/a)	8.45 (n/a)

gemm_384x1536x1792_32x48x64_4cols_bcolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	4.42 (+1.75%)	4.30 (+3.26%)	4.40 (+1.89%)	3.92 (+11.17%)	0.21 (-40.12%)	2054.60 (-10.04%)	1877.86 (-3.59%)	1831.80 (-1.86%)	1824.30 (-1.72%)	99.46 (-47.10%)	1158.77 (+1.75%)	1128.09 (+3.26%)	1154.00 (+1.89%)	1028.87 (+11.17%)	55.92 (-40.12%)
`897d04e` — 2026-03-06 22:12:25	4.34 (n/a)	4.17 (n/a)	4.32 (n/a)	3.53 (n/a)	0.36 (n/a)	2284.00 (n/a)	1947.78 (n/a)	1866.50 (n/a)	1856.20 (n/a)	188.02 (n/a)	1138.86 (n/a)	1092.52 (n/a)	1132.55 (n/a)	925.53 (n/a)	93.39 (n/a)

gemm_896x1792x640_32x64x80_8cols_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	7.08 (+5.31%)	6.11 (-3.21%)	6.81 (+2.91%)	3.14 (-39.48%)	1.66 (+157.30%)	2116.40 (+65.24%)	1200.86 (+12.80%)	977.30 (-2.83%)	939.60 (-5.03%)	512.24 (+313.62%)	2187.43 (+5.31%)	1886.58 (-3.21%)	2102.91 (+2.91%)	971.10 (-39.48%)	513.87 (+157.30%)
`897d04e` — 2026-03-06 22:12:25	6.72 (n/a)	6.31 (n/a)	6.61 (n/a)	5.19 (n/a)	0.65 (n/a)	1280.80 (n/a)	1064.58 (n/a)	1005.80 (n/a)	989.40 (n/a)	123.84 (n/a)	2077.17 (n/a)	1949.09 (n/a)	2043.44 (n/a)	1604.60 (n/a)	199.72 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (-1.06%)	0.08 (-5.47%)	0.07 (-20.10%)	0.06 (+4.35%)	0.02 (+2.58%)	143.40 (-4.21%)	111.54 (+5.91%)	118.50 (+25.13%)	79.30 (+1.15%)	30.64 (-1.50%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	149.70 (n/a)	105.32 (n/a)	94.70 (n/a)	78.40 (n/a)	31.11 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-1.52%)	0.08 (-15.40%)	0.07 (-31.03%)	0.05 (-16.97%)	0.02 (+8.95%)	168.20 (+20.40%)	115.04 (+21.17%)	112.80 (+44.99%)	76.00 (+1.47%)	37.77 (+33.81%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.06 (n/a)	0.02 (n/a)	139.70 (n/a)	94.94 (n/a)	77.80 (n/a)	74.90 (n/a)	28.23 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+3.70%)	0.10 (+6.73%)	0.11 (+10.70%)	0.07 (+15.12%)	0.02 (-1.18%)	118.30 (-13.14%)	88.58 (-7.09%)	77.20 (-9.60%)	75.10 (-3.47%)	18.63 (-21.16%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	136.20 (n/a)	95.34 (n/a)	85.40 (n/a)	77.80 (n/a)	23.63 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+0.06%)	0.09 (+13.93%)	0.11 (+22.53%)	0.05 (+41.38%)	0.02 (-13.27%)	152.10 (-29.26%)	93.42 (-17.69%)	77.20 (-18.31%)	76.00 (+0.00%)	33.03 (-42.41%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.09 (n/a)	0.04 (n/a)	0.03 (n/a)	215.00 (n/a)	113.50 (n/a)	94.50 (n/a)	76.00 (n/a)	57.35 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+6.95%)	0.10 (+15.43%)	0.11 (+18.33%)	0.06 (+33.84%)	0.02 (-6.17%)	141.60 (-25.28%)	88.88 (-16.78%)	76.60 (-15.55%)	72.90 (-6.54%)	29.52 (-36.56%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	189.50 (n/a)	106.80 (n/a)	90.70 (n/a)	78.00 (n/a)	46.53 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (+3.31%)	0.09 (+6.96%)	0.10 (+11.82%)	0.04 (-16.80%)	0.03 (+34.74%)	215.70 (+20.23%)	110.04 (+0.35%)	83.90 (-10.55%)	82.70 (-3.16%)	59.07 (+50.50%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	179.40 (n/a)	109.66 (n/a)	93.80 (n/a)	85.40 (n/a)	39.25 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+14.74%)	0.09 (+21.73%)	0.10 (+21.97%)	0.05 (+3.47%)	0.02 (+32.16%)	152.00 (-3.37%)	94.98 (-15.96%)	83.10 (-18.05%)	74.00 (-12.84%)	32.11 (+15.38%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	157.30 (n/a)	113.02 (n/a)	101.40 (n/a)	84.90 (n/a)	27.83 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-1.60%)	0.07 (-3.52%)	0.08 (-1.75%)	0.05 (+11.88%)	0.02 (-4.86%)	177.00 (-10.61%)	124.04 (+2.04%)	100.50 (+1.72%)	98.20 (+1.66%)	35.82 (-17.65%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	198.00 (n/a)	121.56 (n/a)	98.80 (n/a)	96.60 (n/a)	43.50 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.37 (+17.13%)	0.30 (+24.87%)	0.30 (+38.03%)	0.23 (+12.47%)	0.06 (+35.23%)
`0a6c11c` — 2025-12-04 00:39:10	0.32 (n/a)	0.24 (n/a)	0.22 (n/a)	0.20 (n/a)	0.04 (n/a)

matrix_vector_mul_128x128_32_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	0.26 (-1.81%)	0.24 (+4.06%)	0.24 (+0.52%)	0.21 (+16.97%)	0.02 (-48.16%)	0.26 (-1.81%)	0.24 (+4.06%)	0.24 (+0.52%)	0.20 (+16.97%)	0.02 (-48.16%)
`a4b6ffe` — 2026-01-05 19:24:05	0.26 (n/a)	0.23 (n/a)	0.24 (n/a)	0.18 (n/a)	0.04 (n/a)	0.26 (n/a)	0.23 (n/a)	0.24 (n/a)	0.17 (n/a)	0.04 (n/a)

matrix_vector_mul_128x128_32tsi_128tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.40 (+7.12%)	0.31 (-0.38%)	0.29 (-14.08%)	0.22 (+0.43%)	0.07 (+21.09%)	0.39 (+7.12%)	0.31 (-0.38%)	0.29 (-14.08%)	0.21 (+0.43%)	0.07 (+21.09%)
`897d04e` — 2026-03-06 22:12:25	0.37 (n/a)	0.31 (n/a)	0.34 (n/a)	0.22 (n/a)	0.06 (n/a)	0.36 (n/a)	0.31 (n/a)	0.34 (n/a)	0.21 (n/a)	0.06 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	13.57 (+3.47%)	13.15 (+1.09%)	13.10 (+0.16%)	12.52 (-1.58%)	0.37 (+153.19%)
`0a6c11c` — 2025-12-04 00:39:10	13.11 (n/a)	13.01 (n/a)	13.07 (n/a)	12.72 (n/a)	0.15 (n/a)

matrix_vector_mul_2048x8192_1_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	13.43 (-0.07%)	13.30 (+4.62%)	13.27 (+1.29%)	13.16 (+16.70%)	0.12 (-86.69%)	13.42 (-0.07%)	13.29 (+4.62%)	13.26 (+1.29%)	13.16 (+16.70%)	0.12 (-86.69%)
`a4b6ffe` — 2026-01-05 19:24:05	13.44 (n/a)	12.71 (n/a)	13.10 (n/a)	11.28 (n/a)	0.87 (n/a)	13.43 (n/a)	12.70 (n/a)	13.09 (n/a)	11.27 (n/a)	0.87 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	25.06 (+2.47%)	23.71 (+1.81%)	24.13 (+0.50%)	20.90 (+5.41%)	1.48 (-15.60%)
`0a6c11c` — 2025-12-04 00:39:10	24.46 (n/a)	23.29 (n/a)	24.01 (n/a)	19.83 (n/a)	1.75 (n/a)

matrix_vector_mul_2048x8192_1_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	24.46 (-0.60%)	21.07 (-8.03%)	19.75 (-17.83%)	18.08 (+1.18%)	3.03 (+7.07%)	24.44 (-0.60%)	21.06 (-8.03%)	19.74 (-17.83%)	18.07 (+1.18%)	3.03 (+7.07%)
`a4b6ffe` — 2026-01-05 19:24:05	24.60 (n/a)	22.91 (n/a)	24.04 (n/a)	17.87 (n/a)	2.83 (n/a)	24.59 (n/a)	22.90 (n/a)	24.02 (n/a)	17.86 (n/a)	2.83 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	42.05 (+1.54%)	40.50 (+12.60%)	40.49 (+2.36%)	38.98 (+97.53%)	0.97 (-88.09%)
`0a6c11c` — 2025-12-04 00:39:10	41.41 (n/a)	35.97 (n/a)	39.55 (n/a)	19.73 (n/a)	8.15 (n/a)

matrix_vector_mul_2048x8192_1_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	42.58 (+1.51%)	41.37 (+14.29%)	41.25 (+4.89%)	40.33 (+91.42%)	0.92 (-89.18%)	42.56 (+1.51%)	41.34 (+14.29%)	41.23 (+4.89%)	40.30 (+91.42%)	0.92 (-89.18%)
`a4b6ffe` — 2026-01-05 19:24:05	41.95 (n/a)	36.20 (n/a)	39.33 (n/a)	21.07 (n/a)	8.54 (n/a)	41.92 (n/a)	36.17 (n/a)	39.31 (n/a)	21.05 (n/a)	8.53 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	46.62 (+3.11%)	44.82 (+0.17%)	44.78 (+0.17%)	42.60 (-3.80%)	1.60 (+367.72%)
`0a6c11c` — 2025-12-04 00:39:10	45.21 (n/a)	44.75 (n/a)	44.70 (n/a)	44.29 (n/a)	0.34 (n/a)

matrix_vector_mul_2048x8192_1_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	46.04 (+4.14%)	45.06 (+3.47%)	44.55 (+2.76%)	44.30 (+2.84%)	0.87 (+66.58%)	46.01 (+4.14%)	45.03 (+3.47%)	44.52 (+2.76%)	44.27 (+2.84%)	0.87 (+66.58%)
`a4b6ffe` — 2026-01-05 19:24:05	44.21 (n/a)	43.55 (n/a)	43.35 (n/a)	43.07 (n/a)	0.52 (n/a)	44.18 (n/a)	43.52 (n/a)	43.32 (n/a)	43.05 (n/a)	0.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_1024tso_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	24.78 (+1.28%)	22.81 (-5.57%)	24.04 (-0.67%)	16.55 (-30.61%)	3.53 (+1327.03%)	24.77 (+1.28%)	22.80 (-5.57%)	24.02 (-0.67%)	16.54 (-30.61%)	3.52 (+1327.03%)
`897d04e` — 2026-03-06 22:12:25	24.47 (n/a)	24.16 (n/a)	24.20 (n/a)	23.84 (n/a)	0.25 (n/a)	24.46 (n/a)	24.15 (n/a)	24.18 (n/a)	23.83 (n/a)	0.25 (n/a)

matrix_vector_mul_2048x8192_1tsi_2048tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	13.42 (+1.31%)	13.24 (+1.67%)	13.22 (+0.90%)	13.10 (+4.29%)	0.14 (-47.52%)	13.41 (+1.31%)	13.23 (+1.67%)	13.21 (+0.90%)	13.09 (+4.29%)	0.14 (-47.52%)
`897d04e` — 2026-03-06 22:12:25	13.25 (n/a)	13.02 (n/a)	13.10 (n/a)	12.56 (n/a)	0.27 (n/a)	13.24 (n/a)	13.01 (n/a)	13.09 (n/a)	12.55 (n/a)	0.27 (n/a)

matrix_vector_mul_2048x8192_1tsi_256tso_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	46.48 (-2.57%)	44.91 (-1.03%)	45.19 (-0.06%)	42.63 (-1.94%)	1.41 (-7.02%)	46.45 (-2.57%)	44.89 (-1.03%)	45.16 (-0.06%)	42.60 (-1.94%)	1.41 (-7.02%)
`897d04e` — 2026-03-06 22:12:25	47.71 (n/a)	45.38 (n/a)	45.22 (n/a)	43.47 (n/a)	1.52 (n/a)	47.68 (n/a)	45.35 (n/a)	45.19 (n/a)	43.45 (n/a)	1.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_512tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	41.89 (+2.57%)	40.70 (+2.98%)	41.54 (+5.43%)	38.52 (-0.88%)	1.51 (+96.37%)	41.86 (+2.57%)	40.68 (+2.98%)	41.51 (+5.43%)	38.50 (-0.88%)	1.51 (+96.37%)
`897d04e` — 2026-03-06 22:12:25	40.84 (n/a)	39.53 (n/a)	39.40 (n/a)	38.87 (n/a)	0.77 (n/a)	40.81 (n/a)	39.50 (n/a)	39.37 (n/a)	38.84 (n/a)	0.77 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	13.29 (+1.63%)	13.19 (+6.08%)	13.19 (+1.17%)	13.09 (+26.86%)	0.08 (-92.94%)
`0a6c11c` — 2025-12-04 00:39:10	13.08 (n/a)	12.44 (n/a)	13.03 (n/a)	10.32 (n/a)	1.07 (n/a)

matrix_vector_mul_8192x2048_4_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	13.68 (+3.42%)	13.30 (+8.54%)	13.38 (+7.25%)	12.72 (+14.96%)	0.35 (-66.09%)	13.67 (+3.42%)	13.29 (+8.54%)	13.38 (+7.25%)	12.71 (+14.96%)	0.35 (-66.09%)
`a4b6ffe` — 2026-01-05 19:24:05	13.23 (n/a)	12.25 (n/a)	12.48 (n/a)	11.07 (n/a)	1.04 (n/a)	13.22 (n/a)	12.24 (n/a)	12.47 (n/a)	11.06 (n/a)	1.04 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	25.58 (+4.24%)	24.23 (+6.59%)	24.03 (+0.29%)	23.58 (+37.29%)	0.70 (-74.97%)
`0a6c11c` — 2025-12-04 00:39:10	24.54 (n/a)	22.73 (n/a)	23.96 (n/a)	17.18 (n/a)	2.79 (n/a)

matrix_vector_mul_8192x2048_4_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	25.08 (+1.32%)	24.68 (+13.42%)	24.61 (+3.26%)	24.47 (+48.32%)	0.24 (-93.56%)	25.07 (+1.32%)	24.67 (+13.42%)	24.59 (+3.26%)	24.46 (+48.32%)	0.24 (-93.56%)
`a4b6ffe` — 2026-01-05 19:24:05	24.76 (n/a)	21.76 (n/a)	23.83 (n/a)	16.50 (n/a)	3.74 (n/a)	24.74 (n/a)	21.75 (n/a)	23.82 (n/a)	16.49 (n/a)	3.73 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	40.94 (-2.19%)	39.74 (-1.10%)	39.76 (-0.60%)	38.17 (-2.14%)	1.04 (+4.39%)
`0a6c11c` — 2025-12-04 00:39:10	41.86 (n/a)	40.18 (n/a)	40.00 (n/a)	39.00 (n/a)	1.00 (n/a)

matrix_vector_mul_8192x2048_4_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	40.74 (-1.09%)	37.16 (-7.15%)	40.25 (+1.47%)	24.51 (-37.44%)	7.07 (+736.13%)	40.72 (-1.09%)	37.13 (-7.15%)	40.23 (+1.47%)	24.50 (-37.44%)	7.07 (+736.13%)
`a4b6ffe` — 2026-01-05 19:24:05	41.19 (n/a)	40.02 (n/a)	39.67 (n/a)	39.18 (n/a)	0.85 (n/a)	41.17 (n/a)	39.99 (n/a)	39.64 (n/a)	39.16 (n/a)	0.85 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	46.71 (-1.04%)	44.91 (-2.34%)	44.71 (-2.98%)	43.80 (-1.44%)	0.96 (+6.93%)
`0a6c11c` — 2025-12-04 00:39:10	47.20 (n/a)	45.98 (n/a)	46.08 (n/a)	44.44 (n/a)	0.90 (n/a)

matrix_vector_mul_8192x2048_4_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	46.28 (+5.68%)	44.89 (+14.59%)	44.74 (+4.26%)	44.20 (+62.80%)	0.84 (-87.96%)	46.25 (+5.68%)	44.86 (+14.59%)	44.71 (+4.26%)	44.17 (+62.80%)	0.84 (-87.96%)
`a4b6ffe` — 2026-01-05 19:24:05	43.79 (n/a)	39.17 (n/a)	42.91 (n/a)	27.15 (n/a)	6.98 (n/a)	43.77 (n/a)	39.15 (n/a)	42.88 (n/a)	27.13 (n/a)	6.98 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	13.47 (+0.97%)	12.79 (-3.06%)	13.17 (-0.07%)	10.88 (-17.09%)	1.08 (+1187.72%)	13.46 (+0.97%)	12.79 (-3.06%)	13.16 (-0.07%)	10.87 (-17.09%)	1.08 (+1187.77%)
`897d04e` — 2026-03-06 22:12:25	13.34 (n/a)	13.20 (n/a)	13.18 (n/a)	13.12 (n/a)	0.08 (n/a)	13.33 (n/a)	13.19 (n/a)	13.17 (n/a)	13.11 (n/a)	0.08 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	25.07 (+4.02%)	24.37 (+5.66%)	24.07 (+0.26%)	24.00 (+24.64%)	0.48 (-77.24%)	25.05 (+4.02%)	24.36 (+5.66%)	24.06 (+0.26%)	23.99 (+24.64%)	0.48 (-77.24%)
`897d04e` — 2026-03-06 22:12:25	24.10 (n/a)	23.07 (n/a)	24.01 (n/a)	19.26 (n/a)	2.13 (n/a)	24.08 (n/a)	23.05 (n/a)	23.99 (n/a)	19.25 (n/a)	2.13 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	41.95 (+2.80%)	40.93 (+3.41%)	41.49 (+4.36%)	38.92 (+1.67%)	1.23 (+12.22%)	41.92 (+2.80%)	40.90 (+3.41%)	41.46 (+4.36%)	38.89 (+1.67%)	1.23 (+12.22%)
`897d04e` — 2026-03-06 22:12:25	40.80 (n/a)	39.58 (n/a)	39.75 (n/a)	38.28 (n/a)	1.10 (n/a)	40.78 (n/a)	39.55 (n/a)	39.73 (n/a)	38.26 (n/a)	1.10 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`04bb5c6` — 2026-03-07 18:34:19	49.07 (-0.48%)	46.45 (+0.71%)	45.79 (+1.08%)	44.78 (+0.35%)	1.85 (-0.32%)	49.04 (-0.48%)	46.42 (+0.71%)	45.77 (+1.08%)	44.75 (+0.35%)	1.85 (-0.32%)
`897d04e` — 2026-03-06 22:12:25	49.31 (n/a)	46.12 (n/a)	45.30 (n/a)	44.62 (n/a)	1.85 (n/a)	49.28 (n/a)	46.10 (n/a)	45.28 (n/a)	44.59 (n/a)	1.85 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.07 (+22.03%)	0.06 (+27.86%)	0.06 (+35.49%)	0.05 (+15.00%)	0.01 (+49.69%)	173.30 (-13.00%)	137.94 (-21.32%)	133.60 (-26.19%)	123.40 (-18.06%)	18.40 (+8.53%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	199.20 (n/a)	175.32 (n/a)	181.00 (n/a)	150.60 (n/a)	16.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.07 (-16.43%)	0.06 (+1.14%)	0.07 (+4.14%)	0.04 (+21.66%)	0.01 (-35.59%)	203.50 (-17.81%)	138.62 (-6.58%)	123.20 (-3.98%)	119.80 (+19.68%)	36.35 (-38.07%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.03 (n/a)	0.02 (n/a)	247.60 (n/a)	148.38 (n/a)	128.30 (n/a)	100.10 (n/a)	58.70 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-16.99%)	0.05 (-12.47%)	0.05 (-7.32%)	0.04 (-11.17%)	0.00 (-29.61%)	197.00 (+12.57%)	171.00 (+13.70%)	164.00 (+7.89%)	153.00 (+20.47%)	17.49 (-4.32%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	175.00 (n/a)	150.40 (n/a)	152.00 (n/a)	127.00 (n/a)	18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+5.56%)	0.05 (-1.59%)	0.05 (-1.39%)	0.03 (-14.07%)	0.01 (+25.03%)	263.00 (+16.37%)	166.00 (+4.53%)	144.00 (+1.41%)	126.00 (-5.26%)	49.38 (+43.17%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	226.00 (n/a)	158.80 (n/a)	142.00 (n/a)	133.00 (n/a)	34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.08 (+10.93%)	0.07 (+7.79%)	0.07 (+3.55%)	0.05 (-1.73%)	0.01 (+36.73%)	150.20 (+1.76%)	121.68 (-6.36%)	125.60 (-3.38%)	97.90 (-9.85%)	18.56 (+21.98%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.01 (n/a)	147.60 (n/a)	129.94 (n/a)	130.00 (n/a)	108.60 (n/a)	15.21 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-1.08%)	0.09 (+17.77%)	0.10 (+26.89%)	0.06 (+17.21%)	0.02 (-15.12%)	126.70 (-14.68%)	93.54 (-17.24%)	81.60 (-21.24%)	75.00 (+1.21%)	22.13 (-30.16%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.02 (n/a)	148.50 (n/a)	113.02 (n/a)	103.60 (n/a)	74.10 (n/a)	31.69 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-15.32%)	0.05 (-17.09%)	0.05 (-23.81%)	0.04 (-15.54%)	0.01 (-18.18%)	193.00 (+18.40%)	160.80 (+20.36%)	168.00 (+31.25%)	124.00 (+18.10%)	22.92 (+11.39%)
`0999a9a` — 2025-11-13 19:24:08	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	163.00 (n/a)	133.60 (n/a)	128.00 (n/a)	105.00 (n/a)	20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-23.02%)	0.05 (-6.98%)	0.05 (-2.13%)	0.04 (-15.31%)	0.01 (-33.29%)	196.00 (+18.07%)	147.00 (+6.52%)	141.00 (+2.17%)	126.00 (+29.90%)	25.27 (+8.13%)
`0999a9a` — 2025-11-13 19:24:08	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	166.00 (n/a)	138.00 (n/a)	138.00 (n/a)	97.00 (n/a)	23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (+31.37%)	0.08 (+29.12%)	0.08 (+29.06%)	0.07 (+41.80%)	0.01 (+0.23%)	109.90 (-29.46%)	98.30 (-23.38%)	100.80 (-22.52%)	79.40 (-23.87%)	10.54 (-46.17%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	155.80 (n/a)	128.30 (n/a)	130.10 (n/a)	104.30 (n/a)	19.58 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+1.15%)	0.10 (+1.92%)	0.11 (+0.98%)	0.06 (+11.27%)	0.02 (-8.14%)	145.50 (-10.13%)	90.58 (-3.99%)	75.60 (-0.92%)	73.20 (-1.08%)	31.00 (-18.42%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.03 (n/a)	161.90 (n/a)	94.34 (n/a)	76.30 (n/a)	74.00 (n/a)	38.01 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (+25.02%)	0.07 (+10.01%)	0.07 (+7.53%)	0.05 (-1.99%)	0.01 (+77.08%)	150.10 (+2.04%)	114.60 (-7.22%)	111.70 (-6.99%)	83.90 (-20.02%)	21.23 (+43.54%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	147.10 (n/a)	123.52 (n/a)	120.10 (n/a)	104.90 (n/a)	14.79 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+14.95%)	0.09 (+16.03%)	0.11 (+17.68%)	0.06 (+37.78%)	0.02 (+0.65%)	146.30 (-27.43%)	92.80 (-17.20%)	77.10 (-15.09%)	73.60 (-13.00%)	30.77 (-38.63%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	201.60 (n/a)	112.08 (n/a)	90.80 (n/a)	84.60 (n/a)	50.14 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.07 (+11.97%)	0.05 (+3.09%)	0.05 (+2.10%)	0.03 (-11.35%)	0.01 (+41.65%)	229.00 (+12.81%)	156.00 (-0.51%)	143.00 (-2.05%)	117.00 (-10.69%)	38.21 (+48.71%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	203.00 (n/a)	156.80 (n/a)	146.00 (n/a)	131.00 (n/a)	25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+9.02%)	0.05 (+5.59%)	0.05 (+0.00%)	0.04 (+3.63%)	0.01 (+25.48%)	193.00 (-3.50%)	147.40 (-4.66%)	147.00 (+0.00%)	122.00 (-8.27%)	25.24 (+7.48%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	154.60 (n/a)	147.00 (n/a)	133.00 (n/a)	23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (-3.98%)	0.07 (+4.00%)	0.07 (+7.04%)	0.06 (+3.67%)	0.01 (-15.76%)	129.70 (-3.57%)	113.30 (-4.50%)	116.90 (-6.55%)	90.40 (+4.15%)	15.04 (-13.80%)
`0a6c11c` — 2025-12-04 00:39:10	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	134.50 (n/a)	118.64 (n/a)	125.10 (n/a)	86.80 (n/a)	17.45 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (+19.75%)	0.08 (-0.70%)	0.08 (-2.96%)	0.05 (-18.26%)	0.02 (+68.01%)	178.90 (+22.28%)	113.92 (+5.46%)	102.30 (+3.02%)	79.40 (-16.51%)	38.05 (+77.03%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	146.30 (n/a)	108.02 (n/a)	99.30 (n/a)	95.10 (n/a)	21.49 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.08 (+9.57%)	0.07 (+16.85%)	0.07 (+19.58%)	0.06 (+24.52%)	0.01 (+1.05%)	134.50 (-19.70%)	116.64 (-14.92%)	116.80 (-16.39%)	98.00 (-8.75%)	15.71 (-25.13%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	167.50 (n/a)	137.10 (n/a)	139.70 (n/a)	107.40 (n/a)	20.99 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (-13.47%)	0.07 (-22.07%)	0.09 (-17.73%)	0.05 (-13.63%)	0.02 (-6.17%)	165.40 (+15.83%)	119.06 (+29.50%)	96.10 (+21.65%)	89.80 (+15.57%)	35.22 (+23.60%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	142.80 (n/a)	91.94 (n/a)	79.00 (n/a)	77.70 (n/a)	28.50 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-13.48%)	0.05 (-17.79%)	0.05 (-15.33%)	0.03 (-25.09%)	0.01 (+6.67%)	267.00 (+33.50%)	176.80 (+24.51%)	150.00 (+18.11%)	141.00 (+15.57%)	47.41 (+61.41%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	142.00 (n/a)	127.00 (n/a)	122.00 (n/a)	29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (+13.38%)	0.05 (+23.85%)	0.05 (+37.91%)	0.05 (+30.72%)	0.00 (-56.85%)	166.00 (-23.50%)	153.40 (-20.60%)	153.00 (-27.49%)	142.00 (-11.80%)	7.63 (-70.60%)
`0999a9a` — 2025-11-13 19:24:08	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.01 (n/a)	217.00 (n/a)	193.20 (n/a)	211.00 (n/a)	161.00 (n/a)	25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (+16.31%)	0.08 (+15.34%)	0.08 (+14.60%)	0.07 (+19.30%)	0.01 (-5.41%)	117.30 (-16.15%)	107.80 (-13.61%)	108.50 (-12.78%)	94.10 (-13.99%)	8.29 (-32.01%)
`0a6c11c` — 2025-12-04 00:39:10	0.07 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	139.90 (n/a)	124.78 (n/a)	124.40 (n/a)	109.40 (n/a)	12.20 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-1.49%)	0.07 (-5.48%)	0.08 (-1.02%)	0.05 (-17.20%)	0.01 (+45.84%)	165.10 (+20.78%)	119.26 (+7.79%)	105.80 (+1.05%)	104.50 (+1.46%)	26.05 (+78.58%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	136.70 (n/a)	110.64 (n/a)	104.70 (n/a)	103.00 (n/a)	14.59 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (+12.61%)	0.07 (-2.24%)	0.07 (-8.85%)	0.06 (+5.13%)	0.01 (+35.50%)	136.50 (-4.88%)	120.86 (+2.96%)	125.10 (+9.64%)	91.60 (-11.15%)	15.72 (+10.46%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	143.50 (n/a)	117.38 (n/a)	114.10 (n/a)	103.10 (n/a)	14.23 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (+0.01%)	0.07 (+6.22%)	0.08 (+1.04%)	0.04 (-12.76%)	0.02 (+7.14%)	212.40 (+14.62%)	123.20 (-3.54%)	101.00 (-0.98%)	100.40 (+0.00%)	49.87 (+28.98%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	185.30 (n/a)	127.72 (n/a)	102.00 (n/a)	100.40 (n/a)	38.66 (n/a)

mha

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.18 (+0.16%)	0.18 (+0.19%)	0.18 (+0.12%)	0.18 (+0.32%)	0.00 (-52.24%)	47253.90 (-0.32%)	47213.70 (-0.19%)	47210.90 (-0.12%)	47167.70 (-0.16%)	28.71 (-52.47%)
`0a6c11c` — 2025-12-04 00:39:10	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47405.00 (n/a)	47301.72 (n/a)	47265.90 (n/a)	47241.80 (n/a)	60.40 (n/a)

mha0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`84d3478` — 2026-02-17 23:25:13	0.18 (-0.51%)	0.18 (-0.36%)	0.18 (-0.41%)	0.18 (-0.21%)	0.00 (-35.21%)	47468.60 (+0.21%)	47403.94 (+0.36%)	47426.00 (+0.41%)	47314.40 (+0.51%)	68.83 (-34.73%)
`1531781` — 2026-01-23 18:49:24	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47367.50 (n/a)	47232.68 (n/a)	47232.00 (n/a)	47073.00 (n/a)	105.45 (n/a)

mha_16384_64_1_8_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.18 (+0.07%)	0.18 (+0.16%)	0.18 (+0.06%)	0.18 (+0.33%)	0.00 (-46.08%)	47376.20 (-0.33%)	47304.70 (-0.16%)	47308.20 (-0.06%)	47234.30 (-0.07%)	59.38 (-46.31%)
`897d04e` — 2026-03-06 22:12:25	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47533.70 (n/a)	47380.56 (n/a)	47337.90 (n/a)	47268.00 (n/a)	110.60 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (+0.22%)	0.08 (+2.19%)	0.08 (-3.27%)	0.05 (-1.59%)	0.02 (-13.98%)	153.50 (+1.66%)	111.48 (-3.60%)	96.50 (+3.32%)	91.80 (-0.22%)	26.91 (-14.72%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.07 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	151.00 (n/a)	115.64 (n/a)	93.40 (n/a)	92.00 (n/a)	31.56 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (-0.11%)	0.08 (-4.49%)	0.09 (-1.54%)	0.05 (-19.71%)	0.02 (+48.26%)	162.80 (+24.56%)	111.66 (+7.74%)	95.70 (+1.59%)	93.40 (+0.11%)	29.73 (+85.10%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.06 (n/a)	0.01 (n/a)	130.70 (n/a)	103.64 (n/a)	94.20 (n/a)	93.30 (n/a)	16.06 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (-19.86%)	0.08 (-13.11%)	0.09 (-17.84%)	0.06 (+24.64%)	0.01 (-52.84%)	138.60 (-19.75%)	103.74 (+6.51%)	95.40 (+21.84%)	94.30 (+24.74%)	19.50 (-53.78%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.03 (n/a)	172.70 (n/a)	97.40 (n/a)	78.30 (n/a)	75.60 (n/a)	42.18 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (+0.10%)	0.07 (+1.41%)	0.08 (-0.18%)	0.05 (+14.66%)	0.01 (-15.54%)	176.60 (-12.79%)	118.08 (-4.03%)	103.50 (+0.19%)	101.20 (-0.10%)	32.77 (-26.27%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	202.50 (n/a)	123.04 (n/a)	103.30 (n/a)	101.30 (n/a)	44.44 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (+21.99%)	0.08 (+4.67%)	0.08 (-8.03%)	0.06 (+8.94%)	0.02 (+40.20%)	131.20 (-8.19%)	105.54 (-3.39%)	105.80 (+8.74%)	78.80 (-18.09%)	21.51 (+6.87%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	142.90 (n/a)	109.24 (n/a)	97.30 (n/a)	96.20 (n/a)	20.13 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (+23.58%)	0.08 (+5.74%)	0.08 (+0.14%)	0.05 (-10.22%)	0.02 (+86.13%)	163.50 (+11.38%)	107.34 (-0.72%)	98.10 (-0.10%)	78.40 (-19.09%)	35.18 (+62.10%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	146.80 (n/a)	108.12 (n/a)	98.20 (n/a)	96.90 (n/a)	21.70 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (-22.01%)	0.08 (-22.92%)	0.08 (-20.59%)	0.04 (-34.76%)	0.02 (-3.29%)	191.80 (+53.19%)	114.80 (+34.52%)	98.30 (+26.03%)	87.30 (+28.19%)	43.31 (+90.96%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.10 (n/a)	0.07 (n/a)	0.02 (n/a)	125.20 (n/a)	85.34 (n/a)	78.00 (n/a)	68.10 (n/a)	22.68 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (+1.05%)	0.07 (-14.36%)	0.07 (-13.82%)	0.04 (-24.49%)	0.02 (+53.60%)	185.50 (+32.50%)	128.96 (+21.66%)	113.10 (+16.00%)	95.70 (-1.03%)	37.85 (+99.02%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	140.00 (n/a)	106.00 (n/a)	97.50 (n/a)	96.70 (n/a)	19.02 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-3.76%)	0.07 (-8.60%)	0.08 (-9.12%)	0.05 (-3.63%)	0.01 (-6.65%)	157.90 (+3.75%)	115.92 (+9.09%)	105.20 (+10.04%)	97.00 (+3.97%)	25.43 (-1.06%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.01 (n/a)	152.20 (n/a)	106.26 (n/a)	95.60 (n/a)	93.30 (n/a)	25.71 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (+1.67%)	0.08 (-3.13%)	0.09 (+1.72%)	0.05 (-27.27%)	0.02 (+83.02%)	179.30 (+37.50%)	112.24 (+8.47%)	95.90 (-1.64%)	94.10 (-1.67%)	37.50 (+148.67%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	130.40 (n/a)	103.48 (n/a)	97.50 (n/a)	95.70 (n/a)	15.08 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-5.92%)	0.07 (-2.85%)	0.08 (-1.92%)	0.05 (+13.59%)	0.01 (-23.33%)	167.60 (-11.93%)	119.40 (-0.03%)	105.90 (+2.02%)	101.20 (+6.30%)	27.69 (-30.42%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	190.30 (n/a)	119.44 (n/a)	103.80 (n/a)	95.20 (n/a)	39.79 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.10 (-6.74%)	0.09 (-1.37%)	0.10 (-2.30%)	0.05 (+17.95%)	0.02 (-19.00%)	166.90 (-15.24%)	101.12 (-3.60%)	85.00 (+2.29%)	83.40 (+7.20%)	36.78 (-28.56%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	196.90 (n/a)	104.90 (n/a)	83.10 (n/a)	77.80 (n/a)	51.49 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.19 (-21.66%)	0.17 (-8.53%)	0.18 (+2.09%)	0.14 (-6.71%)	0.02 (-38.07%)	174.10 (+7.20%)	150.06 (+8.11%)	139.60 (-2.04%)	129.80 (+27.63%)	20.36 (-10.65%)
`d48746f` — 2026-01-12 22:17:10	0.24 (n/a)	0.18 (n/a)	0.17 (n/a)	0.15 (n/a)	0.04 (n/a)	162.40 (n/a)	138.80 (n/a)	142.50 (n/a)	101.70 (n/a)	22.79 (n/a)

rope_1c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	1.12 (+5.85%)	0.90 (+1.82%)	0.83 (-9.22%)	0.72 (+1.55%)	0.19 (+33.12%)	136.20 (-1.52%)	113.02 (-0.46%)	119.00 (+10.08%)	87.50 (-5.51%)	23.21 (+21.02%)
`897d04e` — 2026-03-06 22:12:25	1.06 (n/a)	0.89 (n/a)	0.91 (n/a)	0.71 (n/a)	0.15 (n/a)	138.30 (n/a)	113.54 (n/a)	108.10 (n/a)	92.60 (n/a)	19.18 (n/a)

rope_1c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.56 (-8.93%)	0.51 (+0.80%)	0.48 (+0.12%)	0.45 (+0.07%)	0.05 (-22.02%)	165.60 (-0.06%)	146.68 (-1.17%)	152.10 (-0.13%)	131.40 (+9.77%)	14.76 (-13.67%)
`897d04e` — 2026-03-06 22:12:25	0.62 (n/a)	0.50 (n/a)	0.48 (n/a)	0.44 (n/a)	0.07 (n/a)	165.70 (n/a)	148.42 (n/a)	152.30 (n/a)	119.70 (n/a)	17.10 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.21 (-0.56%)	0.17 (-10.62%)	0.16 (-13.58%)	0.13 (-13.33%)	0.03 (+17.05%)	183.70 (+15.39%)	151.76 (+12.77%)	155.20 (+15.73%)	117.30 (+0.60%)	24.24 (+35.73%)
`d48746f` — 2026-01-12 22:17:10	0.21 (n/a)	0.19 (n/a)	0.18 (n/a)	0.15 (n/a)	0.02 (n/a)	159.20 (n/a)	134.58 (n/a)	134.10 (n/a)	116.60 (n/a)	17.86 (n/a)

rope_2c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	1.19 (+9.98%)	1.01 (+13.27%)	1.04 (+11.65%)	0.75 (+32.18%)	0.18 (-12.29%)	130.50 (-24.35%)	99.58 (-13.89%)	94.90 (-10.39%)	82.70 (-9.12%)	19.41 (-41.35%)
`897d04e` — 2026-03-06 22:12:25	1.08 (n/a)	0.90 (n/a)	0.93 (n/a)	0.57 (n/a)	0.20 (n/a)	172.50 (n/a)	115.64 (n/a)	105.90 (n/a)	91.00 (n/a)	33.09 (n/a)

rope_2c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.94 (+7.29%)	0.61 (-3.22%)	0.55 (+7.38%)	0.47 (-3.70%)	0.19 (+7.37%)	157.30 (+3.83%)	128.46 (+3.55%)	133.80 (-6.89%)	78.50 (-6.77%)	30.26 (-2.26%)
`897d04e` — 2026-03-06 22:12:25	0.88 (n/a)	0.63 (n/a)	0.51 (n/a)	0.49 (n/a)	0.18 (n/a)	151.50 (n/a)	124.06 (n/a)	143.70 (n/a)	84.20 (n/a)	30.96 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.22 (+18.92%)	0.17 (+6.24%)	0.17 (+5.57%)	0.14 (-0.50%)	0.03 (+90.77%)	171.10 (+0.47%)	147.40 (-4.39%)	148.10 (-5.31%)	110.10 (-15.89%)	23.59 (+60.67%)
`d48746f` — 2026-01-12 22:17:10	0.19 (n/a)	0.16 (n/a)	0.16 (n/a)	0.14 (n/a)	0.02 (n/a)	170.30 (n/a)	154.16 (n/a)	156.40 (n/a)	130.90 (n/a)	14.69 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.17 (-1.30%)	0.15 (+6.63%)	0.15 (-8.78%)	0.14 (+39.68%)	0.01 (-67.35%)	174.90 (-28.41%)	163.42 (-10.36%)	167.40 (+9.63%)	146.50 (+1.31%)	11.19 (-76.17%)
`d48746f` — 2026-01-12 22:17:10	0.17 (n/a)	0.14 (n/a)	0.16 (n/a)	0.10 (n/a)	0.03 (n/a)	244.30 (n/a)	182.30 (n/a)	152.70 (n/a)	144.60 (n/a)	46.98 (n/a)

rope_8c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	1.13 (+5.72%)	0.95 (+7.13%)	1.09 (+6.41%)	0.69 (+28.13%)	0.22 (-3.34%)	142.70 (-21.94%)	109.10 (-8.46%)	90.10 (-6.05%)	87.30 (-5.42%)	28.07 (-27.62%)
`897d04e` — 2026-03-06 22:12:25	1.07 (n/a)	0.88 (n/a)	1.03 (n/a)	0.54 (n/a)	0.23 (n/a)	182.80 (n/a)	119.18 (n/a)	95.90 (n/a)	92.30 (n/a)	38.79 (n/a)

rope_8c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.64 (+14.66%)	0.54 (+12.71%)	0.51 (-3.12%)	0.50 (+38.90%)	0.06 (-31.74%)	146.10 (-28.03%)	137.60 (-13.08%)	145.00 (+3.28%)	114.50 (-12.80%)	13.47 (-57.08%)
`897d04e` — 2026-03-06 22:12:25	0.56 (n/a)	0.48 (n/a)	0.52 (n/a)	0.36 (n/a)	0.09 (n/a)	203.00 (n/a)	158.30 (n/a)	140.40 (n/a)	131.30 (n/a)	31.38 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+23.52%)	0.07 (-7.42%)	0.06 (-28.86%)	0.05 (+0.08%)	0.02 (+31.78%)	151.20 (-0.07%)	125.16 (+9.77%)	132.30 (+40.60%)	75.70 (-19.04%)	29.39 (+4.81%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	151.30 (n/a)	114.02 (n/a)	94.10 (n/a)	93.50 (n/a)	28.04 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (-19.28%)	0.08 (-12.81%)	0.08 (-24.65%)	0.05 (+9.69%)	0.01 (-49.49%)	160.90 (-8.84%)	113.18 (+5.97%)	102.10 (+32.77%)	94.70 (+23.95%)	27.60 (-38.40%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.03 (n/a)	176.50 (n/a)	106.80 (n/a)	76.90 (n/a)	76.40 (n/a)	44.81 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+19.87%)	0.08 (+6.72%)	0.09 (+6.47%)	0.05 (+9.82%)	0.03 (+61.31%)	156.30 (-8.92%)	110.80 (-1.88%)	94.10 (-6.09%)	75.30 (-16.61%)	39.70 (+19.25%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	171.60 (n/a)	112.92 (n/a)	100.20 (n/a)	90.30 (n/a)	33.29 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-19.51%)	0.06 (-28.35%)	0.05 (-46.44%)	0.05 (+18.01%)	0.02 (-38.47%)	180.60 (-15.25%)	139.78 (+28.03%)	155.80 (+86.81%)	102.70 (+24.33%)	35.18 (-39.44%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	213.10 (n/a)	109.18 (n/a)	83.40 (n/a)	82.60 (n/a)	58.09 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-1.89%)	0.09 (+3.47%)	0.11 (+0.85%)	0.06 (+27.91%)	0.03 (-14.45%)	147.50 (-21.79%)	103.38 (-8.35%)	78.00 (-0.76%)	77.20 (+1.98%)	35.64 (-30.18%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	188.60 (n/a)	112.80 (n/a)	78.60 (n/a)	75.70 (n/a)	51.04 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (-4.77%)	0.08 (+8.75%)	0.09 (+15.57%)	0.06 (+10.14%)	0.01 (-28.94%)	131.10 (-9.21%)	101.10 (-9.72%)	94.10 (-13.51%)	91.40 (+4.94%)	16.83 (-30.07%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.02 (n/a)	144.40 (n/a)	111.98 (n/a)	108.80 (n/a)	87.10 (n/a)	24.06 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-7.23%)	0.08 (-0.69%)	0.08 (+0.23%)	0.06 (+14.52%)	0.01 (-27.10%)	144.90 (-12.66%)	108.72 (-1.75%)	98.80 (-0.20%)	96.80 (+7.80%)	20.54 (-34.08%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	165.90 (n/a)	110.66 (n/a)	99.00 (n/a)	89.80 (n/a)	31.15 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-21.78%)	0.07 (-18.41%)	0.08 (-16.99%)	0.04 (-17.25%)	0.02 (-20.51%)	220.90 (+20.84%)	128.02 (+22.02%)	105.10 (+20.53%)	104.10 (+27.73%)	51.93 (+19.00%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	182.80 (n/a)	104.92 (n/a)	87.20 (n/a)	81.50 (n/a)	43.64 (n/a)

silu_mul_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.15 (n/a)	0.13 (n/a)	0.13 (n/a)	0.11 (n/a)	0.02 (n/a)	109.60 (n/a)	93.60 (n/a)	92.70 (n/a)	80.40 (n/a)	12.21 (n/a)

silu_mul_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.12 (n/a)	0.11 (n/a)	0.11 (n/a)	0.08 (n/a)	0.02 (n/a)	162.70 (n/a)	117.30 (n/a)	108.20 (n/a)	102.40 (n/a)	25.63 (n/a)

silu_mul_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.15 (n/a)	0.13 (n/a)	0.14 (n/a)	0.09 (n/a)	0.02 (n/a)	133.70 (n/a)	95.00 (n/a)	85.70 (n/a)	84.10 (n/a)	21.65 (n/a)

silu_mul_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.12 (n/a)	0.10 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	166.00 (n/a)	123.80 (n/a)	109.50 (n/a)	103.10 (n/a)	26.40 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.21 (+11.01%)	0.18 (+5.94%)	0.18 (+9.86%)	0.12 (-13.09%)	0.03 (+52.17%)	133.30 (+15.11%)	95.78 (-3.51%)	89.80 (-8.92%)	76.50 (-10.00%)	22.37 (+63.85%)
`897d04e` — 2026-03-06 22:12:25	0.19 (n/a)	0.17 (n/a)	0.17 (n/a)	0.14 (n/a)	0.02 (n/a)	115.80 (n/a)	99.26 (n/a)	98.60 (n/a)	85.00 (n/a)	13.65 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.21 (+8.28%)	0.18 (+13.83%)	0.20 (+17.90%)	0.13 (+15.20%)	0.04 (+14.07%)	126.50 (-13.18%)	91.96 (-12.15%)	80.60 (-15.16%)	77.40 (-7.64%)	21.01 (-13.06%)
`897d04e` — 2026-03-06 22:12:25	0.20 (n/a)	0.16 (n/a)	0.17 (n/a)	0.11 (n/a)	0.03 (n/a)	145.70 (n/a)	104.68 (n/a)	95.00 (n/a)	83.80 (n/a)	24.16 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.21 (-17.59%)	0.17 (-1.76%)	0.19 (+7.60%)	0.09 (-25.08%)	0.05 (-1.50%)	192.30 (+33.45%)	105.36 (+6.45%)	85.60 (-7.06%)	78.00 (+21.31%)	48.86 (+65.16%)
`897d04e` — 2026-03-06 22:12:25	0.25 (n/a)	0.18 (n/a)	0.18 (n/a)	0.11 (n/a)	0.05 (n/a)	144.10 (n/a)	98.98 (n/a)	92.10 (n/a)	64.30 (n/a)	29.58 (n/a)

swiglu

No metrics available.

swiglu_decode_1x2048x2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.00 (-15.46%)	0.00 (-27.20%)	0.00 (-28.17%)	0.00 (-33.90%)	0.00 (+1834.83%)	5187.20 (+51.28%)	4720.84 (+38.38%)	4750.90 (+39.22%)	4015.10 (+18.29%)	390.23 (+3298.45%)
`0a6c11c` — 2025-12-04 00:39:10	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	3428.80 (n/a)	3411.62 (n/a)	3412.60 (n/a)	3394.20 (n/a)	11.48 (n/a)

swiglu_decode_1x2048x2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.00 (+119.31%)	0.00 (+119.99%)	0.00 (+115.12%)	0.00 (+137.86%)	0.00 (+77.27%)	2173.90 (-57.96%)	1691.58 (-55.03%)	1584.50 (-53.51%)	1553.60 (-54.40%)	270.03 (-65.72%)
`897d04e` — 2026-03-06 22:12:25	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	5170.80 (n/a)	3761.80 (n/a)	3408.60 (n/a)	3407.30 (n/a)	787.66 (n/a)

swiglu_fused_decode_2048x2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	697.20 (n/a)	681.90 (n/a)	678.20 (n/a)	670.40 (n/a)	11.78 (n/a)

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.09 (+0.55%)	0.07 (-7.33%)	0.08 (-2.65%)	0.05 (-15.48%)	0.01 (+46.18%)	153.50 (+18.35%)	117.10 (+9.93%)	107.90 (+2.76%)	94.80 (-0.52%)	24.05 (+72.41%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	129.70 (n/a)	106.52 (n/a)	105.00 (n/a)	95.30 (n/a)	13.95 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (-0.79%)	0.08 (-14.63%)	0.08 (-30.22%)	0.06 (+13.35%)	0.02 (-22.81%)	141.10 (-11.76%)	106.78 (+12.49%)	109.10 (+43.36%)	75.30 (+0.80%)	24.51 (-33.25%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.02 (n/a)	159.90 (n/a)	94.92 (n/a)	76.10 (n/a)	74.70 (n/a)	36.73 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+32.40%)	0.09 (+23.51%)	0.11 (+37.27%)	0.06 (-9.63%)	0.02 (+177.72%)	142.70 (+10.62%)	95.98 (-14.76%)	77.70 (-27.11%)	76.50 (-24.48%)	29.10 (+124.34%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	129.00 (n/a)	112.60 (n/a)	106.60 (n/a)	101.30 (n/a)	12.97 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-0.94%)	0.07 (-9.81%)	0.08 (-1.66%)	0.05 (-21.76%)	0.02 (+90.01%)	170.90 (+27.82%)	127.48 (+15.89%)	103.70 (+1.77%)	100.30 (+1.01%)	35.15 (+142.58%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	133.70 (n/a)	110.00 (n/a)	101.90 (n/a)	99.30 (n/a)	14.49 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	3.93 (-7.02%)	3.68 (+2.48%)	3.66 (+1.82%)	3.45 (+15.62%)	0.15 (-63.64%)	151.80 (-13.50%)	142.70 (-3.59%)	143.40 (-1.78%)	133.50 (+7.49%)	5.90 (-66.22%)
`0a6c11c` — 2025-12-04 00:39:10	4.22 (n/a)	3.59 (n/a)	3.59 (n/a)	2.99 (n/a)	0.42 (n/a)	175.50 (n/a)	148.02 (n/a)	146.00 (n/a)	124.20 (n/a)	17.46 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	5.28 (+19.29%)	4.14 (+11.23%)	4.19 (+4.25%)	2.80 (-5.80%)	0.89 (+36.22%)	187.60 (+6.17%)	132.08 (-8.57%)	125.10 (-4.06%)	99.30 (-16.13%)	33.00 (+24.10%)
`897d04e` — 2026-03-06 22:12:25	4.43 (n/a)	3.73 (n/a)	4.02 (n/a)	2.97 (n/a)	0.65 (n/a)	176.70 (n/a)	144.46 (n/a)	130.40 (n/a)	118.40 (n/a)	26.60 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	5.11 (+15.57%)	3.85 (-3.32%)	3.40 (-18.64%)	3.29 (+7.09%)	0.71 (+49.14%)	159.60 (-6.61%)	140.18 (+4.80%)	154.20 (+22.97%)	102.60 (-13.49%)	22.70 (+19.77%)
`0a6c11c` — 2025-12-04 00:39:10	4.42 (n/a)	3.99 (n/a)	4.18 (n/a)	3.07 (n/a)	0.48 (n/a)	170.90 (n/a)	133.76 (n/a)	125.40 (n/a)	118.60 (n/a)	18.95 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	5.01 (-5.03%)	4.22 (-2.95%)	4.28 (-3.86%)	3.32 (+19.33%)	0.63 (-36.15%)	158.10 (-16.17%)	126.60 (-0.30%)	122.60 (+3.99%)	104.70 (+5.33%)	20.10 (-44.19%)
`897d04e` — 2026-03-06 22:12:25	5.27 (n/a)	4.35 (n/a)	4.45 (n/a)	2.78 (n/a)	0.98 (n/a)	188.60 (n/a)	126.98 (n/a)	117.90 (n/a)	99.40 (n/a)	36.02 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+29.18%)	0.09 (+32.80%)	0.10 (+42.76%)	0.06 (+17.20%)	0.02 (+50.94%)	144.50 (-14.65%)	93.06 (-23.21%)	79.10 (-29.94%)	77.30 (-22.62%)	28.92 (+1.42%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.01 (n/a)	169.30 (n/a)	121.18 (n/a)	112.90 (n/a)	99.90 (n/a)	28.51 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+0.47%)	0.10 (+0.89%)	0.11 (+1.22%)	0.07 (+26.80%)	0.01 (-31.83%)	110.60 (-21.11%)	86.96 (-4.23%)	77.80 (-1.27%)	77.60 (-0.39%)	14.46 (-47.66%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	140.20 (n/a)	90.80 (n/a)	78.80 (n/a)	77.90 (n/a)	27.62 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.11 (+0.40%)	0.08 (-11.75%)	0.08 (-17.52%)	0.06 (-4.23%)	0.02 (-8.22%)	132.30 (+4.42%)	100.54 (+12.74%)	96.60 (+21.20%)	76.90 (-0.39%)	20.02 (-5.11%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	126.70 (n/a)	89.18 (n/a)	79.70 (n/a)	77.20 (n/a)	21.10 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`04bb5c6` — 2026-03-07 18:34:19	0.08 (-0.71%)	0.07 (+0.40%)	0.08 (-0.47%)	0.05 (+0.06%)	0.01 (+0.36%)	177.70 (-0.06%)	118.96 (-0.39%)	104.40 (+0.38%)	103.60 (+0.68%)	32.85 (+0.38%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.05 (n/a)	0.01 (n/a)	177.80 (n/a)	119.42 (n/a)	104.00 (n/a)	102.90 (n/a)	32.72 (n/a)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

swiglu_fused_decode: Replace DDR partial-sum reduction with on-chip MemTile join + dedicated reduction tile. Stage 2 partials flow through ObjectFIFO join into a single reduction tile that sums element-wise, producing the final output directly. Eliminates 12 KB of DDR output traffic (16 KB partials -> 4 KB single output) and removes host-side partials.sum(dim=0) call. 3-stage pipeline: dual-GEMV+SiLU+Mul -> down-proj GEMV -> on-chip reduce. flowkv_decode: Fuse RoPE rotation into the score tile kernel. Q angles (cos/sin interleaved, 128 bytes) are packed into the Q FIFO buffer alongside query vectors, staying within the 2-input DMA channel limit. The score tile applies two-halves RoPE to Q in-register before the Q*K^T dot product. K is assumed pre-rotated in the KV cache (standard practice). Eliminates RoPE as a separate operator invocation. Both changes verified on AMD Ryzen AI NPU hardware (10/10 tests passed). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

On-chip MemTile reduction added ~400 us pipeline serialization to save only 12 KB DDR traffic (~0.5 us). DDR partials with host sum() is 1.32x faster than baseline vs 1.20x with on-chip reduce. Keep the faster approach. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

github-actions · 2026-03-07T19:01:57Z

📊 Test Results for Small Benchmark/Test Suite

ae902f6 (2026_03_07_19_01_16)

IRONCLAD

Tested on 2026_03_07_19_01_16 at commit ae902f6.

Test	Checks	Latency (mean)	Bandwidth (mean)	GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0_0	✅ 5/5	100.28	0.13	n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0_0	✅ 5/5	115.62	0.11	n/a
axpy_4_cols_2_channels_2048_tile_512_3.0_0	✅ 5/5	126.20	0.10	n/a
axpy_8_cols_2_channels_2048_tile_256_3.0_0	✅ 5/5	145.42	0.09	n/a
dequant_1_cols_1_channels_2048_tile_2048_0	✅ 5/5	123.56	0.04	n/a
dequant_1_cols_2_channels_2048_tile_1024_0	✅ 5/5	122.58	0.04	n/a
dequant_2_cols_1_channels_2048_tile_1024_0	✅ 5/5	113.82	0.05	n/a
dequant_2_cols_2_channels_2048_tile_512_0	✅ 5/5	111.46	0.05	n/a
dequant_4_cols_1_channels_2048_tile_512_0	✅ 5/5	112.32	0.05	n/a
dequant_4_cols_2_channels_2048_tile_256_0	✅ 5/5	124.00	0.05	n/a
dequant_8_cols_1_channels_2048_tile_256_0	✅ 5/5	134.10	0.04	n/a
dequant_8_cols_2_channels_2048_tile_128_0	✅ 5/5	146.38	0.04	n/a
dual_gemv_silu_mul_2048x2048_4tsi_512tso_4col0	✅ 5/5	480.72	34.95	n/a
eltwise_add_1_cols_2_channels_2048_tile_2048	✅ 5/5	106.74	0.12	n/a
eltwise_add_2_cols_2_channels_2048_tile_1024	✅ 5/5	100.40	0.13	n/a
eltwise_add_4_cols_2_channels_2048_tile_512	✅ 5/5	121.56	0.10	n/a
eltwise_add_8_cols_2_channels_2048_tile_256	✅ 5/5	110.84	0.11	n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048	✅ 5/5	97.30	0.13	n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024	✅ 5/5	105.14	0.12	n/a
eltwise_mul_4_cols_2_channels_2048_tile_512	✅ 5/5	122.86	0.10	n/a
eltwise_mul_8_cols_2_channels_2048_tile_256	✅ 5/5	129.68	0.10	n/a
flowkv_decode_32h_8kv_64d_128s_32cs_4col0	✅ 5/5	357.52	0.76	n/a
fused_dequant_gemv_2048x2048_1tsi_512tso_4col_g32_0	✅ 5/5	1376.84	1.75	n/a
fused_qkv_proj_3072x2048_4tsi_768tso_4col0	✅ 5/5	396.24	31.87	n/a
gelu_1_cols_1_channels_2048_tile_2048	✅ 5/5	97.00	0.09	n/a
gelu_1_cols_2_channels_2048_tile_1024	✅ 5/5	99.74	0.09	n/a
gelu_2_cols_1_channels_2048_tile_1024	✅ 5/5	98.48	0.09	n/a
gelu_2_cols_2_channels_2048_tile_512	✅ 5/5	90.16	0.09	n/a
gelu_4_cols_1_channels_2048_tile_512	✅ 5/5	112.18	0.08	n/a
gelu_4_cols_2_channels_2048_tile_256	✅ 5/5	94.10	0.09	n/a
gelu_8_cols_1_channels_2048_tile_256	✅ 5/5	99.24	0.09	n/a
gelu_8_cols_2_channels_2048_tile_128	✅ 5/5	116.72	0.07	n/a
gemm_1792x896x1152_64x32x48_8cols_ccolmaj	✅ 5/5	2473.08	4.20	n/a
gemm_192x384x64_48x96x16_4cols	✅ 5/5	144.64	1.60	n/a
gemm_192x384x64_48x96x16_4cols_bcolmaj_ccolmaj	✅ 5/5	137.90	1.84	n/a
gemm_2048x2048x2048_64x64x64_1cols	✅ 5/5	48387.00	0.52	n/a
gemm_2048x2048x2048_64x64x64_2cols_bcolmaj	✅ 5/5	27692.32	0.91	n/a
gemm_2048x2048x2048_64x64x64_8cols_bcolmaj_ccolmaj	✅ 5/5	7383.98	3.41	n/a
gemm_384x1536x1792_32x48x64_4cols_bcolmaj	✅ 5/5	1949.62	4.17	n/a
gemm_896x1792x640_32x64x80_8cols_ccolmaj	✅ 5/5	1036.42	6.52	n/a
layer_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	94.32	0.09	n/a
layer_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	92.44	0.10	n/a
layer_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	99.26	0.09	n/a
layer_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	91.10	0.10	n/a
layer_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	93.98	0.09	n/a
layer_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	102.42	0.09	n/a
layer_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	107.52	0.08	n/a
layer_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	127.66	0.07	n/a
matrix_vector_mul_128x128_32tsi_128tso_1col0	✅ 5/5	n/a	0.30	n/a
matrix_vector_mul_2048x8192_1tsi_1024tso_2col0	✅ 5/5	n/a	23.80	n/a
matrix_vector_mul_2048x8192_1tsi_2048tso_1col0	✅ 5/5	n/a	12.63	n/a
matrix_vector_mul_2048x8192_1tsi_256tso_8col0	✅ 5/5	n/a	45.80	n/a
matrix_vector_mul_2048x8192_1tsi_512tso_4col0	✅ 5/5	n/a	39.83	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_1col0	✅ 5/5	n/a	13.10	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_2col0	✅ 5/5	n/a	23.44	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_4col0	✅ 5/5	n/a	39.20	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_8col0	✅ 5/5	n/a	44.92	n/a
mem_copy_16_cores_2_chans_2048_tile_128_False0	✅ 5/5	131.54	0.06	n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False0	✅ 5/5	97.86	0.08	n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False0	✅ 5/5	115.08	0.07	n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False0	✅ 5/5	87.72	0.10	n/a
mem_copy_4_cores_1_chans_2048_tile_512_False0	✅ 5/5	83.58	0.10	n/a
mem_copy_4_cores_2_chans_2048_tile_512_False0	✅ 5/5	114.52	0.07	n/a
mem_copy_8_cores_1_chans_2048_tile_256_False0	✅ 5/5	117.04	0.08	n/a
mem_copy_8_cores_2_chans_2048_tile_256_False0	✅ 5/5	113.98	0.08	n/a
mha_16384_64_1_8_0_0	✅ 5/5	47333.76	0.18	n/a
relu_1_cols_1_channels_2048_tile_2048	✅ 5/5	105.94	0.09	n/a
relu_2_cols_1_channels_2048_tile_1024	✅ 5/5	116.10	0.07	n/a
relu_4_cols_1_channels_2048_tile_512	✅ 5/5	103.68	0.08	n/a
relu_8_cols_1_channels_2048_tile_256	✅ 5/5	116.50	0.07	n/a
rms_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	114.22	0.07	n/a
rms_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	116.84	0.07	n/a
rms_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	93.98	0.10	n/a
rms_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	109.86	0.08	n/a
rms_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	110.92	0.08	n/a
rms_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	104.10	0.08	n/a
rms_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	105.04	0.08	n/a
rms_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	98.60	0.09	n/a
rope_1c_32rows_512cols_32arows_0m	✅ 5/5	124.28	0.85	n/a
rope_1c_32rows_512cols_8arows_0m	✅ 5/5	130.82	0.56	n/a
rope_2c_32rows_512cols_32arows_0m	✅ 5/5	115.62	0.88	n/a
rope_2c_32rows_512cols_8arows_0m	✅ 5/5	144.96	0.51	n/a
rope_8c_32rows_512cols_32arows_0m	✅ 5/5	126.68	0.90	n/a
rope_8c_32rows_512cols_8arows_0m	✅ 5/5	168.10	0.45	n/a
sigmoid_1_cols_1_channels_2048_tile_2048	✅ 5/5	117.00	0.07	n/a
sigmoid_2_cols_1_channels_2048_tile_1024	✅ 5/5	92.90	0.09	n/a
sigmoid_4_cols_1_channels_2048_tile_512	✅ 5/5	104.22	0.08	n/a
sigmoid_8_cols_1_channels_2048_tile_256	✅ 5/5	106.12	0.09	n/a
silu_1_cols_1_channels_2048_tile_2048	✅ 5/5	119.40	0.07	n/a
silu_2_cols_1_channels_2048_tile_1024	✅ 5/5	121.06	0.07	n/a
silu_4_cols_1_channels_2048_tile_512	✅ 5/5	105.24	0.08	n/a
silu_8_cols_1_channels_2048_tile_256	✅ 5/5	101.02	0.08	n/a
silu_mul_1_cols_2_channels_2048_tile_2048	✅ 5/5	126.26	0.10	n/a
silu_mul_2_cols_2_channels_2048_tile_1024	✅ 5/5	107.40	0.12	n/a
silu_mul_4_cols_2_channels_2048_tile_512	✅ 5/5	121.20	0.11	n/a
silu_mul_8_cols_2_channels_2048_tile_256	✅ 5/5	126.84	0.10	n/a
softmax_1_cols_2_channels_4096_tile_2048	✅ 5/5	112.10	0.15	n/a
softmax_2_cols_2_channels_4096_tile_1024	✅ 5/5	115.62	0.15	n/a
softmax_2_cols_2_channels_4096_tile_512	✅ 5/5	104.22	0.16	n/a
swiglu_decode_1x2048x2048_0	✅ 5/5	1773.72	0.00	n/a
swiglu_fused_decode_2048x2048_0	✅ 5/5	693.76	0.01	n/a
tanh_1_cols_1_channels_2048_tile_2048	✅ 5/5	105.18	0.08	n/a
tanh_2_cols_1_channels_2048_tile_1024	✅ 5/5	101.34	0.08	n/a
tanh_4_cols_1_channels_2048_tile_512	✅ 5/5	94.00	0.10	n/a
tanh_8_cols_1_channels_2048_tile_256	✅ 5/5	115.16	0.08	n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0	✅ 5/5	134.66	3.95	n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0	✅ 5/5	126.62	4.23	n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048	✅ 5/5	85.16	0.10	n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024	✅ 5/5	102.64	0.09	n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512	✅ 5/5	122.62	0.07	n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256	✅ 5/5	133.58	0.07	n/a

📈 Trends (vs main branch) for Small Benchmark/Test Suite

ae902f6 (2026_03_07_19_01_16)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.13 (-1.96%)	0.11 (+2.52%)	0.10 (+1.86%)	0.08 (-1.91%)	0.02 (-1.72%)	162.40 (+1.95%)	120.96 (-2.36%)	117.00 (-1.85%)	94.40 (+2.05%)	23.11 (+4.09%)
`0a6c11c` — 2025-12-04 00:39:10	0.13 (n/a)	0.10 (n/a)	0.10 (n/a)	0.08 (n/a)	0.02 (n/a)	159.30 (n/a)	123.88 (n/a)	119.20 (n/a)	92.50 (n/a)	22.21 (n/a)

axpy_1_cols_2_channels_2048_tile_2048_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.16 (+0.17%)	0.13 (-5.94%)	0.12 (-17.58%)	0.10 (-0.35%)	0.03 (+8.91%)	126.20 (+0.40%)	100.28 (+7.18%)	101.30 (+21.32%)	74.90 (-0.13%)	24.61 (+9.97%)
`897d04e` — 2026-03-06 22:12:25	0.16 (n/a)	0.14 (n/a)	0.15 (n/a)	0.10 (n/a)	0.03 (n/a)	125.70 (n/a)	93.56 (n/a)	83.50 (n/a)	75.00 (n/a)	22.38 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.11 (-26.77%)	0.09 (-9.09%)	0.09 (-10.81%)	0.08 (+8.25%)	0.01 (-55.42%)	152.00 (-7.60%)	135.46 (+6.28%)	142.80 (+12.18%)	115.00 (+36.58%)	15.03 (-41.36%)
`0a6c11c` — 2025-12-04 00:39:10	0.15 (n/a)	0.10 (n/a)	0.10 (n/a)	0.07 (n/a)	0.02 (n/a)	164.50 (n/a)	127.46 (n/a)	127.30 (n/a)	84.20 (n/a)	25.64 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.14 (+12.00%)	0.11 (+5.60%)	0.13 (+13.19%)	0.07 (+7.51%)	0.03 (+22.99%)	169.90 (-7.01%)	115.62 (-4.34%)	97.90 (-11.64%)	85.80 (-10.72%)	34.52 (-1.81%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	182.70 (n/a)	120.86 (n/a)	110.80 (n/a)	96.10 (n/a)	35.16 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.12 (-10.21%)	0.10 (-8.41%)	0.10 (-6.20%)	0.07 (+3.52%)	0.02 (-23.48%)	166.70 (-3.36%)	128.78 (+7.33%)	121.80 (+6.65%)	103.90 (+11.36%)	22.95 (-18.82%)
`0a6c11c` — 2025-12-04 00:39:10	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	172.50 (n/a)	119.98 (n/a)	114.20 (n/a)	93.30 (n/a)	28.27 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.13 (+2.06%)	0.10 (-4.21%)	0.09 (-22.79%)	0.08 (+27.59%)	0.02 (-16.32%)	152.20 (-21.59%)	126.20 (+1.35%)	133.80 (+29.53%)	95.30 (-1.95%)	25.31 (-37.23%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.12 (n/a)	0.06 (n/a)	0.03 (n/a)	194.10 (n/a)	124.52 (n/a)	103.30 (n/a)	97.20 (n/a)	40.32 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (-16.19%)	0.08 (-10.40%)	0.09 (-2.09%)	0.07 (-17.38%)	0.01 (-10.61%)	184.40 (+21.00%)	153.18 (+11.99%)	144.10 (+2.20%)	127.10 (+19.34%)	21.26 (+34.76%)
`0a6c11c` — 2025-12-04 00:39:10	0.12 (n/a)	0.09 (n/a)	0.09 (n/a)	0.08 (n/a)	0.01 (n/a)	152.40 (n/a)	136.78 (n/a)	141.00 (n/a)	106.50 (n/a)	15.78 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (-15.15%)	0.09 (-20.08%)	0.08 (-29.12%)	0.07 (-13.85%)	0.02 (-0.23%)	181.40 (+16.06%)	145.42 (+26.17%)	159.00 (+41.08%)	112.50 (+17.80%)	31.15 (+28.01%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.08 (n/a)	0.02 (n/a)	156.30 (n/a)	115.26 (n/a)	112.70 (n/a)	95.50 (n/a)	24.34 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (-18.83%)	0.04 (-5.21%)	0.04 (-2.69%)	0.03 (+37.10%)	0.00 (-53.98%)	160.40 (-27.06%)	141.12 (-0.91%)	136.40 (+2.79%)	114.30 (+23.17%)	17.37 (-59.06%)
`0a6c11c` — 2025-12-04 00:39:10	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	219.90 (n/a)	142.42 (n/a)	132.70 (n/a)	92.80 (n/a)	42.43 (n/a)

dequant_1_cols_1_channels_2048_tile_2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.05 (+12.20%)	0.04 (+4.10%)	0.04 (-1.27%)	0.04 (+5.78%)	0.01 (+24.80%)	149.80 (-5.43%)	123.56 (-3.56%)	125.30 (+1.21%)	98.40 (-10.87%)	18.80 (+2.41%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	158.40 (n/a)	128.12 (n/a)	123.80 (n/a)	110.40 (n/a)	18.36 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.06 (-13.28%)	0.05 (-8.93%)	0.06 (-13.59%)	0.04 (+4.63%)	0.01 (-39.10%)	133.60 (-4.43%)	106.08 (+5.85%)	95.10 (+15.69%)	87.90 (+15.35%)	17.90 (-31.97%)
`0a6c11c` — 2025-12-04 00:39:10	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	139.80 (n/a)	100.22 (n/a)	82.20 (n/a)	76.20 (n/a)	26.31 (n/a)

dequant_1_cols_2_channels_2048_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.06 (-13.77%)	0.04 (-10.65%)	0.04 (-22.90%)	0.03 (+5.52%)	0.01 (-13.23%)	154.10 (-5.29%)	122.58 (+10.59%)	128.20 (+29.76%)	94.50 (+15.95%)	27.13 (-12.52%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	162.70 (n/a)	110.84 (n/a)	98.80 (n/a)	81.50 (n/a)	31.02 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.07 (+5.66%)	0.05 (+1.21%)	0.05 (+0.61%)	0.04 (-15.02%)	0.01 (+58.42%)	143.40 (+17.64%)	101.02 (+1.49%)	97.60 (-0.61%)	78.90 (-5.40%)	22.56 (+78.52%)
`0a6c11c` — 2025-12-04 00:39:10	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	121.90 (n/a)	99.54 (n/a)	98.20 (n/a)	83.40 (n/a)	12.64 (n/a)

dequant_2_cols_1_channels_2048_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.06 (-3.13%)	0.05 (+1.07%)	0.05 (+4.20%)	0.03 (+0.18%)	0.01 (-1.16%)	152.00 (-0.20%)	113.82 (-1.09%)	96.70 (-4.07%)	91.00 (+3.29%)	27.12 (-0.27%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	152.30 (n/a)	115.08 (n/a)	100.80 (n/a)	88.10 (n/a)	27.20 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (+17.06%)	0.04 (+8.98%)	0.05 (+21.37%)	0.03 (-11.65%)	0.01 (+301.89%)	159.70 (+13.18%)	126.32 (-5.68%)	109.00 (-17.67%)	106.80 (-14.56%)	22.48 (+280.15%)
`0a6c11c` — 2025-12-04 00:39:10	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	141.10 (n/a)	133.92 (n/a)	132.40 (n/a)	125.00 (n/a)	5.91 (n/a)

dequant_2_cols_2_channels_2048_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.06 (-12.03%)	0.05 (+2.96%)	0.05 (+6.46%)	0.04 (+21.73%)	0.01 (-37.21%)	135.30 (-17.85%)	111.46 (-6.43%)	112.90 (-6.07%)	85.90 (+13.62%)	19.00 (-39.88%)
`897d04e` — 2026-03-06 22:12:25	0.07 (n/a)	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	164.70 (n/a)	119.12 (n/a)	120.20 (n/a)	75.60 (n/a)	31.61 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.06 (+20.24%)	0.05 (-3.19%)	0.05 (-6.73%)	0.03 (-20.69%)	0.01 (+194.26%)	156.10 (+26.09%)	120.86 (+7.15%)	114.90 (+7.18%)	88.30 (-16.85%)	24.40 (+214.82%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	123.80 (n/a)	112.80 (n/a)	107.20 (n/a)	106.20 (n/a)	7.75 (n/a)

dequant_4_cols_1_channels_2048_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.06 (+3.53%)	0.05 (+9.32%)	0.05 (+12.34%)	0.03 (+3.92%)	0.01 (+13.06%)	158.40 (-3.77%)	112.32 (-8.04%)	103.10 (-11.04%)	94.10 (-3.49%)	26.23 (+4.58%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	164.60 (n/a)	122.14 (n/a)	115.90 (n/a)	97.50 (n/a)	25.08 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (-6.09%)	0.04 (-8.04%)	0.04 (-12.46%)	0.03 (-0.41%)	0.01 (-20.19%)	168.10 (+0.42%)	135.74 (+7.44%)	132.20 (+14.26%)	107.40 (+6.44%)	22.91 (-12.67%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	167.40 (n/a)	126.34 (n/a)	115.70 (n/a)	100.90 (n/a)	26.23 (n/a)

dequant_4_cols_2_channels_2048_tile_256_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.06 (-0.51%)	0.05 (+0.35%)	0.05 (+17.03%)	0.03 (-0.93%)	0.01 (+11.89%)	167.90 (+0.90%)	124.00 (+1.36%)	109.10 (-14.57%)	85.00 (+0.47%)	36.28 (+19.08%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	166.40 (n/a)	122.34 (n/a)	127.70 (n/a)	84.60 (n/a)	30.47 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.04 (-13.65%)	0.04 (-13.67%)	0.04 (-18.56%)	0.03 (-13.52%)	0.00 (-23.88%)	170.40 (+15.68%)	140.12 (+15.33%)	135.80 (+22.78%)	119.60 (+15.78%)	17.94 (+1.87%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	147.30 (n/a)	121.50 (n/a)	110.60 (n/a)	103.30 (n/a)	17.61 (n/a)

dequant_8_cols_1_channels_2048_tile_256_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.04 (-6.35%)	0.04 (-6.02%)	0.04 (-6.73%)	0.04 (+0.54%)	0.00 (-39.28%)	141.90 (-0.56%)	134.10 (+6.06%)	134.80 (+7.24%)	123.30 (+6.75%)	6.75 (-36.35%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	142.70 (n/a)	126.44 (n/a)	125.70 (n/a)	115.50 (n/a)	10.61 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (+17.21%)	0.03 (-1.70%)	0.03 (-3.04%)	0.03 (-16.20%)	0.01 (+95.59%)	198.20 (+19.33%)	160.00 (+4.92%)	166.20 (+3.17%)	106.50 (-14.66%)	29.86 (+87.19%)
`0a6c11c` — 2025-12-04 00:39:10	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.00 (n/a)	166.10 (n/a)	152.50 (n/a)	161.10 (n/a)	124.80 (n/a)	15.95 (n/a)

dequant_8_cols_2_channels_2048_tile_128_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.04 (+15.99%)	0.04 (+0.45%)	0.03 (-10.66%)	0.03 (+16.63%)	0.01 (+3.36%)	165.50 (-14.29%)	146.38 (-0.88%)	152.40 (+11.98%)	116.70 (-13.81%)	18.99 (-25.25%)
`897d04e` — 2026-03-06 22:12:25	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	193.10 (n/a)	147.68 (n/a)	136.10 (n/a)	135.40 (n/a)	25.41 (n/a)

dual_gemv_silu_mul_2048x2048_4tsi_512tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	36.76 (n/a)	34.95 (n/a)	34.68 (n/a)	34.11 (n/a)	1.07 (n/a)	492.20 (n/a)	480.72 (n/a)	484.00 (n/a)	456.60 (n/a)	14.27 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.15 (-4.34%)	0.12 (-6.77%)	0.12 (-18.25%)	0.08 (-7.80%)	0.03 (-3.43%)	158.10 (+8.51%)	106.74 (+7.51%)	102.10 (+22.42%)	81.10 (+4.51%)	31.30 (+9.08%)
`897d04e` — 2026-03-06 22:12:25	0.16 (n/a)	0.13 (n/a)	0.15 (n/a)	0.08 (n/a)	0.03 (n/a)	145.70 (n/a)	99.28 (n/a)	83.40 (n/a)	77.60 (n/a)	28.70 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.16 (+35.11%)	0.13 (+25.63%)	0.15 (+29.12%)	0.09 (+18.15%)	0.04 (+65.38%)	133.80 (-15.37%)	100.40 (-18.05%)	81.30 (-22.57%)	75.00 (-26.04%)	30.03 (+9.09%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.12 (n/a)	0.08 (n/a)	0.02 (n/a)	158.10 (n/a)	122.52 (n/a)	105.00 (n/a)	101.40 (n/a)	27.53 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.12 (-23.31%)	0.10 (-12.97%)	0.12 (-17.89%)	0.08 (+22.81%)	0.02 (-51.48%)	161.80 (-18.57%)	121.56 (+5.03%)	105.30 (+21.73%)	103.40 (+30.39%)	25.84 (-49.03%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.12 (n/a)	0.14 (n/a)	0.06 (n/a)	0.04 (n/a)	198.70 (n/a)	115.74 (n/a)	86.50 (n/a)	79.30 (n/a)	50.70 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.12 (+9.02%)	0.11 (+9.86%)	0.11 (+3.44%)	0.10 (+39.17%)	0.01 (-51.42%)	126.50 (-28.17%)	110.84 (-11.43%)	109.00 (-3.28%)	102.20 (-8.26%)	9.22 (-67.64%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	176.10 (n/a)	125.14 (n/a)	112.70 (n/a)	111.40 (n/a)	28.50 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.16 (+9.33%)	0.13 (+3.90%)	0.14 (+3.87%)	0.08 (+13.24%)	0.03 (-3.36%)	146.60 (-11.74%)	97.30 (-5.24%)	85.90 (-3.70%)	76.60 (-8.48%)	28.27 (-20.52%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.13 (n/a)	0.14 (n/a)	0.07 (n/a)	0.03 (n/a)	166.10 (n/a)	102.68 (n/a)	89.20 (n/a)	83.70 (n/a)	35.57 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.12 (-19.82%)	0.12 (-11.74%)	0.12 (-19.85%)	0.11 (+15.25%)	0.01 (-74.34%)	116.70 (-13.17%)	105.14 (+9.43%)	102.80 (+24.76%)	101.60 (+24.66%)	6.49 (-71.58%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.13 (n/a)	0.15 (n/a)	0.09 (n/a)	0.03 (n/a)	134.40 (n/a)	96.08 (n/a)	82.40 (n/a)	81.50 (n/a)	22.84 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.12 (+6.28%)	0.10 (+2.43%)	0.11 (+5.47%)	0.08 (+30.84%)	0.02 (-10.34%)	150.10 (-23.57%)	122.86 (-4.46%)	109.50 (-5.11%)	99.70 (-5.85%)	24.93 (-34.96%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.11 (n/a)	0.06 (n/a)	0.02 (n/a)	196.40 (n/a)	128.60 (n/a)	115.40 (n/a)	105.90 (n/a)	38.33 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+3.42%)	0.10 (-3.54%)	0.11 (+0.36%)	0.07 (-6.19%)	0.02 (+37.61%)	165.50 (+6.64%)	129.68 (+5.14%)	113.30 (-0.35%)	108.50 (-3.30%)	25.72 (+40.12%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.08 (n/a)	0.01 (n/a)	155.20 (n/a)	123.34 (n/a)	113.70 (n/a)	112.20 (n/a)	18.35 (n/a)

flowkv_decode_32h_8kv_64d_128s_32cs_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.81 (n/a)	0.76 (n/a)	0.77 (n/a)	0.71 (n/a)	0.04 (n/a)	379.60 (n/a)	357.52 (n/a)	354.10 (n/a)	336.50 (n/a)	16.57 (n/a)

fused_dequant_gemv_2048x2048_1tsi_512tso_4col_g32_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	1.91 (n/a)	1.75 (n/a)	1.90 (n/a)	1.32 (n/a)	0.25 (n/a)	1798.30 (n/a)	1376.84 (n/a)	1245.90 (n/a)	1240.40 (n/a)	240.59 (n/a)	6.76 (n/a)	6.22 (n/a)	6.73 (n/a)	4.66 (n/a)	0.90 (n/a)

fused_qkv_proj_3072x2048_4tsi_768tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	33.68 (n/a)	31.87 (n/a)	32.11 (n/a)	29.47 (n/a)	1.86 (n/a)	427.40 (n/a)	396.24 (n/a)	392.20 (n/a)	374.00 (n/a)	23.42 (n/a)	33.65 (n/a)	31.84 (n/a)	32.09 (n/a)	29.44 (n/a)	1.86 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+0.43%)	0.09 (-3.33%)	0.08 (-13.10%)	0.07 (+13.95%)	0.02 (-8.85%)	118.40 (-12.23%)	97.00 (+2.23%)	101.20 (+15.13%)	77.30 (-0.39%)	17.70 (-24.01%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.02 (n/a)	134.90 (n/a)	94.88 (n/a)	87.90 (n/a)	77.60 (n/a)	23.30 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (-2.58%)	0.09 (-11.21%)	0.10 (-9.62%)	0.06 (-22.43%)	0.02 (+55.38%)	143.60 (+28.90%)	99.74 (+17.90%)	85.40 (+10.62%)	74.60 (+2.61%)	30.66 (+95.85%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	111.40 (n/a)	84.60 (n/a)	77.20 (n/a)	72.70 (n/a)	15.66 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+2.52%)	0.09 (-3.26%)	0.11 (+4.07%)	0.06 (+17.26%)	0.03 (+11.65%)	132.90 (-14.75%)	98.48 (+3.55%)	76.30 (-3.90%)	74.80 (-2.48%)	31.29 (-8.45%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	155.90 (n/a)	95.10 (n/a)	79.40 (n/a)	76.70 (n/a)	34.18 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+0.20%)	0.09 (-0.71%)	0.10 (-6.01%)	0.06 (+18.47%)	0.02 (-21.28%)	128.10 (-15.56%)	90.16 (-2.68%)	81.50 (+6.40%)	74.80 (-0.13%)	22.02 (-33.74%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.05 (n/a)	0.02 (n/a)	151.70 (n/a)	92.64 (n/a)	76.60 (n/a)	74.90 (n/a)	33.24 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-13.80%)	0.08 (-16.04%)	0.08 (-13.85%)	0.05 (-11.41%)	0.02 (-20.38%)	170.80 (+12.89%)	112.18 (+17.89%)	97.30 (+16.11%)	86.60 (+15.93%)	33.83 (+5.83%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	151.30 (n/a)	95.16 (n/a)	83.80 (n/a)	74.70 (n/a)	31.97 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+1.10%)	0.09 (+4.66%)	0.10 (+2.62%)	0.06 (+36.51%)	0.02 (-29.02%)	133.00 (-26.72%)	94.10 (-9.87%)	82.70 (-2.59%)	82.00 (-1.09%)	22.01 (-49.02%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	181.50 (n/a)	104.40 (n/a)	84.90 (n/a)	82.90 (n/a)	43.16 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+0.49%)	0.09 (+2.46%)	0.09 (+4.58%)	0.05 (-7.36%)	0.02 (+18.04%)	154.70 (+7.96%)	99.24 (-0.54%)	87.30 (-4.38%)	81.20 (-0.49%)	31.28 (+25.34%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.02 (n/a)	143.30 (n/a)	99.78 (n/a)	91.30 (n/a)	81.60 (n/a)	24.96 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-2.14%)	0.07 (-1.97%)	0.08 (-1.05%)	0.05 (+11.88%)	0.01 (-23.67%)	155.20 (-10.65%)	116.72 (-0.14%)	107.30 (+1.04%)	100.30 (+2.14%)	22.27 (-30.45%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.05 (n/a)	0.01 (n/a)	173.70 (n/a)	116.88 (n/a)	106.20 (n/a)	98.20 (n/a)	32.02 (n/a)

gemm_1792x896x1152_64x32x48_8cols_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	5.03 (+0.65%)	4.20 (-13.90%)	4.96 (-0.17%)	2.21 (-51.00%)	1.23 (+493.38%)	4252.50 (+104.09%)	2473.08 (+28.23%)	1896.90 (+0.17%)	1870.20 (-0.64%)	1027.59 (+1084.22%)	1978.10 (+0.65%)	1654.03 (-13.90%)	1950.24 (-0.17%)	869.92 (-51.00%)	484.01 (+493.38%)
`897d04e` — 2026-03-06 22:12:25	5.00 (n/a)	4.88 (n/a)	4.97 (n/a)	4.51 (n/a)	0.21 (n/a)	2083.60 (n/a)	1928.60 (n/a)	1893.70 (n/a)	1882.30 (n/a)	86.77 (n/a)	1965.38 (n/a)	1921.12 (n/a)	1953.55 (n/a)	1775.47 (n/a)	81.57 (n/a)

gemm_192x384x64_48x96x16_4cols

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	1.99 (-2.81%)	1.60 (-3.30%)	1.68 (-9.90%)	1.06 (+35.02%)	0.36 (-32.15%)	208.50 (-25.96%)	144.64 (-4.67%)	131.70 (+11.05%)	111.10 (+2.97%)	38.44 (-47.99%)	84.97 (-2.81%)	68.44 (-3.30%)	71.68 (-9.90%)	45.26 (+35.02%)	15.26 (-32.15%)
`897d04e` — 2026-03-06 22:12:25	2.05 (n/a)	1.66 (n/a)	1.86 (n/a)	0.79 (n/a)	0.53 (n/a)	281.60 (n/a)	151.72 (n/a)	118.60 (n/a)	107.90 (n/a)	73.91 (n/a)	87.43 (n/a)	70.78 (n/a)	79.55 (n/a)	33.52 (n/a)	22.49 (n/a)

gemm_192x384x64_48x96x16_4cols_bcolmaj_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	2.56 (+14.60%)	1.84 (+0.56%)	1.88 (+0.60%)	0.89 (-32.62%)	0.64 (+95.45%)	249.10 (+48.45%)	137.90 (+10.48%)	117.60 (-0.59%)	86.50 (-12.71%)	65.09 (+154.51%)	109.16 (+14.60%)	78.30 (+0.56%)	80.25 (+0.60%)	37.89 (-32.62%)	27.29 (+95.45%)
`897d04e` — 2026-03-06 22:12:25	2.23 (n/a)	1.82 (n/a)	1.87 (n/a)	1.32 (n/a)	0.33 (n/a)	167.80 (n/a)	124.82 (n/a)	118.30 (n/a)	99.10 (n/a)	25.58 (n/a)	95.25 (n/a)	77.86 (n/a)	79.77 (n/a)	56.23 (n/a)	13.96 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.72 (-0.11%)	3.55 (-2.75%)	3.56 (-2.75%)	3.36 (-5.33%)	0.12 (+76.10%)	2725.23 (-0.11%)	2602.52 (-2.75%)	2612.11 (-2.75%)	2459.89 (-5.33%)	86.27 (+76.10%)	6984.00 (+5.63%)	6608.60 (+2.91%)	6577.00 (+2.83%)	6304.00 (+0.11%)	221.87 (+87.15%)
`9e98049` — 2025-11-25 20:50:55	3.72 (n/a)	3.65 (n/a)	3.66 (n/a)	3.54 (n/a)	0.07 (n/a)	2728.26 (n/a)	2676.06 (n/a)	2686.03 (n/a)	2598.29 (n/a)	48.99 (n/a)	6612.00 (n/a)	6422.00 (n/a)	6396.00 (n/a)	6297.00 (n/a)	118.55 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.40 (-3.14%)	3.38 (-0.82%)	3.38 (-0.82%)	3.35 (+4.93%)	0.02 (-84.51%)	2493.81 (-3.14%)	2475.27 (-0.82%)	2479.06 (-0.82%)	2453.92 (+4.93%)	13.33 (-84.51%)	7001.00 (-4.70%)	6940.80 (+0.71%)	6930.00 (+0.83%)	6889.00 (+3.24%)	37.43 (-84.76%)
`9e98049` — 2025-11-25 20:50:55	3.51 (n/a)	3.40 (n/a)	3.41 (n/a)	3.19 (n/a)	0.12 (n/a)	2574.53 (n/a)	2495.72 (n/a)	2499.62 (n/a)	2338.67 (n/a)	86.02 (n/a)	7346.00 (n/a)	6892.20 (n/a)	6873.00 (n/a)	6673.00 (n/a)	245.57 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.02 (+0.52%)	2.87 (-2.05%)	2.86 (-2.24%)	2.70 (-6.16%)	0.11 (+131.66%)	2216.19 (+0.52%)	2104.44 (-2.05%)	2094.08 (-2.24%)	1980.84 (-6.16%)	80.25 (+131.67%)	8673.00 (+6.56%)	8175.60 (+2.21%)	8204.00 (+2.29%)	7752.00 (-0.51%)	314.03 (+145.36%)
`9e98049` — 2025-11-25 20:50:55	3.01 (n/a)	2.93 (n/a)	2.92 (n/a)	2.88 (n/a)	0.05 (n/a)	2204.81 (n/a)	2148.41 (n/a)	2142.13 (n/a)	2110.81 (n/a)	34.64 (n/a)	8139.00 (n/a)	7998.60 (n/a)	8020.00 (n/a)	7792.00 (n/a)	127.99 (n/a)

gemm_2048x2048x2048_64x64x64_1cols

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.52 (-0.73%)	0.52 (-0.14%)	0.52 (+0.02%)	0.52 (-0.03%)	0.00 (-87.39%)	48414.60 (+0.03%)	48387.00 (+0.14%)	48380.70 (-0.02%)	48366.40 (+0.74%)	21.71 (-87.29%)	355.20 (-0.73%)	355.05 (-0.14%)	355.10 (+0.02%)	354.85 (-0.03%)	0.16 (-87.39%)
`897d04e` — 2026-03-06 22:12:25	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.00 (n/a)	48401.80 (n/a)	48318.62 (n/a)	48391.10 (n/a)	48013.20 (n/a)	170.80 (n/a)	357.82 (n/a)	355.56 (n/a)	355.02 (n/a)	354.94 (n/a)	1.26 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	1.04 (+0.94%)	1.03 (+0.23%)	1.03 (+0.09%)	1.02 (+0.07%)	0.00 (+197.51%)	24576.00 (-0.07%)	24485.82 (-0.23%)	24530.40 (-0.09%)	24266.40 (-0.94%)	111.26 (+194.35%)
`0a6c11c` — 2025-12-04 00:39:10	1.03 (n/a)	1.03 (n/a)	1.03 (n/a)	1.02 (n/a)	0.00 (n/a)	24594.30 (n/a)	24542.14 (n/a)	24551.90 (n/a)	24495.50 (n/a)	37.80 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	1.04 (+0.28%)	1.03 (-0.15%)	1.03 (+0.05%)	1.02 (-0.52%)	0.01 (+42.72%)	24719.80 (+0.52%)	24512.42 (+0.16%)	24529.20 (-0.05%)	24092.60 (-0.28%)	252.92 (+43.15%)	713.08 (+0.28%)	700.92 (-0.15%)	700.38 (+0.05%)	694.98 (-0.52%)	7.30 (+42.71%)
`50ad37c` — 2025-12-29 20:35:53	1.04 (n/a)	1.03 (n/a)	1.03 (n/a)	1.02 (n/a)	0.01 (n/a)	24592.30 (n/a)	24473.70 (n/a)	24540.90 (n/a)	24160.80 (n/a)	176.68 (n/a)	711.06 (n/a)	702.00 (n/a)	700.05 (n/a)	698.59 (n/a)	5.12 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.99 (+1.69%)	0.97 (+0.29%)	0.97 (-0.04%)	0.97 (-0.15%)	0.01 (+434.92%)	26025.30 (+0.15%)	25839.34 (-0.29%)	25916.70 (+0.04%)	25446.00 (-1.67%)	202.05 (+425.44%)
`0a6c11c` — 2025-12-04 00:39:10	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.00 (n/a)	25986.90 (n/a)	25913.52 (n/a)	25905.70 (n/a)	25877.00 (n/a)	38.45 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	0.97 (-0.01%)	0.97 (+0.03%)	0.97 (+0.04%)	0.97 (+0.00%)	0.00 (-6.43%)	25927.90 (-0.00%)	25903.20 (-0.03%)	25898.60 (-0.04%)	25892.80 (+0.01%)	14.05 (-6.56%)	663.50 (-0.01%)	663.23 (+0.03%)	663.35 (+0.04%)	662.60 (+0.00%)	0.36 (-6.43%)
`50ad37c` — 2025-12-29 20:35:53	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.00 (n/a)	25928.10 (n/a)	25910.14 (n/a)	25908.10 (n/a)	25891.20 (n/a)	15.04 (n/a)	663.54 (n/a)	663.06 (n/a)	663.11 (n/a)	662.60 (n/a)	0.38 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.92 (-1.02%)	0.92 (-0.66%)	0.92 (-0.10%)	0.91 (-0.78%)	0.01 (-4.54%)	27751.40 (+0.79%)	27480.74 (+0.66%)	27354.80 (+0.10%)	27320.50 (+1.03%)	182.69 (-2.84%)
`0a6c11c` — 2025-12-04 00:39:10	0.93 (n/a)	0.92 (n/a)	0.92 (n/a)	0.91 (n/a)	0.01 (n/a)	27534.80 (n/a)	27299.32 (n/a)	27326.70 (n/a)	27042.30 (n/a)	188.04 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	0.92 (+0.11%)	0.91 (-0.12%)	0.91 (-0.21%)	0.91 (-0.24%)	0.00 (+30.34%)	27723.50 (+0.24%)	27548.94 (+0.12%)	27522.90 (+0.21%)	27403.60 (-0.11%)	124.26 (+30.58%)	626.92 (+0.11%)	623.62 (-0.12%)	624.20 (-0.21%)	619.69 (-0.24%)	2.81 (+30.34%)
`50ad37c` — 2025-12-29 20:35:53	0.92 (n/a)	0.91 (n/a)	0.92 (n/a)	0.91 (n/a)	0.00 (n/a)	27657.10 (n/a)	27515.58 (n/a)	27464.70 (n/a)	27434.60 (n/a)	95.16 (n/a)	626.21 (n/a)	624.37 (n/a)	625.52 (n/a)	621.17 (n/a)	2.16 (n/a)

gemm_2048x2048x2048_64x64x64_2cols_bcolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.91 (-0.24%)	0.91 (+0.73%)	0.91 (+0.20%)	0.91 (+2.45%)	0.00 (-80.10%)	27767.00 (-2.39%)	27692.32 (-0.74%)	27719.30 (-0.20%)	27586.80 (+0.24%)	69.92 (-80.56%)	622.76 (-0.24%)	620.39 (+0.73%)	619.78 (+0.20%)	618.71 (+2.45%)	1.57 (-80.10%)
`897d04e` — 2026-03-06 22:12:25	0.91 (n/a)	0.90 (n/a)	0.91 (n/a)	0.88 (n/a)	0.01 (n/a)	28447.10 (n/a)	27899.18 (n/a)	27774.40 (n/a)	27519.50 (n/a)	359.64 (n/a)	624.28 (n/a)	615.87 (n/a)	618.55 (n/a)	603.92 (n/a)	7.88 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`31ab24e` — 2025-11-22 02:01:56	3.65 (-1.06%)	3.59 (+0.83%)	3.63 (-0.26%)	3.45 (+2.66%)	0.07 (-44.71%)	2678.08 (-1.06%)	2632.13 (+0.83%)	2658.60 (-0.26%)	2528.31 (+2.66%)	53.86 (-44.71%)	6795.00 (-2.59%)	6529.80 (-0.92%)	6462.00 (+0.26%)	6415.00 (+1.07%)	137.14 (-45.27%)
`d9a64c5` — 2025-11-21 20:49:35	3.69 (n/a)	3.56 (n/a)	3.64 (n/a)	3.36 (n/a)	0.13 (n/a)	2706.77 (n/a)	2610.50 (n/a)	2665.61 (n/a)	2462.71 (n/a)	97.41 (n/a)	6976.00 (n/a)	6590.40 (n/a)	6445.00 (n/a)	6347.00 (n/a)	250.58 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.98 (+0.20%)	3.84 (-2.95%)	3.76 (-5.27%)	3.72 (-4.97%)	0.13 (+473.97%)	6760.00 (+5.23%)	6559.50 (+3.13%)	6697.10 (+5.56%)	6321.00 (-0.20%)	218.68 (+499.40%)	2717.91 (+0.20%)	2621.44 (-2.95%)	2565.27 (-5.27%)	2541.40 (-4.97%)	88.37 (+473.97%)
`331dcca` — 2026-01-08 18:34:10	3.97 (n/a)	3.96 (n/a)	3.97 (n/a)	3.92 (n/a)	0.02 (n/a)	6423.80 (n/a)	6360.32 (n/a)	6344.30 (n/a)	6333.90 (n/a)	36.48 (n/a)	2712.39 (n/a)	2701.17 (n/a)	2707.91 (n/a)	2674.40 (n/a)	15.40 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.75 (+0.28%)	3.70 (+1.25%)	3.71 (-0.21%)	3.65 (+4.77%)	0.04 (-66.90%)	6901.80 (-4.56%)	6795.46 (-1.30%)	6790.20 (+0.21%)	6715.90 (-0.28%)	67.05 (-68.40%)	2558.08 (+0.28%)	2528.33 (+1.25%)	2530.10 (-0.21%)	2489.18 (+4.77%)	24.81 (-66.90%)
`331dcca` — 2026-01-08 18:34:10	3.74 (n/a)	3.66 (n/a)	3.71 (n/a)	3.48 (n/a)	0.11 (n/a)	7231.20 (n/a)	6885.18 (n/a)	6775.70 (n/a)	6734.90 (n/a)	212.21 (n/a)	2550.87 (n/a)	2497.04 (n/a)	2535.50 (n/a)	2375.78 (n/a)	74.96 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.62 (-0.77%)	3.54 (+0.14%)	3.60 (-0.04%)	3.44 (+2.17%)	0.09 (-25.77%)	7307.40 (-2.13%)	7103.46 (-0.18%)	6982.50 (+0.04%)	6948.20 (+0.77%)	182.95 (-26.55%)	2472.55 (-0.77%)	2419.80 (+0.14%)	2460.41 (-0.04%)	2351.04 (+2.17%)	61.76 (-25.77%)
`331dcca` — 2026-01-08 18:34:10	3.65 (n/a)	3.54 (n/a)	3.61 (n/a)	3.37 (n/a)	0.12 (n/a)	7466.20 (n/a)	7116.40 (n/a)	6979.60 (n/a)	6895.10 (n/a)	249.09 (n/a)	2491.61 (n/a)	2416.45 (n/a)	2461.45 (n/a)	2301.00 (n/a)	83.20 (n/a)

gemm_2048x2048x2048_64x64x64_8cols_bcolmaj_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	3.50 (-0.28%)	3.41 (-2.20%)	3.48 (-0.20%)	3.24 (-6.94%)	0.11 (+828.98%)	7775.30 (+7.46%)	7383.98 (+2.34%)	7241.40 (+0.20%)	7192.20 (+0.28%)	254.63 (+898.03%)	2388.69 (-0.28%)	2328.80 (-2.20%)	2372.44 (-0.20%)	2209.54 (-6.94%)	78.47 (+828.96%)
`897d04e` — 2026-03-06 22:12:25	3.51 (n/a)	3.49 (n/a)	3.48 (n/a)	3.48 (n/a)	0.01 (n/a)	7235.40 (n/a)	7215.10 (n/a)	7227.20 (n/a)	7171.80 (n/a)	25.51 (n/a)	2395.46 (n/a)	2381.12 (n/a)	2377.13 (n/a)	2374.41 (n/a)	8.45 (n/a)

gemm_384x1536x1792_32x48x64_4cols_bcolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	4.41 (+1.46%)	4.17 (+0.03%)	4.31 (-0.20%)	3.48 (-1.36%)	0.39 (+8.44%)	2315.60 (+1.38%)	1949.62 (+0.09%)	1870.30 (+0.20%)	1829.50 (-1.44%)	205.51 (+9.30%)	1155.45 (+1.46%)	1092.81 (+0.03%)	1130.24 (-0.20%)	912.92 (-1.36%)	101.27 (+8.44%)
`897d04e` — 2026-03-06 22:12:25	4.34 (n/a)	4.17 (n/a)	4.32 (n/a)	3.53 (n/a)	0.36 (n/a)	2284.00 (n/a)	1947.78 (n/a)	1866.50 (n/a)	1856.20 (n/a)	188.02 (n/a)	1138.86 (n/a)	1092.52 (n/a)	1132.55 (n/a)	925.53 (n/a)	93.39 (n/a)

gemm_896x1792x640_32x64x80_8cols_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	7.02 (+4.42%)	6.52 (+3.35%)	6.88 (+4.04%)	5.04 (-2.89%)	0.83 (+28.56%)	1319.00 (+2.98%)	1036.42 (-2.65%)	966.70 (-3.89%)	947.60 (-4.22%)	158.55 (+28.02%)	2168.88 (+4.42%)	2014.39 (+3.35%)	2125.94 (+4.04%)	1558.21 (-2.89%)	256.75 (+28.56%)
`897d04e` — 2026-03-06 22:12:25	6.72 (n/a)	6.31 (n/a)	6.61 (n/a)	5.19 (n/a)	0.65 (n/a)	1280.80 (n/a)	1064.58 (n/a)	1005.80 (n/a)	989.40 (n/a)	123.84 (n/a)	2077.17 (n/a)	1949.09 (n/a)	2043.44 (n/a)	1604.60 (n/a)	199.72 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+0.11%)	0.09 (+9.33%)	0.10 (+16.41%)	0.06 (+9.58%)	0.02 (-16.06%)	136.60 (-8.75%)	94.32 (-10.44%)	81.30 (-14.15%)	78.30 (-0.13%)	24.63 (-20.82%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	149.70 (n/a)	105.32 (n/a)	94.70 (n/a)	78.40 (n/a)	31.11 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+1.26%)	0.10 (+6.03%)	0.11 (+3.99%)	0.05 (-13.01%)	0.03 (+14.27%)	160.60 (+14.96%)	92.44 (-2.63%)	74.80 (-3.86%)	74.00 (-1.20%)	38.15 (+35.18%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.06 (n/a)	0.02 (n/a)	139.70 (n/a)	94.94 (n/a)	77.80 (n/a)	74.90 (n/a)	28.23 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+4.53%)	0.09 (+6.23%)	0.11 (+12.78%)	0.04 (-29.42%)	0.03 (+66.63%)	193.00 (+41.70%)	99.26 (+4.11%)	75.70 (-11.36%)	74.50 (-4.24%)	52.42 (+121.82%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	136.20 (n/a)	95.34 (n/a)	85.40 (n/a)	77.80 (n/a)	23.63 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+2.02%)	0.10 (+17.47%)	0.11 (+23.99%)	0.05 (+41.74%)	0.02 (-9.15%)	151.70 (-29.44%)	91.10 (-19.74%)	76.30 (-19.26%)	74.50 (-1.97%)	33.89 (-40.90%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.09 (n/a)	0.04 (n/a)	0.03 (n/a)	215.00 (n/a)	113.50 (n/a)	94.50 (n/a)	76.00 (n/a)	57.35 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+1.93%)	0.09 (+8.77%)	0.10 (+15.93%)	0.06 (+30.65%)	0.02 (-10.84%)	145.10 (-23.43%)	93.98 (-12.00%)	78.20 (-13.78%)	76.50 (-1.92%)	29.34 (-36.94%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	189.50 (n/a)	106.80 (n/a)	90.70 (n/a)	78.00 (n/a)	46.53 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+13.91%)	0.09 (+11.85%)	0.10 (+14.30%)	0.04 (-4.91%)	0.03 (+32.52%)	188.70 (+5.18%)	102.42 (-6.60%)	82.00 (-12.58%)	75.00 (-12.18%)	48.36 (+23.21%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	179.40 (n/a)	109.66 (n/a)	93.80 (n/a)	85.40 (n/a)	39.25 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+2.29%)	0.08 (+8.62%)	0.10 (+21.53%)	0.05 (-3.60%)	0.02 (+37.17%)	163.20 (+3.75%)	107.52 (-4.87%)	83.40 (-17.75%)	83.00 (-2.24%)	35.96 (+29.21%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	157.30 (n/a)	113.02 (n/a)	101.40 (n/a)	84.90 (n/a)	27.83 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-1.44%)	0.07 (-4.70%)	0.08 (-7.24%)	0.04 (-5.11%)	0.02 (-4.20%)	208.70 (+5.40%)	127.66 (+5.02%)	106.50 (+7.79%)	98.00 (+1.45%)	46.04 (+5.83%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	198.00 (n/a)	121.56 (n/a)	98.80 (n/a)	96.60 (n/a)	43.50 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.37 (+17.13%)	0.30 (+24.87%)	0.30 (+38.03%)	0.23 (+12.47%)	0.06 (+35.23%)
`0a6c11c` — 2025-12-04 00:39:10	0.32 (n/a)	0.24 (n/a)	0.22 (n/a)	0.20 (n/a)	0.04 (n/a)

matrix_vector_mul_128x128_32_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	0.26 (-1.81%)	0.24 (+4.06%)	0.24 (+0.52%)	0.21 (+16.97%)	0.02 (-48.16%)	0.26 (-1.81%)	0.24 (+4.06%)	0.24 (+0.52%)	0.20 (+16.97%)	0.02 (-48.16%)
`a4b6ffe` — 2026-01-05 19:24:05	0.26 (n/a)	0.23 (n/a)	0.24 (n/a)	0.18 (n/a)	0.04 (n/a)	0.26 (n/a)	0.23 (n/a)	0.24 (n/a)	0.17 (n/a)	0.04 (n/a)

matrix_vector_mul_128x128_32tsi_128tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.35 (-4.51%)	0.30 (-5.44%)	0.34 (-1.82%)	0.22 (+1.16%)	0.07 (+10.50%)	0.35 (-4.51%)	0.29 (-5.44%)	0.33 (-1.82%)	0.22 (+1.16%)	0.07 (+10.50%)
`897d04e` — 2026-03-06 22:12:25	0.37 (n/a)	0.31 (n/a)	0.34 (n/a)	0.22 (n/a)	0.06 (n/a)	0.36 (n/a)	0.31 (n/a)	0.34 (n/a)	0.21 (n/a)	0.06 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	13.57 (+3.47%)	13.15 (+1.09%)	13.10 (+0.16%)	12.52 (-1.58%)	0.37 (+153.19%)
`0a6c11c` — 2025-12-04 00:39:10	13.11 (n/a)	13.01 (n/a)	13.07 (n/a)	12.72 (n/a)	0.15 (n/a)

matrix_vector_mul_2048x8192_1_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	13.43 (-0.07%)	13.30 (+4.62%)	13.27 (+1.29%)	13.16 (+16.70%)	0.12 (-86.69%)	13.42 (-0.07%)	13.29 (+4.62%)	13.26 (+1.29%)	13.16 (+16.70%)	0.12 (-86.69%)
`a4b6ffe` — 2026-01-05 19:24:05	13.44 (n/a)	12.71 (n/a)	13.10 (n/a)	11.28 (n/a)	0.87 (n/a)	13.43 (n/a)	12.70 (n/a)	13.09 (n/a)	11.27 (n/a)	0.87 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	25.06 (+2.47%)	23.71 (+1.81%)	24.13 (+0.50%)	20.90 (+5.41%)	1.48 (-15.60%)
`0a6c11c` — 2025-12-04 00:39:10	24.46 (n/a)	23.29 (n/a)	24.01 (n/a)	19.83 (n/a)	1.75 (n/a)

matrix_vector_mul_2048x8192_1_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	24.46 (-0.60%)	21.07 (-8.03%)	19.75 (-17.83%)	18.08 (+1.18%)	3.03 (+7.07%)	24.44 (-0.60%)	21.06 (-8.03%)	19.74 (-17.83%)	18.07 (+1.18%)	3.03 (+7.07%)
`a4b6ffe` — 2026-01-05 19:24:05	24.60 (n/a)	22.91 (n/a)	24.04 (n/a)	17.87 (n/a)	2.83 (n/a)	24.59 (n/a)	22.90 (n/a)	24.02 (n/a)	17.86 (n/a)	2.83 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	42.05 (+1.54%)	40.50 (+12.60%)	40.49 (+2.36%)	38.98 (+97.53%)	0.97 (-88.09%)
`0a6c11c` — 2025-12-04 00:39:10	41.41 (n/a)	35.97 (n/a)	39.55 (n/a)	19.73 (n/a)	8.15 (n/a)

matrix_vector_mul_2048x8192_1_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	42.58 (+1.51%)	41.37 (+14.29%)	41.25 (+4.89%)	40.33 (+91.42%)	0.92 (-89.18%)	42.56 (+1.51%)	41.34 (+14.29%)	41.23 (+4.89%)	40.30 (+91.42%)	0.92 (-89.18%)
`a4b6ffe` — 2026-01-05 19:24:05	41.95 (n/a)	36.20 (n/a)	39.33 (n/a)	21.07 (n/a)	8.54 (n/a)	41.92 (n/a)	36.17 (n/a)	39.31 (n/a)	21.05 (n/a)	8.53 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	46.62 (+3.11%)	44.82 (+0.17%)	44.78 (+0.17%)	42.60 (-3.80%)	1.60 (+367.72%)
`0a6c11c` — 2025-12-04 00:39:10	45.21 (n/a)	44.75 (n/a)	44.70 (n/a)	44.29 (n/a)	0.34 (n/a)

matrix_vector_mul_2048x8192_1_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	46.04 (+4.14%)	45.06 (+3.47%)	44.55 (+2.76%)	44.30 (+2.84%)	0.87 (+66.58%)	46.01 (+4.14%)	45.03 (+3.47%)	44.52 (+2.76%)	44.27 (+2.84%)	0.87 (+66.58%)
`a4b6ffe` — 2026-01-05 19:24:05	44.21 (n/a)	43.55 (n/a)	43.35 (n/a)	43.07 (n/a)	0.52 (n/a)	44.18 (n/a)	43.52 (n/a)	43.32 (n/a)	43.05 (n/a)	0.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_1024tso_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	25.06 (+2.42%)	23.80 (-1.50%)	24.28 (+0.34%)	20.51 (-13.99%)	1.89 (+665.46%)	25.05 (+2.42%)	23.78 (-1.50%)	24.27 (+0.34%)	20.50 (-13.99%)	1.89 (+665.46%)
`897d04e` — 2026-03-06 22:12:25	24.47 (n/a)	24.16 (n/a)	24.20 (n/a)	23.84 (n/a)	0.25 (n/a)	24.46 (n/a)	24.15 (n/a)	24.18 (n/a)	23.83 (n/a)	0.25 (n/a)

matrix_vector_mul_2048x8192_1tsi_2048tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	13.18 (-0.48%)	12.63 (-2.98%)	13.11 (+0.11%)	10.65 (-15.19%)	1.11 (+314.30%)	13.17 (-0.48%)	12.62 (-2.98%)	13.10 (+0.11%)	10.64 (-15.19%)	1.11 (+314.30%)
`897d04e` — 2026-03-06 22:12:25	13.25 (n/a)	13.02 (n/a)	13.10 (n/a)	12.56 (n/a)	0.27 (n/a)	13.24 (n/a)	13.01 (n/a)	13.09 (n/a)	12.55 (n/a)	0.27 (n/a)

matrix_vector_mul_2048x8192_1tsi_256tso_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	47.22 (-1.03%)	45.80 (+0.92%)	46.22 (+2.22%)	43.69 (+0.49%)	1.32 (-13.46%)	47.19 (-1.03%)	45.77 (+0.92%)	46.19 (+2.22%)	43.66 (+0.49%)	1.31 (-13.46%)
`897d04e` — 2026-03-06 22:12:25	47.71 (n/a)	45.38 (n/a)	45.22 (n/a)	43.47 (n/a)	1.52 (n/a)	47.68 (n/a)	45.35 (n/a)	45.19 (n/a)	43.45 (n/a)	1.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_512tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	40.25 (-1.45%)	39.83 (+0.77%)	39.96 (+1.42%)	39.40 (+1.38%)	0.38 (-50.39%)	40.22 (-1.45%)	39.81 (+0.77%)	39.93 (+1.42%)	39.38 (+1.38%)	0.38 (-50.39%)
`897d04e` — 2026-03-06 22:12:25	40.84 (n/a)	39.53 (n/a)	39.40 (n/a)	38.87 (n/a)	0.77 (n/a)	40.81 (n/a)	39.50 (n/a)	39.37 (n/a)	38.84 (n/a)	0.77 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	13.29 (+1.63%)	13.19 (+6.08%)	13.19 (+1.17%)	13.09 (+26.86%)	0.08 (-92.94%)
`0a6c11c` — 2025-12-04 00:39:10	13.08 (n/a)	12.44 (n/a)	13.03 (n/a)	10.32 (n/a)	1.07 (n/a)

matrix_vector_mul_8192x2048_4_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	13.68 (+3.42%)	13.30 (+8.54%)	13.38 (+7.25%)	12.72 (+14.96%)	0.35 (-66.09%)	13.67 (+3.42%)	13.29 (+8.54%)	13.38 (+7.25%)	12.71 (+14.96%)	0.35 (-66.09%)
`a4b6ffe` — 2026-01-05 19:24:05	13.23 (n/a)	12.25 (n/a)	12.48 (n/a)	11.07 (n/a)	1.04 (n/a)	13.22 (n/a)	12.24 (n/a)	12.47 (n/a)	11.06 (n/a)	1.04 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	25.58 (+4.24%)	24.23 (+6.59%)	24.03 (+0.29%)	23.58 (+37.29%)	0.70 (-74.97%)
`0a6c11c` — 2025-12-04 00:39:10	24.54 (n/a)	22.73 (n/a)	23.96 (n/a)	17.18 (n/a)	2.79 (n/a)

matrix_vector_mul_8192x2048_4_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	25.08 (+1.32%)	24.68 (+13.42%)	24.61 (+3.26%)	24.47 (+48.32%)	0.24 (-93.56%)	25.07 (+1.32%)	24.67 (+13.42%)	24.59 (+3.26%)	24.46 (+48.32%)	0.24 (-93.56%)
`a4b6ffe` — 2026-01-05 19:24:05	24.76 (n/a)	21.76 (n/a)	23.83 (n/a)	16.50 (n/a)	3.74 (n/a)	24.74 (n/a)	21.75 (n/a)	23.82 (n/a)	16.49 (n/a)	3.73 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	40.94 (-2.19%)	39.74 (-1.10%)	39.76 (-0.60%)	38.17 (-2.14%)	1.04 (+4.39%)
`0a6c11c` — 2025-12-04 00:39:10	41.86 (n/a)	40.18 (n/a)	40.00 (n/a)	39.00 (n/a)	1.00 (n/a)

matrix_vector_mul_8192x2048_4_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	40.74 (-1.09%)	37.16 (-7.15%)	40.25 (+1.47%)	24.51 (-37.44%)	7.07 (+736.13%)	40.72 (-1.09%)	37.13 (-7.15%)	40.23 (+1.47%)	24.50 (-37.44%)	7.07 (+736.13%)
`a4b6ffe` — 2026-01-05 19:24:05	41.19 (n/a)	40.02 (n/a)	39.67 (n/a)	39.18 (n/a)	0.85 (n/a)	41.17 (n/a)	39.99 (n/a)	39.64 (n/a)	39.16 (n/a)	0.85 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	46.71 (-1.04%)	44.91 (-2.34%)	44.71 (-2.98%)	43.80 (-1.44%)	0.96 (+6.93%)
`0a6c11c` — 2025-12-04 00:39:10	47.20 (n/a)	45.98 (n/a)	46.08 (n/a)	44.44 (n/a)	0.90 (n/a)

matrix_vector_mul_8192x2048_4_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	46.28 (+5.68%)	44.89 (+14.59%)	44.74 (+4.26%)	44.20 (+62.80%)	0.84 (-87.96%)	46.25 (+5.68%)	44.86 (+14.59%)	44.71 (+4.26%)	44.17 (+62.80%)	0.84 (-87.96%)
`a4b6ffe` — 2026-01-05 19:24:05	43.79 (n/a)	39.17 (n/a)	42.91 (n/a)	27.15 (n/a)	6.98 (n/a)	43.77 (n/a)	39.15 (n/a)	42.88 (n/a)	27.13 (n/a)	6.98 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	13.41 (+0.48%)	13.10 (-0.75%)	13.21 (+0.22%)	12.44 (-5.17%)	0.38 (+347.94%)	13.40 (+0.48%)	13.09 (-0.75%)	13.20 (+0.22%)	12.44 (-5.17%)	0.38 (+347.95%)
`897d04e` — 2026-03-06 22:12:25	13.34 (n/a)	13.20 (n/a)	13.18 (n/a)	13.12 (n/a)	0.08 (n/a)	13.33 (n/a)	13.19 (n/a)	13.17 (n/a)	13.11 (n/a)	0.08 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	25.44 (+5.56%)	23.44 (+1.61%)	24.68 (+2.81%)	18.36 (-4.67%)	2.89 (+35.85%)	25.42 (+5.56%)	23.42 (+1.61%)	24.67 (+2.81%)	18.35 (-4.67%)	2.89 (+35.85%)
`897d04e` — 2026-03-06 22:12:25	24.10 (n/a)	23.07 (n/a)	24.01 (n/a)	19.26 (n/a)	2.13 (n/a)	24.08 (n/a)	23.05 (n/a)	23.99 (n/a)	19.25 (n/a)	2.13 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	39.84 (-2.35%)	39.20 (-0.94%)	39.23 (-1.31%)	38.54 (+0.68%)	0.64 (-41.77%)	39.82 (-2.35%)	39.18 (-0.94%)	39.21 (-1.31%)	38.52 (+0.68%)	0.64 (-41.77%)
`897d04e` — 2026-03-06 22:12:25	40.80 (n/a)	39.58 (n/a)	39.75 (n/a)	38.28 (n/a)	1.10 (n/a)	40.78 (n/a)	39.55 (n/a)	39.73 (n/a)	38.26 (n/a)	1.10 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`ae902f6` — 2026-03-07 18:55:21	46.02 (-6.67%)	44.92 (-2.62%)	45.40 (+0.21%)	43.13 (-3.35%)	1.12 (-39.49%)	45.99 (-6.67%)	44.89 (-2.62%)	45.37 (+0.21%)	43.10 (-3.35%)	1.12 (-39.49%)
`897d04e` — 2026-03-06 22:12:25	49.31 (n/a)	46.12 (n/a)	45.30 (n/a)	44.62 (n/a)	1.85 (n/a)	49.28 (n/a)	46.10 (n/a)	45.28 (n/a)	44.59 (n/a)	1.85 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.07 (+22.03%)	0.06 (+27.86%)	0.06 (+35.49%)	0.05 (+15.00%)	0.01 (+49.69%)	173.30 (-13.00%)	137.94 (-21.32%)	133.60 (-26.19%)	123.40 (-18.06%)	18.40 (+8.53%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	199.20 (n/a)	175.32 (n/a)	181.00 (n/a)	150.60 (n/a)	16.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.07 (-14.19%)	0.06 (+4.41%)	0.07 (+6.62%)	0.05 (+43.20%)	0.01 (-49.94%)	172.90 (-30.17%)	131.54 (-11.35%)	120.30 (-6.24%)	116.60 (+16.48%)	23.48 (-60.00%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.03 (n/a)	0.02 (n/a)	247.60 (n/a)	148.38 (n/a)	128.30 (n/a)	100.10 (n/a)	58.70 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-16.99%)	0.05 (-12.47%)	0.05 (-7.32%)	0.04 (-11.17%)	0.00 (-29.61%)	197.00 (+12.57%)	171.00 (+13.70%)	164.00 (+7.89%)	153.00 (+20.47%)	17.49 (-4.32%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	175.00 (n/a)	150.40 (n/a)	152.00 (n/a)	127.00 (n/a)	18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+5.56%)	0.05 (-1.59%)	0.05 (-1.39%)	0.03 (-14.07%)	0.01 (+25.03%)	263.00 (+16.37%)	166.00 (+4.53%)	144.00 (+1.41%)	126.00 (-5.26%)	49.38 (+43.17%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	226.00 (n/a)	158.80 (n/a)	142.00 (n/a)	133.00 (n/a)	34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.08 (+10.93%)	0.07 (+7.79%)	0.07 (+3.55%)	0.05 (-1.73%)	0.01 (+36.73%)	150.20 (+1.76%)	121.68 (-6.36%)	125.60 (-3.38%)	97.90 (-9.85%)	18.56 (+21.98%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.01 (n/a)	147.60 (n/a)	129.94 (n/a)	130.00 (n/a)	108.60 (n/a)	15.21 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-14.51%)	0.08 (+9.14%)	0.09 (+12.06%)	0.07 (+32.01%)	0.01 (-59.43%)	112.50 (-24.24%)	97.86 (-13.41%)	92.40 (-10.81%)	86.70 (+17.00%)	11.01 (-65.26%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.02 (n/a)	148.50 (n/a)	113.02 (n/a)	103.60 (n/a)	74.10 (n/a)	31.69 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-15.32%)	0.05 (-17.09%)	0.05 (-23.81%)	0.04 (-15.54%)	0.01 (-18.18%)	193.00 (+18.40%)	160.80 (+20.36%)	168.00 (+31.25%)	124.00 (+18.10%)	22.92 (+11.39%)
`0999a9a` — 2025-11-13 19:24:08	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	163.00 (n/a)	133.60 (n/a)	128.00 (n/a)	105.00 (n/a)	20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-23.02%)	0.05 (-6.98%)	0.05 (-2.13%)	0.04 (-15.31%)	0.01 (-33.29%)	196.00 (+18.07%)	147.00 (+6.52%)	141.00 (+2.17%)	126.00 (+29.90%)	25.27 (+8.13%)
`0999a9a` — 2025-11-13 19:24:08	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	166.00 (n/a)	138.00 (n/a)	138.00 (n/a)	97.00 (n/a)	23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (+31.37%)	0.08 (+29.12%)	0.08 (+29.06%)	0.07 (+41.80%)	0.01 (+0.23%)	109.90 (-29.46%)	98.30 (-23.38%)	100.80 (-22.52%)	79.40 (-23.87%)	10.54 (-46.17%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	155.80 (n/a)	128.30 (n/a)	130.10 (n/a)	104.30 (n/a)	19.58 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-20.79%)	0.07 (-21.24%)	0.08 (-28.19%)	0.05 (-6.08%)	0.02 (-36.69%)	172.40 (+6.49%)	115.08 (+21.98%)	106.30 (+39.32%)	93.50 (+26.35%)	32.66 (-14.07%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.03 (n/a)	161.90 (n/a)	94.34 (n/a)	76.30 (n/a)	74.00 (n/a)	38.01 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (+25.02%)	0.07 (+10.01%)	0.07 (+7.53%)	0.05 (-1.99%)	0.01 (+77.08%)	150.10 (+2.04%)	114.60 (-7.22%)	111.70 (-6.99%)	83.90 (-20.02%)	21.23 (+43.54%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	147.10 (n/a)	123.52 (n/a)	120.10 (n/a)	104.90 (n/a)	14.79 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.12 (+19.22%)	0.10 (+23.94%)	0.11 (+23.35%)	0.06 (+38.47%)	0.02 (+8.79%)	145.60 (-27.78%)	87.72 (-21.73%)	73.60 (-18.94%)	70.90 (-16.19%)	32.39 (-35.39%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	201.60 (n/a)	112.08 (n/a)	90.80 (n/a)	84.60 (n/a)	50.14 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.07 (+11.97%)	0.05 (+3.09%)	0.05 (+2.10%)	0.03 (-11.35%)	0.01 (+41.65%)	229.00 (+12.81%)	156.00 (-0.51%)	143.00 (-2.05%)	117.00 (-10.69%)	38.21 (+48.71%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	203.00 (n/a)	156.80 (n/a)	146.00 (n/a)	131.00 (n/a)	25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+9.02%)	0.05 (+5.59%)	0.05 (+0.00%)	0.04 (+3.63%)	0.01 (+25.48%)	193.00 (-3.50%)	147.40 (-4.66%)	147.00 (+0.00%)	122.00 (-8.27%)	25.24 (+7.48%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	154.60 (n/a)	147.00 (n/a)	133.00 (n/a)	23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (-3.98%)	0.07 (+4.00%)	0.07 (+7.04%)	0.06 (+3.67%)	0.01 (-15.76%)	129.70 (-3.57%)	113.30 (-4.50%)	116.90 (-6.55%)	90.40 (+4.15%)	15.04 (-13.80%)
`0a6c11c` — 2025-12-04 00:39:10	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	134.50 (n/a)	118.64 (n/a)	125.10 (n/a)	86.80 (n/a)	17.45 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+25.52%)	0.10 (+28.46%)	0.11 (+29.33%)	0.08 (+33.96%)	0.01 (+14.21%)	109.20 (-25.36%)	83.58 (-22.63%)	76.80 (-22.66%)	75.70 (-20.40%)	14.39 (-33.05%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	146.30 (n/a)	108.02 (n/a)	99.30 (n/a)	95.10 (n/a)	21.49 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.08 (+9.57%)	0.07 (+16.85%)	0.07 (+19.58%)	0.06 (+24.52%)	0.01 (+1.05%)	134.50 (-19.70%)	116.64 (-14.92%)	116.80 (-16.39%)	98.00 (-8.75%)	15.71 (-25.13%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	167.50 (n/a)	137.10 (n/a)	139.70 (n/a)	107.40 (n/a)	20.99 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-20.88%)	0.07 (-20.64%)	0.08 (-20.16%)	0.05 (-15.58%)	0.02 (-27.45%)	169.20 (+18.49%)	114.52 (+24.56%)	99.00 (+25.32%)	98.20 (+26.38%)	30.84 (+8.21%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	142.80 (n/a)	91.94 (n/a)	79.00 (n/a)	77.70 (n/a)	28.50 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-13.48%)	0.05 (-17.79%)	0.05 (-15.33%)	0.03 (-25.09%)	0.01 (+6.67%)	267.00 (+33.50%)	176.80 (+24.51%)	150.00 (+18.11%)	141.00 (+15.57%)	47.41 (+61.41%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	142.00 (n/a)	127.00 (n/a)	122.00 (n/a)	29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (+13.38%)	0.05 (+23.85%)	0.05 (+37.91%)	0.05 (+30.72%)	0.00 (-56.85%)	166.00 (-23.50%)	153.40 (-20.60%)	153.00 (-27.49%)	142.00 (-11.80%)	7.63 (-70.60%)
`0999a9a` — 2025-11-13 19:24:08	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.01 (n/a)	217.00 (n/a)	193.20 (n/a)	211.00 (n/a)	161.00 (n/a)	25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (+16.31%)	0.08 (+15.34%)	0.08 (+14.60%)	0.07 (+19.30%)	0.01 (-5.41%)	117.30 (-16.15%)	107.80 (-13.61%)	108.50 (-12.78%)	94.10 (-13.99%)	8.29 (-32.01%)
`0a6c11c` — 2025-12-04 00:39:10	0.07 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	139.90 (n/a)	124.78 (n/a)	124.40 (n/a)	109.40 (n/a)	12.20 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+21.51%)	0.08 (+0.74%)	0.08 (+1.22%)	0.04 (-28.16%)	0.02 (+133.50%)	190.30 (+39.21%)	117.04 (+5.78%)	103.50 (-1.15%)	84.70 (-17.77%)	41.75 (+186.16%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	136.70 (n/a)	110.64 (n/a)	104.70 (n/a)	103.00 (n/a)	14.59 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (+12.61%)	0.07 (-2.24%)	0.07 (-8.85%)	0.06 (+5.13%)	0.01 (+35.50%)	136.50 (-4.88%)	120.86 (+2.96%)	125.10 (+9.64%)	91.60 (-11.15%)	15.72 (+10.46%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	143.50 (n/a)	117.38 (n/a)	114.10 (n/a)	103.10 (n/a)	14.23 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (+1.90%)	0.08 (+10.00%)	0.08 (+2.46%)	0.05 (+8.63%)	0.02 (-14.28%)	170.60 (-7.93%)	113.98 (-10.76%)	99.60 (-2.35%)	98.50 (-1.89%)	31.67 (-18.07%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	185.30 (n/a)	127.72 (n/a)	102.00 (n/a)	100.40 (n/a)	38.66 (n/a)

mha

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.18 (+0.16%)	0.18 (+0.19%)	0.18 (+0.12%)	0.18 (+0.32%)	0.00 (-52.24%)	47253.90 (-0.32%)	47213.70 (-0.19%)	47210.90 (-0.12%)	47167.70 (-0.16%)	28.71 (-52.47%)
`0a6c11c` — 2025-12-04 00:39:10	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47405.00 (n/a)	47301.72 (n/a)	47265.90 (n/a)	47241.80 (n/a)	60.40 (n/a)

mha0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`84d3478` — 2026-02-17 23:25:13	0.18 (-0.51%)	0.18 (-0.36%)	0.18 (-0.41%)	0.18 (-0.21%)	0.00 (-35.21%)	47468.60 (+0.21%)	47403.94 (+0.36%)	47426.00 (+0.41%)	47314.40 (+0.51%)	68.83 (-34.73%)
`1531781` — 2026-01-23 18:49:24	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47367.50 (n/a)	47232.68 (n/a)	47232.00 (n/a)	47073.00 (n/a)	105.45 (n/a)

mha_16384_64_1_8_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.18 (+0.05%)	0.18 (+0.10%)	0.18 (+0.02%)	0.18 (+0.29%)	0.00 (-43.32%)	47396.60 (-0.29%)	47333.76 (-0.10%)	47327.70 (-0.02%)	47243.60 (-0.05%)	62.48 (-43.51%)
`897d04e` — 2026-03-06 22:12:25	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47533.70 (n/a)	47380.56 (n/a)	47337.90 (n/a)	47268.00 (n/a)	110.60 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+25.44%)	0.09 (+17.30%)	0.11 (+25.12%)	0.05 (-9.35%)	0.03 (+68.90%)	166.60 (+10.33%)	105.94 (-8.39%)	74.60 (-20.13%)	73.40 (-20.22%)	44.62 (+41.39%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.07 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	151.00 (n/a)	115.64 (n/a)	93.40 (n/a)	92.00 (n/a)	31.56 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-1.32%)	0.07 (-7.04%)	0.08 (-2.86%)	0.05 (-26.35%)	0.02 (+58.71%)	177.50 (+35.81%)	116.10 (+12.02%)	97.00 (+2.97%)	94.50 (+1.29%)	35.40 (+120.45%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.06 (n/a)	0.01 (n/a)	130.70 (n/a)	103.64 (n/a)	94.20 (n/a)	93.30 (n/a)	16.06 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-13.34%)	0.08 (-11.84%)	0.09 (-17.15%)	0.06 (+16.46%)	0.02 (-40.63%)	148.30 (-14.13%)	103.68 (+6.45%)	94.60 (+20.82%)	87.20 (+15.34%)	25.14 (-40.39%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.03 (n/a)	172.70 (n/a)	97.40 (n/a)	78.30 (n/a)	75.60 (n/a)	42.18 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (+6.90%)	0.07 (+3.09%)	0.08 (-1.07%)	0.05 (+15.50%)	0.02 (-11.05%)	175.30 (-13.43%)	116.50 (-5.32%)	104.40 (+1.06%)	94.80 (-6.42%)	33.12 (-25.47%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	202.50 (n/a)	123.04 (n/a)	103.30 (n/a)	101.30 (n/a)	44.44 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-2.09%)	0.07 (-4.50%)	0.08 (-4.74%)	0.06 (+4.68%)	0.01 (-3.14%)	136.50 (-4.48%)	114.22 (+4.56%)	102.20 (+5.04%)	98.20 (+2.08%)	19.36 (-3.84%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	142.90 (n/a)	109.24 (n/a)	97.30 (n/a)	96.20 (n/a)	20.13 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-0.62%)	0.07 (-6.88%)	0.08 (-8.50%)	0.05 (-9.56%)	0.01 (+4.31%)	162.30 (+10.56%)	116.84 (+8.07%)	107.40 (+9.37%)	97.50 (+0.62%)	25.96 (+19.65%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	146.80 (n/a)	108.12 (n/a)	98.20 (n/a)	96.90 (n/a)	21.70 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (-9.53%)	0.10 (-4.41%)	0.11 (+2.77%)	0.05 (-24.00%)	0.03 (+25.74%)	164.70 (+31.55%)	93.98 (+10.12%)	75.90 (-2.69%)	75.30 (+10.57%)	39.55 (+74.39%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.10 (n/a)	0.07 (n/a)	0.02 (n/a)	125.20 (n/a)	85.34 (n/a)	78.00 (n/a)	68.10 (n/a)	22.68 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+26.46%)	0.08 (+2.06%)	0.08 (-0.64%)	0.05 (-20.93%)	0.02 (+90.89%)	177.10 (+26.50%)	109.86 (+3.64%)	98.10 (+0.62%)	76.50 (-20.89%)	38.79 (+104.01%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	140.00 (n/a)	106.00 (n/a)	97.50 (n/a)	96.70 (n/a)	19.02 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (+2.47%)	0.08 (-1.50%)	0.09 (-0.28%)	0.05 (-13.88%)	0.02 (+25.22%)	176.70 (+16.10%)	110.92 (+4.39%)	95.90 (+0.31%)	91.10 (-2.36%)	36.90 (+43.55%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.01 (n/a)	152.20 (n/a)	106.26 (n/a)	95.60 (n/a)	93.30 (n/a)	25.71 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-1.56%)	0.08 (-1.01%)	0.08 (-1.38%)	0.06 (+3.24%)	0.01 (-16.33%)	126.30 (-3.14%)	104.10 (+0.60%)	98.90 (+1.44%)	97.20 (+1.57%)	12.44 (-17.53%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	130.40 (n/a)	103.48 (n/a)	97.50 (n/a)	95.70 (n/a)	15.08 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+14.11%)	0.08 (+9.44%)	0.08 (+2.32%)	0.06 (+38.46%)	0.01 (-20.02%)	137.50 (-27.75%)	105.04 (-12.06%)	101.50 (-2.22%)	83.40 (-12.39%)	19.76 (-50.35%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	190.30 (n/a)	119.44 (n/a)	103.80 (n/a)	95.20 (n/a)	39.79 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (-6.39%)	0.09 (-0.51%)	0.10 (-2.68%)	0.05 (+27.77%)	0.02 (-26.02%)	154.10 (-21.74%)	98.60 (-6.01%)	85.30 (+2.65%)	83.10 (+6.81%)	31.04 (-39.71%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	196.90 (n/a)	104.90 (n/a)	83.10 (n/a)	77.80 (n/a)	51.49 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.19 (-21.66%)	0.17 (-8.53%)	0.18 (+2.09%)	0.14 (-6.71%)	0.02 (-38.07%)	174.10 (+7.20%)	150.06 (+8.11%)	139.60 (-2.04%)	129.80 (+27.63%)	20.36 (-10.65%)
`d48746f` — 2026-01-12 22:17:10	0.24 (n/a)	0.18 (n/a)	0.17 (n/a)	0.15 (n/a)	0.04 (n/a)	162.40 (n/a)	138.80 (n/a)	142.50 (n/a)	101.70 (n/a)	22.79 (n/a)

rope_1c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	1.03 (-2.64%)	0.85 (-3.86%)	0.98 (+7.52%)	0.52 (-27.02%)	0.23 (+58.25%)	189.50 (+37.02%)	124.28 (+9.46%)	100.50 (-7.03%)	95.10 (+2.70%)	41.06 (+114.08%)
`897d04e` — 2026-03-06 22:12:25	1.06 (n/a)	0.89 (n/a)	0.91 (n/a)	0.71 (n/a)	0.15 (n/a)	138.30 (n/a)	113.54 (n/a)	108.10 (n/a)	92.60 (n/a)	19.18 (n/a)

rope_1c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.59 (-4.36%)	0.56 (+12.23%)	0.57 (+17.18%)	0.53 (+19.74%)	0.02 (-68.72%)	138.40 (-16.48%)	130.82 (-11.86%)	130.00 (-14.64%)	125.10 (+4.51%)	4.85 (-71.61%)
`897d04e` — 2026-03-06 22:12:25	0.62 (n/a)	0.50 (n/a)	0.48 (n/a)	0.44 (n/a)	0.07 (n/a)	165.70 (n/a)	148.42 (n/a)	152.30 (n/a)	119.70 (n/a)	17.10 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.21 (-0.56%)	0.17 (-10.62%)	0.16 (-13.58%)	0.13 (-13.33%)	0.03 (+17.05%)	183.70 (+15.39%)	151.76 (+12.77%)	155.20 (+15.73%)	117.30 (+0.60%)	24.24 (+35.73%)
`d48746f` — 2026-01-12 22:17:10	0.21 (n/a)	0.19 (n/a)	0.18 (n/a)	0.15 (n/a)	0.02 (n/a)	159.20 (n/a)	134.58 (n/a)	134.10 (n/a)	116.60 (n/a)	17.86 (n/a)

rope_2c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	1.05 (-3.01%)	0.88 (-2.07%)	0.90 (-3.20%)	0.62 (+8.85%)	0.16 (-21.73%)	158.50 (-8.12%)	115.62 (-0.02%)	109.40 (+3.31%)	93.80 (+3.08%)	24.98 (-24.52%)
`897d04e` — 2026-03-06 22:12:25	1.08 (n/a)	0.90 (n/a)	0.93 (n/a)	0.57 (n/a)	0.20 (n/a)	172.50 (n/a)	115.64 (n/a)	105.90 (n/a)	91.00 (n/a)	33.09 (n/a)

rope_2c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.53 (-39.21%)	0.51 (-18.96%)	0.53 (+2.77%)	0.47 (-4.20%)	0.03 (-83.31%)	158.20 (+4.42%)	144.96 (+16.85%)	139.80 (-2.71%)	138.50 (+64.49%)	8.72 (-71.83%)
`897d04e` — 2026-03-06 22:12:25	0.88 (n/a)	0.63 (n/a)	0.51 (n/a)	0.49 (n/a)	0.18 (n/a)	151.50 (n/a)	124.06 (n/a)	143.70 (n/a)	84.20 (n/a)	30.96 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.22 (+18.92%)	0.17 (+6.24%)	0.17 (+5.57%)	0.14 (-0.50%)	0.03 (+90.77%)	171.10 (+0.47%)	147.40 (-4.39%)	148.10 (-5.31%)	110.10 (-15.89%)	23.59 (+60.67%)
`d48746f` — 2026-01-12 22:17:10	0.19 (n/a)	0.16 (n/a)	0.16 (n/a)	0.14 (n/a)	0.02 (n/a)	170.30 (n/a)	154.16 (n/a)	156.40 (n/a)	130.90 (n/a)	14.69 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.17 (-1.30%)	0.15 (+6.63%)	0.15 (-8.78%)	0.14 (+39.68%)	0.01 (-67.35%)	174.90 (-28.41%)	163.42 (-10.36%)	167.40 (+9.63%)	146.50 (+1.31%)	11.19 (-76.17%)
`d48746f` — 2026-01-12 22:17:10	0.17 (n/a)	0.14 (n/a)	0.16 (n/a)	0.10 (n/a)	0.03 (n/a)	244.30 (n/a)	182.30 (n/a)	152.70 (n/a)	144.60 (n/a)	46.98 (n/a)

rope_8c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	1.25 (+17.13%)	0.90 (+1.36%)	1.02 (-0.12%)	0.43 (-20.32%)	0.32 (+39.94%)	229.50 (+25.55%)	126.68 (+6.29%)	96.00 (+0.10%)	78.80 (-14.63%)	61.31 (+58.07%)
`897d04e` — 2026-03-06 22:12:25	1.07 (n/a)	0.88 (n/a)	1.03 (n/a)	0.54 (n/a)	0.23 (n/a)	182.80 (n/a)	119.18 (n/a)	95.90 (n/a)	92.30 (n/a)	38.79 (n/a)

rope_8c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.52 (-7.65%)	0.45 (-5.21%)	0.48 (-7.99%)	0.31 (-15.16%)	0.08 (-3.89%)	239.20 (+17.83%)	168.10 (+6.19%)	152.60 (+8.69%)	142.20 (+8.30%)	40.10 (+27.81%)
`897d04e` — 2026-03-06 22:12:25	0.56 (n/a)	0.48 (n/a)	0.52 (n/a)	0.36 (n/a)	0.09 (n/a)	203.00 (n/a)	158.30 (n/a)	140.40 (n/a)	131.30 (n/a)	31.38 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (+7.19%)	0.07 (-0.56%)	0.08 (-2.96%)	0.05 (-12.85%)	0.02 (+15.73%)	173.60 (+14.74%)	117.00 (+2.61%)	97.00 (+3.08%)	87.30 (-6.63%)	35.92 (+28.09%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	151.30 (n/a)	114.02 (n/a)	94.10 (n/a)	93.50 (n/a)	28.04 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+1.80%)	0.09 (+8.65%)	0.10 (-6.57%)	0.06 (+21.21%)	0.02 (-25.08%)	145.60 (-17.51%)	92.90 (-13.01%)	82.30 (+7.02%)	75.10 (-1.70%)	29.79 (-33.51%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.03 (n/a)	176.50 (n/a)	106.80 (n/a)	76.90 (n/a)	76.40 (n/a)	44.81 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-7.32%)	0.08 (+3.82%)	0.08 (+0.83%)	0.06 (+35.60%)	0.01 (-50.92%)	126.60 (-26.22%)	104.22 (-7.70%)	99.40 (-0.80%)	97.40 (+7.86%)	12.55 (-62.31%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	171.60 (n/a)	112.92 (n/a)	100.20 (n/a)	90.30 (n/a)	33.29 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+5.07%)	0.09 (+1.19%)	0.10 (+0.86%)	0.04 (+6.94%)	0.03 (-2.43%)	199.30 (-6.48%)	106.12 (-2.80%)	82.70 (-0.84%)	78.60 (-4.84%)	52.18 (-10.17%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	213.10 (n/a)	109.18 (n/a)	83.40 (n/a)	82.60 (n/a)	58.09 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-20.65%)	0.07 (-15.52%)	0.06 (-37.94%)	0.06 (+28.27%)	0.01 (-56.19%)	147.10 (-22.00%)	119.40 (+5.85%)	126.70 (+61.20%)	95.50 (+26.16%)	22.29 (-56.32%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	188.60 (n/a)	112.80 (n/a)	78.60 (n/a)	75.70 (n/a)	51.04 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-8.02%)	0.07 (-1.69%)	0.08 (+10.61%)	0.04 (-32.15%)	0.02 (+28.69%)	212.80 (+47.37%)	121.06 (+8.11%)	98.40 (-9.56%)	94.70 (+8.73%)	51.41 (+113.64%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.02 (n/a)	144.40 (n/a)	111.98 (n/a)	108.80 (n/a)	87.10 (n/a)	24.06 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-0.97%)	0.08 (+2.86%)	0.08 (+0.76%)	0.06 (+16.49%)	0.01 (-21.02%)	142.40 (-14.17%)	105.24 (-4.90%)	98.30 (-0.71%)	90.70 (+1.00%)	21.01 (-32.55%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	165.90 (n/a)	110.66 (n/a)	99.00 (n/a)	89.80 (n/a)	31.15 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (-0.50%)	0.08 (-2.36%)	0.08 (-13.16%)	0.06 (+37.43%)	0.02 (-30.34%)	133.00 (-27.24%)	101.02 (-3.72%)	100.40 (+15.14%)	81.90 (+0.49%)	20.93 (-52.05%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	182.80 (n/a)	104.92 (n/a)	87.20 (n/a)	81.50 (n/a)	43.64 (n/a)

silu_mul_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.12 (n/a)	0.10 (n/a)	0.12 (n/a)	0.08 (n/a)	0.02 (n/a)	161.70 (n/a)	126.26 (n/a)	104.80 (n/a)	102.30 (n/a)	31.37 (n/a)

silu_mul_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.15 (n/a)	0.12 (n/a)	0.12 (n/a)	0.08 (n/a)	0.03 (n/a)	160.40 (n/a)	107.40 (n/a)	102.80 (n/a)	82.40 (n/a)	31.93 (n/a)

silu_mul_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.13 (n/a)	0.11 (n/a)	0.12 (n/a)	0.07 (n/a)	0.02 (n/a)	164.50 (n/a)	121.20 (n/a)	101.90 (n/a)	98.00 (n/a)	29.74 (n/a)

silu_mul_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.06 (n/a)	0.02 (n/a)	190.30 (n/a)	126.84 (n/a)	110.40 (n/a)	107.50 (n/a)	35.76 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.20 (+3.14%)	0.15 (-8.24%)	0.16 (-4.48%)	0.11 (-20.29%)	0.04 (+64.32%)	145.30 (+25.47%)	112.10 (+12.94%)	103.30 (+4.77%)	82.40 (-3.06%)	28.34 (+107.62%)
`897d04e` — 2026-03-06 22:12:25	0.19 (n/a)	0.17 (n/a)	0.17 (n/a)	0.14 (n/a)	0.02 (n/a)	115.80 (n/a)	99.26 (n/a)	98.60 (n/a)	85.00 (n/a)	13.65 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.18 (-9.88%)	0.15 (-8.46%)	0.17 (-1.66%)	0.11 (-6.59%)	0.03 (+7.88%)	156.00 (+7.07%)	115.62 (+10.45%)	96.60 (+1.68%)	93.00 (+10.98%)	29.19 (+20.80%)
`897d04e` — 2026-03-06 22:12:25	0.20 (n/a)	0.16 (n/a)	0.17 (n/a)	0.11 (n/a)	0.03 (n/a)	145.70 (n/a)	104.68 (n/a)	95.00 (n/a)	83.80 (n/a)	24.16 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.20 (-20.86%)	0.16 (-7.81%)	0.16 (-7.48%)	0.12 (+6.31%)	0.04 (-31.42%)	135.60 (-5.90%)	104.22 (+5.29%)	99.50 (+8.03%)	81.20 (+26.28%)	23.60 (-20.22%)
`897d04e` — 2026-03-06 22:12:25	0.25 (n/a)	0.18 (n/a)	0.18 (n/a)	0.11 (n/a)	0.05 (n/a)	144.10 (n/a)	98.98 (n/a)	92.10 (n/a)	64.30 (n/a)	29.58 (n/a)

swiglu

No metrics available.

swiglu_decode_1x2048x2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.00 (-15.46%)	0.00 (-27.20%)	0.00 (-28.17%)	0.00 (-33.90%)	0.00 (+1834.83%)	5187.20 (+51.28%)	4720.84 (+38.38%)	4750.90 (+39.22%)	4015.10 (+18.29%)	390.23 (+3298.45%)
`0a6c11c` — 2025-12-04 00:39:10	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	3428.80 (n/a)	3411.62 (n/a)	3412.60 (n/a)	3394.20 (n/a)	11.48 (n/a)

swiglu_decode_1x2048x2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.00 (+117.55%)	0.00 (+110.29%)	0.00 (+113.83%)	0.00 (+130.51%)	0.00 (+87.45%)	2243.20 (-56.62%)	1773.72 (-52.85%)	1594.10 (-53.23%)	1566.20 (-54.03%)	291.25 (-63.02%)
`897d04e` — 2026-03-06 22:12:25	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	5170.80 (n/a)	3761.80 (n/a)	3408.60 (n/a)	3407.30 (n/a)	787.66 (n/a)

swiglu_fused_decode_2048x2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	741.10 (n/a)	693.76 (n/a)	682.20 (n/a)	677.80 (n/a)	26.64 (n/a)

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-0.57%)	0.08 (+1.08%)	0.08 (+8.45%)	0.07 (+8.83%)	0.01 (-4.90%)	119.20 (-8.10%)	105.18 (-1.26%)	96.90 (-7.71%)	95.90 (+0.63%)	12.22 (-12.40%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	129.70 (n/a)	106.52 (n/a)	105.00 (n/a)	95.30 (n/a)	13.95 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.09 (-19.66%)	0.08 (-13.06%)	0.09 (-19.05%)	0.07 (+33.39%)	0.01 (-64.71%)	119.90 (-25.02%)	101.34 (+6.76%)	94.00 (+23.52%)	93.00 (+24.50%)	11.77 (-67.96%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.02 (n/a)	159.90 (n/a)	94.92 (n/a)	76.10 (n/a)	74.70 (n/a)	36.73 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+32.23%)	0.10 (+29.46%)	0.11 (+37.98%)	0.05 (-20.26%)	0.02 (+205.16%)	161.70 (+25.35%)	94.00 (-16.52%)	77.30 (-27.49%)	76.60 (-24.38%)	37.85 (+191.81%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	129.00 (n/a)	112.60 (n/a)	106.60 (n/a)	101.30 (n/a)	12.97 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.10 (+19.01%)	0.08 (+5.58%)	0.09 (+16.54%)	0.04 (-33.24%)	0.02 (+179.39%)	200.20 (+49.74%)	115.16 (+4.69%)	87.50 (-14.13%)	83.50 (-15.91%)	50.00 (+245.11%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	133.70 (n/a)	110.00 (n/a)	101.90 (n/a)	99.30 (n/a)	14.49 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	3.93 (-7.02%)	3.68 (+2.48%)	3.66 (+1.82%)	3.45 (+15.62%)	0.15 (-63.64%)	151.80 (-13.50%)	142.70 (-3.59%)	143.40 (-1.78%)	133.50 (+7.49%)	5.90 (-66.22%)
`0a6c11c` — 2025-12-04 00:39:10	4.22 (n/a)	3.59 (n/a)	3.59 (n/a)	2.99 (n/a)	0.42 (n/a)	175.50 (n/a)	148.02 (n/a)	146.00 (n/a)	124.20 (n/a)	17.46 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	4.43 (-0.01%)	3.95 (+6.02%)	4.10 (+1.92%)	3.24 (+9.11%)	0.51 (-21.54%)	161.90 (-8.38%)	134.66 (-6.78%)	128.00 (-1.84%)	118.40 (+0.00%)	18.56 (-30.22%)
`897d04e` — 2026-03-06 22:12:25	4.43 (n/a)	3.73 (n/a)	4.02 (n/a)	2.97 (n/a)	0.65 (n/a)	176.70 (n/a)	144.46 (n/a)	130.40 (n/a)	118.40 (n/a)	26.60 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	5.11 (+15.57%)	3.85 (-3.32%)	3.40 (-18.64%)	3.29 (+7.09%)	0.71 (+49.14%)	159.60 (-6.61%)	140.18 (+4.80%)	154.20 (+22.97%)	102.60 (-13.49%)	22.70 (+19.77%)
`0a6c11c` — 2025-12-04 00:39:10	4.42 (n/a)	3.99 (n/a)	4.18 (n/a)	3.07 (n/a)	0.48 (n/a)	170.90 (n/a)	133.76 (n/a)	125.40 (n/a)	118.60 (n/a)	18.95 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	5.02 (-4.86%)	4.23 (-2.69%)	4.18 (-5.92%)	3.22 (+15.74%)	0.66 (-32.53%)	163.00 (-13.57%)	126.62 (-0.28%)	125.30 (+6.28%)	104.50 (+5.13%)	22.10 (-38.65%)
`897d04e` — 2026-03-06 22:12:25	5.27 (n/a)	4.35 (n/a)	4.45 (n/a)	2.78 (n/a)	0.98 (n/a)	188.60 (n/a)	126.98 (n/a)	117.90 (n/a)	99.40 (n/a)	36.02 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.12 (+41.38%)	0.10 (+41.87%)	0.10 (+44.02%)	0.07 (+41.17%)	0.02 (+32.26%)	119.90 (-29.18%)	85.16 (-29.72%)	78.40 (-30.56%)	70.60 (-29.33%)	19.72 (-30.84%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.01 (n/a)	169.30 (n/a)	121.18 (n/a)	112.90 (n/a)	99.90 (n/a)	28.51 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.11 (+0.72%)	0.09 (-6.35%)	0.10 (+0.94%)	0.04 (-23.67%)	0.03 (+28.79%)	183.60 (+30.96%)	102.64 (+13.04%)	78.00 (-1.02%)	77.40 (-0.64%)	46.01 (+66.56%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	140.20 (n/a)	90.80 (n/a)	78.80 (n/a)	77.90 (n/a)	27.62 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (-23.62%)	0.07 (-24.20%)	0.08 (-22.04%)	0.04 (-37.87%)	0.02 (+3.47%)	203.90 (+60.93%)	122.62 (+37.50%)	102.20 (+28.23%)	101.10 (+30.96%)	45.45 (+115.44%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	126.70 (n/a)	89.18 (n/a)	79.70 (n/a)	77.20 (n/a)	21.10 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`ae902f6` — 2026-03-07 18:55:21	0.08 (+1.92%)	0.07 (-6.85%)	0.08 (-3.05%)	0.04 (-18.58%)	0.02 (+29.98%)	218.40 (+22.83%)	133.58 (+11.86%)	107.20 (+3.08%)	100.90 (-1.94%)	50.05 (+52.95%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.05 (n/a)	0.01 (n/a)	177.80 (n/a)	119.42 (n/a)	104.00 (n/a)	102.90 (n/a)	32.72 (n/a)

github-actions · 2026-03-07T19:18:33Z

📊 Test Results for Small Benchmark/Test Suite

50e35ad (2026_03_07_19_17_53)

IRONCLAD

Tested on 2026_03_07_19_17_53 at commit 50e35ad.

Test	Checks	Latency (mean)	Bandwidth (mean)	GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0_0	✅ 5/5	106.06	0.13	n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0_0	✅ 5/5	109.40	0.11	n/a
axpy_4_cols_2_channels_2048_tile_512_3.0_0	✅ 5/5	114.08	0.11	n/a
axpy_8_cols_2_channels_2048_tile_256_3.0_0	✅ 5/5	124.84	0.10	n/a
dequant_1_cols_1_channels_2048_tile_2048_0	✅ 5/5	111.00	0.05	n/a
dequant_1_cols_2_channels_2048_tile_1024_0	✅ 5/5	99.72	0.06	n/a
dequant_2_cols_1_channels_2048_tile_1024_0	✅ 5/5	100.22	0.05	n/a
dequant_2_cols_2_channels_2048_tile_512_0	✅ 5/5	115.58	0.05	n/a
dequant_4_cols_1_channels_2048_tile_512_0	✅ 5/5	119.82	0.05	n/a
dequant_4_cols_2_channels_2048_tile_256_0	✅ 5/5	107.44	0.05	n/a
dequant_8_cols_1_channels_2048_tile_256_0	✅ 5/5	115.96	0.05	n/a
dequant_8_cols_2_channels_2048_tile_128_0	✅ 5/5	132.48	0.04	n/a
dual_gemv_silu_mul_2048x2048_4tsi_512tso_4col0	✅ 5/5	470.06	35.72	n/a
eltwise_add_1_cols_2_channels_2048_tile_2048	✅ 5/5	129.10	0.10	n/a
eltwise_add_2_cols_2_channels_2048_tile_1024	✅ 5/5	121.30	0.11	n/a
eltwise_add_4_cols_2_channels_2048_tile_512	✅ 5/5	118.44	0.11	n/a
eltwise_add_8_cols_2_channels_2048_tile_256	✅ 5/5	105.24	0.12	n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048	✅ 5/5	99.84	0.13	n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024	✅ 5/5	111.98	0.11	n/a
eltwise_mul_4_cols_2_channels_2048_tile_512	✅ 5/5	99.12	0.13	n/a
eltwise_mul_8_cols_2_channels_2048_tile_256	✅ 5/5	117.64	0.11	n/a
flowkv_decode_32h_8kv_64d_128s_32cs_4col0	✅ 5/5	352.94	0.77	n/a
fused_dequant_gemv_2048x2048_1tsi_512tso_4col_g32_0	✅ 5/5	1264.18	1.87	n/a
fused_qkv_proj_3072x2048_4tsi_768tso_4col0	✅ 5/5	391.90	32.20	n/a
gelu_1_cols_1_channels_2048_tile_2048	✅ 5/5	106.46	0.08	n/a
gelu_1_cols_2_channels_2048_tile_1024	✅ 5/5	90.72	0.09	n/a
gelu_2_cols_1_channels_2048_tile_1024	✅ 5/5	106.02	0.08	n/a
gelu_2_cols_2_channels_2048_tile_512	✅ 5/5	98.64	0.09	n/a
gelu_4_cols_1_channels_2048_tile_512	✅ 5/5	91.32	0.09	n/a
gelu_4_cols_2_channels_2048_tile_256	✅ 5/5	106.70	0.08	n/a
gelu_8_cols_1_channels_2048_tile_256	✅ 5/5	103.24	0.09	n/a
gelu_8_cols_2_channels_2048_tile_128	✅ 5/5	120.32	0.07	n/a
gemm_1792x896x1152_64x32x48_8cols_ccolmaj	✅ 5/5	2404.48	4.33	n/a
gemm_192x384x64_48x96x16_4cols	✅ 5/5	161.42	1.50	n/a
gemm_192x384x64_48x96x16_4cols_bcolmaj_ccolmaj	✅ 5/5	115.18	1.93	n/a
gemm_2048x2048x2048_64x64x64_1cols	✅ 5/5	48349.48	0.52	n/a
gemm_2048x2048x2048_64x64x64_2cols_bcolmaj	✅ 5/5	27562.26	0.91	n/a
gemm_2048x2048x2048_64x64x64_8cols_bcolmaj_ccolmaj	✅ 5/5	7723.50	3.30	n/a
gemm_384x1536x1792_32x48x64_4cols_bcolmaj	✅ 5/5	1890.22	4.27	n/a
gemm_896x1792x640_32x64x80_8cols_ccolmaj	✅ 5/5	1116.72	6.32	n/a
layer_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	95.70	0.09	n/a
layer_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	100.08	0.09	n/a
layer_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	96.62	0.09	n/a
layer_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	95.52	0.09	n/a
layer_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	100.48	0.09	n/a
layer_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	95.04	0.09	n/a
layer_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	113.50	0.08	n/a
layer_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	110.94	0.08	n/a
matrix_vector_mul_128x128_32tsi_128tso_1col0	✅ 5/5	n/a	0.31	n/a
matrix_vector_mul_2048x8192_1tsi_1024tso_2col0	✅ 5/5	n/a	24.42	n/a
matrix_vector_mul_2048x8192_1tsi_2048tso_1col0	✅ 5/5	n/a	13.35	n/a
matrix_vector_mul_2048x8192_1tsi_256tso_8col0	✅ 5/5	n/a	44.63	n/a
matrix_vector_mul_2048x8192_1tsi_512tso_4col0	✅ 5/5	n/a	40.57	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_1col0	✅ 5/5	n/a	13.25	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_2col0	✅ 5/5	n/a	24.95	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_4col0	✅ 5/5	n/a	39.71	n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_8col0	✅ 5/5	n/a	46.95	n/a
mem_copy_16_cores_2_chans_2048_tile_128_False0	✅ 5/5	116.84	0.07	n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False0	✅ 5/5	99.52	0.08	n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False0	✅ 5/5	92.14	0.10	n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False0	✅ 5/5	105.32	0.08	n/a
mem_copy_4_cores_1_chans_2048_tile_512_False0	✅ 5/5	115.64	0.07	n/a
mem_copy_4_cores_2_chans_2048_tile_512_False0	✅ 5/5	91.32	0.10	n/a
mem_copy_8_cores_1_chans_2048_tile_256_False0	✅ 5/5	124.62	0.07	n/a
mem_copy_8_cores_2_chans_2048_tile_256_False0	✅ 5/5	120.40	0.07	n/a
mha_16384_64_1_8_0_0	✅ 5/5	47241.80	0.18	n/a
relu_1_cols_1_channels_2048_tile_2048	✅ 5/5	114.20	0.09	n/a
relu_2_cols_1_channels_2048_tile_1024	✅ 5/5	118.70	0.07	n/a
relu_4_cols_1_channels_2048_tile_512	✅ 5/5	103.06	0.09	n/a
relu_8_cols_1_channels_2048_tile_256	✅ 5/5	132.64	0.07	n/a
rms_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	111.00	0.08	n/a
rms_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	114.12	0.08	n/a
rms_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	115.62	0.07	n/a
rms_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	125.36	0.07	n/a
rms_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	111.22	0.08	n/a
rms_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	114.38	0.08	n/a
rms_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	113.72	0.07	n/a
rms_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	115.46	0.09	n/a
rope_1c_32rows_512cols_32arows_0m	✅ 5/5	133.80	0.77	n/a
rope_1c_32rows_512cols_8arows_0m	✅ 5/5	159.84	0.47	n/a
rope_2c_32rows_512cols_32arows_0m	✅ 5/5	114.16	0.90	n/a
rope_2c_32rows_512cols_8arows_0m	✅ 5/5	153.64	0.48	n/a
rope_8c_32rows_512cols_32arows_0m	✅ 5/5	130.24	0.79	n/a
rope_8c_32rows_512cols_8arows_0m	✅ 5/5	158.16	0.47	n/a
sigmoid_1_cols_1_channels_2048_tile_2048	✅ 5/5	111.92	0.08	n/a
sigmoid_2_cols_1_channels_2048_tile_1024	✅ 5/5	103.84	0.09	n/a
sigmoid_4_cols_1_channels_2048_tile_512	✅ 5/5	115.88	0.07	n/a
sigmoid_8_cols_1_channels_2048_tile_256	✅ 5/5	127.68	0.08	n/a
silu_1_cols_1_channels_2048_tile_2048	✅ 5/5	117.52	0.07	n/a
silu_2_cols_1_channels_2048_tile_1024	✅ 5/5	110.08	0.08	n/a
silu_4_cols_1_channels_2048_tile_512	✅ 5/5	121.24	0.07	n/a
silu_8_cols_1_channels_2048_tile_256	✅ 5/5	96.58	0.09	n/a
silu_mul_1_cols_2_channels_2048_tile_2048	✅ 5/5	103.44	0.12	n/a
silu_mul_2_cols_2_channels_2048_tile_1024	✅ 5/5	117.78	0.11	n/a
silu_mul_4_cols_2_channels_2048_tile_512	✅ 5/5	113.88	0.11	n/a
silu_mul_8_cols_2_channels_2048_tile_256	✅ 5/5	118.76	0.11	n/a
softmax_1_cols_2_channels_4096_tile_2048	✅ 5/5	97.52	0.17	n/a
softmax_2_cols_2_channels_4096_tile_1024	✅ 5/5	91.18	0.19	n/a
softmax_2_cols_2_channels_4096_tile_512	✅ 5/5	112.86	0.16	n/a
swiglu_decode_1x2048x2048_0	✅ 5/5	1705.34	0.00	n/a
swiglu_fused_decode_2048x2048_0	✅ 5/5	833.34	0.01	n/a
tanh_1_cols_1_channels_2048_tile_2048	✅ 5/5	115.40	0.07	n/a
tanh_2_cols_1_channels_2048_tile_1024	✅ 5/5	106.48	0.08	n/a
tanh_4_cols_1_channels_2048_tile_512	✅ 5/5	87.82	0.10	n/a
tanh_8_cols_1_channels_2048_tile_256	✅ 5/5	122.40	0.07	n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0	✅ 5/5	155.72	3.41	n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0	✅ 5/5	132.64	4.06	n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048	✅ 5/5	103.18	0.08	n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024	✅ 5/5	104.62	0.08	n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512	✅ 5/5	100.40	0.09	n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256	✅ 5/5	110.84	0.08	n/a

📈 Trends (vs main branch) for Small Benchmark/Test Suite

50e35ad (2026_03_07_19_17_53)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.13 (-1.96%)	0.11 (+2.52%)	0.10 (+1.86%)	0.08 (-1.91%)	0.02 (-1.72%)	162.40 (+1.95%)	120.96 (-2.36%)	117.00 (-1.85%)	94.40 (+2.05%)	23.11 (+4.09%)
`0a6c11c` — 2025-12-04 00:39:10	0.13 (n/a)	0.10 (n/a)	0.10 (n/a)	0.08 (n/a)	0.02 (n/a)	159.30 (n/a)	123.88 (n/a)	119.20 (n/a)	92.50 (n/a)	22.21 (n/a)

axpy_1_cols_2_channels_2048_tile_2048_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.15 (-6.48%)	0.13 (-6.39%)	0.15 (+0.09%)	0.07 (-32.48%)	0.04 (+22.88%)	186.20 (+48.13%)	106.06 (+13.36%)	83.40 (-0.12%)	80.20 (+6.93%)	45.40 (+102.86%)
`897d04e` — 2026-03-06 22:12:25	0.16 (n/a)	0.14 (n/a)	0.15 (n/a)	0.10 (n/a)	0.03 (n/a)	125.70 (n/a)	93.56 (n/a)	83.50 (n/a)	75.00 (n/a)	22.38 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.11 (-26.77%)	0.09 (-9.09%)	0.09 (-10.81%)	0.08 (+8.25%)	0.01 (-55.42%)	152.00 (-7.60%)	135.46 (+6.28%)	142.80 (+12.18%)	115.00 (+36.58%)	15.03 (-41.36%)
`0a6c11c` — 2025-12-04 00:39:10	0.15 (n/a)	0.10 (n/a)	0.10 (n/a)	0.07 (n/a)	0.02 (n/a)	164.50 (n/a)	127.46 (n/a)	127.30 (n/a)	84.20 (n/a)	25.64 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.14 (+8.33%)	0.11 (+6.93%)	0.12 (+5.55%)	0.09 (+38.49%)	0.02 (-24.47%)	131.90 (-27.81%)	109.40 (-9.48%)	105.00 (-5.23%)	88.70 (-7.70%)	16.95 (-51.78%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	182.70 (n/a)	120.86 (n/a)	110.80 (n/a)	96.10 (n/a)	35.16 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.12 (-10.21%)	0.10 (-8.41%)	0.10 (-6.20%)	0.07 (+3.52%)	0.02 (-23.48%)	166.70 (-3.36%)	128.78 (+7.33%)	121.80 (+6.65%)	103.90 (+11.36%)	22.95 (-18.82%)
`0a6c11c` — 2025-12-04 00:39:10	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	172.50 (n/a)	119.98 (n/a)	114.20 (n/a)	93.30 (n/a)	28.27 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (-3.62%)	0.11 (+5.84%)	0.12 (+0.85%)	0.08 (+20.31%)	0.02 (-23.19%)	161.40 (-16.85%)	114.08 (-8.38%)	102.40 (-0.87%)	100.90 (+3.81%)	26.47 (-34.34%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.12 (n/a)	0.06 (n/a)	0.03 (n/a)	194.10 (n/a)	124.52 (n/a)	103.30 (n/a)	97.20 (n/a)	40.32 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (-16.19%)	0.08 (-10.40%)	0.09 (-2.09%)	0.07 (-17.38%)	0.01 (-10.61%)	184.40 (+21.00%)	153.18 (+11.99%)	144.10 (+2.20%)	127.10 (+19.34%)	21.26 (+34.76%)
`0a6c11c` — 2025-12-04 00:39:10	0.12 (n/a)	0.09 (n/a)	0.09 (n/a)	0.08 (n/a)	0.01 (n/a)	152.40 (n/a)	136.78 (n/a)	141.00 (n/a)	106.50 (n/a)	15.78 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (-13.77%)	0.10 (-8.88%)	0.11 (+0.20%)	0.08 (+1.81%)	0.01 (-27.88%)	153.50 (-1.79%)	124.84 (+8.31%)	112.50 (-0.18%)	110.70 (+15.92%)	19.31 (-20.67%)
`897d04e` — 2026-03-06 22:12:25	0.13 (n/a)	0.11 (n/a)	0.11 (n/a)	0.08 (n/a)	0.02 (n/a)	156.30 (n/a)	115.26 (n/a)	112.70 (n/a)	95.50 (n/a)	24.34 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (-18.83%)	0.04 (-5.21%)	0.04 (-2.69%)	0.03 (+37.10%)	0.00 (-53.98%)	160.40 (-27.06%)	141.12 (-0.91%)	136.40 (+2.79%)	114.30 (+23.17%)	17.37 (-59.06%)
`0a6c11c` — 2025-12-04 00:39:10	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	219.90 (n/a)	142.42 (n/a)	132.70 (n/a)	92.80 (n/a)	42.43 (n/a)

dequant_1_cols_1_channels_2048_tile_2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.06 (+16.18%)	0.05 (+16.76%)	0.05 (+27.96%)	0.04 (+18.47%)	0.01 (+57.25%)	133.70 (-15.59%)	111.00 (-13.36%)	96.70 (-21.89%)	95.10 (-13.86%)	20.68 (+12.65%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	158.40 (n/a)	128.12 (n/a)	123.80 (n/a)	110.40 (n/a)	18.36 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.06 (-13.28%)	0.05 (-8.93%)	0.06 (-13.59%)	0.04 (+4.63%)	0.01 (-39.10%)	133.60 (-4.43%)	106.08 (+5.85%)	95.10 (+15.69%)	87.90 (+15.35%)	17.90 (-31.97%)
`0a6c11c` — 2025-12-04 00:39:10	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	139.80 (n/a)	100.22 (n/a)	82.20 (n/a)	76.20 (n/a)	26.31 (n/a)

dequant_1_cols_2_channels_2048_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.07 (+7.50%)	0.06 (+10.43%)	0.06 (+8.79%)	0.04 (+12.67%)	0.01 (+2.64%)	144.40 (-11.25%)	99.72 (-10.03%)	90.80 (-8.10%)	75.80 (-6.99%)	26.37 (-14.99%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	162.70 (n/a)	110.84 (n/a)	98.80 (n/a)	81.50 (n/a)	31.02 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.07 (+5.66%)	0.05 (+1.21%)	0.05 (+0.61%)	0.04 (-15.02%)	0.01 (+58.42%)	143.40 (+17.64%)	101.02 (+1.49%)	97.60 (-0.61%)	78.90 (-5.40%)	22.56 (+78.52%)
`0a6c11c` — 2025-12-04 00:39:10	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	121.90 (n/a)	99.54 (n/a)	98.20 (n/a)	83.40 (n/a)	12.64 (n/a)

dequant_2_cols_1_channels_2048_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.05 (-8.21%)	0.05 (+10.46%)	0.05 (+3.99%)	0.05 (+35.84%)	0.00 (-68.66%)	112.10 (-26.40%)	100.22 (-12.91%)	96.90 (-3.87%)	96.00 (+8.97%)	6.77 (-75.09%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	152.30 (n/a)	115.08 (n/a)	100.80 (n/a)	88.10 (n/a)	27.20 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (+17.06%)	0.04 (+8.98%)	0.05 (+21.37%)	0.03 (-11.65%)	0.01 (+301.89%)	159.70 (+13.18%)	126.32 (-5.68%)	109.00 (-17.67%)	106.80 (-14.56%)	22.48 (+280.15%)
`0a6c11c` — 2025-12-04 00:39:10	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	141.10 (n/a)	133.92 (n/a)	132.40 (n/a)	125.00 (n/a)	5.91 (n/a)

dequant_2_cols_2_channels_2048_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.05 (-21.27%)	0.05 (+0.68%)	0.05 (+22.46%)	0.03 (+7.49%)	0.01 (-29.40%)	153.30 (-6.92%)	115.58 (-2.97%)	98.10 (-18.39%)	96.00 (+26.98%)	26.49 (-16.18%)
`897d04e` — 2026-03-06 22:12:25	0.07 (n/a)	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	164.70 (n/a)	119.12 (n/a)	120.20 (n/a)	75.60 (n/a)	31.61 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.06 (+20.24%)	0.05 (-3.19%)	0.05 (-6.73%)	0.03 (-20.69%)	0.01 (+194.26%)	156.10 (+26.09%)	120.86 (+7.15%)	114.90 (+7.18%)	88.30 (-16.85%)	24.40 (+214.82%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	123.80 (n/a)	112.80 (n/a)	107.20 (n/a)	106.20 (n/a)	7.75 (n/a)

dequant_4_cols_1_channels_2048_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.07 (+22.40%)	0.05 (+4.25%)	0.05 (-0.63%)	0.03 (+6.23%)	0.01 (+57.53%)	154.90 (-5.89%)	119.82 (-1.90%)	116.60 (+0.60%)	79.60 (-18.36%)	28.81 (+14.85%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	164.60 (n/a)	122.14 (n/a)	115.90 (n/a)	97.50 (n/a)	25.08 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (-6.09%)	0.04 (-8.04%)	0.04 (-12.46%)	0.03 (-0.41%)	0.01 (-20.19%)	168.10 (+0.42%)	135.74 (+7.44%)	132.20 (+14.26%)	107.40 (+6.44%)	22.91 (-12.67%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	167.40 (n/a)	126.34 (n/a)	115.70 (n/a)	100.90 (n/a)	26.23 (n/a)

dequant_4_cols_2_channels_2048_tile_256_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.05 (-17.11%)	0.05 (+8.74%)	0.05 (+21.90%)	0.04 (+36.01%)	0.00 (-69.52%)	122.30 (-26.50%)	107.44 (-12.18%)	104.80 (-17.93%)	102.00 (+20.57%)	8.40 (-72.43%)
`897d04e` — 2026-03-06 22:12:25	0.06 (n/a)	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	166.40 (n/a)	122.34 (n/a)	127.70 (n/a)	84.60 (n/a)	30.47 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.04 (-13.65%)	0.04 (-13.67%)	0.04 (-18.56%)	0.03 (-13.52%)	0.00 (-23.88%)	170.40 (+15.68%)	140.12 (+15.33%)	135.80 (+22.78%)	119.60 (+15.78%)	17.94 (+1.87%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	147.30 (n/a)	121.50 (n/a)	110.60 (n/a)	103.30 (n/a)	17.61 (n/a)

dequant_8_cols_1_channels_2048_tile_256_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.05 (+18.05%)	0.05 (+11.01%)	0.05 (+19.19%)	0.04 (-3.44%)	0.01 (+123.75%)	147.70 (+3.50%)	115.96 (-8.29%)	105.50 (-16.07%)	97.80 (-15.32%)	20.80 (+96.02%)
`897d04e` — 2026-03-06 22:12:25	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	142.70 (n/a)	126.44 (n/a)	125.70 (n/a)	115.50 (n/a)	10.61 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.05 (+17.21%)	0.03 (-1.70%)	0.03 (-3.04%)	0.03 (-16.20%)	0.01 (+95.59%)	198.20 (+19.33%)	160.00 (+4.92%)	166.20 (+3.17%)	106.50 (-14.66%)	29.86 (+87.19%)
`0a6c11c` — 2025-12-04 00:39:10	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.00 (n/a)	166.10 (n/a)	152.50 (n/a)	161.10 (n/a)	124.80 (n/a)	15.95 (n/a)

dequant_8_cols_2_channels_2048_tile_128_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.04 (+13.79%)	0.04 (+10.92%)	0.04 (+13.74%)	0.03 (+26.45%)	0.01 (+3.04%)	152.70 (-20.92%)	132.48 (-10.29%)	119.70 (-12.05%)	119.00 (-12.11%)	18.05 (-28.95%)
`897d04e` — 2026-03-06 22:12:25	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	193.10 (n/a)	147.68 (n/a)	136.10 (n/a)	135.40 (n/a)	25.41 (n/a)

dual_gemv_silu_mul_2048x2048_4tsi_512tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	36.71 (n/a)	35.72 (n/a)	35.58 (n/a)	34.65 (n/a)	0.78 (n/a)	484.40 (n/a)	470.06 (n/a)	471.70 (n/a)	457.20 (n/a)	10.33 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (-25.92%)	0.10 (-23.21%)	0.11 (-22.01%)	0.06 (-24.16%)	0.02 (-25.74%)	192.20 (+31.91%)	129.10 (+30.04%)	107.00 (+28.30%)	104.70 (+34.92%)	37.59 (+31.00%)
`897d04e` — 2026-03-06 22:12:25	0.16 (n/a)	0.13 (n/a)	0.15 (n/a)	0.08 (n/a)	0.03 (n/a)	145.70 (n/a)	99.28 (n/a)	83.40 (n/a)	77.60 (n/a)	28.70 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (+1.30%)	0.11 (+1.51%)	0.12 (+1.04%)	0.07 (-6.69%)	0.02 (+4.28%)	169.50 (+7.21%)	121.30 (-1.00%)	103.90 (-1.05%)	100.10 (-1.28%)	30.22 (+9.77%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.12 (n/a)	0.08 (n/a)	0.02 (n/a)	158.10 (n/a)	122.52 (n/a)	105.00 (n/a)	101.40 (n/a)	27.53 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (-24.54%)	0.11 (-11.90%)	0.12 (-18.67%)	0.08 (+35.40%)	0.02 (-62.14%)	146.70 (-26.17%)	118.44 (+2.33%)	106.30 (+22.89%)	105.10 (+32.53%)	18.67 (-63.17%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.12 (n/a)	0.14 (n/a)	0.06 (n/a)	0.04 (n/a)	198.70 (n/a)	115.74 (n/a)	86.50 (n/a)	79.30 (n/a)	50.70 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.13 (+20.47%)	0.12 (+19.77%)	0.13 (+20.61%)	0.08 (+15.03%)	0.02 (+30.20%)	153.10 (-13.06%)	105.24 (-15.90%)	93.50 (-17.04%)	92.50 (-16.97%)	26.77 (-6.10%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	176.10 (n/a)	125.14 (n/a)	112.70 (n/a)	111.40 (n/a)	28.50 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.15 (+3.11%)	0.13 (+1.57%)	0.14 (+5.04%)	0.08 (+9.54%)	0.03 (-3.06%)	151.60 (-8.73%)	99.84 (-2.77%)	84.90 (-4.82%)	81.20 (-2.99%)	29.90 (-15.95%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.13 (n/a)	0.14 (n/a)	0.07 (n/a)	0.03 (n/a)	166.10 (n/a)	102.68 (n/a)	89.20 (n/a)	83.70 (n/a)	35.57 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.14 (-8.69%)	0.11 (-13.61%)	0.12 (-20.36%)	0.08 (-17.94%)	0.02 (-8.40%)	163.80 (+21.88%)	111.98 (+16.55%)	103.40 (+25.49%)	89.20 (+9.45%)	29.73 (+30.19%)
`897d04e` — 2026-03-06 22:12:25	0.15 (n/a)	0.13 (n/a)	0.15 (n/a)	0.09 (n/a)	0.03 (n/a)	134.40 (n/a)	96.08 (n/a)	82.40 (n/a)	81.50 (n/a)	22.84 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.16 (+34.29%)	0.13 (+30.65%)	0.14 (+31.86%)	0.08 (+26.29%)	0.03 (+36.47%)	155.50 (-20.82%)	99.12 (-22.92%)	87.60 (-24.09%)	78.90 (-25.50%)	31.72 (-17.23%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.11 (n/a)	0.06 (n/a)	0.02 (n/a)	196.40 (n/a)	128.60 (n/a)	115.40 (n/a)	105.90 (n/a)	38.33 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (+5.48%)	0.11 (+5.45%)	0.11 (+4.42%)	0.08 (+0.05%)	0.02 (+19.35%)	155.20 (+0.00%)	117.64 (-4.62%)	108.90 (-4.22%)	106.40 (-5.17%)	21.03 (+14.55%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.08 (n/a)	0.01 (n/a)	155.20 (n/a)	123.34 (n/a)	113.70 (n/a)	112.20 (n/a)	18.35 (n/a)

flowkv_decode_32h_8kv_64d_128s_32cs_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.80 (n/a)	0.77 (n/a)	0.79 (n/a)	0.73 (n/a)	0.03 (n/a)	373.70 (n/a)	352.94 (n/a)	345.60 (n/a)	338.50 (n/a)	16.20 (n/a)

fused_dequant_gemv_2048x2048_1tsi_512tso_4col_g32_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	1.95 (n/a)	1.87 (n/a)	1.89 (n/a)	1.79 (n/a)	0.06 (n/a)	1321.80 (n/a)	1264.18 (n/a)	1255.30 (n/a)	1217.10 (n/a)	37.96 (n/a)	6.89 (n/a)	6.64 (n/a)	6.68 (n/a)	6.35 (n/a)	0.20 (n/a)

fused_qkv_proj_3072x2048_4tsi_768tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	34.04 (n/a)	32.20 (n/a)	32.31 (n/a)	30.11 (n/a)	1.64 (n/a)	418.20 (n/a)	391.90 (n/a)	389.70 (n/a)	370.00 (n/a)	20.14 (n/a)	34.01 (n/a)	32.18 (n/a)	32.29 (n/a)	30.09 (n/a)	1.64 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (-0.96%)	0.08 (-7.61%)	0.08 (-11.44%)	0.05 (-19.71%)	0.02 (+26.26%)	168.10 (+24.61%)	106.46 (+12.20%)	99.20 (+12.86%)	78.40 (+1.03%)	36.46 (+56.52%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.02 (n/a)	134.90 (n/a)	94.88 (n/a)	87.90 (n/a)	77.60 (n/a)	23.30 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (-3.84%)	0.09 (-5.94%)	0.09 (-11.14%)	0.07 (-10.97%)	0.02 (+8.21%)	125.10 (+12.30%)	90.72 (+7.23%)	86.90 (+12.56%)	75.60 (+3.99%)	19.91 (+27.13%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.07 (n/a)	0.02 (n/a)	111.40 (n/a)	84.60 (n/a)	77.20 (n/a)	72.70 (n/a)	15.66 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (-2.50%)	0.08 (-12.57%)	0.08 (-22.16%)	0.05 (+2.65%)	0.02 (-19.26%)	151.90 (-2.57%)	106.02 (+11.48%)	102.00 (+28.46%)	78.60 (+2.48%)	27.82 (-18.60%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	155.90 (n/a)	95.10 (n/a)	79.40 (n/a)	76.70 (n/a)	34.18 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+0.17%)	0.09 (-5.67%)	0.10 (-7.21%)	0.05 (-3.94%)	0.02 (+2.62%)	157.90 (+4.09%)	98.64 (+6.48%)	82.50 (+7.70%)	74.80 (-0.13%)	34.87 (+4.93%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.11 (n/a)	0.05 (n/a)	0.02 (n/a)	151.70 (n/a)	92.64 (n/a)	76.60 (n/a)	74.90 (n/a)	33.24 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (-10.15%)	0.09 (-1.62%)	0.09 (-3.64%)	0.08 (+40.26%)	0.01 (-57.82%)	107.90 (-28.68%)	91.32 (-4.04%)	87.00 (+3.82%)	83.10 (+11.24%)	10.37 (-67.57%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	151.30 (n/a)	95.16 (n/a)	83.80 (n/a)	74.70 (n/a)	31.97 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-6.26%)	0.08 (-4.19%)	0.09 (-5.44%)	0.05 (+3.85%)	0.02 (-13.39%)	174.80 (-3.69%)	106.70 (+2.20%)	89.70 (+5.65%)	88.50 (+6.76%)	38.09 (-11.75%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	181.50 (n/a)	104.40 (n/a)	84.90 (n/a)	82.90 (n/a)	43.16 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (-0.05%)	0.09 (+1.30%)	0.10 (+8.45%)	0.05 (-18.72%)	0.02 (+35.29%)	176.30 (+23.03%)	103.24 (+3.47%)	84.20 (-7.78%)	81.60 (+0.00%)	41.02 (+64.34%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.02 (n/a)	143.30 (n/a)	99.78 (n/a)	91.30 (n/a)	81.60 (n/a)	24.96 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-1.20%)	0.07 (-2.97%)	0.08 (+1.88%)	0.05 (+0.41%)	0.02 (+0.52%)	172.90 (-0.46%)	120.32 (+2.94%)	104.20 (-1.88%)	99.40 (+1.22%)	31.30 (-2.26%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.05 (n/a)	0.01 (n/a)	173.70 (n/a)	116.88 (n/a)	106.20 (n/a)	98.20 (n/a)	32.02 (n/a)

gemm_1792x896x1152_64x32x48_8cols_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	5.07 (+1.47%)	4.33 (-11.42%)	4.99 (+0.50%)	2.22 (-50.73%)	1.22 (+489.12%)	4229.20 (+102.98%)	2404.48 (+24.67%)	1884.30 (-0.50%)	1854.90 (-1.46%)	1030.30 (+1087.34%)	1994.36 (+1.47%)	1701.76 (-11.42%)	1963.26 (+0.50%)	874.73 (-50.73%)	480.53 (+489.12%)
`897d04e` — 2026-03-06 22:12:25	5.00 (n/a)	4.88 (n/a)	4.97 (n/a)	4.51 (n/a)	0.21 (n/a)	2083.60 (n/a)	1928.60 (n/a)	1893.70 (n/a)	1882.30 (n/a)	86.77 (n/a)	1965.38 (n/a)	1921.12 (n/a)	1953.55 (n/a)	1775.47 (n/a)	81.57 (n/a)

gemm_192x384x64_48x96x16_4cols

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	1.97 (-3.94%)	1.50 (-9.60%)	1.45 (-22.11%)	0.84 (+6.43%)	0.44 (-16.01%)	264.60 (-6.04%)	161.42 (+6.39%)	152.30 (+28.41%)	112.40 (+4.17%)	60.88 (-17.63%)	83.98 (-3.94%)	63.99 (-9.60%)	61.96 (-22.11%)	35.67 (+6.43%)	18.89 (-16.01%)
`897d04e` — 2026-03-06 22:12:25	2.05 (n/a)	1.66 (n/a)	1.86 (n/a)	0.79 (n/a)	0.53 (n/a)	281.60 (n/a)	151.72 (n/a)	118.60 (n/a)	107.90 (n/a)	73.91 (n/a)	87.43 (n/a)	70.78 (n/a)	79.55 (n/a)	33.52 (n/a)	22.49 (n/a)

gemm_192x384x64_48x96x16_4cols_bcolmaj_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	2.11 (-5.27%)	1.93 (+5.86%)	1.95 (+4.26%)	1.67 (+27.01%)	0.16 (-51.00%)	132.10 (-21.28%)	115.18 (-7.72%)	113.50 (-4.06%)	104.60 (+5.55%)	10.19 (-60.17%)	90.23 (-5.27%)	82.42 (+5.86%)	83.17 (+4.26%)	71.42 (+27.01%)	6.84 (-51.00%)
`897d04e` — 2026-03-06 22:12:25	2.23 (n/a)	1.82 (n/a)	1.87 (n/a)	1.32 (n/a)	0.33 (n/a)	167.80 (n/a)	124.82 (n/a)	118.30 (n/a)	99.10 (n/a)	25.58 (n/a)	95.25 (n/a)	77.86 (n/a)	79.77 (n/a)	56.23 (n/a)	13.96 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.72 (-0.11%)	3.55 (-2.75%)	3.56 (-2.75%)	3.36 (-5.33%)	0.12 (+76.10%)	2725.23 (-0.11%)	2602.52 (-2.75%)	2612.11 (-2.75%)	2459.89 (-5.33%)	86.27 (+76.10%)	6984.00 (+5.63%)	6608.60 (+2.91%)	6577.00 (+2.83%)	6304.00 (+0.11%)	221.87 (+87.15%)
`9e98049` — 2025-11-25 20:50:55	3.72 (n/a)	3.65 (n/a)	3.66 (n/a)	3.54 (n/a)	0.07 (n/a)	2728.26 (n/a)	2676.06 (n/a)	2686.03 (n/a)	2598.29 (n/a)	48.99 (n/a)	6612.00 (n/a)	6422.00 (n/a)	6396.00 (n/a)	6297.00 (n/a)	118.55 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.40 (-3.14%)	3.38 (-0.82%)	3.38 (-0.82%)	3.35 (+4.93%)	0.02 (-84.51%)	2493.81 (-3.14%)	2475.27 (-0.82%)	2479.06 (-0.82%)	2453.92 (+4.93%)	13.33 (-84.51%)	7001.00 (-4.70%)	6940.80 (+0.71%)	6930.00 (+0.83%)	6889.00 (+3.24%)	37.43 (-84.76%)
`9e98049` — 2025-11-25 20:50:55	3.51 (n/a)	3.40 (n/a)	3.41 (n/a)	3.19 (n/a)	0.12 (n/a)	2574.53 (n/a)	2495.72 (n/a)	2499.62 (n/a)	2338.67 (n/a)	86.02 (n/a)	7346.00 (n/a)	6892.20 (n/a)	6873.00 (n/a)	6673.00 (n/a)	245.57 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`3a053d3` — 2025-11-26 01:12:16	3.02 (+0.52%)	2.87 (-2.05%)	2.86 (-2.24%)	2.70 (-6.16%)	0.11 (+131.66%)	2216.19 (+0.52%)	2104.44 (-2.05%)	2094.08 (-2.24%)	1980.84 (-6.16%)	80.25 (+131.67%)	8673.00 (+6.56%)	8175.60 (+2.21%)	8204.00 (+2.29%)	7752.00 (-0.51%)	314.03 (+145.36%)
`9e98049` — 2025-11-25 20:50:55	3.01 (n/a)	2.93 (n/a)	2.92 (n/a)	2.88 (n/a)	0.05 (n/a)	2204.81 (n/a)	2148.41 (n/a)	2142.13 (n/a)	2110.81 (n/a)	34.64 (n/a)	8139.00 (n/a)	7998.60 (n/a)	8020.00 (n/a)	7792.00 (n/a)	127.99 (n/a)

gemm_2048x2048x2048_64x64x64_1cols

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.52 (+0.08%)	0.52 (-0.06%)	0.52 (-0.01%)	0.52 (-0.22%)	0.00 (+25.74%)	48510.50 (+0.22%)	48349.48 (+0.06%)	48398.30 (+0.01%)	47974.90 (-0.08%)	214.91 (+25.83%)	358.10 (+0.08%)	355.33 (-0.06%)	354.97 (-0.01%)	354.15 (-0.22%)	1.59 (+25.73%)
`897d04e` — 2026-03-06 22:12:25	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.00 (n/a)	48401.80 (n/a)	48318.62 (n/a)	48391.10 (n/a)	48013.20 (n/a)	170.80 (n/a)	357.82 (n/a)	355.56 (n/a)	355.02 (n/a)	354.94 (n/a)	1.26 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	1.04 (+0.94%)	1.03 (+0.23%)	1.03 (+0.09%)	1.02 (+0.07%)	0.00 (+197.51%)	24576.00 (-0.07%)	24485.82 (-0.23%)	24530.40 (-0.09%)	24266.40 (-0.94%)	111.26 (+194.35%)
`0a6c11c` — 2025-12-04 00:39:10	1.03 (n/a)	1.03 (n/a)	1.03 (n/a)	1.02 (n/a)	0.00 (n/a)	24594.30 (n/a)	24542.14 (n/a)	24551.90 (n/a)	24495.50 (n/a)	37.80 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	1.04 (+0.28%)	1.03 (-0.15%)	1.03 (+0.05%)	1.02 (-0.52%)	0.01 (+42.72%)	24719.80 (+0.52%)	24512.42 (+0.16%)	24529.20 (-0.05%)	24092.60 (-0.28%)	252.92 (+43.15%)	713.08 (+0.28%)	700.92 (-0.15%)	700.38 (+0.05%)	694.98 (-0.52%)	7.30 (+42.71%)
`50ad37c` — 2025-12-29 20:35:53	1.04 (n/a)	1.03 (n/a)	1.03 (n/a)	1.02 (n/a)	0.01 (n/a)	24592.30 (n/a)	24473.70 (n/a)	24540.90 (n/a)	24160.80 (n/a)	176.68 (n/a)	711.06 (n/a)	702.00 (n/a)	700.05 (n/a)	698.59 (n/a)	5.12 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.99 (+1.69%)	0.97 (+0.29%)	0.97 (-0.04%)	0.97 (-0.15%)	0.01 (+434.92%)	26025.30 (+0.15%)	25839.34 (-0.29%)	25916.70 (+0.04%)	25446.00 (-1.67%)	202.05 (+425.44%)
`0a6c11c` — 2025-12-04 00:39:10	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.00 (n/a)	25986.90 (n/a)	25913.52 (n/a)	25905.70 (n/a)	25877.00 (n/a)	38.45 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	0.97 (-0.01%)	0.97 (+0.03%)	0.97 (+0.04%)	0.97 (+0.00%)	0.00 (-6.43%)	25927.90 (-0.00%)	25903.20 (-0.03%)	25898.60 (-0.04%)	25892.80 (+0.01%)	14.05 (-6.56%)	663.50 (-0.01%)	663.23 (+0.03%)	663.35 (+0.04%)	662.60 (+0.00%)	0.36 (-6.43%)
`50ad37c` — 2025-12-29 20:35:53	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.97 (n/a)	0.00 (n/a)	25928.10 (n/a)	25910.14 (n/a)	25908.10 (n/a)	25891.20 (n/a)	15.04 (n/a)	663.54 (n/a)	663.06 (n/a)	663.11 (n/a)	662.60 (n/a)	0.38 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.92 (-1.02%)	0.92 (-0.66%)	0.92 (-0.10%)	0.91 (-0.78%)	0.01 (-4.54%)	27751.40 (+0.79%)	27480.74 (+0.66%)	27354.80 (+0.10%)	27320.50 (+1.03%)	182.69 (-2.84%)
`0a6c11c` — 2025-12-04 00:39:10	0.93 (n/a)	0.92 (n/a)	0.92 (n/a)	0.91 (n/a)	0.01 (n/a)	27534.80 (n/a)	27299.32 (n/a)	27326.70 (n/a)	27042.30 (n/a)	188.04 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`a4b6ffe` — 2026-01-05 19:24:05	0.92 (+0.11%)	0.91 (-0.12%)	0.91 (-0.21%)	0.91 (-0.24%)	0.00 (+30.34%)	27723.50 (+0.24%)	27548.94 (+0.12%)	27522.90 (+0.21%)	27403.60 (-0.11%)	124.26 (+30.58%)	626.92 (+0.11%)	623.62 (-0.12%)	624.20 (-0.21%)	619.69 (-0.24%)	2.81 (+30.34%)
`50ad37c` — 2025-12-29 20:35:53	0.92 (n/a)	0.91 (n/a)	0.92 (n/a)	0.91 (n/a)	0.00 (n/a)	27657.10 (n/a)	27515.58 (n/a)	27464.70 (n/a)	27434.60 (n/a)	95.16 (n/a)	626.21 (n/a)	624.37 (n/a)	625.52 (n/a)	621.17 (n/a)	2.16 (n/a)

gemm_2048x2048x2048_64x64x64_2cols_bcolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.92 (+0.79%)	0.91 (+1.21%)	0.91 (+0.28%)	0.91 (+2.41%)	0.01 (-33.46%)	27777.70 (-2.35%)	27562.26 (-1.21%)	27697.40 (-0.28%)	27303.30 (-0.79%)	231.34 (-35.68%)	629.22 (+0.79%)	623.35 (+1.21%)	620.27 (+0.28%)	618.48 (+2.41%)	5.25 (-33.46%)
`897d04e` — 2026-03-06 22:12:25	0.91 (n/a)	0.90 (n/a)	0.91 (n/a)	0.88 (n/a)	0.01 (n/a)	28447.10 (n/a)	27899.18 (n/a)	27774.40 (n/a)	27519.50 (n/a)	359.64 (n/a)	624.28 (n/a)	615.87 (n/a)	618.55 (n/a)	603.92 (n/a)	7.88 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`31ab24e` — 2025-11-22 02:01:56	3.65 (-1.06%)	3.59 (+0.83%)	3.63 (-0.26%)	3.45 (+2.66%)	0.07 (-44.71%)	2678.08 (-1.06%)	2632.13 (+0.83%)	2658.60 (-0.26%)	2528.31 (+2.66%)	53.86 (-44.71%)	6795.00 (-2.59%)	6529.80 (-0.92%)	6462.00 (+0.26%)	6415.00 (+1.07%)	137.14 (-45.27%)
`d9a64c5` — 2025-11-21 20:49:35	3.69 (n/a)	3.56 (n/a)	3.64 (n/a)	3.36 (n/a)	0.13 (n/a)	2706.77 (n/a)	2610.50 (n/a)	2665.61 (n/a)	2462.71 (n/a)	97.41 (n/a)	6976.00 (n/a)	6590.40 (n/a)	6445.00 (n/a)	6347.00 (n/a)	250.58 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.98 (+0.20%)	3.84 (-2.95%)	3.76 (-5.27%)	3.72 (-4.97%)	0.13 (+473.97%)	6760.00 (+5.23%)	6559.50 (+3.13%)	6697.10 (+5.56%)	6321.00 (-0.20%)	218.68 (+499.40%)	2717.91 (+0.20%)	2621.44 (-2.95%)	2565.27 (-5.27%)	2541.40 (-4.97%)	88.37 (+473.97%)
`331dcca` — 2026-01-08 18:34:10	3.97 (n/a)	3.96 (n/a)	3.97 (n/a)	3.92 (n/a)	0.02 (n/a)	6423.80 (n/a)	6360.32 (n/a)	6344.30 (n/a)	6333.90 (n/a)	36.48 (n/a)	2712.39 (n/a)	2701.17 (n/a)	2707.91 (n/a)	2674.40 (n/a)	15.40 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.75 (+0.28%)	3.70 (+1.25%)	3.71 (-0.21%)	3.65 (+4.77%)	0.04 (-66.90%)	6901.80 (-4.56%)	6795.46 (-1.30%)	6790.20 (+0.21%)	6715.90 (-0.28%)	67.05 (-68.40%)	2558.08 (+0.28%)	2528.33 (+1.25%)	2530.10 (-0.21%)	2489.18 (+4.77%)	24.81 (-66.90%)
`331dcca` — 2026-01-08 18:34:10	3.74 (n/a)	3.66 (n/a)	3.71 (n/a)	3.48 (n/a)	0.11 (n/a)	7231.20 (n/a)	6885.18 (n/a)	6775.70 (n/a)	6734.90 (n/a)	212.21 (n/a)	2550.87 (n/a)	2497.04 (n/a)	2535.50 (n/a)	2375.78 (n/a)	74.96 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`d48746f` — 2026-01-12 22:17:10	3.62 (-0.77%)	3.54 (+0.14%)	3.60 (-0.04%)	3.44 (+2.17%)	0.09 (-25.77%)	7307.40 (-2.13%)	7103.46 (-0.18%)	6982.50 (+0.04%)	6948.20 (+0.77%)	182.95 (-26.55%)	2472.55 (-0.77%)	2419.80 (+0.14%)	2460.41 (-0.04%)	2351.04 (+2.17%)	61.76 (-25.77%)
`331dcca` — 2026-01-08 18:34:10	3.65 (n/a)	3.54 (n/a)	3.61 (n/a)	3.37 (n/a)	0.12 (n/a)	7466.20 (n/a)	7116.40 (n/a)	6979.60 (n/a)	6895.10 (n/a)	249.09 (n/a)	2491.61 (n/a)	2416.45 (n/a)	2461.45 (n/a)	2301.00 (n/a)	83.20 (n/a)

gemm_2048x2048x2048_64x64x64_8cols_bcolmaj_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	3.50 (-0.24%)	3.30 (-5.41%)	3.48 (-0.09%)	2.63 (-24.52%)	0.38 (+2961.09%)	9585.60 (+32.48%)	7723.50 (+7.05%)	7233.60 (+0.09%)	7189.00 (+0.24%)	1044.25 (+3992.91%)	2389.76 (-0.24%)	2252.33 (-5.41%)	2375.02 (-0.09%)	1792.26 (-24.52%)	258.57 (+2961.04%)
`897d04e` — 2026-03-06 22:12:25	3.51 (n/a)	3.49 (n/a)	3.48 (n/a)	3.48 (n/a)	0.01 (n/a)	7235.40 (n/a)	7215.10 (n/a)	7227.20 (n/a)	7171.80 (n/a)	25.51 (n/a)	2395.46 (n/a)	2381.12 (n/a)	2377.13 (n/a)	2374.41 (n/a)	8.45 (n/a)

gemm_384x1536x1792_32x48x64_4cols_bcolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	4.44 (+2.23%)	4.27 (+2.56%)	4.33 (+0.34%)	3.92 (+10.98%)	0.20 (-42.62%)	2058.00 (-9.89%)	1890.22 (-2.96%)	1860.20 (-0.34%)	1815.70 (-2.18%)	95.79 (-49.06%)	1164.26 (+2.23%)	1120.53 (+2.56%)	1136.43 (+0.34%)	1027.17 (+10.98%)	53.59 (-42.62%)
`897d04e` — 2026-03-06 22:12:25	4.34 (n/a)	4.17 (n/a)	4.32 (n/a)	3.53 (n/a)	0.36 (n/a)	2284.00 (n/a)	1947.78 (n/a)	1866.50 (n/a)	1856.20 (n/a)	188.02 (n/a)	1138.86 (n/a)	1092.52 (n/a)	1132.55 (n/a)	925.53 (n/a)	93.39 (n/a)

gemm_896x1792x640_32x64x80_8cols_ccolmaj

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	7.11 (+5.70%)	6.32 (+0.19%)	6.94 (+4.94%)	3.79 (-27.01%)	1.42 (+119.96%)	1754.80 (+37.01%)	1116.72 (+4.90%)	958.40 (-4.71%)	936.10 (-5.39%)	357.30 (+188.51%)	2195.55 (+5.70%)	1952.74 (+0.19%)	2144.32 (+4.94%)	1171.19 (-27.01%)	439.30 (+119.96%)
`897d04e` — 2026-03-06 22:12:25	6.72 (n/a)	6.31 (n/a)	6.61 (n/a)	5.19 (n/a)	0.65 (n/a)	1280.80 (n/a)	1064.58 (n/a)	1005.80 (n/a)	989.40 (n/a)	123.84 (n/a)	2077.17 (n/a)	1949.09 (n/a)	2043.44 (n/a)	1604.60 (n/a)	199.72 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+1.39%)	0.09 (+8.91%)	0.10 (+17.75%)	0.06 (+3.76%)	0.02 (-7.94%)	144.20 (-3.67%)	95.70 (-9.13%)	80.40 (-15.10%)	77.30 (-1.40%)	28.21 (-9.32%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	149.70 (n/a)	105.32 (n/a)	94.70 (n/a)	78.40 (n/a)	31.11 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (-3.48%)	0.09 (-3.98%)	0.10 (-0.82%)	0.06 (-6.10%)	0.02 (+5.91%)	148.80 (+6.51%)	100.08 (+5.41%)	78.40 (+0.77%)	77.60 (+3.60%)	32.31 (+14.47%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.06 (n/a)	0.02 (n/a)	139.70 (n/a)	94.94 (n/a)	77.80 (n/a)	74.90 (n/a)	28.23 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+0.62%)	0.09 (+3.16%)	0.10 (+6.11%)	0.05 (-16.94%)	0.02 (+34.65%)	164.00 (+20.41%)	96.62 (+1.34%)	80.50 (-5.74%)	77.40 (-0.51%)	37.73 (+59.64%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	136.20 (n/a)	95.34 (n/a)	85.40 (n/a)	77.80 (n/a)	23.63 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (-2.57%)	0.09 (+10.86%)	0.10 (+14.32%)	0.05 (+40.10%)	0.02 (-18.48%)	153.50 (-28.60%)	95.52 (-15.84%)	82.70 (-12.49%)	78.00 (+2.63%)	32.53 (-43.28%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.09 (n/a)	0.04 (n/a)	0.03 (n/a)	215.00 (n/a)	113.50 (n/a)	94.50 (n/a)	76.00 (n/a)	57.35 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (+15.32%)	0.09 (+3.85%)	0.09 (-2.10%)	0.05 (+17.84%)	0.03 (+3.79%)	160.90 (-15.09%)	100.48 (-5.92%)	92.60 (+2.09%)	67.60 (-13.33%)	35.41 (-23.89%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	189.50 (n/a)	106.80 (n/a)	90.70 (n/a)	78.00 (n/a)	46.53 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (+4.92%)	0.09 (+10.34%)	0.10 (+11.76%)	0.07 (+42.62%)	0.02 (-21.83%)	125.80 (-29.88%)	95.04 (-13.33%)	83.90 (-10.55%)	81.40 (-4.68%)	19.16 (-51.19%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	179.40 (n/a)	109.66 (n/a)	93.80 (n/a)	85.40 (n/a)	39.25 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (+0.63%)	0.08 (+9.28%)	0.09 (+17.26%)	0.04 (-27.97%)	0.03 (+53.61%)	218.40 (+38.84%)	113.50 (+0.42%)	86.50 (-14.69%)	84.30 (-0.71%)	58.77 (+111.16%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	157.30 (n/a)	113.02 (n/a)	101.40 (n/a)	84.90 (n/a)	27.83 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-1.87%)	0.08 (+5.48%)	0.08 (-0.01%)	0.05 (+24.33%)	0.01 (-23.69%)	159.30 (-19.55%)	110.94 (-8.74%)	98.80 (+0.00%)	98.50 (+1.97%)	27.04 (-37.85%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	198.00 (n/a)	121.56 (n/a)	98.80 (n/a)	96.60 (n/a)	43.50 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.37 (+17.13%)	0.30 (+24.87%)	0.30 (+38.03%)	0.23 (+12.47%)	0.06 (+35.23%)
`0a6c11c` — 2025-12-04 00:39:10	0.32 (n/a)	0.24 (n/a)	0.22 (n/a)	0.20 (n/a)	0.04 (n/a)

matrix_vector_mul_128x128_32_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	0.26 (-1.81%)	0.24 (+4.06%)	0.24 (+0.52%)	0.21 (+16.97%)	0.02 (-48.16%)	0.26 (-1.81%)	0.24 (+4.06%)	0.24 (+0.52%)	0.20 (+16.97%)	0.02 (-48.16%)
`a4b6ffe` — 2026-01-05 19:24:05	0.26 (n/a)	0.23 (n/a)	0.24 (n/a)	0.18 (n/a)	0.04 (n/a)	0.26 (n/a)	0.23 (n/a)	0.24 (n/a)	0.17 (n/a)	0.04 (n/a)

matrix_vector_mul_128x128_32tsi_128tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.35 (-6.74%)	0.31 (-1.41%)	0.34 (-0.74%)	0.20 (-6.16%)	0.06 (-0.61%)	0.34 (-6.74%)	0.30 (-1.41%)	0.33 (-0.74%)	0.20 (-6.16%)	0.06 (-0.61%)
`897d04e` — 2026-03-06 22:12:25	0.37 (n/a)	0.31 (n/a)	0.34 (n/a)	0.22 (n/a)	0.06 (n/a)	0.36 (n/a)	0.31 (n/a)	0.34 (n/a)	0.21 (n/a)	0.06 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	13.57 (+3.47%)	13.15 (+1.09%)	13.10 (+0.16%)	12.52 (-1.58%)	0.37 (+153.19%)
`0a6c11c` — 2025-12-04 00:39:10	13.11 (n/a)	13.01 (n/a)	13.07 (n/a)	12.72 (n/a)	0.15 (n/a)

matrix_vector_mul_2048x8192_1_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	13.43 (-0.07%)	13.30 (+4.62%)	13.27 (+1.29%)	13.16 (+16.70%)	0.12 (-86.69%)	13.42 (-0.07%)	13.29 (+4.62%)	13.26 (+1.29%)	13.16 (+16.70%)	0.12 (-86.69%)
`a4b6ffe` — 2026-01-05 19:24:05	13.44 (n/a)	12.71 (n/a)	13.10 (n/a)	11.28 (n/a)	0.87 (n/a)	13.43 (n/a)	12.70 (n/a)	13.09 (n/a)	11.27 (n/a)	0.87 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	25.06 (+2.47%)	23.71 (+1.81%)	24.13 (+0.50%)	20.90 (+5.41%)	1.48 (-15.60%)
`0a6c11c` — 2025-12-04 00:39:10	24.46 (n/a)	23.29 (n/a)	24.01 (n/a)	19.83 (n/a)	1.75 (n/a)

matrix_vector_mul_2048x8192_1_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	24.46 (-0.60%)	21.07 (-8.03%)	19.75 (-17.83%)	18.08 (+1.18%)	3.03 (+7.07%)	24.44 (-0.60%)	21.06 (-8.03%)	19.74 (-17.83%)	18.07 (+1.18%)	3.03 (+7.07%)
`a4b6ffe` — 2026-01-05 19:24:05	24.60 (n/a)	22.91 (n/a)	24.04 (n/a)	17.87 (n/a)	2.83 (n/a)	24.59 (n/a)	22.90 (n/a)	24.02 (n/a)	17.86 (n/a)	2.83 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	42.05 (+1.54%)	40.50 (+12.60%)	40.49 (+2.36%)	38.98 (+97.53%)	0.97 (-88.09%)
`0a6c11c` — 2025-12-04 00:39:10	41.41 (n/a)	35.97 (n/a)	39.55 (n/a)	19.73 (n/a)	8.15 (n/a)

matrix_vector_mul_2048x8192_1_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	42.58 (+1.51%)	41.37 (+14.29%)	41.25 (+4.89%)	40.33 (+91.42%)	0.92 (-89.18%)	42.56 (+1.51%)	41.34 (+14.29%)	41.23 (+4.89%)	40.30 (+91.42%)	0.92 (-89.18%)
`a4b6ffe` — 2026-01-05 19:24:05	41.95 (n/a)	36.20 (n/a)	39.33 (n/a)	21.07 (n/a)	8.54 (n/a)	41.92 (n/a)	36.17 (n/a)	39.31 (n/a)	21.05 (n/a)	8.53 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	46.62 (+3.11%)	44.82 (+0.17%)	44.78 (+0.17%)	42.60 (-3.80%)	1.60 (+367.72%)
`0a6c11c` — 2025-12-04 00:39:10	45.21 (n/a)	44.75 (n/a)	44.70 (n/a)	44.29 (n/a)	0.34 (n/a)

matrix_vector_mul_2048x8192_1_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	46.04 (+4.14%)	45.06 (+3.47%)	44.55 (+2.76%)	44.30 (+2.84%)	0.87 (+66.58%)	46.01 (+4.14%)	45.03 (+3.47%)	44.52 (+2.76%)	44.27 (+2.84%)	0.87 (+66.58%)
`a4b6ffe` — 2026-01-05 19:24:05	44.21 (n/a)	43.55 (n/a)	43.35 (n/a)	43.07 (n/a)	0.52 (n/a)	44.18 (n/a)	43.52 (n/a)	43.32 (n/a)	43.05 (n/a)	0.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_1024tso_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	25.11 (+2.59%)	24.42 (+1.09%)	24.34 (+0.56%)	24.02 (+0.75%)	0.42 (+68.97%)	25.09 (+2.59%)	24.41 (+1.09%)	24.32 (+0.56%)	24.01 (+0.75%)	0.42 (+68.97%)
`897d04e` — 2026-03-06 22:12:25	24.47 (n/a)	24.16 (n/a)	24.20 (n/a)	23.84 (n/a)	0.25 (n/a)	24.46 (n/a)	24.15 (n/a)	24.18 (n/a)	23.83 (n/a)	0.25 (n/a)

matrix_vector_mul_2048x8192_1tsi_2048tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	13.64 (+2.99%)	13.35 (+2.57%)	13.37 (+2.05%)	13.01 (+3.61%)	0.22 (-16.23%)	13.63 (+2.99%)	13.35 (+2.57%)	13.36 (+2.05%)	13.00 (+3.61%)	0.22 (-16.23%)
`897d04e` — 2026-03-06 22:12:25	13.25 (n/a)	13.02 (n/a)	13.10 (n/a)	12.56 (n/a)	0.27 (n/a)	13.24 (n/a)	13.01 (n/a)	13.09 (n/a)	12.55 (n/a)	0.27 (n/a)

matrix_vector_mul_2048x8192_1tsi_256tso_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	45.15 (-5.37%)	44.63 (-1.66%)	44.94 (-0.61%)	43.73 (+0.59%)	0.58 (-61.95%)	45.12 (-5.37%)	44.60 (-1.66%)	44.91 (-0.61%)	43.70 (+0.59%)	0.58 (-61.95%)
`897d04e` — 2026-03-06 22:12:25	47.71 (n/a)	45.38 (n/a)	45.22 (n/a)	43.47 (n/a)	1.52 (n/a)	47.68 (n/a)	45.35 (n/a)	45.19 (n/a)	43.45 (n/a)	1.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_512tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	42.56 (+4.21%)	40.57 (+2.64%)	40.49 (+2.77%)	39.17 (+0.78%)	1.25 (+62.42%)	42.53 (+4.21%)	40.55 (+2.64%)	40.46 (+2.77%)	39.15 (+0.78%)	1.25 (+62.42%)
`897d04e` — 2026-03-06 22:12:25	40.84 (n/a)	39.53 (n/a)	39.40 (n/a)	38.87 (n/a)	0.77 (n/a)	40.81 (n/a)	39.50 (n/a)	39.37 (n/a)	38.84 (n/a)	0.77 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	13.29 (+1.63%)	13.19 (+6.08%)	13.19 (+1.17%)	13.09 (+26.86%)	0.08 (-92.94%)
`0a6c11c` — 2025-12-04 00:39:10	13.08 (n/a)	12.44 (n/a)	13.03 (n/a)	10.32 (n/a)	1.07 (n/a)

matrix_vector_mul_8192x2048_4_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	13.68 (+3.42%)	13.30 (+8.54%)	13.38 (+7.25%)	12.72 (+14.96%)	0.35 (-66.09%)	13.67 (+3.42%)	13.29 (+8.54%)	13.38 (+7.25%)	12.71 (+14.96%)	0.35 (-66.09%)
`a4b6ffe` — 2026-01-05 19:24:05	13.23 (n/a)	12.25 (n/a)	12.48 (n/a)	11.07 (n/a)	1.04 (n/a)	13.22 (n/a)	12.24 (n/a)	12.47 (n/a)	11.06 (n/a)	1.04 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	25.58 (+4.24%)	24.23 (+6.59%)	24.03 (+0.29%)	23.58 (+37.29%)	0.70 (-74.97%)
`0a6c11c` — 2025-12-04 00:39:10	24.54 (n/a)	22.73 (n/a)	23.96 (n/a)	17.18 (n/a)	2.79 (n/a)

matrix_vector_mul_8192x2048_4_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	25.08 (+1.32%)	24.68 (+13.42%)	24.61 (+3.26%)	24.47 (+48.32%)	0.24 (-93.56%)	25.07 (+1.32%)	24.67 (+13.42%)	24.59 (+3.26%)	24.46 (+48.32%)	0.24 (-93.56%)
`a4b6ffe` — 2026-01-05 19:24:05	24.76 (n/a)	21.76 (n/a)	23.83 (n/a)	16.50 (n/a)	3.74 (n/a)	24.74 (n/a)	21.75 (n/a)	23.82 (n/a)	16.49 (n/a)	3.73 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	40.94 (-2.19%)	39.74 (-1.10%)	39.76 (-0.60%)	38.17 (-2.14%)	1.04 (+4.39%)
`0a6c11c` — 2025-12-04 00:39:10	41.86 (n/a)	40.18 (n/a)	40.00 (n/a)	39.00 (n/a)	1.00 (n/a)

matrix_vector_mul_8192x2048_4_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	40.74 (-1.09%)	37.16 (-7.15%)	40.25 (+1.47%)	24.51 (-37.44%)	7.07 (+736.13%)	40.72 (-1.09%)	37.13 (-7.15%)	40.23 (+1.47%)	24.50 (-37.44%)	7.07 (+736.13%)
`a4b6ffe` — 2026-01-05 19:24:05	41.19 (n/a)	40.02 (n/a)	39.67 (n/a)	39.18 (n/a)	0.85 (n/a)	41.17 (n/a)	39.99 (n/a)	39.64 (n/a)	39.16 (n/a)	0.85 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)
`130b6ea` — 2025-12-05 21:15:49	46.71 (-1.04%)	44.91 (-2.34%)	44.71 (-2.98%)	43.80 (-1.44%)	0.96 (+6.93%)
`0a6c11c` — 2025-12-04 00:39:10	47.20 (n/a)	45.98 (n/a)	46.08 (n/a)	44.44 (n/a)	0.90 (n/a)

matrix_vector_mul_8192x2048_4_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`331dcca` — 2026-01-08 18:34:10	46.28 (+5.68%)	44.89 (+14.59%)	44.74 (+4.26%)	44.20 (+62.80%)	0.84 (-87.96%)	46.25 (+5.68%)	44.86 (+14.59%)	44.71 (+4.26%)	44.17 (+62.80%)	0.84 (-87.96%)
`a4b6ffe` — 2026-01-05 19:24:05	43.79 (n/a)	39.17 (n/a)	42.91 (n/a)	27.15 (n/a)	6.98 (n/a)	43.77 (n/a)	39.15 (n/a)	42.88 (n/a)	27.13 (n/a)	6.98 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_1col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	13.33 (-0.06%)	13.25 (+0.35%)	13.26 (+0.57%)	13.13 (+0.03%)	0.09 (+2.07%)	13.32 (-0.06%)	13.24 (+0.35%)	13.25 (+0.57%)	13.12 (+0.03%)	0.09 (+2.07%)
`897d04e` — 2026-03-06 22:12:25	13.34 (n/a)	13.20 (n/a)	13.18 (n/a)	13.12 (n/a)	0.08 (n/a)	13.33 (n/a)	13.19 (n/a)	13.17 (n/a)	13.11 (n/a)	0.08 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_2col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	25.49 (+5.78%)	24.95 (+8.17%)	24.84 (+3.47%)	24.38 (+26.60%)	0.47 (-78.15%)	25.47 (+5.78%)	24.93 (+8.17%)	24.83 (+3.47%)	24.37 (+26.60%)	0.47 (-78.15%)
`897d04e` — 2026-03-06 22:12:25	24.10 (n/a)	23.07 (n/a)	24.01 (n/a)	19.26 (n/a)	2.13 (n/a)	24.08 (n/a)	23.05 (n/a)	23.99 (n/a)	19.25 (n/a)	2.13 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_4col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	41.62 (+2.01%)	39.71 (+0.34%)	39.74 (-0.04%)	38.11 (-0.45%)	1.47 (+34.38%)	41.60 (+2.01%)	39.69 (+0.34%)	39.72 (-0.04%)	38.08 (-0.45%)	1.47 (+34.38%)
`897d04e` — 2026-03-06 22:12:25	40.80 (n/a)	39.58 (n/a)	39.75 (n/a)	38.28 (n/a)	1.10 (n/a)	40.78 (n/a)	39.55 (n/a)	39.73 (n/a)	38.26 (n/a)	1.10 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_8col0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`50e35ad` — 2026-03-07 19:11:58	49.16 (-0.30%)	46.95 (+1.79%)	46.44 (+2.50%)	45.17 (+1.24%)	1.74 (-5.99%)	49.13 (-0.30%)	46.92 (+1.79%)	46.41 (+2.50%)	45.15 (+1.24%)	1.74 (-5.99%)
`897d04e` — 2026-03-06 22:12:25	49.31 (n/a)	46.12 (n/a)	45.30 (n/a)	44.62 (n/a)	1.85 (n/a)	49.28 (n/a)	46.10 (n/a)	45.28 (n/a)	44.59 (n/a)	1.85 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.07 (+22.03%)	0.06 (+27.86%)	0.06 (+35.49%)	0.05 (+15.00%)	0.01 (+49.69%)	173.30 (-13.00%)	137.94 (-21.32%)	133.60 (-26.19%)	123.40 (-18.06%)	18.40 (+8.53%)
`0a6c11c` — 2025-12-04 00:39:10	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	199.20 (n/a)	175.32 (n/a)	181.00 (n/a)	150.60 (n/a)	16.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (+1.14%)	0.07 (+22.65%)	0.08 (+28.83%)	0.04 (+32.63%)	0.02 (-7.58%)	186.70 (-24.60%)	116.84 (-21.26%)	99.60 (-22.37%)	98.90 (-1.20%)	39.05 (-33.46%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.03 (n/a)	0.02 (n/a)	247.60 (n/a)	148.38 (n/a)	128.30 (n/a)	100.10 (n/a)	58.70 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-16.99%)	0.05 (-12.47%)	0.05 (-7.32%)	0.04 (-11.17%)	0.00 (-29.61%)	197.00 (+12.57%)	171.00 (+13.70%)	164.00 (+7.89%)	153.00 (+20.47%)	17.49 (-4.32%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	175.00 (n/a)	150.40 (n/a)	152.00 (n/a)	127.00 (n/a)	18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+5.56%)	0.05 (-1.59%)	0.05 (-1.39%)	0.03 (-14.07%)	0.01 (+25.03%)	263.00 (+16.37%)	166.00 (+4.53%)	144.00 (+1.41%)	126.00 (-5.26%)	49.38 (+43.17%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	226.00 (n/a)	158.80 (n/a)	142.00 (n/a)	133.00 (n/a)	34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.08 (+10.93%)	0.07 (+7.79%)	0.07 (+3.55%)	0.05 (-1.73%)	0.01 (+36.73%)	150.20 (+1.76%)	121.68 (-6.36%)	125.60 (-3.38%)	97.90 (-9.85%)	18.56 (+21.98%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.01 (n/a)	147.60 (n/a)	129.94 (n/a)	130.00 (n/a)	108.60 (n/a)	15.21 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-14.91%)	0.08 (+7.47%)	0.09 (+10.19%)	0.07 (+29.85%)	0.01 (-57.20%)	114.40 (-22.96%)	99.52 (-11.94%)	94.00 (-9.27%)	87.10 (+17.54%)	11.95 (-62.30%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.02 (n/a)	148.50 (n/a)	113.02 (n/a)	103.60 (n/a)	74.10 (n/a)	31.69 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-15.32%)	0.05 (-17.09%)	0.05 (-23.81%)	0.04 (-15.54%)	0.01 (-18.18%)	193.00 (+18.40%)	160.80 (+20.36%)	168.00 (+31.25%)	124.00 (+18.10%)	22.92 (+11.39%)
`0999a9a` — 2025-11-13 19:24:08	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	163.00 (n/a)	133.60 (n/a)	128.00 (n/a)	105.00 (n/a)	20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-23.02%)	0.05 (-6.98%)	0.05 (-2.13%)	0.04 (-15.31%)	0.01 (-33.29%)	196.00 (+18.07%)	147.00 (+6.52%)	141.00 (+2.17%)	126.00 (+29.90%)	25.27 (+8.13%)
`0999a9a` — 2025-11-13 19:24:08	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	166.00 (n/a)	138.00 (n/a)	138.00 (n/a)	97.00 (n/a)	23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (+31.37%)	0.08 (+29.12%)	0.08 (+29.06%)	0.07 (+41.80%)	0.01 (+0.23%)	109.90 (-29.46%)	98.30 (-23.38%)	100.80 (-22.52%)	79.40 (-23.87%)	10.54 (-46.17%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	155.80 (n/a)	128.30 (n/a)	130.10 (n/a)	104.30 (n/a)	19.58 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+0.83%)	0.10 (+3.28%)	0.11 (+1.93%)	0.05 (-0.52%)	0.03 (+5.13%)	162.80 (+0.56%)	92.14 (-2.33%)	74.90 (-1.83%)	73.40 (-0.81%)	39.51 (+3.95%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.03 (n/a)	161.90 (n/a)	94.34 (n/a)	76.30 (n/a)	74.00 (n/a)	38.01 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.10 (+25.02%)	0.07 (+10.01%)	0.07 (+7.53%)	0.05 (-1.99%)	0.01 (+77.08%)	150.10 (+2.04%)	114.60 (-7.22%)	111.70 (-6.99%)	83.90 (-20.02%)	21.23 (+43.54%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	147.10 (n/a)	123.52 (n/a)	120.10 (n/a)	104.90 (n/a)	14.79 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-6.47%)	0.08 (-1.38%)	0.09 (-3.96%)	0.06 (+40.25%)	0.01 (-38.49%)	143.80 (-28.67%)	105.32 (-6.03%)	94.50 (+4.07%)	90.40 (+6.86%)	22.52 (-55.09%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	201.60 (n/a)	112.08 (n/a)	90.80 (n/a)	84.60 (n/a)	50.14 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.07 (+11.97%)	0.05 (+3.09%)	0.05 (+2.10%)	0.03 (-11.35%)	0.01 (+41.65%)	229.00 (+12.81%)	156.00 (-0.51%)	143.00 (-2.05%)	117.00 (-10.69%)	38.21 (+48.71%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	203.00 (n/a)	156.80 (n/a)	146.00 (n/a)	131.00 (n/a)	25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+9.02%)	0.05 (+5.59%)	0.05 (+0.00%)	0.04 (+3.63%)	0.01 (+25.48%)	193.00 (-3.50%)	147.40 (-4.66%)	147.00 (+0.00%)	122.00 (-8.27%)	25.24 (+7.48%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	154.60 (n/a)	147.00 (n/a)	133.00 (n/a)	23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (-3.98%)	0.07 (+4.00%)	0.07 (+7.04%)	0.06 (+3.67%)	0.01 (-15.76%)	129.70 (-3.57%)	113.30 (-4.50%)	116.90 (-6.55%)	90.40 (+4.15%)	15.04 (-13.80%)
`0a6c11c` — 2025-12-04 00:39:10	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	134.50 (n/a)	118.64 (n/a)	125.10 (n/a)	86.80 (n/a)	17.45 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-3.07%)	0.07 (-4.78%)	0.08 (-0.93%)	0.05 (-14.44%)	0.02 (+22.28%)	170.90 (+16.81%)	115.64 (+7.05%)	100.20 (+0.91%)	98.10 (+3.15%)	31.25 (+45.39%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	146.30 (n/a)	108.02 (n/a)	99.30 (n/a)	95.10 (n/a)	21.49 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.08 (+9.57%)	0.07 (+16.85%)	0.07 (+19.58%)	0.06 (+24.52%)	0.01 (+1.05%)	134.50 (-19.70%)	116.64 (-14.92%)	116.80 (-16.39%)	98.00 (-8.75%)	15.71 (-25.13%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	167.50 (n/a)	137.10 (n/a)	139.70 (n/a)	107.40 (n/a)	20.99 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+0.74%)	0.10 (+0.96%)	0.10 (+0.43%)	0.06 (-0.31%)	0.02 (+2.28%)	143.30 (+0.35%)	91.32 (-0.67%)	78.70 (-0.38%)	77.10 (-0.77%)	29.07 (+1.99%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	142.80 (n/a)	91.94 (n/a)	79.00 (n/a)	77.70 (n/a)	28.50 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-13.48%)	0.05 (-17.79%)	0.05 (-15.33%)	0.03 (-25.09%)	0.01 (+6.67%)	267.00 (+33.50%)	176.80 (+24.51%)	150.00 (+18.11%)	141.00 (+15.57%)	47.41 (+61.41%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	142.00 (n/a)	127.00 (n/a)	122.00 (n/a)	29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (+13.38%)	0.05 (+23.85%)	0.05 (+37.91%)	0.05 (+30.72%)	0.00 (-56.85%)	166.00 (-23.50%)	153.40 (-20.60%)	153.00 (-27.49%)	142.00 (-11.80%)	7.63 (-70.60%)
`0999a9a` — 2025-11-13 19:24:08	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.01 (n/a)	217.00 (n/a)	193.20 (n/a)	211.00 (n/a)	161.00 (n/a)	25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (+16.31%)	0.08 (+15.34%)	0.08 (+14.60%)	0.07 (+19.30%)	0.01 (-5.41%)	117.30 (-16.15%)	107.80 (-13.61%)	108.50 (-12.78%)	94.10 (-13.99%)	8.29 (-32.01%)
`0a6c11c` — 2025-12-04 00:39:10	0.07 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	139.90 (n/a)	124.78 (n/a)	124.40 (n/a)	109.40 (n/a)	12.20 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-2.51%)	0.07 (-8.26%)	0.07 (-5.91%)	0.04 (-25.87%)	0.01 (+65.15%)	184.50 (+34.97%)	124.62 (+12.64%)	111.30 (+6.30%)	105.60 (+2.52%)	33.75 (+131.31%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	136.70 (n/a)	110.64 (n/a)	104.70 (n/a)	103.00 (n/a)	14.59 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.09 (+12.61%)	0.07 (-2.24%)	0.07 (-8.85%)	0.06 (+5.13%)	0.01 (+35.50%)	136.50 (-4.88%)	120.86 (+2.96%)	125.10 (+9.64%)	91.60 (-11.15%)	15.72 (+10.46%)
`0a6c11c` — 2025-12-04 00:39:10	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	143.50 (n/a)	117.38 (n/a)	114.10 (n/a)	103.10 (n/a)	14.23 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-0.63%)	0.07 (+6.36%)	0.08 (-0.28%)	0.04 (-4.82%)	0.02 (-3.57%)	194.70 (+5.07%)	120.40 (-5.73%)	102.30 (+0.29%)	101.00 (+0.60%)	41.54 (+7.44%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	185.30 (n/a)	127.72 (n/a)	102.00 (n/a)	100.40 (n/a)	38.66 (n/a)

mha

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.18 (+0.16%)	0.18 (+0.19%)	0.18 (+0.12%)	0.18 (+0.32%)	0.00 (-52.24%)	47253.90 (-0.32%)	47213.70 (-0.19%)	47210.90 (-0.12%)	47167.70 (-0.16%)	28.71 (-52.47%)
`0a6c11c` — 2025-12-04 00:39:10	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47405.00 (n/a)	47301.72 (n/a)	47265.90 (n/a)	47241.80 (n/a)	60.40 (n/a)

mha0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`84d3478` — 2026-02-17 23:25:13	0.18 (-0.51%)	0.18 (-0.36%)	0.18 (-0.41%)	0.18 (-0.21%)	0.00 (-35.21%)	47468.60 (+0.21%)	47403.94 (+0.36%)	47426.00 (+0.41%)	47314.40 (+0.51%)	68.83 (-34.73%)
`1531781` — 2026-01-23 18:49:24	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47367.50 (n/a)	47232.68 (n/a)	47232.00 (n/a)	47073.00 (n/a)	105.45 (n/a)

mha_16384_64_1_8_0_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.18 (+0.71%)	0.18 (+0.29%)	0.18 (+0.10%)	0.18 (+0.37%)	0.00 (+59.07%)	47358.00 (-0.37%)	47241.80 (-0.29%)	47290.60 (-0.10%)	46937.00 (-0.70%)	173.95 (+57.29%)
`897d04e` — 2026-03-06 22:12:25	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.18 (n/a)	0.00 (n/a)	47533.70 (n/a)	47380.56 (n/a)	47337.90 (n/a)	47268.00 (n/a)	110.60 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+24.27%)	0.09 (+14.11%)	0.11 (+25.38%)	0.04 (-24.86%)	0.03 (+85.07%)	201.00 (+33.11%)	114.20 (-1.25%)	74.50 (-20.24%)	74.10 (-19.46%)	57.86 (+83.36%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.07 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	151.00 (n/a)	115.64 (n/a)	93.40 (n/a)	92.00 (n/a)	31.56 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (+1.13%)	0.07 (-8.42%)	0.09 (-0.43%)	0.05 (-23.79%)	0.02 (+77.06%)	171.50 (+31.22%)	118.70 (+14.53%)	94.70 (+0.53%)	92.20 (-1.18%)	35.82 (+123.02%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.06 (n/a)	0.01 (n/a)	130.70 (n/a)	103.64 (n/a)	94.20 (n/a)	93.30 (n/a)	16.06 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+0.48%)	0.09 (-5.52%)	0.11 (+2.16%)	0.05 (+8.69%)	0.03 (+8.93%)	158.90 (-7.99%)	103.06 (+5.81%)	76.70 (-2.04%)	75.20 (-0.53%)	38.80 (-8.02%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.03 (n/a)	172.70 (n/a)	97.40 (n/a)	78.30 (n/a)	75.60 (n/a)	42.18 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-1.07%)	0.07 (-1.85%)	0.08 (+0.33%)	0.03 (-19.72%)	0.02 (+21.15%)	252.30 (+24.59%)	132.64 (+7.80%)	103.00 (-0.29%)	102.40 (+1.09%)	66.89 (+50.52%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	202.50 (n/a)	123.04 (n/a)	103.30 (n/a)	101.30 (n/a)	44.44 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-0.63%)	0.08 (-0.97%)	0.08 (-2.78%)	0.05 (-6.60%)	0.01 (+7.24%)	153.00 (+7.07%)	111.00 (+1.61%)	100.10 (+2.88%)	96.80 (+0.62%)	23.86 (+18.50%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	142.90 (n/a)	109.24 (n/a)	97.30 (n/a)	96.20 (n/a)	20.13 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (+22.92%)	0.08 (-1.05%)	0.08 (-1.88%)	0.05 (-15.49%)	0.02 (+69.50%)	173.70 (+18.32%)	114.12 (+5.55%)	100.10 (+1.93%)	78.80 (-18.68%)	36.35 (+67.49%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	146.80 (n/a)	108.12 (n/a)	98.20 (n/a)	96.90 (n/a)	21.70 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (-12.37%)	0.07 (-25.61%)	0.07 (-34.28%)	0.06 (-13.93%)	0.02 (-2.63%)	145.40 (+16.13%)	115.62 (+35.48%)	118.70 (+52.18%)	77.70 (+14.10%)	27.72 (+22.20%)
`897d04e` — 2026-03-06 22:12:25	0.12 (n/a)	0.10 (n/a)	0.10 (n/a)	0.07 (n/a)	0.02 (n/a)	125.20 (n/a)	85.34 (n/a)	78.00 (n/a)	68.10 (n/a)	22.68 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (+4.03%)	0.07 (-11.25%)	0.07 (-16.34%)	0.04 (-29.14%)	0.02 (+57.11%)	197.60 (+41.14%)	125.36 (+18.26%)	116.50 (+19.49%)	93.00 (-3.83%)	41.90 (+120.35%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	140.00 (n/a)	106.00 (n/a)	97.50 (n/a)	96.70 (n/a)	19.02 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-3.74%)	0.08 (-5.50%)	0.08 (-6.16%)	0.06 (+2.58%)	0.01 (-16.80%)	148.30 (-2.56%)	111.22 (+4.67%)	101.90 (+6.59%)	97.00 (+3.97%)	21.52 (-16.29%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.01 (n/a)	152.20 (n/a)	106.26 (n/a)	95.60 (n/a)	93.30 (n/a)	25.71 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (+3.30%)	0.08 (-6.18%)	0.08 (-0.51%)	0.05 (-23.97%)	0.02 (+66.99%)	171.50 (+31.52%)	114.38 (+10.53%)	98.00 (+0.51%)	92.60 (-3.24%)	32.72 (+117.00%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	130.40 (n/a)	103.48 (n/a)	97.50 (n/a)	95.70 (n/a)	15.08 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-4.64%)	0.07 (+1.69%)	0.08 (+1.57%)	0.05 (+19.62%)	0.01 (-24.66%)	159.10 (-16.40%)	113.72 (-4.79%)	102.20 (-1.54%)	99.90 (+4.94%)	25.46 (-36.03%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.07 (n/a)	0.08 (n/a)	0.04 (n/a)	0.02 (n/a)	190.30 (n/a)	119.44 (n/a)	103.80 (n/a)	95.20 (n/a)	39.79 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (-4.17%)	0.09 (-2.48%)	0.10 (+0.24%)	0.03 (-20.60%)	0.03 (+12.91%)	248.00 (+25.95%)	115.46 (+10.07%)	82.90 (-0.24%)	81.20 (+4.37%)	74.10 (+43.91%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	196.90 (n/a)	104.90 (n/a)	83.10 (n/a)	77.80 (n/a)	51.49 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.19 (-21.66%)	0.17 (-8.53%)	0.18 (+2.09%)	0.14 (-6.71%)	0.02 (-38.07%)	174.10 (+7.20%)	150.06 (+8.11%)	139.60 (-2.04%)	129.80 (+27.63%)	20.36 (-10.65%)
`d48746f` — 2026-01-12 22:17:10	0.24 (n/a)	0.18 (n/a)	0.17 (n/a)	0.15 (n/a)	0.04 (n/a)	162.40 (n/a)	138.80 (n/a)	142.50 (n/a)	101.70 (n/a)	22.79 (n/a)

rope_1c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.91 (-14.38%)	0.77 (-13.41%)	0.84 (-8.20%)	0.52 (-27.35%)	0.16 (+9.49%)	190.40 (+37.67%)	133.80 (+17.84%)	117.70 (+8.88%)	108.10 (+16.74%)	33.88 (+76.64%)
`897d04e` — 2026-03-06 22:12:25	1.06 (n/a)	0.89 (n/a)	0.91 (n/a)	0.71 (n/a)	0.15 (n/a)	138.30 (n/a)	113.54 (n/a)	108.10 (n/a)	92.60 (n/a)	19.18 (n/a)

rope_1c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.53 (-13.44%)	0.47 (-7.29%)	0.47 (-2.31%)	0.39 (-12.51%)	0.05 (-20.86%)	189.40 (+14.30%)	159.84 (+7.69%)	155.90 (+2.36%)	138.30 (+15.54%)	18.70 (+9.34%)
`897d04e` — 2026-03-06 22:12:25	0.62 (n/a)	0.50 (n/a)	0.48 (n/a)	0.44 (n/a)	0.07 (n/a)	165.70 (n/a)	148.42 (n/a)	152.30 (n/a)	119.70 (n/a)	17.10 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.21 (-0.56%)	0.17 (-10.62%)	0.16 (-13.58%)	0.13 (-13.33%)	0.03 (+17.05%)	183.70 (+15.39%)	151.76 (+12.77%)	155.20 (+15.73%)	117.30 (+0.60%)	24.24 (+35.73%)
`d48746f` — 2026-01-12 22:17:10	0.21 (n/a)	0.19 (n/a)	0.18 (n/a)	0.15 (n/a)	0.02 (n/a)	159.20 (n/a)	134.58 (n/a)	134.10 (n/a)	116.60 (n/a)	17.86 (n/a)

rope_2c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	1.10 (+1.85%)	0.90 (+0.43%)	0.93 (+0.18%)	0.68 (+18.45%)	0.20 (+1.26%)	145.60 (-15.59%)	114.16 (-1.28%)	105.80 (-0.09%)	89.30 (-1.87%)	27.03 (-18.31%)
`897d04e` — 2026-03-06 22:12:25	1.08 (n/a)	0.90 (n/a)	0.93 (n/a)	0.57 (n/a)	0.20 (n/a)	172.50 (n/a)	115.64 (n/a)	105.90 (n/a)	91.00 (n/a)	33.09 (n/a)

rope_2c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.52 (-41.00%)	0.48 (-23.50%)	0.47 (-8.77%)	0.45 (-8.53%)	0.03 (-82.26%)	165.60 (+9.31%)	153.64 (+23.84%)	157.50 (+9.60%)	142.70 (+69.48%)	9.91 (-67.98%)
`897d04e` — 2026-03-06 22:12:25	0.88 (n/a)	0.63 (n/a)	0.51 (n/a)	0.49 (n/a)	0.18 (n/a)	151.50 (n/a)	124.06 (n/a)	143.70 (n/a)	84.20 (n/a)	30.96 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.22 (+18.92%)	0.17 (+6.24%)	0.17 (+5.57%)	0.14 (-0.50%)	0.03 (+90.77%)	171.10 (+0.47%)	147.40 (-4.39%)	148.10 (-5.31%)	110.10 (-15.89%)	23.59 (+60.67%)
`d48746f` — 2026-01-12 22:17:10	0.19 (n/a)	0.16 (n/a)	0.16 (n/a)	0.14 (n/a)	0.02 (n/a)	170.30 (n/a)	154.16 (n/a)	156.40 (n/a)	130.90 (n/a)	14.69 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`1b2d230` — 2026-01-13 22:38:03	0.17 (-1.30%)	0.15 (+6.63%)	0.15 (-8.78%)	0.14 (+39.68%)	0.01 (-67.35%)	174.90 (-28.41%)	163.42 (-10.36%)	167.40 (+9.63%)	146.50 (+1.31%)	11.19 (-76.17%)
`d48746f` — 2026-01-12 22:17:10	0.17 (n/a)	0.14 (n/a)	0.16 (n/a)	0.10 (n/a)	0.03 (n/a)	244.30 (n/a)	182.30 (n/a)	152.70 (n/a)	144.60 (n/a)	46.98 (n/a)

rope_8c_32rows_512cols_32arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	1.03 (-3.75%)	0.79 (-10.17%)	0.70 (-32.19%)	0.60 (+12.11%)	0.20 (-11.36%)	163.10 (-10.78%)	130.24 (+9.28%)	141.40 (+47.45%)	95.90 (+3.90%)	31.40 (-19.06%)
`897d04e` — 2026-03-06 22:12:25	1.07 (n/a)	0.88 (n/a)	1.03 (n/a)	0.54 (n/a)	0.23 (n/a)	182.80 (n/a)	119.18 (n/a)	95.90 (n/a)	92.30 (n/a)	38.79 (n/a)

rope_8c_32rows_512cols_8arows_0m

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.51 (-9.71%)	0.47 (-1.87%)	0.51 (-3.72%)	0.41 (+13.96%)	0.05 (-43.51%)	178.10 (-12.27%)	158.16 (-0.09%)	145.90 (+3.92%)	145.50 (+10.81%)	17.17 (-45.27%)
`897d04e` — 2026-03-06 22:12:25	0.56 (n/a)	0.48 (n/a)	0.52 (n/a)	0.36 (n/a)	0.09 (n/a)	203.00 (n/a)	158.30 (n/a)	140.40 (n/a)	131.30 (n/a)	31.38 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+20.93%)	0.08 (+7.17%)	0.08 (-3.26%)	0.05 (-3.41%)	0.03 (+57.81%)	156.70 (+3.57%)	111.92 (-1.84%)	97.30 (+3.40%)	77.30 (-17.33%)	39.14 (+39.58%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.05 (n/a)	0.02 (n/a)	151.30 (n/a)	114.02 (n/a)	94.10 (n/a)	93.50 (n/a)	28.04 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+2.92%)	0.09 (+1.35%)	0.11 (+0.20%)	0.05 (+17.05%)	0.03 (-1.27%)	150.80 (-14.56%)	103.84 (-2.77%)	76.80 (-0.13%)	74.30 (-2.75%)	38.69 (-13.66%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.03 (n/a)	176.50 (n/a)	106.80 (n/a)	76.90 (n/a)	76.40 (n/a)	44.81 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-5.05%)	0.07 (-2.93%)	0.08 (+3.84%)	0.05 (+2.78%)	0.02 (-1.31%)	167.00 (-2.68%)	115.88 (+2.62%)	96.50 (-3.69%)	95.10 (+5.32%)	31.30 (-5.97%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	171.60 (n/a)	112.92 (n/a)	100.20 (n/a)	90.30 (n/a)	33.29 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+12.39%)	0.08 (-9.57%)	0.09 (-5.22%)	0.03 (-13.17%)	0.03 (+20.91%)	245.40 (+15.16%)	127.68 (+16.94%)	88.00 (+5.52%)	73.50 (-11.02%)	71.84 (+23.66%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	213.10 (n/a)	109.18 (n/a)	83.40 (n/a)	82.60 (n/a)	58.09 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-18.37%)	0.07 (-11.51%)	0.09 (-16.15%)	0.05 (+20.44%)	0.02 (-38.63%)	156.60 (-16.97%)	117.52 (+4.18%)	93.80 (+19.34%)	92.80 (+22.59%)	33.14 (-35.08%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.08 (n/a)	0.10 (n/a)	0.04 (n/a)	0.03 (n/a)	188.60 (n/a)	112.80 (n/a)	78.60 (n/a)	75.70 (n/a)	51.04 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-7.92%)	0.08 (+2.70%)	0.09 (+13.97%)	0.05 (-12.07%)	0.02 (-0.04%)	164.20 (+13.71%)	110.08 (-1.70%)	95.50 (-12.22%)	94.60 (+8.61%)	30.38 (+26.25%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.02 (n/a)	144.40 (n/a)	111.98 (n/a)	108.80 (n/a)	87.10 (n/a)	24.06 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-5.07%)	0.07 (-8.91%)	0.08 (-4.70%)	0.05 (+6.54%)	0.02 (-0.49%)	155.70 (-6.15%)	121.24 (+9.56%)	103.90 (+4.95%)	94.60 (+5.35%)	29.85 (-4.17%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	165.90 (n/a)	110.66 (n/a)	99.00 (n/a)	89.80 (n/a)	31.15 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (-1.16%)	0.09 (+1.81%)	0.10 (+4.82%)	0.07 (+52.97%)	0.02 (-31.37%)	119.50 (-34.63%)	96.58 (-7.95%)	83.20 (-4.59%)	82.40 (+1.10%)	18.85 (-56.79%)
`897d04e` — 2026-03-06 22:12:25	0.10 (n/a)	0.09 (n/a)	0.09 (n/a)	0.04 (n/a)	0.02 (n/a)	182.80 (n/a)	104.92 (n/a)	87.20 (n/a)	81.50 (n/a)	43.64 (n/a)

silu_mul_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.14 (n/a)	0.12 (n/a)	0.13 (n/a)	0.08 (n/a)	0.03 (n/a)	152.50 (n/a)	103.44 (n/a)	91.90 (n/a)	84.80 (n/a)	28.41 (n/a)

silu_mul_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (n/a)	0.11 (n/a)	0.11 (n/a)	0.08 (n/a)	0.02 (n/a)	160.80 (n/a)	117.78 (n/a)	110.40 (n/a)	100.50 (n/a)	24.97 (n/a)

silu_mul_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.12 (n/a)	0.11 (n/a)	0.12 (n/a)	0.08 (n/a)	0.02 (n/a)	161.40 (n/a)	113.88 (n/a)	102.00 (n/a)	100.90 (n/a)	26.58 (n/a)

silu_mul_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (n/a)	0.11 (n/a)	0.11 (n/a)	0.08 (n/a)	0.01 (n/a)	152.50 (n/a)	118.76 (n/a)	110.30 (n/a)	107.90 (n/a)	18.95 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.21 (+9.18%)	0.17 (+2.91%)	0.16 (-0.85%)	0.14 (-0.87%)	0.03 (+36.86%)	116.80 (+0.86%)	97.52 (-1.75%)	99.50 (+0.91%)	77.80 (-8.47%)	17.37 (+27.23%)
`897d04e` — 2026-03-06 22:12:25	0.19 (n/a)	0.17 (n/a)	0.17 (n/a)	0.14 (n/a)	0.02 (n/a)	115.80 (n/a)	99.26 (n/a)	98.60 (n/a)	85.00 (n/a)	13.65 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.22 (+10.08%)	0.19 (+15.41%)	0.21 (+19.09%)	0.13 (+12.50%)	0.04 (+21.48%)	129.50 (-11.12%)	91.18 (-12.90%)	79.80 (-16.00%)	76.20 (-9.07%)	22.67 (-6.18%)
`897d04e` — 2026-03-06 22:12:25	0.20 (n/a)	0.16 (n/a)	0.17 (n/a)	0.11 (n/a)	0.03 (n/a)	145.70 (n/a)	104.68 (n/a)	95.00 (n/a)	83.80 (n/a)	24.16 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.21 (-17.29%)	0.16 (-8.71%)	0.19 (+6.17%)	0.09 (-23.25%)	0.05 (+0.77%)	187.80 (+30.33%)	112.86 (+14.02%)	86.80 (-5.75%)	77.70 (+20.84%)	46.37 (+56.77%)
`897d04e` — 2026-03-06 22:12:25	0.25 (n/a)	0.18 (n/a)	0.18 (n/a)	0.11 (n/a)	0.05 (n/a)	144.10 (n/a)	98.98 (n/a)	92.10 (n/a)	64.30 (n/a)	29.58 (n/a)

swiglu

No metrics available.

swiglu_decode_1x2048x2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	0.00 (-15.46%)	0.00 (-27.20%)	0.00 (-28.17%)	0.00 (-33.90%)	0.00 (+1834.83%)	5187.20 (+51.28%)	4720.84 (+38.38%)	4750.90 (+39.22%)	4015.10 (+18.29%)	390.23 (+3298.45%)
`0a6c11c` — 2025-12-04 00:39:10	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	3428.80 (n/a)	3411.62 (n/a)	3412.60 (n/a)	3394.20 (n/a)	11.48 (n/a)

swiglu_decode_1x2048x2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.00 (+117.10%)	0.00 (+118.44%)	0.00 (+115.17%)	0.00 (+134.24%)	0.00 (+80.46%)	2207.50 (-57.31%)	1705.34 (-54.67%)	1584.10 (-53.53%)	1569.50 (-53.94%)	280.93 (-64.33%)
`897d04e` — 2026-03-06 22:12:25	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	5170.80 (n/a)	3761.80 (n/a)	3408.60 (n/a)	3407.30 (n/a)	787.66 (n/a)

swiglu_fused_decode_2048x2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	0.00 (n/a)	1230.70 (n/a)	833.34 (n/a)	732.90 (n/a)	710.10 (n/a)	223.64 (n/a)

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-1.87%)	0.07 (-4.74%)	0.08 (+6.82%)	0.05 (-22.65%)	0.02 (+65.67%)	167.70 (+29.30%)	115.40 (+8.34%)	98.30 (-6.38%)	97.10 (+1.89%)	30.32 (+117.34%)
`897d04e` — 2026-03-06 22:12:25	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	129.70 (n/a)	106.52 (n/a)	105.00 (n/a)	95.30 (n/a)	13.95 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.09 (-19.16%)	0.08 (-14.93%)	0.09 (-18.38%)	0.05 (+4.83%)	0.02 (-39.42%)	152.60 (-4.57%)	106.48 (+12.18%)	93.30 (+22.60%)	92.40 (+23.69%)	26.06 (-29.04%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.09 (n/a)	0.11 (n/a)	0.05 (n/a)	0.02 (n/a)	159.90 (n/a)	94.92 (n/a)	76.10 (n/a)	74.70 (n/a)	36.73 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+37.16%)	0.10 (+31.64%)	0.10 (+36.20%)	0.07 (+3.16%)	0.02 (+124.08%)	125.00 (-3.10%)	87.82 (-22.01%)	78.30 (-26.55%)	73.80 (-27.15%)	21.20 (+63.46%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	129.00 (n/a)	112.60 (n/a)	106.60 (n/a)	101.30 (n/a)	12.97 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.08 (-6.05%)	0.07 (-8.96%)	0.07 (-11.57%)	0.05 (-18.90%)	0.01 (+22.66%)	164.80 (+23.26%)	122.40 (+11.27%)	115.30 (+13.15%)	105.70 (+6.45%)	24.09 (+66.25%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	133.70 (n/a)	110.00 (n/a)	101.90 (n/a)	99.30 (n/a)	14.49 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	3.93 (-7.02%)	3.68 (+2.48%)	3.66 (+1.82%)	3.45 (+15.62%)	0.15 (-63.64%)	151.80 (-13.50%)	142.70 (-3.59%)	143.40 (-1.78%)	133.50 (+7.49%)	5.90 (-66.22%)
`0a6c11c` — 2025-12-04 00:39:10	4.22 (n/a)	3.59 (n/a)	3.59 (n/a)	2.99 (n/a)	0.42 (n/a)	175.50 (n/a)	148.02 (n/a)	146.00 (n/a)	124.20 (n/a)	17.46 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	3.96 (-10.63%)	3.41 (-8.41%)	3.40 (-15.41%)	2.93 (-1.27%)	0.44 (-33.04%)	179.00 (+1.30%)	155.72 (+7.79%)	154.20 (+18.25%)	132.50 (+11.91%)	19.88 (-25.26%)
`897d04e` — 2026-03-06 22:12:25	4.43 (n/a)	3.73 (n/a)	4.02 (n/a)	2.97 (n/a)	0.65 (n/a)	176.70 (n/a)	144.46 (n/a)	130.40 (n/a)	118.40 (n/a)	26.60 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`130b6ea` — 2025-12-05 21:15:49	5.11 (+15.57%)	3.85 (-3.32%)	3.40 (-18.64%)	3.29 (+7.09%)	0.71 (+49.14%)	159.60 (-6.61%)	140.18 (+4.80%)	154.20 (+22.97%)	102.60 (-13.49%)	22.70 (+19.77%)
`0a6c11c` — 2025-12-04 00:39:10	4.42 (n/a)	3.99 (n/a)	4.18 (n/a)	3.07 (n/a)	0.48 (n/a)	170.90 (n/a)	133.76 (n/a)	125.40 (n/a)	118.60 (n/a)	18.95 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	5.00 (-5.19%)	4.06 (-6.59%)	4.35 (-2.23%)	3.30 (+18.63%)	0.74 (-24.75%)	159.00 (-15.69%)	132.64 (+4.46%)	120.60 (+2.29%)	104.90 (+5.53%)	24.55 (-31.85%)
`897d04e` — 2026-03-06 22:12:25	5.27 (n/a)	4.35 (n/a)	4.45 (n/a)	2.78 (n/a)	0.98 (n/a)	188.60 (n/a)	126.98 (n/a)	117.90 (n/a)	99.40 (n/a)	36.02 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.10 (+26.12%)	0.08 (+17.14%)	0.08 (+9.30%)	0.06 (+26.99%)	0.02 (+22.98%)	133.30 (-21.26%)	103.18 (-14.85%)	103.30 (-8.50%)	79.20 (-20.72%)	21.55 (-24.40%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.01 (n/a)	169.30 (n/a)	121.18 (n/a)	112.90 (n/a)	99.90 (n/a)	28.51 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+2.05%)	0.08 (-11.64%)	0.08 (-19.79%)	0.05 (-12.62%)	0.02 (+11.85%)	160.40 (+14.41%)	104.62 (+15.22%)	98.20 (+24.62%)	76.40 (-1.93%)	34.09 (+23.44%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	140.20 (n/a)	90.80 (n/a)	78.80 (n/a)	77.90 (n/a)	27.62 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (-0.86%)	0.09 (-8.14%)	0.09 (-11.79%)	0.05 (-20.25%)	0.02 (+26.65%)	158.90 (+25.41%)	100.40 (+12.58%)	90.30 (+13.30%)	77.90 (+0.91%)	33.67 (+59.58%)
`897d04e` — 2026-03-06 22:12:25	0.11 (n/a)	0.10 (n/a)	0.10 (n/a)	0.06 (n/a)	0.02 (n/a)	126.70 (n/a)	89.18 (n/a)	79.70 (n/a)	77.20 (n/a)	21.10 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`50e35ad` — 2026-03-07 19:11:58	0.11 (+32.35%)	0.08 (+8.37%)	0.08 (-1.75%)	0.05 (+12.19%)	0.02 (+31.37%)	158.50 (-10.85%)	110.84 (-7.18%)	105.80 (+1.73%)	77.70 (-24.49%)	29.34 (-10.34%)
`897d04e` — 2026-03-06 22:12:25	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.05 (n/a)	0.01 (n/a)	177.80 (n/a)	119.42 (n/a)	104.00 (n/a)	102.90 (n/a)	32.72 (n/a)

github-actions · 2026-03-07T19:25:33Z

📊 Test Results for Test Example Applications

50e35ad (2026_03_07_19_25_10)

IRONCLAD

Tested on 2026_03_07_19_25_10 at commit 50e35ad.

Test	Checks	TTFT (mean)	TPS (mean)
llama_3.2_1b_prompt_13_tokens_1	✅ 1/1	0.60	0.00
llama_3.2_1b_prompt_13_tokens_40	✅ 1/1	0.60	5.07
llama_3.2_1b_prompt_2048_tokens_1	✅ 1/1	2.67	0.00
llama_3.2_1b_prompt_2048_tokens_40	✅ 1/1	2.65	4.80

📈 Trends (vs main branch) for Test Example Applications

50e35ad (2026_03_07_19_25_10)

IRONCLAD Trends

llama_3.2_1b

Commit/Date	Num Tokens (max)	Num Tokens (mean)	Num Tokens (median)	Num Tokens (min)	Num Tokens (stddev)	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)	Total (max)	Total (mean)	Total (median)	Total (min)	Total (stddev)
`130b6ea` — 2025-12-05 21:33:12	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	0.00 (n/a)	4.71 (-0.42%)	4.64 (-0.09%)	4.64 (+0.65%)	4.55 (-0.22%)	0.05 (-17.66%)	4.41 (-0.34%)	4.39 (-0.19%)	4.38 (-0.33%)	4.37 (-0.15%)	0.01 (-25.90%)	12.96 (-0.00%)	12.80 (+0.07%)	12.80 (-0.23%)	12.67 (+0.44%)	0.09 (-21.12%)
`0a6c11c` — 2025-12-03 23:35:15	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	0.00 (n/a)	4.73 (n/a)	4.64 (n/a)	4.61 (n/a)	4.56 (n/a)	0.06 (n/a)	4.42 (n/a)	4.40 (n/a)	4.40 (n/a)	4.37 (n/a)	0.02 (n/a)	12.96 (n/a)	12.79 (n/a)	12.83 (n/a)	12.62 (n/a)	0.12 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date	Num_Tokens (max)	Num_Tokens (mean)	Num_Tokens (median)	Num_Tokens (min)	Num_Tokens (stddev)	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`50e35ad` — 2026-03-07 19:20:25	1.00 (+0.00%)	1.00 (+0.00%)	1.00 (+0.00%)	1.00 (+0.00%)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.60 (-2.63%)	0.60 (-2.63%)	0.60 (-2.63%)	0.60 (-2.63%)	0.00 (n/a)
`897d04e` — 2026-03-06 22:56:07	1.00 (n/a)	1.00 (n/a)	1.00 (n/a)	1.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.62 (n/a)	0.62 (n/a)	0.62 (n/a)	0.62 (n/a)	0.00 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date	Num_Tokens (max)	Num_Tokens (mean)	Num_Tokens (median)	Num_Tokens (min)	Num_Tokens (stddev)	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`50e35ad` — 2026-03-07 19:20:25	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	0.00 (n/a)	5.07 (+17.91%)	5.07 (+17.91%)	5.07 (+17.91%)	5.07 (+17.91%)	0.00 (n/a)	0.60 (-2.25%)	0.60 (-2.25%)	0.60 (-2.25%)	0.60 (-2.25%)	0.00 (n/a)
`897d04e` — 2026-03-06 22:56:07	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	0.00 (n/a)	4.30 (n/a)	4.30 (n/a)	4.30 (n/a)	4.30 (n/a)	0.00 (n/a)	0.61 (n/a)	0.61 (n/a)	0.61 (n/a)	0.61 (n/a)	0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_1

Commit/Date	Num_Tokens (max)	Num_Tokens (mean)	Num_Tokens (median)	Num_Tokens (min)	Num_Tokens (stddev)	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`50e35ad` — 2026-03-07 19:20:25	1.00 (+0.00%)	1.00 (+0.00%)	1.00 (+0.00%)	1.00 (+0.00%)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	2.67 (-0.31%)	2.67 (-0.31%)	2.67 (-0.31%)	2.67 (-0.31%)	0.00 (n/a)
`897d04e` — 2026-03-06 22:56:07	1.00 (n/a)	1.00 (n/a)	1.00 (n/a)	1.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	2.68 (n/a)	2.68 (n/a)	2.68 (n/a)	2.68 (n/a)	0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_40

Commit/Date	Num_Tokens (max)	Num_Tokens (mean)	Num_Tokens (median)	Num_Tokens (min)	Num_Tokens (stddev)	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`50e35ad` — 2026-03-07 19:20:25	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	0.00 (n/a)	4.80 (+20.00%)	4.80 (+20.00%)	4.80 (+20.00%)	4.80 (+20.00%)	0.00 (n/a)	2.65 (-2.00%)	2.65 (-2.00%)	2.65 (-2.00%)	2.65 (-2.00%)	0.00 (n/a)
`897d04e` — 2026-03-06 22:56:07	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	0.00 (n/a)	4.00 (n/a)	4.00 (n/a)	4.00 (n/a)	4.00 (n/a)	0.00 (n/a)	2.70 (n/a)	2.70 (n/a)	2.70 (n/a)	2.70 (n/a)	0.00 (n/a)

andrej · 2026-03-09T17:34:30Z

iron/operators/fused_qkv_proj/design.py

+This module re-exports the GEMV design function for documentation and
+to maintain the 4-file operator convention.


I don't think this is really needed. In my opinion it would be clearer to import GEMV directly.

jgmelber and others added 3 commits March 7, 2026 10:13

jgmelber requested review from andrej and hunhoffe as code owners March 7, 2026 18:27

Fix C++ formatting for CI clang-format compliance

79e42f9

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

jgmelber changed the title ~~Add decode dataflow fusion operators (Phases 1-3, 5)~~ Add decode dataflow fusion operators Mar 7, 2026

jgmelber and others added 4 commits March 7, 2026 11:43

Fix flowkv.cc clang-format: one param per line, join short expressions

6f41edd

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Update README benchmarks with on-chip reduction results

c1d55fc

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

jgmelber force-pushed the decode-fusion branch from fe9813b to 82a71c4 Compare March 7, 2026 19:02

andrej reviewed Mar 9, 2026

View reviewed changes

		This module re-exports the GEMV design function for documentation and
		to maintain the 4-file operator convention.

Conversation

jgmelber commented Mar 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Benchmark: swiglu_fused_decode vs swiglu_decode (Llama 3.2 1B dims)

Uh oh!

github-actions bot commented Mar 7, 2026

IRONCLAD

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

axpy_1_cols_2_channels_2048_tile_2048_3.0_0

axpy_2_cols_2_channels_2048_tile_1024_3.0

axpy_2_cols_2_channels_2048_tile_1024_3.0_0

axpy_4_cols_2_channels_2048_tile_512_3.0

axpy_4_cols_2_channels_2048_tile_512_3.0_0

axpy_8_cols_2_channels_2048_tile_256_3.0

axpy_8_cols_2_channels_2048_tile_256_3.0_0

dequant_1_cols_1_channels_2048_tile_2048

dequant_1_cols_1_channels_2048_tile_2048_0

dequant_1_cols_2_channels_2048_tile_1024

dequant_1_cols_2_channels_2048_tile_1024_0

dequant_2_cols_1_channels_2048_tile_1024

dequant_2_cols_1_channels_2048_tile_1024_0

dequant_2_cols_2_channels_2048_tile_512

dequant_2_cols_2_channels_2048_tile_512_0

dequant_4_cols_1_channels_2048_tile_512

dequant_4_cols_1_channels_2048_tile_512_0

dequant_4_cols_2_channels_2048_tile_256

dequant_4_cols_2_channels_2048_tile_256_0

dequant_8_cols_1_channels_2048_tile_256

dequant_8_cols_1_channels_2048_tile_256_0

dequant_8_cols_2_channels_2048_tile_128

dequant_8_cols_2_channels_2048_tile_128_0

dual_gemv_silu_mul_2048x2048_4tsi_512tso_4col0

eltwise_add_1_cols_2_channels_2048_tile_2048

eltwise_add_2_cols_2_channels_2048_tile_1024

eltwise_add_4_cols_2_channels_2048_tile_512

eltwise_add_8_cols_2_channels_2048_tile_256

eltwise_mul_1_cols_2_channels_2048_tile_2048

eltwise_mul_2_cols_2_channels_2048_tile_1024

eltwise_mul_4_cols_2_channels_2048_tile_512

eltwise_mul_8_cols_2_channels_2048_tile_256

flowkv_decode_32h_8kv_64d_128s_32cs_4col0

fused_dequant_gemv_2048x2048_1tsi_512tso_4col_g32_0

fused_qkv_proj_3072x2048_4tsi_768tso_4col0

gelu_1_cols_1_channels_2048_tile_2048

gelu_1_cols_2_channels_2048_tile_1024

gelu_2_cols_1_channels_2048_tile_1024

gelu_2_cols_2_channels_2048_tile_512

gelu_4_cols_1_channels_2048_tile_512

gelu_4_cols_2_channels_2048_tile_256

gelu_8_cols_1_channels_2048_tile_256

gelu_8_cols_2_channels_2048_tile_128

gemm_1792x896x1152_64x32x48_8cols_ccolmaj

gemm_192x384x64_48x96x16_4cols

gemm_192x384x64_48x96x16_4cols_bcolmaj_ccolmaj

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

gemm_2048x2048x2048_64x64x64_1cols

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0_0

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0_0

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0_0

gemm_2048x2048x2048_64x64x64_2cols_bcolmaj

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0

gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0

gemm_2048x2048x2048_64x64x64_8cols_bcolmaj_ccolmaj

gemm_384x1536x1792_32x48x64_4cols_bcolmaj

gemm_896x1792x640_32x64x80_8cols_ccolmaj

layer_norm_1_cols_1_channels_2048_tile_2048

layer_norm_1_cols_2_channels_2048_tile_1024

layer_norm_2_cols_1_channels_2048_tile_1024

layer_norm_2_cols_2_channels_2048_tile_512

layer_norm_4_cols_1_channels_2048_tile_512

jgmelber commented Mar 7, 2026 •

edited

Loading

Benchmark: `swiglu_fused_decode` vs `swiglu_decode` (Llama 3.2 1B dims)