Repository navigation
Count a node left on one core as holding its tensors whole in the capacity tiler - #155
Conversation
Stream AIE Metrics Regression Guard⚠ 5 cell(s) flagged (total_latency > 0.1% tol): hardware_two_conv[eyeriss_like_dual_core], hardware_two_conv[eyeriss_like_quad_core], hardware_two_conv[meta_prototype], hardware_two_conv[simba_small], hardware_two_conv[tpu_like_quad_core] 16 of 16 cells captured Provenance: baseline hardware_swiglu — 8 hardware
hardware_two_conv — 8 hardware (⚠ 5 flagged)
To regenerate baseline: |
dc45e9b to
5544970
Compare
The capacity tiler divided every tensor's footprint by the group's inter-core split. A node the mapping leaves on one core, like a softmax's elementwise exp on a single vector core, holds its tensors whole, so the tiler believed that core held a quarter of the scores and never tiled them. The allocation then rejected the mapping (128.5 KB pinned on a 128 KB core).
Tensors of a node placed on a single core now count in full on that core.
Test: a Gemm whose output columns the group splits over four cores streams only its contraction dim; the same Gemm left on one core also streams its output columns. Without the change both plans are the same.
Stacked on #154.