Round 35 blitz: Wr/Wr2 router dq reuse (-47 dispatches/chunk), gemm_f16_16_96_2 Walbe (-13.6%), M%128<=64 64_128_4 (1.14x @ M=306), hc_up_tile row-tail trim (-2.5% @ T=289), mtp_rms_xprep (-37.5%) & mtp_embed (-21.8%) & mtp_slop_pen (-96.5%) -> 629.05 tok/s GPU prefill, 25.26 tok/s @10.2K decode, mtp_ms 192.17/355.15ms

9d9dc8ae parent 07a5b206 +856 −180
browse files