device Apple M5
pipelines: qsa_attn_mm max threads 1024, tg mem 6912; qsa_flash max threads 1024, tg mem 13760
pos0     0, T 96: qsa_attn_mm vs qsa_attn (after merge) rel L2 3.09e-04  PASS
pos0     0, T 96: qsa_flash (fp16 out) vs qsa_attn + merge rel L2 3.72e-04  PASS
pos0  1984, T 96: qsa_attn_mm vs qsa_attn (after merge) rel L2 3.61e-04  PASS
pos0  1984, T 96: qsa_flash (fp16 out) vs qsa_attn + merge rel L2 4.27e-04  PASS
pos0  2050, T 96: qsa_attn_mm vs qsa_attn (after merge) rel L2 3.62e-04  PASS
pos0  2050, T 96: qsa_flash (fp16 out) vs qsa_attn + merge rel L2 4.28e-04  PASS
pos0 30000, T 96: qsa_attn_mm vs qsa_attn (after merge) rel L2 3.57e-04  PASS
pos0 30000, T 96: qsa_flash (fp16 out) vs qsa_attn + merge rel L2 4.23e-04  PASS
score pos0 30000, T 96: qsa_score_mm vs qsa_score worst rel 2.76e-06  PASS
qsa_prep(QSA_Q_F16_FC) vs qsa_prep+qsa_q_f16: qcurh memcmp PASS, qsa_flash memcmp PASS
ALL PASS