paired P=30000 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 7.398 / 7.289 (ratio 0.9842)
score 25.516 / 25.477 (ratio 0.9996)
topk 14.164 / 14.010 (ratio 0.9775)
attn 50.865 / 50.469 (ratio 0.9917)
merge 10.125 / 6.055 (ratio 0.5957)
paired P=30000 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 9.039 / 9.151 (ratio 1.0054)
score 41.872 / 27.826 (ratio 0.9976)
topk 14.268 / 14.091 (ratio 0.9838)
attn 99.729 / 98.557 (ratio 0.9885)
merge 22.018 / 21.464 (ratio 0.9762)
paired P=30000 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.911 / 10.750 (ratio 0.9913)
score 36.117 / 36.112 (ratio 0.9999)
topk 14.060 / 14.445 (ratio 1.0262)
attn 148.052 / 146.667 (ratio 0.9899)
merge 33.581 / 33.560 (ratio 1.0008)
paired P=30000 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 13.594 / 13.641 (ratio 1.0200)
score 208.391 / 208.427 (ratio 0.9988)
topk 33.667 / 33.841 (ratio 1.0042)
attn 196.599 / 194.807 (ratio 0.9905)
merge 45.617 / 43.651 (ratio 0.9558)
paired P=30000 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 24.669 / 24.594 (ratio 1.0049)
score 117.820 / 112.247 (ratio 0.9995)
topk 14.414 / 14.281 (ratio 0.9880)
attn 388.141 / 386.224 (ratio 0.9954)
merge 90.964 / 86.977 (ratio 0.9556)
paired P=30000 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 995.479 / 992.313 (ratio 0.9886)
paired P=30000 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1027.844 / 1014.938 (ratio 0.9874)