paired P=10180 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 7.039 / 7.109 (ratio 1.0100)
score 5.286 / 5.286 (ratio 0.9995)
topk 8.500 / 8.375 (ratio 0.9920)
attn 50.893 / 50.385 (ratio 0.9903)
merge 10.271 / 6.148 (ratio 0.5984)
paired P=10180 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 8.870 / 9.016 (ratio 1.0068)
score 12.107 / 12.107 (ratio 0.9996)
topk 8.070 / 8.185 (ratio 1.0142)
attn 99.880 / 98.500 (ratio 0.9862)
merge 21.911 / 21.523 (ratio 0.9864)
paired P=10180 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.698 / 10.724 (ratio 1.0046)
score 12.948 / 12.883 (ratio 0.9930)
topk 8.219 / 8.448 (ratio 1.0279)
attn 147.336 / 146.255 (ratio 0.9927)
merge 33.529 / 33.125 (ratio 0.9884)
paired P=10180 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 13.107 / 12.729 (ratio 0.9971)
score 16.846 / 16.846 (ratio 1.0000)
topk 8.414 / 8.435 (ratio 1.0096)
attn 195.586 / 193.758 (ratio 0.9904)
merge 45.708 / 43.352 (ratio 0.9484)
paired P=10180 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 22.922 / 23.500 (ratio 0.9804)
score 32.771 / 32.742 (ratio 1.0003)
topk 8.068 / 8.286 (ratio 1.0271)
attn 384.734 / 382.318 (ratio 0.9937)
merge 90.992 / 86.070 (ratio 0.9488)
paired P=10180 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 971.354 / 986.990 (ratio 1.0108)
paired P=10180 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1026.281 / 1034.135 (ratio 1.0249)