paired P=10180 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 7.273 / 7.318 (ratio 0.9972)
score 5.289 / 5.273 (ratio 0.9970)
topk 8.365 / 8.406 (ratio 0.9896)
attn 50.875 / 50.437 (ratio 0.9921)
merge 10.089 / 6.523 (ratio 0.6479)
paired P=10180 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 9.083 / 9.008 (ratio 1.0087)
score 8.987 / 8.979 (ratio 0.9977)
topk 8.219 / 8.357 (ratio 1.0285)
attn 99.315 / 98.672 (ratio 0.9917)
merge 21.937 / 21.549 (ratio 0.9823)
paired P=10180 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 11.016 / 10.904 (ratio 0.9922)
score 21.297 / 21.302 (ratio 1.0000)
topk 8.271 / 8.271 (ratio 0.9819)
attn 147.648 / 146.031 (ratio 0.9890)
merge 33.617 / 32.982 (ratio 0.9843)
paired P=10180 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 6.654 / 6.542 (ratio 0.9968)
score 16.953 / 16.852 (ratio 0.9952)
topk 8.477 / 7.911 (ratio 0.9396)
attn 195.630 / 193.781 (ratio 0.9906)
merge 45.521 / 43.383 (ratio 0.9528)
paired P=10180 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 24.161 / 24.185 (ratio 0.9989)
score 32.828 / 32.745 (ratio 0.9975)
topk 8.466 / 8.445 (ratio 0.9890)
attn 385.242 / 382.505 (ratio 0.9929)
merge 90.805 / 86.240 (ratio 0.9495)
paired P=10180 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 985.000 / 992.104 (ratio 1.0021)
paired P=10180 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1028.552 / 1048.875 (ratio 1.0140)