paired P=30000 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 2.688 / 2.695 (ratio 1.0039)
score 26.898 / 25.477 (ratio 0.9985)
topk 14.148 / 13.997 (ratio 1.0031)
attn 50.883 / 50.461 (ratio 0.9916)
merge 9.945 / 6.445 (ratio 0.6489)
paired P=30000 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 9.062 / 9.062 (ratio 1.0000)
score 25.323 / 25.271 (ratio 0.9978)
topk 14.289 / 14.023 (ratio 0.9929)
attn 99.570 / 98.607 (ratio 0.9899)
merge 21.958 / 21.448 (ratio 0.9747)
paired P=30000 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.880 / 10.857 (ratio 0.9986)
score 36.188 / 36.133 (ratio 0.9982)
topk 14.065 / 14.484 (ratio 1.0298)
attn 147.904 / 146.596 (ratio 0.9910)
merge 33.594 / 33.279 (ratio 0.9902)
paired P=30000 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 13.492 / 12.823 (ratio 0.9401)
score 47.870 / 47.852 (ratio 0.9996)
topk 14.307 / 14.312 (ratio 0.9813)
attn 196.112 / 194.602 (ratio 0.9931)
merge 45.367 / 43.659 (ratio 0.9620)
paired P=30000 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 22.393 / 23.977 (ratio 1.0531)
score 94.857 / 94.878 (ratio 0.9999)
topk 14.279 / 14.273 (ratio 1.0162)
attn 388.385 / 386.602 (ratio 0.9956)
merge 91.096 / 87.198 (ratio 0.9549)
paired P=30000 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1033.010 / 994.500 (ratio 0.9841)
paired P=30000 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1038.406 / 1010.396 (ratio 0.9621)