paired P=3000 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 2.242 / 2.242 (ratio 1.0000)
score 2.922 / 2.914 (ratio 0.9973)
topk 6.523 / 6.737 (ratio 1.0164)
attn 50.818 / 50.352 (ratio 0.9909)
merge 10.195 / 6.294 (ratio 0.6273)
paired P=3000 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 9.177 / 9.182 (ratio 1.0006)
score 3.453 / 3.466 (ratio 1.0030)
topk 6.766 / 6.531 (ratio 0.9654)
attn 98.906 / 98.271 (ratio 0.9951)
merge 21.927 / 21.594 (ratio 0.9794)
paired P=3000 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.773 / 10.659 (ratio 0.9894)
score 4.586 / 4.589 (ratio 1.0226)
topk 6.776 / 6.745 (ratio 0.9942)
attn 146.336 / 144.961 (ratio 0.9906)
merge 33.615 / 33.089 (ratio 0.9845)
paired P=3000 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 12.813 / 13.151 (ratio 0.9820)
score 25.451 / 25.201 (ratio 0.9970)
topk 6.607 / 6.703 (ratio 0.9828)
attn 193.346 / 191.594 (ratio 0.9908)
merge 45.727 / 43.313 (ratio 0.9480)
paired P=3000 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 23.443 / 23.995 (ratio 1.0236)
score 10.497 / 10.523 (ratio 0.9985)
topk 6.664 / 6.724 (ratio 1.0246)
attn 380.055 / 377.034 (ratio 0.9922)
merge 90.633 / 86.607 (ratio 0.9549)
paired P=3000 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 980.542 / 983.604 (ratio 1.0031)
paired P=3000 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1023.500 / 1023.094 (ratio 0.9929)