paired P=3000 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 7.125 / 7.190 (ratio 1.0044)
score 5.227 / 5.234 (ratio 1.0005)
topk 6.471 / 6.719 (ratio 1.0241)
attn 50.724 / 50.276 (ratio 0.9912)
merge 10.266 / 6.078 (ratio 0.5912)
paired P=3000 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 9.253 / 8.867 (ratio 0.9550)
score 10.146 / 10.201 (ratio 0.9970)
topk 6.753 / 6.516 (ratio 0.9649)
attn 99.292 / 98.451 (ratio 0.9898)
merge 21.969 / 21.492 (ratio 0.9780)
paired P=3000 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.687 / 10.841 (ratio 0.9985)
score 4.591 / 4.591 (ratio 0.9965)
topk 6.570 / 6.758 (ratio 1.0121)
attn 146.141 / 145.052 (ratio 0.9927)
merge 33.766 / 33.000 (ratio 0.9793)
paired P=3000 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 12.849 / 13.031 (ratio 1.0246)
score 5.734 / 5.747 (ratio 1.0009)
topk 6.781 / 6.516 (ratio 0.9590)
attn 193.172 / 191.469 (ratio 0.9913)
merge 45.599 / 43.302 (ratio 0.9488)
paired P=3000 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 23.305 / 22.266 (ratio 0.9843)
score 10.445 / 10.437 (ratio 1.0000)
topk 6.633 / 6.763 (ratio 1.0342)
attn 379.750 / 376.664 (ratio 0.9921)
merge 90.648 / 86.599 (ratio 0.9554)
paired P=3000 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 973.813 / 1011.719 (ratio 1.0276)
paired P=3000 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1010.000 / 1014.750 (ratio 1.0047)