paired P=30000 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 7.078 / 7.107 (ratio 1.0029)
score 32.344 / 32.388 (ratio 0.9983)
topk 43.786 / 43.844 (ratio 1.0013)
attn 132.607 / 118.047 (ratio 0.9911)
merge 17.180 / 10.807 (ratio 0.6295)
paired P=30000 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 8.456 / 8.471 (ratio 1.0019)
score 105.219 / 105.216 (ratio 1.0000)
topk 63.245 / 63.401 (ratio 1.0033)
attn 101.031 / 100.091 (ratio 0.9910)
merge 22.125 / 21.547 (ratio 0.9739)
paired P=30000 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.674 / 10.648 (ratio 0.9978)
score 108.435 / 83.169 (ratio 0.9991)
topk 26.979 / 27.034 (ratio 1.0026)
attn 172.091 / 170.409 (ratio 0.9899)
merge 33.500 / 33.471 (ratio 0.9955)
paired P=30000 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 12.654 / 13.430 (ratio 1.0502)
score 207.747 / 208.276 (ratio 1.0011)
topk 33.771 / 33.904 (ratio 1.0034)
attn 198.734 / 196.766 (ratio 0.9902)
merge 45.469 / 43.544 (ratio 0.9577)
paired P=30000 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 23.466 / 23.810 (ratio 1.0229)
score 94.807 / 94.805 (ratio 0.9999)
topk 14.232 / 14.391 (ratio 1.0062)
attn 390.703 / 389.167 (ratio 0.9963)
merge 91.594 / 88.021 (ratio 0.9556)
paired P=30000 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 997.521 / 1009.469 (ratio 0.9897)
paired P=30000 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1069.354 / 1133.031 (ratio 0.9944)