paired P=30000 nt=1 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 7.141 / 7.320 (ratio 1.0089)
score 58.344 / 58.073 (ratio 1.0054)
topk 14.534 / 14.539 (ratio 1.0020)
attn 46.711 / 46.901 (ratio 1.0025)
merge 5.966 / 4.052 (ratio 0.6784)
paired P=30000 nt=2 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 9.141 / 8.896 (ratio 0.9881)
score 42.872 / 27.826 (ratio 1.0010)
topk 14.305 / 14.081 (ratio 0.9878)
attn 84.143 / 84.201 (ratio 1.0000)
merge 6.687 / 5.372 (ratio 0.8106)
paired P=30000 nt=3 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 10.883 / 10.865 (ratio 0.9927)
score 53.570 / 51.617 (ratio 0.9994)
topk 14.102 / 14.656 (ratio 1.0306)
attn 126.227 / 126.073 (ratio 0.9985)
merge 16.419 / 17.349 (ratio 1.0563)
paired P=30000 nt=4 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 12.599 / 12.344 (ratio 0.9806)
score 62.320 / 47.906 (ratio 0.9993)
topk 14.078 / 14.492 (ratio 1.0086)
attn 165.086 / 165.195 (ratio 1.0005)
merge 23.615 / 22.219 (ratio 0.9409)
paired P=30000 nt=8 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 22.362 / 23.547 (ratio 1.0209)
score 108.987 / 101.703 (ratio 0.9996)
topk 14.385 / 14.544 (ratio 0.9903)
attn 332.862 / 332.672 (ratio 0.9997)
merge 45.729 / 43.919 (ratio 0.9579)
paired P=30000 nt=1984 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1003.563 / 991.687 (ratio 1.0010)
paired P=30000 nt=2048 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1042.229 / 1036.750 (ratio 0.9982)