paired P=3000 nt=1 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 7.367 / 7.112 (ratio 0.9895)
score 10.122 / 10.008 (ratio 1.0039)
topk 32.169 / 31.419 (ratio 0.9823)
attn 108.711 / 108.607 (ratio 1.0004)
merge 9.823 / 9.815 (ratio 0.9997)
paired P=3000 nt=2 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 9.133 / 9.141 (ratio 1.0000)
score 16.008 / 16.260 (ratio 1.0158)
topk 31.391 / 32.273 (ratio 1.0208)
attn 194.680 / 194.924 (ratio 1.0005)
merge 8.359 / 8.383 (ratio 1.0037)
paired P=3000 nt=3 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 11.125 / 10.984 (ratio 0.9874)
score 21.109 / 21.292 (ratio 1.0041)
topk 32.008 / 31.974 (ratio 0.9883)
attn 124.969 / 124.594 (ratio 0.9971)
merge 16.414 / 16.414 (ratio 1.0000)
paired P=3000 nt=4 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 13.336 / 13.477 (ratio 1.0152)
score 25.703 / 25.924 (ratio 1.0080)
topk 31.875 / 32.083 (ratio 1.0086)
attn 160.729 / 160.659 (ratio 0.9989)
merge 23.516 / 23.555 (ratio 1.0028)
paired P=3000 nt=8 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 24.187 / 23.508 (ratio 0.9850)
score 46.758 / 46.628 (ratio 0.9972)
topk 31.792 / 32.055 (ratio 1.0088)
attn 316.414 / 316.109 (ratio 0.9991)
merge 46.141 / 45.961 (ratio 0.9961)
paired P=3000 nt=1984 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 985.771 / 981.042 (ratio 1.0134)
paired P=3000 nt=2048 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1004.865 / 1006.500 (ratio 1.0016)