paired P=10180 nt=1 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 7.354 / 7.141 (ratio 0.9979)
score 26.320 / 26.518 (ratio 1.0064)
topk 39.250 / 38.987 (ratio 0.9894)
attn 107.724 / 94.398 (ratio 0.9966)
merge 8.102 / 5.492 (ratio 0.6776)
paired P=10180 nt=2 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 8.914 / 9.078 (ratio 1.0011)
score 8.974 / 8.977 (ratio 1.0003)
topk 8.250 / 8.195 (ratio 1.0195)
attn 83.227 / 83.190 (ratio 1.0016)
merge 6.898 / 5.492 (ratio 0.8041)
paired P=10180 nt=3 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 10.776 / 10.841 (ratio 1.0029)
score 12.898 / 12.935 (ratio 1.0089)
topk 8.289 / 8.297 (ratio 1.0155)
attn 125.417 / 125.102 (ratio 0.9965)
merge 16.367 / 17.435 (ratio 1.0652)
paired P=10180 nt=4 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 13.078 / 12.836 (ratio 0.9862)
score 16.836 / 16.828 (ratio 1.0015)
topk 7.891 / 8.435 (ratio 1.0693)
attn 162.078 / 161.914 (ratio 0.9995)
merge 23.547 / 22.120 (ratio 0.9428)
paired P=10180 nt=8 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 22.227 / 23.302 (ratio 0.9868)
score 48.805 / 48.820 (ratio 1.0008)
topk 10.539 / 10.547 (ratio 1.0007)
attn 324.810 / 324.659 (ratio 0.9989)
merge 46.128 / 43.958 (ratio 0.9549)
paired P=10180 nt=1984 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 989.500 / 995.594 (ratio 1.0028)
paired P=10180 nt=2048 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1029.563 / 1032.083 (ratio 0.9913)