paired P=3000 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 6.828 / 6.846 (ratio 1.0027)
score 9.732 / 9.740 (ratio 0.9997)
topk 28.977 / 28.914 (ratio 0.9978)
attn 118.224 / 75.477 (ratio 0.9881)
merge 15.143 / 9.273 (ratio 0.6122)
paired P=3000 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 8.867 / 8.953 (ratio 1.0025)
score 15.464 / 15.008 (ratio 0.9924)
topk 6.701 / 6.417 (ratio 0.9648)
attn 100.195 / 99.367 (ratio 0.9911)
merge 21.924 / 21.516 (ratio 0.9812)
paired P=3000 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.935 / 10.857 (ratio 0.9986)
score 6.193 / 6.195 (ratio 1.0017)
topk 7.247 / 7.221 (ratio 0.9968)
attn 147.727 / 146.453 (ratio 0.9917)
merge 33.688 / 32.969 (ratio 0.9791)
paired P=3000 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 12.112 / 12.039 (ratio 0.9939)
score 24.513 / 24.578 (ratio 1.0027)
topk 29.099 / 29.016 (ratio 0.9980)
attn 195.198 / 193.445 (ratio 0.9916)
merge 45.458 / 43.227 (ratio 0.9522)
paired P=3000 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 19.992 / 19.859 (ratio 0.9965)
score 45.008 / 45.003 (ratio 0.9995)
topk 29.115 / 29.055 (ratio 0.9985)
attn 384.055 / 380.742 (ratio 0.9914)
merge 91.102 / 86.547 (ratio 0.9501)
paired P=3000 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 997.938 / 995.854 (ratio 1.0029)
paired P=3000 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1015.865 / 1026.094 (ratio 1.0062)