paired P=10180 nt=1 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 7.026 / 7.073 (ratio 1.0056)
score 5.286 / 5.292 (ratio 1.0015)
topk 8.042 / 8.271 (ratio 1.0285)
attn 51.812 / 51.010 (ratio 0.9898)
merge 10.961 / 6.844 (ratio 0.6240)
paired P=10180 nt=2 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 9.039 / 9.115 (ratio 1.0121)
score 12.099 / 12.117 (ratio 1.0017)
topk 9.729 / 9.695 (ratio 0.9968)
attn 100.708 / 99.680 (ratio 0.9901)
merge 21.977 / 21.589 (ratio 0.9834)
paired P=10180 nt=3 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 10.255 / 10.273 (ratio 1.0025)
score 55.672 / 55.685 (ratio 1.0004)
topk 36.477 / 36.427 (ratio 0.9990)
attn 148.958 / 147.414 (ratio 0.9893)
merge 33.732 / 32.961 (ratio 0.9772)
paired P=10180 nt=4 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 13.375 / 13.422 (ratio 0.9970)
score 16.859 / 16.852 (ratio 0.9995)
topk 8.219 / 8.195 (ratio 0.9810)
attn 197.557 / 195.672 (ratio 0.9905)
merge 45.344 / 43.313 (ratio 0.9546)
paired P=10180 nt=8 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 19.945 / 19.906 (ratio 0.9957)
score 142.211 / 142.211 (ratio 1.0002)
topk 36.568 / 36.487 (ratio 0.9983)
attn 388.375 / 385.505 (ratio 0.9927)
merge 91.393 / 86.607 (ratio 0.9493)
paired P=10180 nt=1984 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 985.844 / 977.042 (ratio 1.0114)
paired P=10180 nt=2048 mrope=0 attn=2 (memcmp PASS), ref / candidate GPU us
prep 1032.750 / 1019.031 (ratio 0.9805)