paired P=3000 nt=1 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 7.143 / 7.289 (ratio 1.0075)
score 6.844 / 6.831 (ratio 1.0000)
topk 15.458 / 15.424 (ratio 0.9971)
attn 77.891 / 77.836 (ratio 0.9994)
merge 8.078 / 5.477 (ratio 0.6779)
paired P=3000 nt=2 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 9.130 / 8.690 (ratio 0.9806)
score 3.432 / 3.430 (ratio 0.9977)
topk 6.430 / 6.664 (ratio 1.0320)
attn 83.362 / 83.508 (ratio 1.0019)
merge 6.698 / 5.456 (ratio 0.8110)
paired P=3000 nt=3 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 10.898 / 10.773 (ratio 0.9964)
score 4.508 / 4.565 (ratio 1.0173)
topk 6.599 / 6.578 (ratio 1.0145)
attn 124.635 / 124.799 (ratio 1.0022)
merge 16.437 / 17.208 (ratio 1.0483)
paired P=3000 nt=4 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 12.297 / 12.938 (ratio 1.0136)
score 5.734 / 5.758 (ratio 1.0054)
topk 6.440 / 6.669 (ratio 1.0348)
attn 160.836 / 160.805 (ratio 1.0007)
merge 23.490 / 22.161 (ratio 0.9434)
paired P=3000 nt=8 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 23.086 / 22.891 (ratio 1.0161)
score 10.453 / 10.437 (ratio 0.9983)
topk 6.581 / 6.625 (ratio 0.9996)
attn 315.937 / 316.089 (ratio 1.0007)
merge 46.117 / 43.852 (ratio 0.9509)
paired P=3000 nt=1984 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 971.292 / 984.625 (ratio 1.0209)
paired P=3000 nt=2048 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1007.854 / 1018.385 (ratio 1.0104)