paired P=3000 nt=1 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 7.315 / 7.289 (ratio 1.0028)
score 6.859 / 6.810 (ratio 0.9924)
topk 15.482 / 15.500 (ratio 1.0005)
attn 86.906 / 86.859 (ratio 0.9996)
merge 8.078 / 5.469 (ratio 0.6769)
paired P=3000 nt=2 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 8.906 / 8.742 (ratio 0.9894)
score 3.458 / 3.456 (ratio 0.9985)
topk 6.732 / 6.750 (ratio 1.0015)
attn 82.930 / 83.094 (ratio 1.0013)
merge 6.661 / 5.469 (ratio 0.8210)
paired P=3000 nt=3 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 10.706 / 10.664 (ratio 1.0144)
score 13.659 / 13.661 (ratio 0.9979)
topk 6.612 / 6.555 (ratio 0.9831)
attn 124.562 / 124.687 (ratio 1.0006)
merge 16.391 / 17.211 (ratio 1.0551)
paired P=3000 nt=4 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 13.273 / 13.461 (ratio 1.0035)
score 10.508 / 10.500 (ratio 0.9993)
topk 6.544 / 6.638 (ratio 1.0048)
attn 160.992 / 160.945 (ratio 0.9996)
merge 23.477 / 22.227 (ratio 0.9452)
paired P=3000 nt=8 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 24.237 / 24.201 (ratio 1.0000)
score 12.984 / 12.990 (ratio 0.9994)
topk 6.706 / 6.724 (ratio 1.0194)
attn 316.211 / 316.211 (ratio 1.0001)
merge 45.961 / 44.016 (ratio 0.9569)
paired P=3000 nt=1984 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 978.250 / 996.896 (ratio 1.0102)
paired P=3000 nt=2048 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1008.271 / 1018.385 (ratio 1.0100)