paired P=30000 nt=1 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 7.083 / 7.135 (ratio 1.0074)
score 59.336 / 60.596 (ratio 1.0212)
topk 65.310 / 65.651 (ratio 1.0048)
attn 109.383 / 109.302 (ratio 0.9993)
merge 11.102 / 7.503 (ratio 0.6758)
paired P=30000 nt=2 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 8.917 / 8.875 (ratio 1.0035)
score 109.680 / 110.154 (ratio 1.0061)
topk 65.401 / 65.898 (ratio 1.0070)
attn 196.049 / 195.747 (ratio 0.9981)
merge 6.961 / 5.258 (ratio 0.7553)
paired P=30000 nt=3 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 11.237 / 11.180 (ratio 0.9956)
score 83.232 / 83.201 (ratio 0.9997)
topk 33.846 / 33.930 (ratio 1.0018)
attn 126.208 / 126.227 (ratio 1.0002)
merge 16.417 / 17.440 (ratio 1.0588)
paired P=30000 nt=4 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 13.438 / 13.594 (ratio 1.0116)
score 211.352 / 212.031 (ratio 1.0040)
topk 64.773 / 44.307 (ratio 0.9977)
attn 165.656 / 165.573 (ratio 0.9917)
merge 23.529 / 22.190 (ratio 0.9434)
paired P=30000 nt=8 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 24.268 / 24.477 (ratio 0.9965)
score 362.250 / 320.018 (ratio 0.9490)
topk 27.164 / 27.169 (ratio 0.9988)
attn 336.633 / 334.083 (ratio 0.9992)
merge 45.935 / 44.151 (ratio 0.9621)
paired P=30000 nt=1984 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1001.917 / 991.240 (ratio 1.0044)
paired P=30000 nt=2048 mrope=0 attn=1 (memcmp PASS), ref / candidate GPU us
prep 1038.167 / 1015.844 (ratio 1.0015)