=== Phase 0 Hardware Microbench: 13" MacBook Air M5 ===
Creating 4.0 GiB uncached benchmark file at /tmp/flash_next_ssd_bench.bin ...
Wrote 4.0 GiB uncached in 1.37 s (3.13 GB/s)
1. Seq 4 MiB reads (F_NOCACHE=1, SSD ceiling) | th=1 | 1073.7 MB | med 5.56 GB/s (min 4.75, max 5.84)
1b. Seq 4 MiB reads (F_NOCACHE=1, 4 threads) | th=4 | 1073.7 MB | med 7.08 GB/s (min 7.03, max 7.10)
2a. Prefill 3x512 KiB/exp (std GGUF) | th=1 | 1509.9 MB | med 2.40 GB/s (min 2.29, max 2.43)
2b. Prefill 3x512 KiB/exp (std GGUF) | th=4 | 1509.9 MB | med 7.13 GB/s (min 7.11, max 7.14)
2c. Prefill 3x512 KiB/exp (std GGUF) | th=8 | 1509.9 MB | med 7.12 GB/s (min 2.46, max 7.13)
3a. Prefill 1x1.5 MiB/exp (experts' copy) | th=1 | 1509.9 MB | med 3.95 GB/s (min 3.83, max 4.02)
3b. Prefill 1x1.5 MiB/exp (experts' copy) | th=4 | 1509.9 MB | med 6.77 GB/s (min 6.64, max 6.82)
3c. Prefill 1x1.5 MiB/exp (experts' copy) | th=8 | 1509.9 MB | med 6.80 GB/s (min 6.61, max 6.87)
4a. Decode 3x512 KiB random (std GGUF) | th=1 | 453.0 MB | med 2.29 GB/s (min 2.18, max 2.44)
4b. Decode 3x512 KiB random (std GGUF) | th=4 | 453.0 MB | med 7.10 GB/s (min 6.59, max 7.13)
4c. Decode 3x512 KiB random (std GGUF) | th=8 | 453.0 MB | med 7.10 GB/s (min 6.71, max 7.13)
5a. Decode 1x1.5 MiB random (experts' copy) | th=1 | 453.0 MB | med 4.05 GB/s (min 3.62, max 4.24)
5b. Decode 1x1.5 MiB random (experts' copy) | th=4 | 453.0 MB | med 6.71 GB/s (min 6.67, max 6.84)
5c. Decode 1x1.5 MiB random (experts' copy) | th=8 | 453.0 MB | med 6.85 GB/s (min 6.74, max 6.88)
6a. PLE 4 KiB random reads (1 thread) | th=1 | 16.8 MB | med 0.04 GB/s (min 0.04, max 0.05)
6b. PLE 4 KiB random reads (8 threads) | th=8 | 16.8 MB | med 0.33 GB/s (min 0.32, max 0.38)
=== Metal GPU Benchmark ===
Device: Apple M5 | unifiedMemory=1 | recMaxWorkingSet=17.76 GiB
FP16 GEMM M= 512 K=2560 N=2560 | med 12.60 TFLOP/s (min 11.71, max 13.12)
FP16 GEMM M= 512 K=2560 N=4096 | med 13.11 TFLOP/s (min 12.68, max 13.19)
FP16 GEMM M=1024 K=2560 N=2560 | med 13.66 TFLOP/s (min 13.22, max 13.76)
FP16 GEMM M=1024 K=2560 N=4096 | med 13.58 TFLOP/s (min 13.43, max 13.65)
FP16 GEMM M=4096 K=2560 N=2560 | med 14.07 TFLOP/s (min 13.99, max 14.08)
FP16 GEMM M=4096 K=2560 N=4096 | med 14.03 TFLOP/s (min 13.96, max 14.08)