strata metal stream: experts read from /Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/models/K512_iq2_xs/k512-iq2_xs-metal.gguf.experts (one request per expert)
strata metal: HC read in Q8_0 (STRATA_HC_Q8=0: BF16): 290 matrices, 680 MB, made in 153 ms
strata metal stream: locked 2.27 GB of active GPU dense tensors (unpinned 0.34 GB CPU token_embd + 1.28 GB skipped BF16 HC in 3.90 GB file map)
strata metal stream: 1079 dense tensors wrapped zero-copy from file (3.90 GB clean file-backed map, 172.7 ms)
strata metal: decode window on Apple M5: /Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/models/K512_iq2_xs/k512-iq2_xs-metal.gguf streamed from the SSD (experts) (3.9 GB), 32896 cells, PLE on, ready in 674 ms
strata metal: MTP map: 0.71 GB wired (mlock; 0.00 GB failed), 0.18 GB unused released
strata metal: MTP draft round in one command buffer (embedding type 23 on the GPU: max |GPU - host| 0 over 8 rows)
strata metal: MTP draft layer from /Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/models/K512_iq2_xs/mtp-q2_0.gguf (0.89 GB, 9 norms folded), draft head over 40525 tokens
strata metal stream: 0.00 GB of the host code's device weight copies given back (unused by the Metal window)
strata metal stream: 2.60 GB allocated before the arena (the process holds 2.24 GB, 5.40 GB resident); RAM 25.8 GB (12.1 GB available, 7.0 GB kept for macOS), GPU working set 19.1 GB
strata metal stream: planned resident footprint 9.6 GB decode (10.7 GB virtual peak during prefill with 1.12 GB transient prompt scratch) = arena 6.5 + 2.6 held before it + 0.5 reserved for the n-gram table; cap 18.8 GB = the lesser of the GPU working set 19.1 GB and the RAM 25.8 GB less 7.0 GB left to macOS and its file cache
strata metal stream: expert arena 6.50 GB, 4129 slots in 2 size classes, 4129 experts read from the profile's top (24576 ranked) in 1.9 s (3.25 GB/s); 8 I/O threads, read-ahead top 6; 1 buffers
strata metal stream: 6.5 GB of the arena wired (mlock) in 888 ms; macOS cannot compress it while the engine idles (STRATA_METAL_WIRE_ARENA=0 turns it off)
strata metal stream: resident footprint after the fill: the process holds 8.7 GB (9.8 GB resident), planned 9.6 GB, cap 18.8 GB
strata metal stream: prompt scratch 1.12 GB mapped in separate anonymous mmap
strata metal: prompts on the matrix units in chunks of 2048 (experts v3, QSA flash, matmul2d layout K4; 1.12 GB of buffers, in a separate transient mmap while a prompt runs)
strata metal: prompt chunk pos 0, 2048 rows: 4799 ms (embd 20 ms, ple 0 ms, graph build 54 ms)
strata metal: prompt chunk pos 2048, 2048 rows: 4564 ms (embd 7 ms, ple 0 ms, graph build 1 ms)
strata metal: prompt chunk pos 4096, 2048 rows: 4646 ms (embd 6 ms, ple 0 ms, graph build 2 ms)
strata metal: prompt chunk pos 6144, 2048 rows: 4838 ms (embd 4 ms, ple 0 ms, graph build 1 ms)
strata metal: prompt chunk pos 8192, 1987 rows: 4882 ms (embd 4 ms, ple 0 ms, graph build 1 ms)
strata metal stream: prompt scratch 1.12 GB unmapped after prefill (phys_footprint 8.89 -> 8.79 GB, resident RSS 9.61 -> 9.53 GB)
strata metal: window pos 10179 token 198 -> 760 (top 760 23.8239, 2nd 35 23.7743, margin 0.0496) 160.61 ms (GPU 118.47 ms, 1233 dispatches)
expert stream prompts 5 chunks: 82802 distinct lookups (345.0 per layer), in the arena 0.1981, streamed ahead 0.6932, missed 0.1088; 66194 streamed in (21984.8 MB/chunk, 74964 reads); host 480.0 ms per chunk, of it waiting 445.9 ms
expert stream 1 windows: 480 distinct lookups (480.0 per window), hits 0.5417, read-ahead hits 0.2875 (4 of them late), misses 0.1708 (82.0 per window); read-aheads 176 (176.0 per window, 235 dropped); 375.2 MB read per window (258 reads); host 26.58 ms per window, of it waiting 25.73 ms (+ 1.32 ms after the GPU went on)
stream windows T=1 1 (decode): 160.34 ms each (GPU incl. the host's turns 118.47 ms)
strata metal: window pos 10180 token 760 -> 1156 (top 1156 29.0186, 2nd 6353 15.3183, margin 13.7003) 92.91 ms (GPU 89.53 ms, 1233 dispatches)
strata metal: window pos 10183 token 33362 -> 11 (top 11 27.0843, 2nd 13 19.1119, margin 7.9724) 88.00 ms (GPU 85.02 ms, 1269 dispatches)
strata metal: window pos 10186 token 8523 -> 728 (top 728 26.5949, 2nd 279 17.2821, margin 9.3128) 79.03 ms (GPU 76.25 ms, 1269 dispatches)
strata metal: window pos 10188 token 13 -> 2838 (top 2838 22.9993, 2nd 2302 20.3597, margin 2.6395) 53.14 ms (GPU 50.53 ms, 1269 dispatches)
strata metal: window pos 10189 token 2838 -> 579 (top 579 24.7598, 2nd 42315 19.9055, margin 4.8543) 62.31 ms (GPU 60.03 ms, 1233 dispatches)
strata metal: window pos 10191 token 5315 -> 1292 (top 1292 22.6356, 2nd 15131 21.4028, margin 1.2328) 62.35 ms (GPU 59.18 ms, 1269 dispatches)
strata metal: window pos 10193 token 37444 -> 685 (top 685 25.6466, 2nd 321 15.4891, margin 10.1575) 67.21 ms (GPU 64.21 ms, 1269 dispatches)
strata metal: window pos 10196 token 9859 -> 1092 (top 1092 23.8715, 2nd 62431 16.8946, margin 6.9769) 60.54 ms (GPU 58.23 ms, 1269 dispatches)
strata metal: window pos 10199 token 2908 -> 978 (top 978 27.4026, 2nd 2725 16.9151, margin 10.4874) 59.16 ms (GPU 56.94 ms, 1269 dispatches)
strata metal: window pos 10202 token 13 -> 1061 (top 1061 21.7433, 2nd 2532 20.4921, margin 1.2513) 61.83 ms (GPU 60.27 ms, 1269 dispatches)
strata metal: window pos 10205 token 264 -> 15855 (top 15855 26.3293, 2nd 3471 19.5190, margin 6.8104) 73.30 ms (GPU 71.74 ms, 1269 dispatches)
strata metal: window pos 10207 token 40719 -> 13 (top 13 21.3241, 2nd 11 20.2257, margin 1.0984) 59.08 ms (GPU 55.78 ms, 1269 dispatches)
strata metal: window pos 10208 token 13 -> 353 (top 353 23.4751, 2nd 6558 22.0544, margin 1.4206) 62.02 ms (GPU 59.79 ms, 1269 dispatches)
STRATA_RESULT init_ms=4106.98 prompt_tokens=10180 prefill_ms=24080.38 prefill_tok_s=422.75 decode_tokens=31 decode_ms=920.70 decode_tok_s=33.67 decode_ms_per_tok=29.70
STRATA_SPEC rounds=13 drafted=23 accepted=18 accept_pct=78.3 tok_per_round=2.38 mtp_ms=115.79
GEN_IDS: 760 1156 369 33362 11 852 8523 728 13 2838 579 5315 1292 37444 685 321 9859 1092 353 2908 978 3604 13 1061 369 264 15855 40719 13 353 1220 5707
expert stream 13 windows: 11692 distinct lookups (899.4 per window), hits 0.8885, read-ahead hits 0.0457 (78 of them late), misses 0.0659 (59.2 per window); read-aheads 1303 (100.2 per window, 0 dropped); 232.8 MB read per window (2073 reads); host 18.28 ms per window, of it waiting 17.66 ms (+ 0.95 ms after the GPU went on)
stream windows T=1 1 (decode): 52.89 ms each (GPU incl. the host's turns 50.53 ms)
stream windows T=2 1 (decode): 58.85 ms each (GPU incl. the host's turns 55.78 ms)
stream windows T=3 11 (decode): 69.65 ms each (GPU incl. the host's turns 67.38 ms)