strata metal stream: experts read from /Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/models/K512_iq2_xs/k512-iq2_xs-metal.gguf.experts (one request per expert)
strata metal: HC read in Q8_0 (STRATA_HC_Q8=0: BF16): 290 matrices, 680 MB, made in 134 ms
strata metal stream: locked 2.27 GB of active GPU dense tensors (unpinned 0.34 GB CPU token_embd + 1.28 GB skipped BF16 HC in 3.90 GB file map)
strata metal stream: 1079 dense tensors wrapped zero-copy from file (3.90 GB clean file-backed map, 133.1 ms)
strata metal: decode window on Apple M5: /Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/models/K512_iq2_xs/k512-iq2_xs-metal.gguf streamed from the SSD (experts) (3.9 GB), 32896 cells, PLE on, ready in 553 ms
strata metal: MTP map: 0.71 GB wired (mlock; 0.00 GB failed), 0.18 GB unused released
strata metal: MTP draft round in one command buffer (embedding type 23 on the GPU: max |GPU - host| 0 over 8 rows)
strata metal: MTP draft layer from /Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/models/K512_iq2_xs/mtp-q2_0.gguf (0.89 GB, 9 norms folded), draft head over 40525 tokens
strata metal stream: 0.00 GB of the host code's device weight copies given back (unused by the Metal window)
strata metal stream: 2.60 GB allocated before the arena (the process holds 2.24 GB, 5.40 GB resident); RAM 25.8 GB (12.1 GB available, 7.0 GB kept for macOS), GPU working set 19.1 GB
strata metal stream: planned resident footprint 9.6 GB decode (10.7 GB virtual peak during prefill with 1.12 GB transient prompt scratch) = arena 6.5 + 2.6 held before it + 0.5 reserved for the n-gram table; cap 18.8 GB = the lesser of the GPU working set 19.1 GB and the RAM 25.8 GB less 7.0 GB left to macOS and its file cache
strata metal stream: expert arena 6.50 GB, 4129 slots in 2 size classes, 4129 experts read from the profile's top (24576 ranked) in 1.5 s (4.13 GB/s); 8 I/O threads, read-ahead top 6; 1 buffers
strata metal stream: 6.5 GB of the arena wired (mlock) in 897 ms; macOS cannot compress it while the engine idles (STRATA_METAL_WIRE_ARENA=0 turns it off)
strata metal stream: resident footprint after the fill: the process holds 8.7 GB (10.2 GB resident), planned 9.6 GB, cap 18.8 GB
strata metal stream: prompt scratch 1.12 GB mapped in separate anonymous mmap
strata metal: prompts on the matrix units in chunks of 2048 (experts v3, QSA flash, matmul2d layout K4; 1.12 GB of buffers, in a separate transient mmap while a prompt runs)
strata metal: prompt chunk pos 0, 1983 rows: 5882 ms (embd 21 ms, ple 1 ms, graph build 63 ms)
strata metal stream: prompt scratch 1.12 GB unmapped after prefill (phys_footprint 8.89 -> 8.78 GB, resident RSS 9.52 -> 9.52 GB)
strata metal: window pos 1983 token 28 -> 16 (top 16 19.7624, 2nd 248046 19.6264, margin 0.1360) 167.18 ms (GPU 123.11 ms, 1197 dispatches)
expert stream prompts 1 chunks: 21669 distinct lookups (451.4 per layer), in the arena 0.1383, streamed ahead 0.7971, missed 0.0647; 18410 streamed in (29000.1 MB/chunk, 19751 reads); host 461.4 ms per chunk, of it waiting 398.9 ms
expert stream 1 windows: 480 distinct lookups (480.0 per window), hits 0.5146, read-ahead hits 0.3125 (5 of them late), misses 0.1729 (83.0 per window); read-aheads 228 (228.0 per window, 60 dropped); 455.8 MB read per window (311 reads); host 27.92 ms per window, of it waiting 26.75 ms (+ 1.70 ms after the GPU went on)
stream windows T=1 1 (decode): 166.84 ms each (GPU incl. the host's turns 123.11 ms)
strata metal: window pos 1984 token 16 -> 248046 (top 248046 20.9569, 2nd 15 19.4699, margin 1.4870) 69.50 ms (GPU 67.22 ms, 1197 dispatches)
strata metal: window pos 1985 token 248046 -> 198 (top 198 30.4136, 2nd 248044 13.3331, margin 17.0805) 97.21 ms (GPU 94.23 ms, 1197 dispatches)
strata metal: window pos 1988 token 248046 -> 198 (top 198 34.6470, 2nd 271 17.3126, margin 17.3344) 70.43 ms (GPU 67.19 ms, 1233 dispatches)
strata metal: window pos 1991 token 74455 -> 198 (top 198 28.0621, 2nd 248046 18.3070, margin 9.7551) 77.54 ms (GPU 73.95 ms, 1233 dispatches)
strata metal: window pos 1994 token 271 -> 248069 (top 248069 34.4544, 2nd 510 14.2772, margin 20.1772) 59.86 ms (GPU 56.30 ms, 1233 dispatches)
strata metal: window pos 1997 token 71093 -> 2164 (top 2164 23.4538, 2nd 198 16.9753, margin 6.4785) 74.07 ms (GPU 71.50 ms, 1233 dispatches)
strata metal: window pos 2000 token 90 -> 198 (top 198 21.8618, 2nd 248046 16.6073, margin 5.2545) 80.28 ms (GPU 77.56 ms, 1233 dispatches)
strata metal: window pos 2003 token 328 -> 10083 (top 10083 21.7508, 2nd 7945 21.2813, margin 0.4695) 87.67 ms (GPU 85.14 ms, 1233 dispatches)
strata metal: window pos 2004 token 10083 -> 763 (top 763 23.1994, 2nd 3147 13.6225, margin 9.5770) 104.81 ms (GPU 101.76 ms, 1233 dispatches)
strata metal: window pos 2008 token 799 -> 1534 (top 1534 23.7638, 2nd 1483 16.7971, margin 6.9667) 115.65 ms (GPU 112.35 ms, 1233 dispatches)
strata metal: window pos 2012 token 318 -> 89478 (top 89478 23.2369, 2nd 13259 17.0454, margin 6.1915) 122.15 ms (GPU 118.72 ms, 1233 dispatches)
strata metal: window pos 2016 token 11 -> 4713 (top 4713 23.7222, 2nd 14408 19.8758, margin 3.8464) 94.24 ms (GPU 91.72 ms, 1233 dispatches)
strata metal: window pos 2020 token 11 -> 14408 (top 14408 26.5939, 2nd 321 17.7990, margin 8.7950) 98.10 ms (GPU 95.57 ms, 1233 dispatches)
strata metal: window pos 2024 token 11836 -> 681 (top 681 22.5685, 2nd 11 19.3141, margin 3.2543) 105.32 ms (GPU 102.79 ms, 1233 dispatches)
strata metal: window pos 2028 token 279 -> 3274 (top 3274 24.5338, 2nd 4434 15.0477, margin 9.4860) 111.79 ms (GPU 109.05 ms, 1233 dispatches)
strata metal: window pos 2032 token 198 -> 220 (top 220 23.5962, 2nd 1 16.3865, margin 7.2098) 96.08 ms (GPU 93.34 ms, 1233 dispatches)
strata metal: window pos 2036 token 763 -> 498 (top 498 23.6984, 2nd 9774 18.6071, margin 5.0914) 94.11 ms (GPU 91.43 ms, 1233 dispatches)
strata metal: window pos 2040 token 313 -> 198 (top 198 24.4607, 2nd 328 18.3975, margin 6.0631) 102.97 ms (GPU 100.34 ms, 1233 dispatches)
strata metal: window pos 2044 token 432 -> 582 (top 582 23.2588, 2nd 39903 12.5246, margin 10.7341) 112.30 ms (GPU 108.41 ms, 1233 dispatches)
strata metal: window pos 2045 token 582 -> 53188 (top 53188 28.0282, 2nd 7206 19.4190, margin 8.6091) 98.82 ms (GPU 94.77 ms, 1233 dispatches)
strata metal: window pos 2046 token 53188 -> 763 (top 763 24.6892, 2nd 3147 15.0103, margin 9.6789) 104.58 ms (GPU 101.28 ms, 1233 dispatches)
strata metal: window pos 2050 token 359 -> 8442 (top 8442 23.6402, 2nd 95429 16.1098, margin 7.5303) 115.30 ms (GPU 110.82 ms, 1269 dispatches)
strata metal: window pos 2054 token 31361 -> 3381 (top 3381 22.9197, 2nd 1981 14.6839, margin 8.2359) 115.60 ms (GPU 111.38 ms, 1269 dispatches)
strata metal: window pos 2058 token 2502 -> 1228 (top 1228 25.2811, 2nd 18997 18.3873, margin 6.8938) 117.91 ms (GPU 114.79 ms, 1269 dispatches)
strata metal: window pos 2062 token 593 -> 2911 (top 2911 25.1616, 2nd 41490 19.8592, margin 5.3024) 121.03 ms (GPU 118.02 ms, 1269 dispatches)
strata metal: window pos 2066 token 3778 -> 976 (top 976 23.8748, 2nd 248046 17.3181, margin 6.5567) 113.67 ms (GPU 110.57 ms, 1269 dispatches)
strata metal: window pos 2070 token 5454 -> 53294 (top 53294 23.8362, 2nd 248046 16.4544, margin 7.3819) 113.94 ms (GPU 110.72 ms, 1269 dispatches)
strata metal: window pos 2074 token 33684 -> 6 (top 6 24.3685, 2nd 318 16.9675, margin 7.4010) 107.39 ms (GPU 104.40 ms, 1269 dispatches)
strata metal: window pos 2078 token 7018 -> 1152 (top 1152 24.8221, 2nd 13259 17.0250, margin 7.7970) 94.28 ms (GPU 89.86 ms, 1269 dispatches)
strata metal: window pos 2080 token 1331 -> 25 (top 25 24.1473, 2nd 314 14.1257, margin 10.0216) 107.73 ms (GPU 103.51 ms, 1269 dispatches)
strata metal: window pos 2084 token 471 -> 66 (top 66 26.1635, 2nd 248046 16.1265, margin 10.0370) 104.44 ms (GPU 101.47 ms, 1269 dispatches)
strata metal: window pos 2088 token 2911 -> 80334 (top 80334 26.8637, 2nd 14 16.2198, margin 10.6438) 91.60 ms (GPU 87.80 ms, 1269 dispatches)
strata metal: window pos 2090 token 53294 -> 3778 (top 3778 24.5964, 2nd 13 13.7553, margin 10.8411) 93.13 ms (GPU 87.37 ms, 1269 dispatches)
strata metal: window pos 2092 token 8 -> 5639 (top 5639 25.4322, 2nd 248046 17.5445, margin 7.8877) 103.67 ms (GPU 100.65 ms, 1269 dispatches)
strata metal: window pos 2096 token 1627 -> 359 (top 359 23.6442, 2nd 7018 23.0138, margin 0.6305) 81.09 ms (GPU 77.83 ms, 1269 dispatches)
strata metal: window pos 2098 token 4277 -> 593 (top 593 22.6791, 2nd 7658 18.9420, margin 3.7372) 96.27 ms (GPU 93.49 ms, 1269 dispatches)
strata metal: window pos 2102 token 11836 -> 12091 (top 12091 23.7703, 2nd 318 17.5935, margin 6.1768) 98.68 ms (GPU 96.06 ms, 1269 dispatches)
strata metal: window pos 2106 token 18997 -> 471 (top 471 24.9212, 2nd 248046 14.8304, margin 10.0908) 83.35 ms (GPU 80.27 ms, 1269 dispatches)
strata metal: window pos 2108 token 16 -> 593 (top 593 24.9663, 2nd 49 15.3718, margin 9.5945) 84.12 ms (GPU 81.30 ms, 1269 dispatches)
STRATA_RESULT init_ms=3523.84 prompt_tokens=1984 prefill_ms=6219.43 prefill_tok_s=319.00 decode_tokens=127 decode_ms=3997.56 decode_tok_s=31.77 decode_ms_per_tok=31.48
STRATA_SPEC rounds=39 drafted=99 accepted=88 accept_pct=88.9 tok_per_round=3.26 mtp_ms=253.96
GEN_IDS: 16 248046 198 248045 248046 198 248045 74455 198 248068 271 248069 271 71093 2164 198 90 198 220 328 10083 763 328 6516 799 1534 57287 18944 318 89478 11 1331 11 4713 2552 52186 11 14408 314 7658 11836 681 1179 1804 279 3274 4434 10152 198 220 328 23508 763 498 198 262 313 198 406 328 432 582 53188 763 328 2949 359 8442 64697 43681 31361 3381 1981 6 2502 1228 471 69 593 2911 80334 53294 3778 976 1627 359 5454 53294 3778 25 33684 6 2502 1627 7018 1152 1331 25 4771 23277 471 66 361 593 2911 80334 53294 3778 8 5639 2037 2502 1627 359 4277 593 2911 76644 11836 12091 6 2502 18997 471 16 593 2911 76644
expert stream 39 windows: 42631 distinct lookups (1093.1 per window), hits 0.8959, read-ahead hits 0.0405 (181 of them late), misses 0.0635 (69.5 per window); read-aheads 5239 (134.3 per window, 0 dropped); 297.4 MB read per window (7948 reads); host 25.40 ms per window, of it waiting 24.44 ms (+ 1.54 ms after the GPU went on)
stream windows T=1 1 (decode): 69.27 ms each (GPU incl. the host's turns 67.22 ms)
stream windows T=3 15 (decode): 85.32 ms each (GPU incl. the host's turns 82.23 ms)
stream windows T=4 23 (decode): 106.85 ms each (GPU incl. the host's turns 104.10 ms)