.........[strata] done: 12 tokens in 0 s (185725.6 tok/s) (stop, cancel=False)
..[strata] other apps now use the Chat settings: temperature=0.5
.[strata] done: 12 tokens in 0 s (299593.1 tok/s) (stop, cancel=False)
.....[strata] done: 12 tokens in 0 s (324720.3 tok/s) (stop, cancel=False)
.[strata] other apps now use the Chat settings: temperature=0.5
[strata] other apps now use the Chat settings: temperature=0.5
[strata] other apps now use the Chat settings: temperature=0.5
..[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
.[strata] done: 1 tokens in 0 s (47662.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) + max tokens (1) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 1 tokens in 0 s (99864.4 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] done: 1 tokens in 0 s (91180.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) + max tokens (1) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 1 tokens in 0 s (91180.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] done: 1 tokens in 0 s (43240.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 1 tokens in 0 s (58254.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
....sssss....[strata] 400 invalid request: unknown reasoning effort 'huge': use none, low, medium or high
.[strata] done: 24 tokens in 0 s (241979.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (333322.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (342392.2 tok/s) (stop, cancel=False)
[strata] thinking capped at 25 of max_tokens 50 to leave room for the answer (budget 500)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] thinking capped at 25 of max_tokens 50 to leave room for the answer (budget 2047)
[strata] done: 24 tokens in 0 s (375609.3 tok/s) (stop, cancel=False)
[strata] thinking capped at 25 of max_tokens 50 to leave room for the answer (budget 2048)
[strata] done: 24 tokens in 0 s (381300.4 tok/s) (stop, cancel=False)
[strata] thinking capped at 25 of max_tokens 50 to leave room for the answer (budget 8191)
[strata] done: 24 tokens in 0 s (375609.3 tok/s) (stop, cancel=False)
[strata] thinking capped at 25 of max_tokens 50 to leave room for the answer (budget 8192)
[strata] done: 24 tokens in 0 s (327893.5 tok/s) (stop, cancel=False)
[strata] thinking capped at 25 of max_tokens 50 to leave room for the answer (budget 31999)
[strata] done: 24 tokens in 0 s (370085.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (351969.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (343560.7 tok/s) (stop, cancel=False)
.[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (375609.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (387166.5 tok/s) (stop, cancel=False)
[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (276547.5 tok/s) (stop, cancel=False)
[strata] thinking limited to 6114 of max_tokens 8152 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (394758.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (374213.0 tok/s) (stop, cancel=False)
[strata] thinking limited to 6114 of max_tokens 8152 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (305040.3 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (405900.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (385683.1 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (311651.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (381300.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (379861.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (324720.3 tok/s) (stop, cancel=False)
.[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (387166.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (387166.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (399457.5 tok/s) (stop, cancel=False)
[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (409200.4 tok/s) (stop, cancel=False)
[strata] thinking limited to 6114 of max_tokens 8152 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (405900.4 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (405900.4 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (388661.4 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (399457.5 tok/s) (stop, cancel=False)
[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (394758.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (388661.4 tok/s) (stop, cancel=False)
.[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (391686.0 tok/s) (stop, cancel=False)
[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (401049.0 tok/s) (stop, cancel=False)
[strata] thinking limited to 6114 of max_tokens 8152 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (407543.7 tok/s) (stop, cancel=False)
[strata] thinking limited to 6114 of max_tokens 8152 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (387166.5 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (387166.5 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (391686.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (387166.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (391686.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (391686.0 tok/s) (stop, cancel=False)
.[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (292625.9 tok/s) (stop, cancel=False)
[strata] thinking limited to 6114 of max_tokens 8152 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (311651.1 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (306900.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (296941.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (328965.0 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (285975.3 tok/s) (stop, cancel=False)
.[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (399457.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (381300.4 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (315558.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (401049.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (387166.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (333322.2 tok/s) (stop, cancel=False)
.[strata] thinking limited to 5964 of max_tokens 7951 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (371451.3 tok/s) (stop, cancel=False)
[strata] thinking limited to 6073 of max_tokens 8097 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (385683.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (351969.6 tok/s) (stop, cancel=False)
.[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (381300.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (347114.8 tok/s) (stop, cancel=False)
[strata] thinking capped at 25 of max_tokens 50 to leave room for the answer (budget 20000)
[strata] done: 24 tokens in 0 s (368730.0 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (303202.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (370085.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (381300.4 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (113232.1 tok/s) (stop, cancel=False)
[strata] thinking limited to 6005 of max_tokens 8006 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (139422.8 tok/s) (stop, cancel=False)
[strata] thinking limited to 6114 of max_tokens 8152 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (133860.8 tok/s) (stop, cancel=False)
[strata] thinking limited to 5952 of max_tokens 7935 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (150919.5 tok/s) (stop, cancel=False)
.[strata] thinking limited to 5266 of max_tokens 7021 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] thinking limited to 5213 of max_tokens 6950 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (393216.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (381300.4 tok/s) (stop, cancel=False)
.................[strata] the engine stopped unexpectedly (exit code -15). Unrecoverable native verification failure: verify: timed out at layer 18; its GPU waits were released and the GPU finished (#267) The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -15); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (20068.4 tok/s) (length, cancel=False)
...[strata] the engine stopped unexpectedly (exit code -15). Unrecoverable native verification failure: verify: timed out at layer 18; its GPU waits were released and the GPU finished (#267) The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -15); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (27060.0 tok/s) (length, cancel=False)
................................[strata] image: 512x768, n=2, 8 steps, seed 11
/Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/vendor/strata/serve/server.py:5726: ResourceWarning: unclosed file <_io.TextIOWrapper name=11 encoding='UTF-8'>
images, figures = gen.run(job, cancel)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
[strata] image done in 0.2 s (keep)
.[strata] 400 invalid request: size 999x999: each side a multiple of 32 from 256 to 2048
[strata] image: 1024x1024, n=1, 8 steps, seed 1390336375
[strata] image job failed: sd-cli exited with code 1
[INFO ] loading tensors completed, taking 0.10s
[ERROR] ggml_vulkan: ErrorDeviceLost
/Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/vendor/strata/serve/server.py:5730: ResourceWarning: unclosed file <_io.TextIOWrapper name=11 encoding='UTF-8'>
return
ResourceWarning: Enable tracemalloc to get the object allocation traceback
.[strata] image: 1024x1024, n=1, 8 steps, seed 320404728
/Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/vendor/strata/serve/server.py:5726: ResourceWarning: unclosed file <_io.TextIOWrapper name=11 encoding='UTF-8'>
images, figures = gen.run(job, cancel)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
[strata] image done in 1.6 s (keep)
[strata] done: 8 tokens in 0 s (127100.1 tok/s) (length, cancel=False)
...[strata] image: 1024x1024, n=1, 8 steps, seed 0
/Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/vendor/strata/serve/server.py:5726: ResourceWarning: unclosed file <_io.TextIOWrapper name=11 encoding='UTF-8'>
images, figures = gen.run(job, cancel)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
[strata] image done in 0.3 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 1
/Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/vendor/strata/serve/server.py:5726: ResourceWarning: unclosed file <_io.TextIOWrapper name=9 encoding='UTF-8'>
images, figures = gen.run(job, cancel)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
[strata] image done in 0.3 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 2
[strata] image done in 0.3 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 3
/Users/dawn/proj/swift1.5-qwen3.8-next-flash-ps-scr-qat-persona/vendor/strata/serve/server.py:5726: ResourceWarning: unclosed file <_io.TextIOWrapper name=9 encoding='UTF-8'>
images, figures = gen.run(job, cancel)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
[strata] image done in 0.3 s (keep)
.[strata] image job: the conversation (123 tokens) saved; unloading the model
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] the conversation from before the image job is back (123 tokens)
...[strata] image job: the engine's expert cache gave VRAM back (9000 MiB free)
.[strata] image job: the conversation (123 tokens) saved; unloading the model
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] the conversation from before the image job is back (123 tokens)
.........[strata] done: 3 tokens in 0 s (73584.3 tok/s) (stop, cancel=False)
F[strata] loading the model again (it was unloaded) ...
.[strata] model unloaded; the next request loads it again
.....[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 7 tokens in 0 s (132252.8 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (248814.6 tok/s) (stop, cancel=False)
[strata] model unloaded; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 7 tokens in 0 s (105993.2 tok/s) (stop, cancel=False)
.[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
....[strata] 400 invalid request: logit_bias: expected an object or a list of [token_id, bias] pairs
[strata] 400 invalid request: logit_bias: this engine does not support token biases; use a supporting CUDA/HIP build
[strata] 400 invalid request: logit_bias: biases must be finite numbers between -100 and 100; false is a pair-list ban
..........[strata] MCP server 'missing' did not start: could not start 'strata-no-such-program': [Errno 2] No such file or directory: 'strata-no-such-program'. Its tools are left out; the chat works without them.
[strata] MCP server 'paged': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
...[strata] MCP server 'solo': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'solo' had stopped; starting it again
[strata] MCP server 'solo': 6 tools (echo, fail, sleep, big, die, add)
........[strata] MCP server 'down' did not start: could not reach http://127.0.0.1:9/mcp: <urlopen error [Errno 61] Connection refused>. Its tools are left out; the chat works without them.
[strata] MCP server 'web': 6 tools (echo, fail, sleep, big, die, add)
..[strata] thinking limited to 5955 of max_tokens 7939 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 13 tokens in 0 s (117008.5 tok/s) (stop, cancel=False)
.[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 400: 'Bad Request'>
_warnings.warn(self.warn_message, ResourceWarning)
[strata] thinking limited to 4660 of max_tokens 6213 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 83 tokens in 0 s (113065.0 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 401: 'Unauthorized'>
_warnings.warn(self.warn_message, ResourceWarning)
.[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] thinking limited to 4660 of max_tokens 6213 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 120 tokens in 0 s (142139.6 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 5 characters in 0.0 s
[strata] thinking limited to 4520 of max_tokens 6026 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 120 tokens in 0 s (170211.9 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 5 characters in 0.0 s
[strata] thinking limited to 4380 of max_tokens 5839 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 120 tokens in 0 s (183491.2 tok/s) (stop, cancel=False)
.[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] thinking limited to 4660 of max_tokens 6213 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 141 tokens in 0 s (122493.1 tok/s) (stop, cancel=False)
[strata] tool fake__add: ok, 1 characters in 0.0 s
[strata] thinking limited to 4507 of max_tokens 6009 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 13 tokens in 0 s (288497.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] refused an API request from the web page 'http://evil.example' (no API key; add its host to "allowed_hosts" or its origin to "cors_origins" in the config)
[strata] thinking limited to 4660 of max_tokens 6213 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 13 tokens in 0 s (175324.6 tok/s) (stop, cancel=False)
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 415: 'Unsupported Media Type'>
_warnings.warn(self.warn_message, ResourceWarning)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] thinking limited to 4590 of max_tokens 6119 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 109 tokens in 0 s (144357.2 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] thinking limited to 5949 of max_tokens 7932 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 116 tokens in 0 s (108699.6 tok/s) (stop, cancel=False)
[strata] thinking limited to 5949 of max_tokens 7932 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 16 tokens in 0 s (141579.9 tok/s) (stop, cancel=False)
[strata] thinking limited to 5949 of max_tokens 7932 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 16 tokens in 0 s (188508.0 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] thinking limited to 4665 of max_tokens 6220 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 120 tokens in 0 s (107408.6 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] thinking limited to 4660 of max_tokens 6213 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 134 tokens in 0 s (152272.2 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 19 characters in 0.0 s
[strata] thinking limited to 4499 of max_tokens 5998 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 31 tokens in 0 s (144150.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] thinking limited to 4660 of max_tokens 6213 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 84 tokens in 0 s (149225.6 tok/s) (stop, cancel=False)
[strata] tool fake__fail: error, 27 characters in 0.0 s
[strata] thinking limited to 4530 of max_tokens 6040 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 21 tokens in 0 s (164023.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] thinking limited to 4660 of max_tokens 6213 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 115 tokens in 0 s (146922.0 tok/s) (stop, cancel=False)
[strata] tool fake__big: ok, 3,000 characters in 0.0 s (truncated for the model)
[strata] thinking limited to 4090 of max_tokens 5453 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 16 tokens in 0 s (211034.2 tok/s) (stop, cancel=False)
.[strata] done: 8 tokens in 0 s (147816.9 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 8 tokens in 0 s (209715.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 8 tokens in 0 s (229824.9 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 8 tokens in 0 s (215092.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 8 tokens in 0 s (268435.5 tok/s) (length, cancel=False)
.[strata] done: 8 tokens in 0 s (228261.4 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 8 tokens in 0 s (286790.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
..[strata] done: 8 tokens in 0 s (250406.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] thinking limited to 2882 of max_tokens 3842 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 24 tokens in 0 s (292625.9 tok/s) (stop, cancel=False)
....[strata] 400 invalid request: request exceeds the context window: prompt (183 tokens) + max tokens (20000) exceeds the context (16384); requests are never truncated. Send a smaller max_tokens (at most 16193 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] thinking capped at 128 of max_tokens 256 to leave room for the answer (budget 1024)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] thinking capped at 128 of max_tokens 256 to leave room for the answer (budget 1024)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] thinking limited to 12098 of max_tokens 16130 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 50 tokens in 0 s (252364.9 tok/s) (stop, cancel=False)
.[strata] done: 50 tokens in 0 s (246144.6 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (112087.2 tok/s) (stop, cancel=False)
[strata] thinking capped at 128 of max_tokens 256 to leave room for the answer (budget 1024)
[strata] done: 50 tokens in 0 s (264458.0 tok/s) (stop, cancel=False)
[strata] thinking capped at 128 of max_tokens 256 to leave room for the answer (budget 1024)
[strata] done: 50 tokens in 0 s (111610.0 tok/s) (stop, cancel=False)
..[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 50 tokens in 0 s (253585.5 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (170777.9 tok/s) (stop, cancel=False)
.[strata] thinking limited to 2879 of max_tokens 3838 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 7 tokens in 0 s (180123.5 tok/s) (stop, cancel=False)
..[strata] "parallel" must be a whole number of requests (2..8), not '4': ignored
[strata] "parallel" must be a whole number of requests (2..8), not True: ignored
[strata] "parallel": 12 - the engine runs at most 8 requests together; it will use 8
.[strata] answering: 6 of max 8 tokens, 6.0 tok/s, 1 s
[strata] answering: 5 of max 8 tokens, 8.1 tok/s, 1 s
[strata] done: 8 tokens in 1 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 1 s so far
[strata] done: 8 tokens in 2 s (6.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] answering: 7 of max 8 tokens, 6.1 tok/s, 3 s
[strata] done: 8 tokens in 3 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] answering: 8 of max 8 tokens, 6.3 tok/s, 3 s
[strata] done: 8 tokens in 3 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] answering: 7 of max 8 tokens, 6.9 tok/s, 4 s
[strata] done: 8 tokens in 4 s (7.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] answering: 8 of max 8 tokens, 7.6 tok/s, 4 s
[strata] done: 8 tokens in 4 s (7.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] answering: 6 of max 8 tokens, 5.3 tok/s, 5 s
[strata] answering: 7 of max 8 tokens, 7.0 tok/s, 5 s
[strata] done: 8 tokens in 5 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 6 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 6 s so far
[strata] answering: 6 of max 8 tokens, 5.7 tok/s, 6 s
[strata] done: 8 tokens in 7 s (6.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] answering: 8 of max 8 tokens, 5.8 tok/s, 7 s
[strata] done: 8 tokens in 7 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 7 s so far
[strata] answering: 7 of max 8 tokens, 6.2 tok/s, 8 s
[strata] done: 8 tokens in 8 s (6.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] answering: 8 of max 8 tokens, 7.5 tok/s, 8 s
[strata] done: 8 tokens in 8 s (7.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] answering: 8 of max 8 tokens, 7.5 tok/s, 9 s
[strata] done: 8 tokens in 9 s (7.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 9 s so far
[strata] answering: 8 of max 8 tokens, 7.0 tok/s, 9 s
[strata] done: 8 tokens in 9 s (7.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 9 s so far
[strata] answering: 6 of max 8 tokens, 5.4 tok/s, 10 s
[strata] answering: 7 of max 8 tokens, 6.9 tok/s, 10 s
[strata] done: 8 tokens in 10 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 10 s so far
[strata] done: 8 tokens in 11 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 11 s so far
[strata] answering: 6 of max 8 tokens, 5.4 tok/s, 12 s
[strata] done: 8 tokens in 12 s (5.8 tok/s) (length, cancel=False)
[strata] answering: 7 of max 8 tokens, 6.9 tok/s, 12 s
[strata] reading the prompt: 32 of 46 tokens, 12 s so far
[strata] done: 8 tokens in 12 s (6.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 12 s so far
[strata] answering: 7 of max 8 tokens, 6.4 tok/s, 13 s
[strata] done: 8 tokens in 13 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 13 s so far
[strata] answering: 8 of max 8 tokens, 6.7 tok/s, 13 s
[strata] done: 8 tokens in 13 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 14 s so far
[strata] answering: 7 of max 8 tokens, 6.4 tok/s, 14 s
[strata] done: 8 tokens in 14 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 14 s so far
[strata] answering: 8 of max 8 tokens, 6.4 tok/s, 15 s
[strata] done: 8 tokens in 15 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 15 s so far
[strata] answering: 6 of max 8 tokens, 5.7 tok/s, 16 s
[strata] done: 8 tokens in 16 s (6.0 tok/s) (length, cancel=False)
[strata] answering: 7 of max 8 tokens, 6.7 tok/s, 16 s
[strata] reading the prompt: 32 of 46 tokens, 16 s so far
[strata] done: 8 tokens in 16 s (5.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 16 s so far
[strata] answering: 6 of max 8 tokens, 5.7 tok/s, 17 s
[strata] answering: 7 of max 8 tokens, 7.0 tok/s, 17 s
[strata] done: 8 tokens in 17 s (5.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 17 s so far
[strata] done: 8 tokens in 18 s (5.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 18 s so far
[strata] answering: 6 of max 8 tokens, 5.5 tok/s, 18 s
[strata] done: 8 tokens in 19 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 19 s so far
[strata] answering: 8 of max 8 tokens, 5.9 tok/s, 19 s
[strata] done: 8 tokens in 19 s (5.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 19 s so far
[strata] answering: 6 of max 8 tokens, 5.8 tok/s, 20 s
[strata] done: 8 tokens in 20 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 20 s so far
[strata] answering: 8 of max 8 tokens, 6.3 tok/s, 20 s
[strata] done: 8 tokens in 20 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 20 s so far
[strata] answering: 6 of max 8 tokens, 6.0 tok/s, 21 s
[strata] done: 8 tokens in 21 s (6.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 22 s so far
[strata] answering: 8 of max 8 tokens, 6.5 tok/s, 22 s
[strata] done: 8 tokens in 22 s (6.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 22 s so far
[strata] answering: 7 of max 8 tokens, 6.9 tok/s, 23 s
[strata] done: 8 tokens in 23 s (6.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 23 s so far
[strata] answering: 8 of max 8 tokens, 6.1 tok/s, 23 s
[strata] done: 8 tokens in 23 s (6.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 23 s so far
[strata] answering: 6 of max 8 tokens, 5.7 tok/s, 24 s
[strata] done: 8 tokens in 24 s (6.0 tok/s) (length, cancel=False)
[strata] answering: 7 of max 8 tokens, 6.9 tok/s, 24 s
[strata] reading the prompt: 32 of 46 tokens, 24 s so far
[strata] done: 8 tokens in 24 s (5.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 25 s so far
[strata] answering: 6 of max 8 tokens, 6.0 tok/s, 25 s
[strata] done: 8 tokens in 25 s (6.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 26 s so far
[strata] answering: 8 of max 8 tokens, 6.5 tok/s, 26 s
[strata] done: 8 tokens in 26 s (6.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 26 s so far
[strata] answering: 7 of max 8 tokens, 6.7 tok/s, 27 s
[strata] done: 8 tokens in 27 s (6.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 27 s so far
[strata] answering: 8 of max 8 tokens, 6.3 tok/s, 27 s
[strata] done: 8 tokens in 27 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 27 s so far
[strata] answering: 6 of max 8 tokens, 5.6 tok/s, 28 s
[strata] done: 8 tokens in 28 s (6.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 28 s so far
[strata] answering: 8 of max 8 tokens, 6.6 tok/s, 28 s
[strata] done: 8 tokens in 28 s (6.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 28 s so far
[strata] answering: 7 of max 8 tokens, 6.7 tok/s, 29 s
[strata] done: 8 tokens in 29 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 29 s so far
[strata] answering: 8 of max 8 tokens, 6.5 tok/s, 30 s
[strata] done: 8 tokens in 30 s (6.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 30 s so far
[strata] answering: 7 of max 8 tokens, 6.8 tok/s, 30 s
[strata] done: 8 tokens in 31 s (6.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 31 s so far
[strata] answering: 8 of max 8 tokens, 6.9 tok/s, 31 s
[strata] done: 8 tokens in 31 s (6.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 31 s so far
[strata] answering: 8 of max 8 tokens, 7.1 tok/s, 32 s
[strata] done: 8 tokens in 32 s (7.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 32 s so far
[strata] answering: 8 of max 8 tokens, 6.7 tok/s, 32 s
[strata] done: 8 tokens in 32 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 32 s so far
[strata] answering: 7 of max 8 tokens, 6.4 tok/s, 33 s
[strata] done: 8 tokens in 33 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 33 s so far
[strata] answering: 8 of max 8 tokens, 7.0 tok/s, 33 s
[strata] done: 8 tokens in 33 s (7.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 33 s so far
[strata] answering: 7 of max 8 tokens, 6.8 tok/s, 34 s
[strata] done: 8 tokens in 34 s (6.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 34 s so far
[strata] answering: 8 of max 8 tokens, 6.0 tok/s, 35 s
[strata] done: 8 tokens in 35 s (6.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 35 s so far
[strata] answering: 6 of max 8 tokens, 5.8 tok/s, 35 s
[strata] done: 8 tokens in 36 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 36 s so far
[strata] answering: 8 of max 8 tokens, 6.7 tok/s, 36 s
[strata] done: 8 tokens in 36 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 36 s so far
[strata] answering: 8 of max 8 tokens, 7.7 tok/s, 37 s
[strata] done: 8 tokens in 37 s (7.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 37 s so far
[strata] answering: 8 of max 8 tokens, 7.9 tok/s, 37 s
[strata] done: 8 tokens in 37 s (7.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 37 s so far
[strata] answering: 7 of max 8 tokens, 7.0 tok/s, 38 s
[strata] done: 8 tokens in 38 s (7.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 38 s so far
[strata] answering: 8 of max 8 tokens, 7.1 tok/s, 38 s
[strata] done: 8 tokens in 38 s (7.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 38 s so far
[strata] answering: 6 of max 8 tokens, 5.8 tok/s, 39 s
[strata] done: 8 tokens in 39 s (6.1 tok/s) (length, cancel=False)
[strata] answering: 8 of max 8 tokens, 7.0 tok/s, 39 s
[strata] done: 8 tokens in 39 s (7.0 tok/s) (length, cancel=False)
.[strata] thinking: 1 of max 200 tokens, 1.6 tok/s, 1 s
[strata] reading the prompt: 32 of 249 tokens, 1 s so far
[strata] thinking: 5 of max 200 tokens, 3.0 tok/s, 2 s
[strata] thinking: 4 of max 200 tokens, 6.1 tok/s, 2 s
[strata] thinking: 12 of max 200 tokens, 4.4 tok/s, 3 s
[strata] done: 10 tokens in 3 s (6.5 tok/s) (stop, cancel=False)
[strata] thinking: 18 of max 200 tokens, 4.8 tok/s, 4 s
[strata] thinking: 26 of max 200 tokens, 5.4 tok/s, 5 s
[strata] thinking: 34 of max 200 tokens, 5.7 tok/s, 6 s
[strata] thinking: 41 of max 200 tokens, 5.8 tok/s, 7 s
[strata] thinking: 49 of max 200 tokens, 6.0 tok/s, 9 s
[strata] done: 55 tokens in 10 s (6.0 tok/s) (stop, cancel=False)
.[strata] the engine stopped unexpectedly (exit code 1). The engine exited (code 1) after it reported: verify batch: layer 34 never rang (graph finished) - please report it at github.com/Niko1221/Strata/issues with the log. The next request starts the engine again.
[strata] done: 3 tokens in 1 s (3.2 tok/s) (error, cancel=False)
[strata] the engine stopped unexpectedly (exit code 1). The engine exited (code 1) after it reported: verify batch: layer 34 never rang (graph finished) - please report it at github.com/Niko1221/Strata/issues with the log. The next request starts the engine again.
[strata] done: 1 tokens in 1 s (2.9 tok/s) (error, cancel=False)
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 503: 'Service Unavailable'>
_warnings.warn(self.warn_message, ResourceWarning)
.[strata] parallel: slot(s) 0, 1 were marked busy with no request using them (issue #1603); freed, the waiting request goes on
[strata] reading the prompt: 32 of 52 tokens, 1 s so far
[strata] answering: 8 of max 16 tokens, 7.5 tok/s, 2 s
[strata] done: 10 tokens in 3 s (7.2 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 288 of 3,037 tokens, 1 s so far
[strata] answering: 5 of max 64 tokens, 5.5 tok/s, 1 s
[strata] reading the prompt: 928 of 3,037 tokens, 2 s so far
[strata] done: 10 tokens in 2 s (4.6 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,376 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 1,952 of 3,037 tokens, 4 s so far
[strata] reading the prompt: 2,464 of 3,037 tokens, 5 s so far
[strata] reading the prompt: 2,912 of 3,037 tokens, 6 s so far
[strata] answering: 6 of max 64 tokens, 6.7 tok/s, 7 s
[strata] done: 10 tokens in 8 s (7.1 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 1 s (10.0 tok/s) (stop, cancel=False)
[strata] answering: 7 of max 64 tokens, 7.6 tok/s, 1 s
[strata] done: 10 tokens in 2 s (6.4 tok/s) (stop, cancel=False)
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] answering: 8 of max 16 tokens, 8.2 tok/s, 1 s
[strata] done: 10 tokens in 1 s (7.5 tok/s) (stop, cancel=False)
.[strata] answering: 7 of max 200 tokens, 7.2 tok/s, 1 s
[strata] answering: 6 of max 200 tokens, 8.0 tok/s, 1 s
[strata] done: 10 tokens in 2 s (7.8 tok/s) (stop, cancel=False)
[strata] answering: 15 of max 200 tokens, 7.1 tok/s, 2 s
[strata] answering: 24 of max 200 tokens, 7.6 tok/s, 3 s
[strata] answering: 31 of max 200 tokens, 7.3 tok/s, 4 s
[strata] answering: 43 of max 200 tokens, 8.1 tok/s, 5 s
[strata] answering: 51 of max 200 tokens, 8.0 tok/s, 6 s
[strata] done: 55 tokens in 7 s (7.8 tok/s) (stop, cancel=False)
.[strata] answering: 8 of max 200 tokens, 8.1 tok/s, 1 s
[strata] answering: 7 of max 200 tokens, 8.9 tok/s, 1 s
[strata] done: 10 tokens in 1 s (8.4 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (9.0 tok/s) (stop, cancel=False)
.[strata] answering: 5 of max 60 tokens, 4.2 tok/s, 1 s
[strata] reading the prompt: 128 of 3,037 tokens, 1 s so far
[strata] answering: 3 of max 64 tokens, 4.1 tok/s, 1 s
[strata] reading the prompt: 608 of 3,037 tokens, 2 s so far
[strata] answering: 9 of max 60 tokens, 3.9 tok/s, 2 s
[strata] done: 10 tokens in 3 s (3.9 tok/s) (stop, cancel=False)
[strata] answering: 8 of max 64 tokens, 4.1 tok/s, 2 s
[strata] reading the prompt: 1,120 of 3,037 tokens, 3 s so far
[strata] done: 10 tokens in 3 s (4.0 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,600 of 3,037 tokens, 4 s so far
[strata] reading the prompt: 2,112 of 3,037 tokens, 5 s so far
[strata] reading the prompt: 2,624 of 3,037 tokens, 6 s so far
[strata] answering: 4 of max 64 tokens, 8.4 tok/s, 7 s
[strata] done: 10 tokens in 8 s (7.6 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 6 s so far
[strata] answering: 1 of max 64 tokens, 135300.1 tok/s, 5 s
[strata] answering: 3 of max 60 tokens, 0.3 tok/s, 11 s
[strata] answering: 2 of max 64 tokens, 0.4 tok/s, 11 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 11 s so far
[strata] answering: 3 of max 64 tokens, 0.4 tok/s, 12 s
[strata] answering: 2 of max 64 tokens, 6.4 tok/s, 13 s
[strata] answering: 5 of max 60 tokens, 0.4 tok/s, 13 s
[strata] done: 10 tokens in 13 s (1.3 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 13 s (9.6 tok/s) (stop, cancel=False)
[strata] answering: 15 of max 60 tokens, 1.1 tok/s, 14 s
[strata] answering: 24 of max 60 tokens, 1.6 tok/s, 15 s
[strata] answering: 32 of max 60 tokens, 2.0 tok/s, 16 s
[strata] answering: 39 of max 60 tokens, 2.3 tok/s, 17 s
[strata] answering: 50 of max 60 tokens, 2.8 tok/s, 18 s
[strata] done: 55 tokens in 19 s (3.0 tok/s) (stop, cancel=False)
.[strata] parallel: slot(s) 0 were marked busy with no request using them (issue #1603); freed, the waiting request goes on
..[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (1/6) (issue #1994)
[strata] answering: 6 of max 64 tokens, 6.5 tok/s, 1 s
[strata] answering: 2 of max 64 tokens, 6.0 tok/s, 1 s
[strata] answering: 13 of max 64 tokens, 6.4 tok/s, 2 s
[strata] done: 10 tokens in 2 s (7.6 tok/s) (stop, cancel=False)
[strata] answering: 23 of max 64 tokens, 7.2 tok/s, 3 s
[strata] answering: 31 of max 64 tokens, 7.2 tok/s, 4 s
[strata] answering: 40 of max 64 tokens, 7.6 tok/s, 5 s
[strata] answering: 47 of max 64 tokens, 7.5 tok/s, 6 s
[strata] answering: 54 of max 64 tokens, 7.3 tok/s, 8 s
[strata] done: 55 tokens in 8 s (7.3 tok/s) (stop, cancel=False)
[strata] answering: 8 of max 64 tokens, 8.1 tok/s, 1 s
[strata] done: 10 tokens in 2 s (6.8 tok/s) (stop, cancel=False)
.[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (1/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (2/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (3/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (4/6) (issue #1994)
[strata] answering: 8 of max 64 tokens, 6.7 tok/s, 1 s
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (5/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (6/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (7/6) (issue #1994)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (length, cancel=False)
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 503: 'Service Unavailable'>
_warnings.warn(self.warn_message, ResourceWarning)
[strata] answering: 14 of max 64 tokens, 6.3 tok/s, 2 s
[strata] answering: 23 of max 64 tokens, 6.9 tok/s, 3 s
[strata] answering: 31 of max 64 tokens, 7.0 tok/s, 4 s
[strata] answering: 40 of max 64 tokens, 7.4 tok/s, 5 s
[strata] answering: 48 of max 64 tokens, 7.4 tok/s, 6 s
[strata] done: 55 tokens in 7 s (7.4 tok/s) (stop, cancel=False)
[strata] answering: 8 of max 64 tokens, 8.4 tok/s, 1 s
[strata] done: 10 tokens in 2 s (6.9 tok/s) (stop, cancel=False)
.[strata] answering: 5 of max 64 tokens, 5.4 tok/s, 1 s
[strata] answering: 7 of max 64 tokens, 11.6 tok/s, 1 s
[strata] done: 10 tokens in 1 s (11.4 tok/s) (stop, cancel=False)
[strata] reading the prompt: 32 of 66 tokens, 1 s so far
[strata] answering: 15 of max 64 tokens, 7.3 tok/s, 2 s
[strata] answering: 8 of max 64 tokens, 7.8 tok/s, 2 s
[strata] answering: 22 of max 64 tokens, 7.2 tok/s, 3 s
[strata] done: 10 tokens in 3 s (7.3 tok/s) (stop, cancel=False)
[strata] answering: 29 of max 64 tokens, 7.2 tok/s, 4 s
[strata] answering: 37 of max 64 tokens, 7.3 tok/s, 5 s
[strata] answering: 47 of max 64 tokens, 7.6 tok/s, 6 s
[strata] done: 55 tokens in 7 s (7.8 tok/s) (stop, cancel=False)
.[strata] parallel requests: 4 asked, the engine runs 2 (its log says why)
.[strata] parallel requests: 4 asked, the engine runs one at a time (its log says why)
[strata] answering: 8 of max 64 tokens, 8.4 tok/s, 1 s
[strata] done: 10 tokens in 1 s (8.8 tok/s) (stop, cancel=False)
.[strata] answering: 5 of max 200 tokens, 4.6 tok/s, 1 s
[strata] answering: 3 of max 200 tokens, 6.0 tok/s, 1 s
[strata] done: 10 tokens in 2 s (8.4 tok/s) (stop, cancel=False)
[strata] answering: 15 of max 200 tokens, 7.0 tok/s, 2 s
[strata] answering: 22 of max 200 tokens, 6.9 tok/s, 3 s
[strata] answering: 29 of max 200 tokens, 6.8 tok/s, 4 s
[strata] answering: 37 of max 200 tokens, 6.9 tok/s, 5 s
[strata] answering: 44 of max 200 tokens, 6.8 tok/s, 6 s
[strata] answering: 51 of max 200 tokens, 6.8 tok/s, 8 s
[strata] done: 55 tokens in 8 s (6.8 tok/s) (stop, cancel=False)
.[strata] answering: 6 of max 200 tokens, 5.9 tok/s, 1 s
[strata] answering: 5 of max 64 tokens, 6.8 tok/s, 1 s
[strata] done: 10 tokens in 2 s (7.4 tok/s) (stop, cancel=False)
[strata] answering: 14 of max 200 tokens, 6.8 tok/s, 2 s
[strata] answering: 25 of max 200 tokens, 8.1 tok/s, 3 s
[strata] answering: 33 of max 200 tokens, 8.1 tok/s, 4 s
[strata] answering: 43 of max 200 tokens, 8.3 tok/s, 5 s
[strata] answering: 53 of max 200 tokens, 8.6 tok/s, 6 s
[strata] done: 55 tokens in 6 s (8.8 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 672 of 3,037 tokens, 1 s so far
[strata] reading the prompt: 1,312 of 3,037 tokens, 2 s so far
[strata] reading the prompt: 1,984 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 2,720 of 3,037 tokens, 4 s so far
[strata] answering: 1 of max 64 tokens, 1.8 tok/s, 5 s
[strata] answering: 1 of max 64 tokens, 0.6 tok/s, 6 s
[strata] answering: 1 of max 64 tokens, 0.4 tok/s, 7 s
[strata] answering: 1 of max 64 tokens, 0.3 tok/s, 8 s
[strata] answering: 1 of max 64 tokens, 0.2 tok/s, 9 s
[strata] reading the prompt: 32 of 3,037 tokens, 10 s so far
[strata] answering: 3 of max 64 tokens, 0.5 tok/s, 10 s
[strata] reading the prompt: 704 of 3,037 tokens, 11 s so far
[strata] answering: 9 of max 64 tokens, 1.3 tok/s, 11 s
[strata] done: 10 tokens in 12 s (1.4 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,440 of 3,037 tokens, 12 s so far
[strata] reading the prompt: 2,016 of 3,037 tokens, 13 s so far
[strata] reading the prompt: 2,624 of 3,037 tokens, 14 s so far
[strata] answering: 4 of max 64 tokens, 11.0 tok/s, 15 s
[strata] done: 10 tokens in 16 s (9.9 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 4 s so far
[strata] answering: 1 of max 64 tokens, 0.2 tok/s, 9 s
[strata] answering: 3 of max 64 tokens, 0.3 tok/s, 14 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 14 s so far
[strata] answering: 4 of max 64 tokens, 9.6 tok/s, 15 s
[strata] answering: 6 of max 64 tokens, 0.6 tok/s, 15 s
[strata] done: 10 tokens in 15 s (0.9 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 15 s (9.4 tok/s) (stop, cancel=False)
.[strata] the engine's logits became non-finite before the first token (#879); it dropped its cached state: sending the request again once
[strata] done: 10 tokens in 1 s (9.5 tok/s) (stop, cancel=False)
[strata] the engine's logits became non-finite before the first token (#879); it dropped its cached state: sending the request again once
[strata] answering: 6 of max 64 tokens, 6.1 tok/s, 1 s
[strata] answering: 5 of max 64 tokens, 9.3 tok/s, 1 s
[strata] done: 10 tokens in 2 s (9.2 tok/s) (stop, cancel=False)
[strata] answering: 16 of max 64 tokens, 7.8 tok/s, 2 s
[strata] answering: 25 of max 64 tokens, 8.0 tok/s, 3 s
[strata] answering: 33 of max 64 tokens, 8.0 tok/s, 4 s
[strata] answering: 42 of max 64 tokens, 8.0 tok/s, 5 s
[strata] answering: 52 of max 64 tokens, 8.2 tok/s, 6 s
[strata] done: 55 tokens in 7 s (8.0 tok/s) (stop, cancel=False)
[strata] the engine's logits became non-finite after 2 tokens (#879): the reply ends here as "length"; the engine dropped its cached state, so the next request reads its prompt from the start
[strata] done: 2 tokens in 1 s (7.4 tok/s) (length, cancel=False)
[strata] answering: 7 of max 64 tokens, 6.6 tok/s, 1 s
[strata] answering: 18 of max 64 tokens, 8.2 tok/s, 2 s
[strata] answering: 26 of max 64 tokens, 7.9 tok/s, 3 s
[strata] answering: 33 of max 64 tokens, 7.6 tok/s, 4 s
[strata] answering: 41 of max 64 tokens, 7.7 tok/s, 5 s
[strata] answering: 49 of max 64 tokens, 7.6 tok/s, 7 s
[strata] done: 55 tokens in 7 s (7.4 tok/s) (stop, cancel=False)
.[strata] done: 9 tokens in 1 s (8.6 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (10.5 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 5 s so far
[strata] answering: 1 of max 64 tokens, 174762.7 tok/s, 5 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 10 s so far
[strata] answering: 2 of max 64 tokens, 0.4 tok/s, 10 s
[strata] answering: 3 of max 64 tokens, 0.5 tok/s, 11 s
[strata] answering: 2 of max 64 tokens, 6.9 tok/s, 11 s
[strata] done: 10 tokens in 12 s (1.5 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 12 s (9.4 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 32 of 3,037 tokens, 1 s so far
[strata] reading the prompt: 352 of 3,037 tokens, 2 s so far
[strata] reading the prompt: 864 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 1,408 of 3,037 tokens, 4 s so far
[strata] reading the prompt: 1,952 of 3,037 tokens, 5 s so far
[strata] reading the prompt: 2,464 of 3,037 tokens, 6 s so far
[strata] reading the prompt: 32 of 3,037 tokens, 7 s so far
[strata] answering: 2 of max 64 tokens, 5.5 tok/s, 8 s
[strata] reading the prompt: 608 of 3,037 tokens, 8 s so far
[strata] answering: 7 of max 64 tokens, 4.1 tok/s, 9 s
[strata] reading the prompt: 1,088 of 3,037 tokens, 9 s so far
[strata] done: 10 tokens in 10 s (4.1 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,600 of 3,037 tokens, 10 s so far
[strata] reading the prompt: 1,952 of 3,037 tokens, 11 s so far
[strata] reading the prompt: 2,112 of 3,037 tokens, 11 s so far
[strata] reading the prompt: 2,688 of 3,037 tokens, 12 s so far
[strata] reading the prompt: 32 of 43 tokens, 13 s so far
[strata] answering: 2 of max 64 tokens, 3.6 tok/s, 13 s
[strata] answering: 7 of max 64 tokens, 6.9 tok/s, 14 s
[strata] done: 10 tokens in 14 s (7.3 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 14 s (8.7 tok/s) (stop, cancel=False)
...............[strata] reading the prompt: 8 of max 64 tokens, 8.1 tok/s, 1 s
[strata] reading the prompt: 7 of max 64 tokens, 7.5 tok/s, 1 s
[strata] reading the prompt: 10 of max 64 tokens, 9.0 tok/s, 1 s
[strata] answering: 17 of max 64 tokens, 8.4 tok/s, 2 s
[strata] answering: 15 of max 64 tokens, 7.4 tok/s, 2 s
[strata] answering: 19 of max 64 tokens, 8.6 tok/s, 2 s
[strata] answering: 27 of max 64 tokens, 8.7 tok/s, 3 s
[strata] answering: 27 of max 64 tokens, 8.5 tok/s, 3 s
[strata] answering: 28 of max 64 tokens, 8.5 tok/s, 3 s
[strata] answering: 36 of max 64 tokens, 8.6 tok/s, 4 s
[strata] answering: 35 of max 64 tokens, 8.1 tok/s, 4 s
[strata] answering: 36 of max 64 tokens, 8.2 tok/s, 4 s
[strata] answering: 44 of max 64 tokens, 8.5 tok/s, 5 s
[strata] answering: 45 of max 64 tokens, 8.4 tok/s, 5 s
[strata] answering: 44 of max 64 tokens, 8.0 tok/s, 6 s
[strata] done: 51 tokens in 6 s (8.3 tok/s) (stop, cancel=False)
[strata] done: 51 tokens in 6 s (8.3 tok/s) (stop, cancel=False)
[strata] done: 51 tokens in 6 s (7.9 tok/s) (stop, cancel=False)
.[strata] done: 22 tokens in 0 s (292935.5 tok/s) (stop, cancel=False)
............[strata] the config has a "vision" section but no --vision in its args: added --vision (run setup again with --vision to write them)
....[strata] thinking limited to 24386 of max_tokens 32514 so the answer has room ("answer_room": false in the config turns this off)
[strata] done: 3 tokens in 0 s (9970.6 tok/s) (stop, cancel=False)
...[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (16912.5 tok/s) (length, cancel=False)
.[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (5683.3 tok/s) (length, cancel=False)
.[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (11781.8 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (5849.8 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (7194.3 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (14266.3 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (5957.8 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (5289.2 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] answering: 1 of max 1 tokens, 167772.2 tok/s, 1 s
[strata] done: 1 tokens in 1 s (4810.0 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (41527.8 tok/s) (length, cancel=False)
[deadline exceeded after 300s; process group 91074 terminated after SIGTERM]