.....[strata] done: 12 tokens in 0 s (184365.0 tok/s) (stop, cancel=False)
..[strata] other apps now use the Chat settings: temperature=0.5
.[strata] done: 12 tokens in 0 s (316551.2 tok/s) (stop, cancel=False)
.....[strata] done: 12 tokens in 0 s (316551.2 tok/s) (stop, cancel=False)
.[strata] other apps now use the Chat settings: temperature=0.5
[strata] other apps now use the Chat settings: temperature=0.5
[strata] other apps now use the Chat settings: temperature=0.5
..[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
.[strata] done: 1 tokens in 0 s (72315.6 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) + max tokens (1) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 1 tokens in 0 s (107546.3 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] done: 1 tokens in 0 s (89240.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) + max tokens (1) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 1 tokens in 0 s (91180.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] done: 1 tokens in 0 s (55188.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 1 tokens in 0 s (47127.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
....sssss....[strata] 400 invalid request: unknown reasoning effort 'huge': use none, low, medium or high
.[strata] done: 24 tokens in 0 s (249784.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (295200.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (328965.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (337796.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (343560.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (342392.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (351969.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (315558.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (353204.5 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (359511.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (353204.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (264208.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (351969.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (285975.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (337796.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (337796.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (289262.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (324720.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (328965.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (282762.1 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (328965.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (328965.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (338933.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (332222.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (315558.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (343560.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (353204.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (356962.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (328965.0 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (356962.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (368730.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (332222.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (332222.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (332222.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (324720.3 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (266305.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (275789.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (289262.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (285975.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (290096.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (278845.7 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (342392.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (289262.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (334429.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (333322.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (289262.3 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (332222.1 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (359511.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (356962.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (290096.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (337796.3 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (117734.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (135664.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (152983.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (127421.9 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (319566.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (334429.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (337796.3 tok/s) (stop, cancel=False)
.................[strata] the engine stopped unexpectedly (exit code -15). Unrecoverable native verification failure: verify: timed out at layer 18; its GPU waits were released and the GPU finished (#267) The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -15); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (18558.9 tok/s) (length, cancel=False)
...[strata] the engine stopped unexpectedly (exit code -15). Unrecoverable native verification failure: verify: timed out at layer 18; its GPU waits were released and the GPU finished (#267) The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -15); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (24385.5 tok/s) (length, cancel=False)
................................[strata] image: 512x768, n=2, 8 steps, seed 11
/private/tmp/r39-serve-baseline/serve/server.py:5603: ResourceWarning: unclosed file <_io.TextIOWrapper name=9 encoding='UTF-8'>
images, figures = gen.run(job, cancel)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
[strata] image done in 0.2 s (keep)
.[strata] 400 invalid request: size 999x999: each side a multiple of 32 from 256 to 2048
[strata] image: 1024x1024, n=1, 8 steps, seed 1394238321
[strata] image job failed: sd-cli exited with code 1
[INFO ] loading tensors completed, taking 0.10s
[ERROR] ggml_vulkan: ErrorDeviceLost
/private/tmp/r39-serve-baseline/serve/server.py:5607: ResourceWarning: unclosed file <_io.TextIOWrapper name=9 encoding='UTF-8'>
return
ResourceWarning: Enable tracemalloc to get the object allocation traceback
.[strata] image: 1024x1024, n=1, 8 steps, seed 2022972244
[strata] image done in 1.7 s (keep)
[strata] done: 8 tokens in 0 s (204600.2 tok/s) (length, cancel=False)
...[strata] image: 1024x1024, n=1, 8 steps, seed 0
[strata] image done in 0.3 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 1
[strata] image done in 0.3 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 2
[strata] image done in 0.3 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 3
[strata] image done in 0.4 s (keep)
.[strata] image job: the conversation (123 tokens) saved; unloading the model
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] the conversation from before the image job is back (123 tokens)
...[strata] image job: the engine's expert cache gave VRAM back (9000 MiB free)
.[strata] image job: the conversation (123 tokens) saved; unloading the model
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] the conversation from before the image job is back (123 tokens)
.........[strata] done: 3 tokens in 0 s (103991.0 tok/s) (stop, cancel=False)
F[strata] loading the model again (it was unloaded) ...
.[strata] model unloaded; the next request loads it again
.....[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 7 tokens in 0 s (166818.9 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (233016.9 tok/s) (stop, cancel=False)
[strata] model unloaded; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 7 tokens in 0 s (81330.0 tok/s) (stop, cancel=False)
.[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
....[strata] 400 invalid request: logit_bias: expected an object or a list of [token_id, bias] pairs
[strata] 400 invalid request: logit_bias: this engine does not support token biases; use a supporting CUDA/HIP build
[strata] 400 invalid request: logit_bias: biases must be finite numbers between -100 and 100; false is a pair-list ban
...[strata] MCP server 'missing' did not start: could not start 'strata-no-such-program': [Errno 2] No such file or directory: 'strata-no-such-program'. Its tools are left out; the chat works without them.
[strata] MCP server 'paged': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
...[strata] MCP server 'solo': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'solo' had stopped; starting it again
[strata] MCP server 'solo': 6 tools (echo, fail, sleep, big, die, add)
........[strata] MCP server 'down' did not start: could not reach http://127.0.0.1:9/mcp: <urlopen error [Errno 61] Connection refused>. Its tools are left out; the chat works without them.
[strata] MCP server 'web': 6 tools (echo, fail, sleep, big, die, add)
..[strata] done: 13 tokens in 0 s (212992.0 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 83 tokens in 0 s (162070.4 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 401: 'Unauthorized'>
_warnings.warn(self.warn_message, ResourceWarning)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 120 tokens in 0 s (128857.3 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 5 characters in 0.0 s
[strata] done: 120 tokens in 0 s (153450.1 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 5 characters in 0.0 s
[strata] done: 120 tokens in 0 s (156796.4 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 141 tokens in 0 s (157035.8 tok/s) (stop, cancel=False)
[strata] tool fake__add: ok, 1 characters in 0.0 s
[strata] done: 13 tokens in 0 s (351780.3 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] refused an API request from the web page 'http://evil.example' (no API key; add its host to "allowed_hosts" or its origin to "cors_origins" in the config)
[strata] done: 13 tokens in 0 s (200463.1 tok/s) (stop, cancel=False)
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 415: 'Unsupported Media Type'>
_warnings.warn(self.warn_message, ResourceWarning)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 109 tokens in 0 s (147144.9 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 116 tokens in 0 s (130334.7 tok/s) (stop, cancel=False)
[strata] done: 16 tokens in 0 s (207767.4 tok/s) (stop, cancel=False)
[strata] done: 16 tokens in 0 s (208412.6 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 120 tokens in 0 s (127648.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 134 tokens in 0 s (146592.8 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 19 characters in 0.0 s
[strata] done: 31 tokens in 0 s (148259.3 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 84 tokens in 0 s (168979.2 tok/s) (stop, cancel=False)
[strata] tool fake__fail: error, 27 characters in 0.0 s
[strata] done: 21 tokens in 0 s (190650.2 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 115 tokens in 0 s (104290.8 tok/s) (stop, cancel=False)
[strata] tool fake__big: ok, 3,000 characters in 0.0 s (truncated for the model)
[strata] done: 16 tokens in 0 s (175677.7 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (319566.0 tok/s) (stop, cancel=False)
....[strata] 400 invalid request: request exceeds the context window: prompt (183 tokens) + max tokens (20000) exceeds the context (16384); requests are never truncated. Send a smaller max_tokens (at most 16193 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 50 tokens in 0 s (249958.5 tok/s) (stop, cancel=False)
.[strata] done: 50 tokens in 0 s (114410.9 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (57614.1 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (123725.8 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (61284.4 tok/s) (stop, cancel=False)
..[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 50 tokens in 0 s (36766.3 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (39741.4 tok/s) (stop, cancel=False)
.[strata] done: 7 tokens in 0 s (107941.6 tok/s) (stop, cancel=False)
..[strata] "parallel" must be a whole number of requests (2..8), not '4': ignored
[strata] "parallel" must be a whole number of requests (2..8), not True: ignored
[strata] "parallel": 12 - the engine runs at most 8 requests together; it will use 8
.[strata] answering: 5 of max 8 tokens, 5.1 tok/s, 1 s
[strata] answering: 4 of max 8 tokens, 6.2 tok/s, 1 s
[strata] done: 8 tokens in 1 s (6.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 1 s so far
[strata] done: 8 tokens in 2 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] answering: 8 of max 8 tokens, 7.4 tok/s, 3 s
[strata] done: 8 tokens in 3 s (7.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] answering: 8 of max 8 tokens, 7.8 tok/s, 3 s
[strata] done: 8 tokens in 3 s (7.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (8.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] done: 8 tokens in 4 s (8.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 4 s so far
[strata] answering: 7 of max 8 tokens, 6.2 tok/s, 5 s
[strata] done: 8 tokens in 5 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] answering: 8 of max 8 tokens, 6.4 tok/s, 5 s
[strata] done: 8 tokens in 5 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] answering: 8 of max 8 tokens, 7.3 tok/s, 6 s
[strata] done: 8 tokens in 6 s (7.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 6 s so far
[strata] answering: 8 of max 8 tokens, 7.6 tok/s, 6 s
[strata] done: 8 tokens in 6 s (7.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 6 s so far
[strata] answering: 8 of max 8 tokens, 7.5 tok/s, 7 s
[strata] done: 8 tokens in 7 s (7.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] answering: 8 of max 8 tokens, 6.6 tok/s, 7 s
[strata] done: 8 tokens in 7 s (6.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] answering: 6 of max 8 tokens, 5.8 tok/s, 8 s
[strata] done: 8 tokens in 8 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] answering: 8 of max 8 tokens, 7.2 tok/s, 9 s
[strata] done: 8 tokens in 9 s (7.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 9 s so far
[strata] answering: 8 of max 8 tokens, 7.2 tok/s, 10 s
[strata] done: 8 tokens in 10 s (7.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 10 s so far
[strata] answering: 8 of max 8 tokens, 6.2 tok/s, 10 s
[strata] done: 8 tokens in 10 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 10 s so far
[strata] answering: 7 of max 8 tokens, 6.7 tok/s, 11 s
[strata] done: 8 tokens in 11 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 11 s so far
[strata] answering: 8 of max 8 tokens, 6.2 tok/s, 11 s
[strata] done: 8 tokens in 11 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 11 s so far
[strata] answering: 6 of max 8 tokens, 5.9 tok/s, 12 s
[strata] done: 8 tokens in 12 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 12 s so far
[strata] answering: 8 of max 8 tokens, 6.6 tok/s, 13 s
[strata] done: 8 tokens in 13 s (6.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 13 s so far
[strata] done: 8 tokens in 13 s (9.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 13 s so far
[strata] done: 8 tokens in 13 s (9.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 13 s so far
[strata] answering: 8 of max 8 tokens, 7.0 tok/s, 14 s
[strata] done: 8 tokens in 14 s (7.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 14 s so far
[strata] answering: 8 of max 8 tokens, 7.0 tok/s, 15 s
[strata] done: 8 tokens in 15 s (7.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 15 s so far
[strata] answering: 7 of max 8 tokens, 6.3 tok/s, 15 s
[strata] done: 8 tokens in 16 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 16 s so far
[strata] answering: 8 of max 8 tokens, 6.1 tok/s, 16 s
[strata] done: 8 tokens in 16 s (6.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 16 s so far
[strata] answering: 6 of max 8 tokens, 5.7 tok/s, 17 s
[strata] done: 8 tokens in 17 s (5.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 17 s so far
[strata] answering: 8 of max 8 tokens, 6.4 tok/s, 17 s
[strata] done: 8 tokens in 17 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 17 s so far
[strata] answering: 8 of max 8 tokens, 7.9 tok/s, 18 s
[strata] done: 8 tokens in 18 s (7.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 18 s so far
[strata] done: 8 tokens in 18 s (8.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 18 s so far
[strata] answering: 8 of max 8 tokens, 7.0 tok/s, 19 s
[strata] done: 8 tokens in 19 s (7.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 19 s so far
[strata] answering: 8 of max 8 tokens, 6.6 tok/s, 20 s
[strata] done: 8 tokens in 20 s (6.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 20 s so far
[strata] answering: 7 of max 8 tokens, 6.6 tok/s, 20 s
[strata] done: 8 tokens in 21 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 21 s so far
[strata] answering: 8 of max 8 tokens, 6.9 tok/s, 21 s
[strata] done: 8 tokens in 21 s (6.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 21 s so far
[strata] answering: 7 of max 8 tokens, 6.2 tok/s, 22 s
[strata] done: 8 tokens in 22 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 22 s so far
[strata] answering: 8 of max 8 tokens, 6.4 tok/s, 22 s
[strata] done: 8 tokens in 22 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 22 s so far
[strata] answering: 6 of max 8 tokens, 6.0 tok/s, 23 s
[strata] done: 8 tokens in 23 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 23 s so far
[strata] answering: 8 of max 8 tokens, 6.1 tok/s, 24 s
[strata] done: 8 tokens in 24 s (6.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 24 s so far
[strata] answering: 6 of max 8 tokens, 5.4 tok/s, 24 s
[strata] done: 8 tokens in 25 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 25 s so far
[strata] answering: 8 of max 8 tokens, 6.4 tok/s, 25 s
[strata] done: 8 tokens in 25 s (6.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 25 s so far
[strata] answering: 6 of max 8 tokens, 6.0 tok/s, 26 s
[strata] done: 8 tokens in 26 s (6.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 26 s so far
[strata] answering: 8 of max 8 tokens, 6.8 tok/s, 26 s
[strata] done: 8 tokens in 26 s (6.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 26 s so far
[strata] answering: 6 of max 8 tokens, 5.6 tok/s, 27 s
[strata] done: 8 tokens in 27 s (6.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 27 s so far
[strata] answering: 8 of max 8 tokens, 5.9 tok/s, 28 s
[strata] done: 8 tokens in 28 s (5.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 28 s so far
[strata] answering: 6 of max 8 tokens, 5.5 tok/s, 28 s
[strata] answering: 7 of max 8 tokens, 6.8 tok/s, 29 s
[strata] done: 8 tokens in 29 s (5.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 29 s so far
[strata] done: 8 tokens in 29 s (5.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 29 s so far
[strata] answering: 6 of max 8 tokens, 5.8 tok/s, 30 s
[strata] done: 8 tokens in 30 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 30 s so far
[strata] answering: 8 of max 8 tokens, 7.3 tok/s, 30 s
[strata] done: 8 tokens in 30 s (7.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 30 s so far
[strata] answering: 6 of max 8 tokens, 5.8 tok/s, 31 s
[strata] done: 8 tokens in 31 s (5.9 tok/s) (length, cancel=False)
[strata] answering: 7 of max 8 tokens, 6.7 tok/s, 31 s
[strata] reading the prompt: 32 of 46 tokens, 31 s so far
[strata] done: 8 tokens in 32 s (6.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 32 s so far
[strata] answering: 7 of max 8 tokens, 6.7 tok/s, 32 s
[strata] done: 8 tokens in 33 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 33 s so far
[strata] answering: 8 of max 8 tokens, 6.0 tok/s, 33 s
[strata] done: 8 tokens in 33 s (6.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 33 s so far
[strata] answering: 8 of max 8 tokens, 7.4 tok/s, 34 s
[strata] done: 8 tokens in 34 s (7.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 34 s so far
[strata] answering: 8 of max 8 tokens, 7.9 tok/s, 34 s
[strata] done: 8 tokens in 34 s (7.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 34 s so far
[strata] answering: 7 of max 8 tokens, 6.8 tok/s, 35 s
[strata] done: 8 tokens in 35 s (6.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 35 s so far
[strata] answering: 8 of max 8 tokens, 6.3 tok/s, 35 s
[strata] done: 8 tokens in 35 s (6.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 35 s so far
[strata] answering: 6 of max 8 tokens, 5.7 tok/s, 36 s
[strata] done: 8 tokens in 36 s (5.9 tok/s) (length, cancel=False)
[strata] answering: 7 of max 8 tokens, 6.7 tok/s, 36 s
[strata] reading the prompt: 32 of 46 tokens, 37 s so far
[strata] done: 8 tokens in 37 s (5.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 37 s so far
[strata] answering: 8 of max 8 tokens, 7.2 tok/s, 38 s
[strata] done: 8 tokens in 38 s (7.2 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 38 s (8.5 tok/s) (length, cancel=False)
.[strata] thinking: 3 of max 200 tokens, 4.4 tok/s, 1 s
[strata] reading the prompt: 160 of 249 tokens, 1 s so far
[strata] thinking: 12 of max 200 tokens, 6.6 tok/s, 2 s
[strata] done: 10 tokens in 2 s (10.4 tok/s) (stop, cancel=False)
[strata] thinking: 19 of max 200 tokens, 6.5 tok/s, 3 s
[strata] thinking: 26 of max 200 tokens, 6.4 tok/s, 5 s
[strata] thinking: 33 of max 200 tokens, 6.5 tok/s, 6 s
[strata] thinking: 41 of max 200 tokens, 6.6 tok/s, 7 s
[strata] thinking: 50 of max 200 tokens, 6.8 tok/s, 8 s
[strata] done: 55 tokens in 9 s (6.7 tok/s) (stop, cancel=False)
.[strata] the engine stopped unexpectedly (exit code 1). The engine exited (code 1) after it reported: verify batch: layer 34 never rang (graph finished) - please report it at github.com/Niko1221/Strata/issues with the log. The next request starts the engine again.
[strata] done: 3 tokens in 1 s (3.1 tok/s) (error, cancel=False)
[strata] the engine stopped unexpectedly (exit code 1). The engine exited (code 1) after it reported: verify batch: layer 34 never rang (graph finished) - please report it at github.com/Niko1221/Strata/issues with the log. The next request starts the engine again.
[strata] done: 1 tokens in 1 s (3.0 tok/s) (error, cancel=False)
/opt/homebrew/Cellar/python@3.14/3.14.7/Frameworks/Python.framework/Versions/3.14/lib/python3.14/tempfile.py:484: ResourceWarning: Implicitly cleaning up <HTTPError 503: 'Service Unavailable'>
_warnings.warn(self.warn_message, ResourceWarning)
.[strata] parallel: slot(s) 0, 1 were marked busy with no request using them (issue #1603); freed, the waiting request goes on
[strata] reading the prompt: 32 of 52 tokens, 1 s so far
[strata] done: 10 tokens in 2 s (8.8 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 224 of 3,037 tokens, 1 s so far
[strata] answering: 4 of max 64 tokens, 4.3 tok/s, 1 s
[strata] reading the prompt: 768 of 3,037 tokens, 2 s so far
[strata] answering: 9 of max 64 tokens, 4.2 tok/s, 2 s
[strata] done: 10 tokens in 2 s (4.3 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,312 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 1,792 of 3,037 tokens, 4 s so far
[strata] reading the prompt: 2,272 of 3,037 tokens, 5 s so far
[strata] reading the prompt: 2,784 of 3,037 tokens, 6 s so far
[strata] answering: 6 of max 64 tokens, 8.4 tok/s, 7 s
[strata] done: 10 tokens in 8 s (7.7 tok/s) (stop, cancel=False)
.[strata] answering: 9 of max 64 tokens, 8.4 tok/s, 1 s
[strata] done: 10 tokens in 1 s (7.1 tok/s) (stop, cancel=False)
[strata] answering: 9 of max 64 tokens, 8.5 tok/s, 1 s
[strata] done: 10 tokens in 1 s (7.5 tok/s) (stop, cancel=False)
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] answering: 9 of max 16 tokens, 9.2 tok/s, 1 s
[strata] done: 10 tokens in 1 s (8.3 tok/s) (stop, cancel=False)
.[strata] answering: 6 of max 200 tokens, 6.0 tok/s, 1 s
[strata] answering: 5 of max 200 tokens, 6.4 tok/s, 1 s
[strata] answering: 13 of max 200 tokens, 6.2 tok/s, 2 s
[strata] done: 10 tokens in 2 s (6.7 tok/s) (stop, cancel=False)
[strata] answering: 24 of max 200 tokens, 7.6 tok/s, 3 s
[strata] answering: 34 of max 200 tokens, 8.1 tok/s, 4 s
[strata] answering: 41 of max 200 tokens, 7.7 tok/s, 5 s
[strata] answering: 50 of max 200 tokens, 7.8 tok/s, 6 s
[strata] done: 55 tokens in 7 s (7.8 tok/s) (stop, cancel=False)
.[strata] answering: 4 of max 200 tokens, 6.0 tok/s, 1 s
[strata] answering: 5 of max 200 tokens, 4.6 tok/s, 1 s
[strata] done: 10 tokens in 2 s (5.8 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 2 s (7.0 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 64 of 3,037 tokens, 1 s so far
[strata] answering: 5 of max 60 tokens, 3.9 tok/s, 1 s
[strata] answering: 3 of max 64 tokens, 4.5 tok/s, 1 s
[strata] reading the prompt: 544 of 3,037 tokens, 2 s so far
[strata] answering: 9 of max 60 tokens, 3.9 tok/s, 2 s
[strata] done: 10 tokens in 3 s (4.0 tok/s) (stop, cancel=False)
[strata] answering: 8 of max 64 tokens, 4.5 tok/s, 2 s
[strata] done: 10 tokens in 2 s (4.9 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,280 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 1,792 of 3,037 tokens, 4 s so far
[strata] reading the prompt: 2,432 of 3,037 tokens, 5 s so far
[strata] reading the prompt: 3,008 of 3,037 tokens, 6 s so far
[strata] answering: 7 of max 64 tokens, 6.8 tok/s, 7 s
[strata] done: 10 tokens in 8 s (7.6 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 6 s so far
[strata] answering: 1 of max 64 tokens, 167772.2 tok/s, 5 s
[strata] answering: 4 of max 60 tokens, 0.4 tok/s, 11 s
[strata] answering: 2 of max 64 tokens, 0.4 tok/s, 11 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 11 s so far
[strata] answering: 6 of max 60 tokens, 0.5 tok/s, 12 s
[strata] answering: 2 of max 64 tokens, 10.9 tok/s, 12 s
[strata] answering: 3 of max 64 tokens, 0.5 tok/s, 12 s
[strata] answering: 13 of max 60 tokens, 1.0 tok/s, 14 s
[strata] answering: 9 of max 64 tokens, 6.8 tok/s, 13 s
[strata] done: 10 tokens in 13 s (1.3 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 14 s (6.7 tok/s) (stop, cancel=False)
[strata] answering: 20 of max 60 tokens, 1.4 tok/s, 15 s
[strata] answering: 28 of max 60 tokens, 1.8 tok/s, 16 s
[strata] answering: 36 of max 60 tokens, 2.2 tok/s, 17 s
[strata] answering: 43 of max 60 tokens, 2.4 tok/s, 18 s
[strata] answering: 50 of max 60 tokens, 2.6 tok/s, 19 s
[strata] done: 55 tokens in 19 s (2.8 tok/s) (stop, cancel=False)
.[strata] parallel: slot(s) 0 were marked busy with no request using them (issue #1603); freed, the waiting request goes on
..[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (1/6) (issue #1994)
[strata] answering: 2 of max 64 tokens, 8.3 tok/s, 1 s
[strata] answering: 8 of max 64 tokens, 6.7 tok/s, 1 s
[strata] done: 10 tokens in 2 s (8.4 tok/s) (stop, cancel=False)
[strata] answering: 17 of max 64 tokens, 7.3 tok/s, 2 s
[strata] answering: 25 of max 64 tokens, 7.3 tok/s, 3 s
[strata] answering: 34 of max 64 tokens, 7.7 tok/s, 4 s
[strata] answering: 45 of max 64 tokens, 8.1 tok/s, 6 s
[strata] answering: 53 of max 64 tokens, 8.0 tok/s, 7 s
[strata] done: 55 tokens in 7 s (8.1 tok/s) (stop, cancel=False)
[strata] answering: 9 of max 64 tokens, 9.2 tok/s, 1 s
[strata] done: 10 tokens in 1 s (8.1 tok/s) (stop, cancel=False)
.[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (1/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (2/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (3/6) (issue #1994)
[strata] answering: 8 of max 64 tokens, 7.9 tok/s, 1 s
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (4/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (5/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (6/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (7/6) (issue #1994)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (length, cancel=False)
[strata] answering: 14 of max 64 tokens, 6.7 tok/s, 2 s
[strata] answering: 22 of max 64 tokens, 6.9 tok/s, 3 s
[strata] answering: 29 of max 64 tokens, 6.9 tok/s, 4 s
[strata] answering: 36 of max 64 tokens, 6.9 tok/s, 5 s
[strata] answering: 43 of max 64 tokens, 6.7 tok/s, 6 s
[strata] answering: 50 of max 64 tokens, 6.6 tok/s, 8 s
[strata] done: 55 tokens in 8 s (6.7 tok/s) (stop, cancel=False)
[strata] answering: 9 of max 64 tokens, 8.4 tok/s, 1 s
[strata] done: 10 tokens in 1 s (7.2 tok/s) (stop, cancel=False)
.[strata] answering: 8 of max 64 tokens, 8.1 tok/s, 1 s
[strata] answering: 5 of max 64 tokens, 9.6 tok/s, 1 s
[strata] done: 10 tokens in 2 s (9.8 tok/s) (stop, cancel=False)
[strata] reading the prompt: 32 of 66 tokens, 1 s so far
[strata] answering: 16 of max 64 tokens, 7.5 tok/s, 2 s
[strata] answering: 8 of max 64 tokens, 7.9 tok/s, 2 s
[strata] done: 10 tokens in 3 s (7.8 tok/s) (stop, cancel=False)
[strata] answering: 24 of max 64 tokens, 7.5 tok/s, 3 s
[strata] answering: 33 of max 64 tokens, 7.6 tok/s, 4 s
[strata] answering: 41 of max 64 tokens, 7.6 tok/s, 5 s
[strata] answering: 48 of max 64 tokens, 7.4 tok/s, 6 s
[strata] done: 55 tokens in 7 s (7.5 tok/s) (stop, cancel=False)
.[strata] parallel requests: 4 asked, the engine runs 2 (its log says why)
.[strata] parallel requests: 4 asked, the engine runs one at a time (its log says why)
[strata] done: 10 tokens in 1 s (10.6 tok/s) (stop, cancel=False)
.[strata] answering: 5 of max 200 tokens, 4.9 tok/s, 1 s
[strata] answering: 5 of max 200 tokens, 8.5 tok/s, 1 s
[strata] done: 10 tokens in 2 s (7.9 tok/s) (stop, cancel=False)
[strata] answering: 14 of max 200 tokens, 6.5 tok/s, 2 s
[strata] answering: 21 of max 200 tokens, 6.6 tok/s, 3 s
[strata] answering: 31 of max 200 tokens, 7.4 tok/s, 4 s
[strata] answering: 40 of max 200 tokens, 7.7 tok/s, 5 s
[strata] answering: 48 of max 200 tokens, 7.6 tok/s, 6 s
[strata] done: 55 tokens in 8 s (7.3 tok/s) (stop, cancel=False)
.[strata] answering: 5 of max 200 tokens, 5.3 tok/s, 1 s
[strata] answering: 5 of max 64 tokens, 7.7 tok/s, 1 s
[strata] done: 10 tokens in 2 s (8.7 tok/s) (stop, cancel=False)
[strata] answering: 14 of max 200 tokens, 7.1 tok/s, 2 s
[strata] answering: 22 of max 200 tokens, 7.2 tok/s, 3 s
[strata] answering: 31 of max 200 tokens, 7.3 tok/s, 4 s
[strata] answering: 38 of max 200 tokens, 7.2 tok/s, 5 s
[strata] answering: 46 of max 200 tokens, 7.3 tok/s, 6 s
[strata] done: 55 tokens in 7 s (7.5 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 576 of 3,037 tokens, 1 s so far
[strata] reading the prompt: 1,344 of 3,037 tokens, 2 s so far
[strata] reading the prompt: 2,016 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 2,624 of 3,037 tokens, 4 s so far
[strata] answering: 1 of max 64 tokens, 3.5 tok/s, 5 s
[strata] answering: 1 of max 64 tokens, 0.8 tok/s, 6 s
[strata] answering: 1 of max 64 tokens, 0.4 tok/s, 7 s
[strata] answering: 1 of max 64 tokens, 0.3 tok/s, 8 s
[strata] answering: 1 of max 64 tokens, 0.2 tok/s, 9 s
[strata] reading the prompt: 32 of 3,037 tokens, 10 s so far
[strata] answering: 4 of max 64 tokens, 0.7 tok/s, 10 s
[strata] reading the prompt: 672 of 3,037 tokens, 11 s so far
[strata] answering: 9 of max 64 tokens, 1.4 tok/s, 11 s
[strata] done: 10 tokens in 12 s (1.5 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,280 of 3,037 tokens, 12 s so far
[strata] reading the prompt: 1,920 of 3,037 tokens, 13 s so far
[strata] reading the prompt: 2,528 of 3,037 tokens, 14 s so far
[strata] answering: 4 of max 64 tokens, 11.4 tok/s, 15 s
[strata] done: 10 tokens in 16 s (8.7 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 4 s so far
[strata] answering: 1 of max 64 tokens, 0.2 tok/s, 9 s
[strata] answering: 3 of max 64 tokens, 0.3 tok/s, 14 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 13 s so far
[strata] answering: 5 of max 64 tokens, 0.5 tok/s, 15 s
[strata] answering: 3 of max 64 tokens, 9.6 tok/s, 14 s
[strata] done: 10 tokens in 15 s (0.9 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 15 s (8.7 tok/s) (stop, cancel=False)
.[strata] the engine's logits became non-finite before the first token (#879); it dropped its cached state: sending the request again once
[strata] answering: 9 of max 64 tokens, 9.4 tok/s, 1 s
[strata] done: 10 tokens in 1 s (8.0 tok/s) (stop, cancel=False)
[strata] the engine's logits became non-finite before the first token (#879); it dropped its cached state: sending the request again once
[strata] answering: 7 of max 64 tokens, 7.0 tok/s, 1 s
[strata] answering: 6 of max 64 tokens, 9.5 tok/s, 1 s
[strata] done: 10 tokens in 1 s (9.5 tok/s) (stop, cancel=False)
[strata] answering: 16 of max 64 tokens, 7.8 tok/s, 2 s
[strata] answering: 26 of max 64 tokens, 8.1 tok/s, 3 s
[strata] answering: 35 of max 64 tokens, 8.2 tok/s, 4 s
[strata] answering: 44 of max 64 tokens, 8.2 tok/s, 5 s
[strata] answering: 54 of max 64 tokens, 8.4 tok/s, 7 s
[strata] done: 55 tokens in 7 s (8.3 tok/s) (stop, cancel=False)
[strata] the engine's logits became non-finite after 2 tokens (#879): the reply ends here as "length"; the engine dropped its cached state, so the next request reads its prompt from the start
[strata] done: 2 tokens in 1 s (6.3 tok/s) (length, cancel=False)
[strata] answering: 8 of max 64 tokens, 7.6 tok/s, 1 s
[strata] answering: 16 of max 64 tokens, 7.4 tok/s, 2 s
[strata] answering: 24 of max 64 tokens, 7.6 tok/s, 3 s
[strata] answering: 36 of max 64 tokens, 8.5 tok/s, 4 s
[strata] answering: 46 of max 64 tokens, 8.7 tok/s, 5 s
[strata] done: 55 tokens in 6 s (8.6 tok/s) (stop, cancel=False)
.[strata] answering: 9 of max 64 tokens, 8.8 tok/s, 1 s
[strata] done: 9 tokens in 1 s (8.5 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (10.6 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 5 s so far
[strata] answering: 1 of max 64 tokens, 161319.4 tok/s, 5 s
[strata] answering: 2 of max 64 tokens, 0.4 tok/s, 10 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 10 s so far
[strata] answering: 2 of max 64 tokens, 6.8 tok/s, 11 s
[strata] answering: 3 of max 64 tokens, 0.5 tok/s, 11 s
[strata] done: 10 tokens in 12 s (1.4 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 13 s (7.2 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 32 of 3,037 tokens, 1 s so far
[strata] reading the prompt: 64 of 3,037 tokens, 1 s so far
[strata] reading the prompt: 416 of 3,037 tokens, 2 s so far
[strata] reading the prompt: 928 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 1,504 of 3,037 tokens, 4 s so far
[strata] reading the prompt: 2,112 of 3,037 tokens, 5 s so far
[strata] reading the prompt: 2,624 of 3,037 tokens, 6 s so far
[strata] reading the prompt: 32 of 3,037 tokens, 7 s so far
[strata] answering: 2 of max 64 tokens, 5.1 tok/s, 8 s
[strata] reading the prompt: 672 of 3,037 tokens, 8 s so far
[strata] answering: 7 of max 64 tokens, 5.0 tok/s, 9 s
[strata] done: 10 tokens in 9 s (4.4 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,184 of 3,037 tokens, 9 s so far
[strata] reading the prompt: 1,696 of 3,037 tokens, 10 s so far
[strata] reading the prompt: 2,176 of 3,037 tokens, 11 s so far
[strata] reading the prompt: 2,688 of 3,037 tokens, 12 s so far
[strata] reading the prompt: 32 of 43 tokens, 13 s so far
[strata] answering: 2 of max 64 tokens, 3.8 tok/s, 13 s
[strata] answering: 7 of max 64 tokens, 6.4 tok/s, 14 s
[strata] answering: 9 of max 64 tokens, 5.5 tok/s, 15 s
[strata] done: 10 tokens in 14 s (6.2 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 15 s (5.6 tok/s) (stop, cancel=False)
.........[strata] reading the prompt: 9 of max 64 tokens, 9.3 tok/s, 1 s
[strata] reading the prompt: 9 of max 64 tokens, 9.0 tok/s, 1 s
[strata] reading the prompt: 8 of max 64 tokens, 8.1 tok/s, 1 s
[strata] answering: 16 of max 64 tokens, 8.0 tok/s, 2 s
[strata] answering: 16 of max 64 tokens, 7.9 tok/s, 2 s
[strata] answering: 16 of max 64 tokens, 7.6 tok/s, 2 s
[strata] answering: 26 of max 64 tokens, 8.3 tok/s, 3 s
[strata] answering: 24 of max 64 tokens, 7.7 tok/s, 3 s
[strata] answering: 25 of max 64 tokens, 7.6 tok/s, 3 s
[strata] answering: 35 of max 64 tokens, 8.4 tok/s, 4 s
[strata] answering: 32 of max 64 tokens, 7.6 tok/s, 4 s
[strata] answering: 35 of max 64 tokens, 8.1 tok/s, 4 s
[strata] answering: 40 of max 64 tokens, 7.7 tok/s, 5 s
[strata] answering: 44 of max 64 tokens, 8.4 tok/s, 5 s
[strata] answering: 42 of max 64 tokens, 7.8 tok/s, 6 s
[strata] done: 51 tokens in 6 s (8.2 tok/s) (stop, cancel=False)
[strata] answering: 47 of max 64 tokens, 7.4 tok/s, 6 s
[strata] answering: 50 of max 64 tokens, 7.8 tok/s, 7 s
[strata] done: 51 tokens in 7 s (7.7 tok/s) (stop, cancel=False)
[strata] done: 51 tokens in 7 s (7.5 tok/s) (stop, cancel=False)
.[strata] done: 22 tokens in 0 s (149796.6 tok/s) (stop, cancel=False)
.....[strata] done: 3 tokens in 0 s (11305.4 tok/s) (stop, cancel=False)
...[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (7884.0 tok/s) (length, cancel=False)
.[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] answering: 1 of max 1 tokens, 167772.2 tok/s, 1 s
[strata] done: 1 tokens in 1 s (4675.9 tok/s) (length, cancel=False)
.[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (10838.0 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] answering: 1 of max 1 tokens, 322638.8 tok/s, 1 s
[strata] done: 1 tokens in 1 s (12633.4 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (40329.8 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (5468.5 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (6978.9 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (9258.9 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (6754.1 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (6492.7 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (6141.0 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (30393.5 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (29330.8 tok/s) (length, cancel=False)
...[strata] loading the model again (it was unloaded) ...
[strata] the engine did not start (try 1 of 3); again in 0 s
[strata] the engine did not start (try 2 of 3); again in 0 s
.[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (13706.9 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine did not start (try 1 of 3); again in 0 s
[strata] the engine did not start (try 2 of 3); again in 0 s
..[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2086 tokens in 0 s (215830.0 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2071 tokens in 0 s (361556.9 tok/s) (stop, cancel=False)
.[strata] done: 1 tokens in 0 s (27776.8 tok/s) (cancel, cancel=True)
.[strata] done: 16384 tokens in 0 s (596777.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 28001 tokens in 0 s (692256.1 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2082 tokens in 0 s (639840.3 tok/s) (stop, cancel=False)
.[strata] done: 28001 tokens in 0 s (675210.2 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2106 tokens in 0 s (640876.7 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2086 tokens in 0 s (630581.5 tok/s) (stop, cancel=False)
..[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 16384 tokens in 0 s (674646.3 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 28001 tokens in 0 s (566856.4 tok/s) (stop, cancel=False)
..[strata] the thinking repeated the same passages (coverage=1.000) at 2560 tokens: ended as "length" (reasoning_loop_recovery: "stop" in strata-<model>.json; remove it to turn this off)
[strata] done: 2560 tokens in 0 s (642190.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] the thinking repeated the same passages (coverage=1.000) at 2048 tokens: ended as "length" (reasoning_loop_recovery: "stop" in strata-<model>.json; remove it to turn this off)
[strata] done: 2048 tokens in 0 s (645423.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
..................[strata] done: 116 tokens in 0 s (214428.9 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (161265.9 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (216432.1 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (163817.9 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (218081.2 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (171558.3 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[deadline exceeded after 300s; process group 91073 terminated after SIGTERM]