common/common.cpp at main in okami.mom/llama-cpp-bonsai

skip to content

≡ llama-cpp-bonsai

82 kB 2,416 lines

03c09b18

bonsai: optimize time-to-first-token on cached prompts (ttft)

nekomimi.pet Oct 13

⋯

common/common.cpp

at main C++