media/llama1-banner.png at main in okami.mom/llama-cpp-bonsai

skip to content

okami.mom / llama-cpp-bonsai

okami.mom/llama-cpp-bonsai

llama.cpp fork for Ternary Bonsai 2 27B: MTP speculation, suffix cache reuse (SCR), q8 KV, two-slot fairness, fused DeltaNet kernels

files main

/

languages

C++ 63%
C 14%
Python 8%
TypeScript 5%
GLSL 3%
Svelte 3%
other 4%

refs 2

main 8906fd8 Oct 18 bolt 87e1b42 Oct 16

≡ llama-cpp-bonsai

readme tickets …commits pipelines settings

llama1-banner.png

llama1-banner.png

media/llama1-banner.png

33 kB

⋯

media/llama1-banner.png

download raw history

at main

previews are not supported for this file type.