professorpalmer/bonsai-ada-surgery
Bonsai 2 27B: 262k context (trained max) on 12 GB, 54 to 97 tok/s decode, 2x prefill, q8_0 KV recipe, grammar tool calls 9/9. Same ternary weights. Windows bundle + receipts.
Language: Python
72GitHub stars
6public forks
Observed star growth
+2 stars24h growth
Observed OpenPulse samples
Observed OpenPulse samples
Building history7d growth
Not enough current observations
Not enough current observations
Building history30d growth
Not enough current observations
Not enough current observations
Latest OpenPulse observation:
GitHub topics
- bonsai
- cuda
- llama-cpp
- local-llm
- quantization
- qwen
- rtx-4070
- speculative-decoding
- ternary