r/LocalLLaMA • u/d77chong • 15h ago
New Model Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B
We're launching Precision Numerics by releasing Boole-1.7B, a 1-bit version of Qwen3-1.7B.
- 247 MB packed weights: 13.9× smaller than BF16.
- 85.9% of the BF16 model’s average score across our 10-task evaluation - outperforms 1-bit Bonsai-1.7B and nearly matches 1.58-bit Bonsai-1.7B.
Try it locally in your browser (it's for low-latency tasks using English and non-thinking mode), or use it with vLLM or llama.cpp.
We'll ship more capable models for the open-source community. Let us know what you what models/capabilities you want to see next.
- Blog: precisionnumerics.ai/blog/boole-1p7b
- Weights: huggingface.co/precision-numerics/Boole-1.7B (GGUF)
- Demo code (for vLLM, llama.cpp): github.com/PrecisionNumerics/boole-demo
- Local chat in browser: precisionnumerics.ai/chat/
- X: https://x.com/precision_num/status/2109309446379950447
78
Upvotes
Duplicates
LocalLLM • u/d77chong • 15h ago
Model Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B
1
Upvotes


