r/LocalLLaMA • • 15h ago

New Model Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B

We're launching Precision Numerics by releasing Boole-1.7B, a 1-bit version of Qwen3-1.7B.

  • 247 MB packed weights: 13.9× smaller than BF16.
  • 85.9% of the BF16 model’s average score across our 10-task evaluation - outperforms 1-bit Bonsai-1.7B and nearly matches 1.58-bit Bonsai-1.7B.

Try it locally in your browser (it's for low-latency tasks using English and non-thinking mode), or use it with vLLM or llama.cpp.

We'll ship more capable models for the open-source community. Let us know what you what models/capabilities you want to see next.

78 Upvotes

Duplicates