1-bit WebGPU LLM Demo Checking WebGPU...

1-bit LLMs, in your browser.

Run LLMs entirely locally in your browser on WebGPU, powered by Transformers.js.

Try the demo ->

Load locally.

Each Bonsai model runs in your browser via WebGPU. Pick a size - smaller loads faster, larger reasons better.