Inference in the browser

Browser-native LLM inference engine in WGSL compute shaders. Zero server cost.

0

server inference cost

494M

params, client-side

100%

WGSL kernels

LiveWGSL · WebGPU · TypeScript · Qwen2.5-0.5B