r/WebAssembly

Llama.WASM + WebGPU = Local LLMs
▲ 12 r/WebAssembly+2 crossposts

Llama.WASM + WebGPU = Local LLMs

Over the weekend I built a technical proof of concept showing an LLM running client-side in a browser using Llama.cpp compiled to WASM with WebGPU.

github.com
u/Numerous-Fan8138 — 4 days ago