I trained an LLM that runs on an ESP32 and directly in the browser

Link to try it out yourself is: topk.sh

The models download their weights directly in the browser so it works offline.

Keep in mind they are very small and inaccurate. (8M and 13M parameters)

However, I am building 500M and 1B+ parameter local models for agent based coding and other purposes.

I will be shipping hardware designed for these tasks which connect directly to you computer or other device.

u/Live_Confusion_3003 — 13 days ago