
Agent Behavior Lab — a self-hosted lab for studying how tool-using LLM agents behave (MIT, React/TS/Prisma)
Sharing a project I've been building: Agent Behavior Lab, a self-hosted platform for running reproducible experiments on tool-using LLM agents.
You define an agent's context (model, tools, persona, prior conversation), vary one factor at a time, run repeated trials, and get grouped metrics + heatmaps + effect sizes to see what actually changed the behavior. Works with any OpenAI-compatible provider; ships with seed data so it's populated on first run.
- Stack: React 19, Vite, TypeScript, TanStack Query, Express, Prisma, PostgreSQL, Docker Compose
- License: MIT
- Safety: doesn't execute tools — records whether a model attempted a call
https://github.com/Null-Square/agent-behavior-lab
Contributions welcome (there's a CONTRIBUTING guide). Happy to answer questions about the architecture.