Agent Behavior Lab — a self-hosted lab for studying how tool-using LLM agents behave (MIT, React/TS/Prisma)
▲ 3 r/PromptEngineering+2 crossposts

Agent Behavior Lab — a self-hosted lab for studying how tool-using LLM agents behave (MIT, React/TS/Prisma)

Sharing a project I've been building: Agent Behavior Lab, a self-hosted platform for running reproducible experiments on tool-using LLM agents.

You define an agent's context (model, tools, persona, prior conversation), vary one factor at a time, run repeated trials, and get grouped metrics + heatmaps + effect sizes to see what actually changed the behavior. Works with any OpenAI-compatible provider; ships with seed data so it's populated on first run.

  • Stack: React 19, Vite, TypeScript, TanStack Query, Express, Prisma, PostgreSQL, Docker Compose
  • License: MIT
  • Safety: doesn't execute tools — records whether a model attempted a call

https://github.com/Null-Square/agent-behavior-lab

Contributions welcome (there's a CONTRIBUTING guide). Happy to answer questions about the architecture.

github.com
u/IcyPop8985 — 3 days ago

Has anybody heard of Nullsquare?

A while ago, I started working for a cybersecurity company called nullsquare.net. They are building a fully AI-powered vulnerability management platform, and recently they added a new feature for compliance readiness audits, all through the agent. I was wondering how famous they are in the cybersecurity space. I know most of their clients are in MENA (government-related projects), but I wonder if they are known in the West.

reddit.com
u/IcyPop8985 — 18 days ago