
I wrote an open framework around a problem I think gets overlooked with AI agents: proving what actually happened
I’ve been working on something called the AI Execution Integrity Framework (AIEF) and I’d like to get some outside eyes on it.
The idea came from watching AI systems move from generating answers to actually doing things.
Calling tools. Updating systems. Making decisions. Triggering workflows. Acting with less human involvement.
We talk a lot about AI governance, safety and guardrails, but I kept coming back to a more basic question:
If something goes wrong six months later, what evidence do we actually have of what the AI did?
Logs are useful, but they’re usually produced and controlled by the same system being questioned.
And cryptography doesn’t solve everything either.
You can prove that a record hasn’t been changed without proving that the system captured everything it should have captured in the first place.
So I wrote AIEF around the execution side of the problem.
It looks at things like:
- what should be captured during an AI execution
- integrity of the resulting artifact
- provenance
- linking multiple execution steps
- independent verification
- what can and cannot legitimately be claimed from the evidence
It’s intentionally not another general AI governance framework.
Governance answers things like:
“What should this system be allowed to do?”
AIEF is more interested in:
“Now that it ran, what evidence exists of what actually happened?”
I’ve published it openly here:
And it’s on GitHub too:
https://github.com/artnames/AIEF
I’d really appreciate feedback from people actually building or operating AI systems.
Even if your reaction is “this is solving the wrong problem”, that’s useful.
The part I’m especially interested in pressure-testing is where the boundary should sit between execution evidence and governance.