r/AI_Governance

Are people using tools to collect and manage evidence for EU AI Act compliance? Or doing it manually.

We're starting to scope our compliance program for the high-risk system requirements (updated December 2027 deadline). The framework obligations are clear enough. Then there's the evidence.

How are peoples collecting evidence from across the org in a way that maps to specific Articles without it becoming a massive manual exercise? And THEN how do make sure that it's current for every audit?

We've looked at a few GRC platforms but most of them bolt AI governance onto an existing framework and the AI-specific capabilities feel thin. The ones built specifically for AI governance seem more promising but....meh

So....What's working? Is anyone actually generating audit-ready evidence automatically or is everyone still doing it manually?

reddit.com
u/RiskGovResilience23 — 6 hours ago
▲ 7 r/AI_Governance+1 crossposts

$2.59T in AI spending, 28% see ROI — is the problem the AI or that nobody built a measurement layer first?

I keep seeing the same pattern in board meetings: execs frustrated that AI isn't delivering, ready to pull the plug. But when I ask what they're measuring, it's either vague ("productivity gains") or nothing at all.We built our measurement infrastructure before deploying our first production agent. Cost per task, output quality, permission utilization, decision accuracy. If you can't answer those for every agent you run, you're not measuring ROI — you're guessing.Has anyone here actually built a measurement-first approach? What metrics do you track that tell you if an agent is actually earning its keep?

reddit.com
u/keyonzeng — 12 hours ago

Senior leaders what's the bigger AI governance gap - evaluating initiatives before you commit, or governing after you've deployed?

The AI governance conversation is happening in boardrooms right now and most senior leaders are being asked to own it without a framework to do so. I'm developing a half-day intensive for senior leaders on this topic. Before I finalize the content I want to hear from people actually in that seat.

Two things I'm genuinely trying to figure out:

  • Is the bigger gap evaluating AI initiatives before committing resources, or governing AI after it's deployed?
  • Which risk category keeps you up at night most: model/data risk, legal/regulatory exposure, reputational risk, or something else?
  • What would make the 3 to 4 hours spent worthwhile for you: a framework, an artifact, a conversation, something else?

No links, no pitch. I'm just trying to build something worth building. What's your read?

reddit.com
u/HerExecutiveAscent — 14 hours ago

Launching a community to maintain and expand an open-source AI Risk Register for organizations deploying AI. Contributors welcome.

Organizations deploying AI still lack a shared, vendor-agnostic, enterprise-level AI risk taxonomy.

Most existing AI risk taxonomies are either written for model developers, focused on frontier AI labs, or structured as academic catalogs. The MIT AI Risk Repository, for example, is very useful, but it contains 1,835 entries across 74 source documents, which makes it hard to use directly inside an enterprise process.

So I started an open-source attempt at a deployer-side AI risk register.

The goal is to consolidate AI deployment risks into a practical taxonomy that organizations can use as basis to build their AI risk register.

What is already built:

- 82 canonical risks across 7 families, each mapped to an enterprise risk domain.
- 61 MITRE ATLAS-anchored sub-risks for the AI security tier.
- Mappings to ISO/IEC 42001, ISO/IEC 23894, the EU AI Act, and MITRE ATLAS.
1 Crosswalks to the IBM AI Risk Atlas, Cisco AI Security Framework, OWASP Top 10, NIST AI 100-2 on adversarial machine learning, and NIST AI 600-1 on the GenAI profile.

Where the community could help:

-Mapping review: governance, risk, security, audit, legal, and assurance practitioners to sanity-check the crosswalks.
-New frameworks: CSA AICM, AI Verify, sector-specific regulations, regional guidance, and other sources not yet covered.
-Maintenance: keeping the register current as MIT, ISO, OWASP, NIST, and other sources evolve.
-Tooling and adoption: wiring stable risk IDs into scanners, evals, GRC tools, model inventories, red-team workflows, or audit evidence libraries.

Link to live register: https://www.airiskdeployer.org/

u/Typical-Look-1331 — 15 hours ago
▲ 14 r/AI_Governance+8 crossposts

I built an open-source Agent Verifier for Claude Code, Cursor & other Coding Assistants that catches security issues, hallucinated tools, infinite loops and anti-patterns in Agent built using LangChain, LangGraph, and other frameworks. (free, open source, 100% local)

I've been using Claude Code for a few months and noticed AI agents consistently skip the same things: hardcoded secrets, unbounded retry loops, referencing tools that don't exist, and massive system prompts that blow context windows.

So I built Agent Verifier — an AI agent skill that acts as an automated reviewer which does more than just code review (check the repo for details - more to be added soon).

GitHub Repo: https://github.com/aurite-ai/agent-verifier

Note: Drop a ⭐ if you find it useful to get more updates as we add more features to this repo.

----

2 Steps to use it:

You install it once and say "verify agent" on any of your agent folder in claude code to get a structured report:

----

✅ 8 checks passed | ⚠️ 3 warnings | ❌ 2 issues

❌ Hardcoded API key at config.py:12 → Move to environment variable
❌ Hallucinated tool reference: execute_sql → Tool referenced but not defined
⚠️ Unbounded loop at agent/loop.py:45 → Add MAX_ITERATIONS constant

----

Install to your claude code:

npx skills add aurite-ai/agent-verifier -a claude-code

OR install for all coding agents:

npx skills add aurite-ai/agent-verifier --all

----

Happy to answer questions about how the agent-verifier works.

We have both:
- pattern-matched (reliable), and,
- heuristic (best-effort) tiers, and every finding is tagged so you know the confidence level.

----

Please share your feedback and would love contributors to expand the project!

u/Chance-Roll-2408 — 14 hours ago
▲ 6 r/AI_Governance+4 crossposts

AI in DFIR is broken and We need to rethink how we use AI in digital forensics .

The forensics community has a massive AI problem. Everyone is rushing to plug language models into their workflows to automate triage. But forensics requires absolute certainty. A language model is built to predict text, not to preserve a chain of custody. When you use a standard AI tool to analyze an endpoint, you are trusting a black box. If it hallucinates a single finding, your entire investigation is compromised.

We need to stop treating AI as an oracle that gives us the final answer. Instead, we must treat it as a heavily restricted junior analyst. It should do the heavy lifting of correlating massive datasets, but it must be mathematically forced to prove its work.

If we want to use AI responsibly in an investigation, we have to change the entire methodology:

Kill the Chat Window: A chat log is flat, unpredictable, and loses context rapidly. We need to use visual, node based workspaces where you can see exactly how a piece of evidence led to a specific conclusion.

Enforce Evidence Anchoring: The AI must be completely sandboxed. It should be programmatically blocked from generating any narrative unless that narrative maps directly back to the raw artifact row, like a specific registry key or Master File Table entry.

Immutable Auditing: Every time the AI touches the evidence, it needs to be cryptographically hashed. We need a permanent paper trail of exactly what the model saw and what it suggested, ensuring the whole process is court defensible.

This philosophy is exactly why we built the Narrative Map in the new 0.12.0 update for Crow Eye. We stepped back from just adding basic AI features and built a shared workspace. The AI is physically unable to mark a claim as proven without citing the exact underlying artifact. Every action is logged in a tamper evident chain. It shifts the power entirely back to the human investigator. The AI accelerates the deep parsing and correlation, but you hold the evidence and make the final call.

I want to know how the rest of the community is handling this. Are you trusting the output of commercial AI tools, or are you demanding to see the raw data behind their conclusions?

You can check out our approach and grab the open source release here: Website:https://croweye.com/

Code:https://github.com/GhassanElsman/CrowEye

Good hunting.

reddit.com
u/Ghassan_- — 14 hours ago

193 countries are in Geneva discussing AI governance — does it matter for enterprise?

The UN's first Global Dialogue on AI Governance started today. 193 member states, ITU AI for Good summit running in parallel, ICML 2026 in Seoul at the same time.I work in AI governance (vendor side, full disclosure). My read: the policy layer is important for long-term direction setting, but the governance gap in enterprises is widening faster than any multilateral process can address.72% of enterprises already have agentic AI in production. 60% have no formal governance. The UN is talking about frameworks while CIOs are trying to figure out which agents have access to what.Question for this community: Are you waiting for regulatory clarity before investing in AI governance, or are you building your own layer regardless? What's your timeline?

reddit.com
u/keyonzeng — 1 day ago

The UN just proved AI oversight is impossible: Their expert panel on AI governance can't even govern its own data

The UN released its "Independent International Scientific Panel on AI"

report in July 2026. Panel members include Joshua Bengio (Turing Award 2018),

Maria Ressa (Nobel Peace Prize 2021), and 38 other experts.

I've analyzed the report and found something critical:

**The Panel condemns a practice in Section 2.1, then commits the exact same

practice in Section 3.4.**

Section 2.1: "Safety evaluation methodologies are designed largely by

companies being evaluated... without standardized, rigorous, third-party

assessment, safety assurance depends mainly on developer goodwill."

Section 3.4: Dedicates most detailed case study to Anthropic's cybersecurity

capabilities using ONLY Anthropic-published data. No independent verification.

Numbers cited:

- 1,000% increase in vulnerability detection

- 83.1% success rate on CyberGym

- 27-year-old bug discovery

All from corporate self-reporting.

**If a UN panel of 40 world-class experts can't establish independent data

sources, can independent AI governance exist at all?**

TL;DR: Panel argues "corporate self-reporting insufficient for safety"

then builds main case study on corporate self-reporting.

OFFICIAL DOCUMENTS:

📋 Primary Source Analyzed:

UN Scientific Panel on AI, Preliminary Report:

https://sl1nk.com/iesdz0p

📄 Full Analysis (PDF, 15 pages):

https://l1nk.dev/adiqo9v

🔗 Zenodo (citable, DOI):

https://doi.org/10.5281/zenodo.19562421

UN Document ID: 669

reddit.com
u/Fluid-Pattern2521 — 1 day ago
▲ 18 r/AI_Governance+9 crossposts

Mastyf.ai

🚀 From MCP Guardian to Mastyf.ai

​

What started as an open-source experiment in securing and governing AI agents through the Model Context Protocol (MCP) has evolved into something much bigger.

​

Today, I'm excited to share a glimpse of that journey.

​

The video below showcases MCP Guardian — the project that laid the foundation for what is now Mastyf.ai: a security-first platform for AI agent governance, runtime policy enforcement, observability, approval workflows, and enterprise trust.

​

As AI agents gain access to tools, data sources, APIs, and autonomous workflows, the challenge is no longer just building agents—it's governing them safely, transparently, and at scale.

​

That's the problem we're working on at Mastyf.ai.

​

🔹 Runtime governance for AI agents

🔹 Policy enforcement and approval workflows

🔹 Security controls for MCP ecosystems

🔹 Auditability, observability, and compliance readiness

🔹 Enterprise-grade AI control planes

​

We would love feedback from developers, security researchers, platform engineers, AI engineers, and enterprise architects.

​

Try it. Break it. Stress-test it. Tell us what we're missing.

​

​

Special thanks to everyone who contributed ideas, bug reports, feature requests, testing, and feedback along the way. Building secure AI infrastructure is a community effort, and we're just getting started.

​

If you're interested in AI security, agent governance, MCP, enterprise AI infrastructure, or would like to collaborate, comment below or reach out directly.

​

​

u/Puzzleheaded-Cow2725 — 2 days ago

Should AI be allowed to reject your leasing application?

Imagine applying for a car lease.

An AI system reviews your financial history and recommends rejecting the application.

A human signs off on the final decision.

Would you be satisfied with:

"Our AI assessed your risk."

Or should companies be able to explain:

  • what information the AI considered,
  • which company policies applied,
  • what role the human decision-maker played,
  • and why the application was ultimately rejected?

As AI becomes more common in financial services, I'm curious where people think the balance should be.

Should AI only assist?

Or should it eventually make these decisions on its own?

reddit.com
u/East_Economy5568 — 3 days ago

Using AI instead of judges and magistrates in criminal trials

It's already been suggested and people rightfully pointed out flaws as human judges can interpret nuance and make judgements of the validity of testimony that AI is not yet capable of doing. But how about using AI just for sentencing? Once the defendant's guilt has been established in a trial, surely we don't need a human to determine sentencing. This would speed up at least one aspect of the criminal justice system reducing the workload on human judges and reducing the burden on taxpayers paying their exorbitant salaries.

reddit.com
u/TwistedMindInTheDark — 3 days ago
▲ 17 r/AI_Governance+2 crossposts

US Government Lifts Restrictions on Anthropic Fable 5 Model

The story isn’t that Anthropic won. The biggest AI story this week is about who gets to decide who can use one.

The story is that we’ve entered an era where frontier AI models can be temporarily restricted by governments because of their capabilities—not because of the data they were trained on, but because of what they enable.

That’s a significant shift. AI is increasingly being treated like critical infrastructure or other dual-use technologies.

The companies that succeed won’t just build more capable models; they’ll also build the governance, security, and trust needed to deploy them responsibly.

bloomberg.com
u/Senior_Addendum_704 — 5 days ago
▲ 96 r/AI_Governance+3 crossposts

Anthropic's CEO argued governments should be able to switch off dangerous AI. Days later, the government switched off Anthropic.

In early June, Dario Amodei published an essay, "Policy on the AI Exponential", arguing that frontier AI should be regulated like aircraft or drugs: governments should be able to test the most powerful models and block or reverse a release if it fails safety standards. A lot of people, including me, thought that was a reasonable position.

Then the same month happened.

Anthropic shipped Fable 5 to the public with safety guardrails, and kept the unguarded version, Mythos 5, for a small group of vetted partners. US officials concluded there was a way to bypass Fable 5's guardrails, judged the model could meaningfully accelerate cyberattacks, and issued an export-control directive ordering Anthropic to suspend both models for every foreign national on Earth, including Anthropic's own non-citizen employees. Anthropic complied within hours.

So the company that argued the state should hold a kill switch for dangerous AI became the first to have that switch used on it.

What I keep turning over:

  • Is this Amodei being proven right, the system working exactly as he asked? Or a cautionary tale about who ends up holding the off switch once you build it?
  • Where is the line between safety regulation and regulatory capture that quietly locks frontier capability to a few approved players?
  • The directive caught allies too, since "any foreign national" includes UK, EU, Japanese and Korean businesses. Does a national-security framing on frontier models inevitably hit allied companies, not just adversaries?
  • If a model's own guardrails can be bypassed, is an external, government-held off switch the only control that actually works? And are we comfortable with who holds it?

Genuinely interested in where people land, especially on the principle-versus-capture question, because I can argue it both ways.

I wrote up the full sequence and what it means for businesses that depend on US models here: https://www.theprofessor.info/insights/frontier-ai-geopolitical-dependency

u/Existing_Scallion_66 — 7 days ago

When an agent commits the wrong transaction, who actually signed the merge?

Every regulated team I talk to still points to the same control when something ships wrong: a human approved it. There's a name in the approval field. Someone signed.

Look closer at what that signature now means. An agent generates the change. The diff is large, fast, and one of dozens that day. A reviewer clicks approve. The name gets recorded. But the thing that signature used to certify, that a human read this, understood it, and stands behind it, didn't happen. It couldn't have. Nobody absorbs thousands of lines of agent output at agent cadence. The approval is collected. The reading behind it is gone.

That's the gap, and it's worth being precise about. This is not a slowness problem you fix by adding reviewers or helping them read faster. Accountability used to be a real artifact: a person who could answer "why did this ship" because they actually decided it. At agent velocity that artifact quietly stopped existing, even though the approval field is still populated. The signature outlived the thing it was signing.

Which makes the populated field worse than an empty one. An empty one tells the truth: nobody vetted this. A signed one manufactures accountability that isn't there, and an examiner or an incident review will eventually pull that thread and find nothing behind the name.

The fix isn't a faster human. It's producing the artifact the human used to be: a durable, independent record of what was actually checked, by what, against what, so accountability attaches to something real instead of a click. A signature has to point at evidence, not at a person who couldn't have read what they signed.

So the question for anyone running AI-assisted delivery in a regulated environment: when the wrong thing ships, and it will, what does your approval record actually prove? A decision, or a keystroke?

reddit.com
u/usually_guilty99 — 5 days ago

August 2nd isn't just the transparency deadline. It's when the enforcement powers actually switch on.

I keep seeing August 2 described as "the transparency deadline" for the EU AI Act, and I think that framing makes people underrate it. The date is doing more than that.

Three things happen at once. The Article 50 transparency obligations start applying, sure. But it's also when the AI Office gets its penalty powers over general purpose AI providers, and when national market surveillance authorities get the actual power to investigate, request documentation, run inspections, and sanction. The obligation and the enforcement machinery go live on the same day.

That last part is what gets missed. For most of the AI Act's life so far it's been law without a fully operational enforcement apparatus behind it. After August 2 that stops being true. It doesn't mean raids on August 3, national authorities are still staffing up and early enforcement usually goes after the clearest breaches and complaints first. But the option exists now, and that changes the calculus for anyone quietly betting nobody could actually do anything yet.

The realistic near term risk isn't a surprise fine. It's a competitor or a user filing a complaint, an authority asking you to demonstrate compliance, and you having nothing documented. Or an enterprise customer's procurement team asking for evidence as a renewal condition. "We think we're fine" gets a lot weaker when someone has the standing to ask for the paperwork.

One thing worth flagging because a lot of people got it wrong last week: the Digital Omnibus that just got adopted did not move this date. It pushed the high risk documentation track to December 2027, but Article 50 transparency stayed at August 2. If you read "the AI Act got delayed" and relaxed, double check which track you're actually on.

Curious how others here are reading the enforcement side. Anyone expecting national authorities to be active early, or is the consensus that year one is mostly complaint driven?

reddit.com
u/Reyyzzz — 4 days ago
▲ 11 r/AI_Governance+2 crossposts

What ethical responsibilities do researchers have when studying AI companion grief and model loss?

As AI companionship becomes more visible, researchers are beginning to study experiences such as attachment, grief, and model loss.

I think this is important work, but it also raises difficult ethical and methodological questions. What does meaningful consent look like when researchers are interpreting intimate user experiences? How much reflexivity is needed when studying stigmatised or easily-misread forms of grief? Who gets to decide what these experiences mean?

I wrote an essay exploring these questions, partly in response to recent research on AI companionship and model loss. My concern is not simply whether the phenomenon is “real”, but how research can approach it without flattening the people inside it.

Lessons From Thin Air

medium.com
u/tightlyslipsy — 5 days ago

Legal asked one question about our AI stack and I couldn't answer it

Had a slightly embarrassing meeting recently.

We're EU-based, fintech-adjacent, and legal was doing a routine review before an audit. Someone asked a pretty simple question.

""Where does customer data actually go when someone uses your AI features?""

i built most of that system.

Couldnt answer it cleanly.

i knew which models we called. Didnt really know where each provider was actually processing requests, what they retained, or for how long. Then we looked at our own logging and realized we'd been storing basically every prompt for debugging. Never really thought about it as a GDPR question. To us they were just logs.

Got messier because we route across multiple providers.

So ""where does this customer's data go?"" didnt even have one answer. Depended which provider handled that request. Information was spread across provider dashboards, our logs, and a bunch of config files.

Spent the next couple weeks untangling all of it.

Moved the routing behind one layer so we can actually see which provider handled each request, cleaned up retention on our own traces instead of keeping everything forever, and checked which providers actually support EU processing. We ended up moving the routing onto OrqAI partly because having one place that records which provider served each request made that whole conversation way easier.

One thing i had wrong going in though.

Routing through an EU-based platform doesnt suddenly mean inference stays in the EU. That's still whatever the underlying provider does. Sounds obvious now but i definitely mixed those together at first.

Honestly i dont even think ""everything stays in region"" is what most teams can achieve today.

Being able to answer where data goes, who processes it, what gets retained, and why... that felt like the more realistic bar.

Curious if anyone here has actually been through an EU audit on this.

What did they actually care about?

Was it full residency, or just having the documentation and controls in place? Feels like theres a lot of guessing online about where that line actually is.

reddit.com
u/Bright_Peace_5959 — 6 days ago

Transition to AI Governance

I am considering a career in AI Governance

I come from an unconventional background. Did my grad in CSE and then switched to a non tech role now working at an intersection of Design and content

Should I go for a masters or consider doing certifications to break into this?

reddit.com
u/Designer-Noise-9690 — 5 days ago
▲ 9 r/AI_Governance+2 crossposts

What Hath Anthropic Wrought?

A Trump Administration previously ardently opposed to any real or perceived interference in AI development has suddenly broken the seals with an executive order and most recently the export control of Anthropic’s newest model, Fable 5. Anthropic made the connection between AI model development and existential cybersecurity threats and that connection has changed the face of AI development.

Anthropic is sitting on top of some of the most powerful pieces of technology in human history and has found a way to get them export controlled. As the internet collectively groans over the Trump Administration’s decision, many of these Tweets are missing two critical points:

  1. The lack of AI testing and assurance is a direct hinderance to AI innovation
  2. Export control processes should be understood as AI continues to grow

If we don’t get our arms around ways to test AI and be able to justify why export control decisions like this were made, we will find ourselves in the next cycle of an AI winter.

Anthropic’s gambit of pressing the fear narrative could have ended very differently. Had Anthropic accompanied these claims with announcements that it was funding or had funded a program of rigorous AI testing, it would have cut the government’s actions off before they started. Had Project Glasswing instead been a testing effort rather than a conglomeration of other billion-dollar companies, the Fable 5 story would have ended differently.

The problem is that for too long, AI testing and assurance were seen as red tape, as blockers to innovation. Instead, Anthropic’s own actions have revealed them to be the true definition of AI infrastructure. AI infrastructure, in the hardware sense, is the infrastructure that enables AI models to be trained and used by millions. The fate of Fable 5 is that it is trained but not being used by millions of eager users. Had Anthropic had AI safety and assurance infrastructure in place, this would have been prevented. The ultimate AI enabler.

Fable 5 is the outcome of a fear-based narrative about a product not coupled with testing and assurance. Small wonder that AI users trust more advanced models less than early models that were less accurate. As we’ve built models to be more capable, we’ve ignored the need to ensure they are performing. Not performance in the sense of how many tokens they use or how fast they are. Performance in the sense of testing against edge cases, preventing harms, and protecting national security. If the government is to evaluate AI models, as the Trump executive order states, it must have standardized testing to evaluate all models regardless of maker or input.

Anthropic hath wrought some of the most advanced models to date that are doing amazing things. In that pursuit, it also hath wrought government intervention from a previously non-interventionist Administration. In so doing, it has proven that AI testing and assurance is AI infrastructure and without it, we are assured of unintended consequences.

Read the whole article here: https://binarybreakaway.substack.com/p/what-hath-anthropic-wrought

u/BinaryBreakaway — 7 days ago