Microsoft Copilot found a decade of our oversharing in about a week.
we ran a pilot group expecting complaints about accuracy when we turned on copilot, but it turned into the most effective permissions auditor we've ever run, and entirely by accident at that.
what happened was someone asked it something totally normal about budgets and it pulled numbers from a finance folder that had been shared to "everyome in the org" during a reorganisation. this means that if your account can reach a file, copilot will read it, summarise and quote it back in the chat. I imagine this would translate to it auditing ten years of our sharepoint sharing.
If you made it past the pilot stage, how did you get through cleaning up the oversharing and did you find a way to see what people are feeding the non copilot AI tools?