i don't really believe in "self-service BI" anymore
we rolled it out across a large org, dozens of markets, tens of thousands of users, and the pitch was exactly what you'd expect — data for everyone, empower the business, reduce dependency on the data team, all of that
and for maybe the first six months it felt like it was working
then we started noticing shadow dashboards appearing everywhere, teams building their own logic, the same metric calculated five different ways by five different people who were all completely convinced they were right, and suddenly instead of one version of truth we were maintaining dozens of versions of chaos and nobody could agree on anything because everyone had their own numbers and their own definitions and their own reasons why their version was the correct one
the hardest part wasn't technical, we had governance, we had documentation, we had training, none of it really mattered because most people don't think in terms of data models or grain or definitions, they just want an answer fast and they'll build whatever gets them there
and once you give teams full control over their data you can't really take it back, everyone optimizes for their own use case and alignment becomes almost impossible, you've essentially traded one bottleneck for a hundred small fires
i'm not saying self-service is useless but i think we massively underestimate how much structure it actually needs to not fall apart, because without that you don't get data democratization, you just get distributed chaos with nicer dashboards
curious if anyone actually made this work at scale or if it always ends up like this