How do you actually test whether a BI tool is worth switching to or just looks good in demos?
Been poking at a few BI tools lately because Power BI isn't always the right fit for every freelance project and clients sometimes have opinions. The thing is, every tool looks reasonable in a demo or a YouTube walkthrough built on clean sample data. The gap between that and real messy client data with weird relationships and inconsistent naming is where tools either hold up or fall apart.
My rough approach right now is to take one actual dataset from a past project, something with a few joins, some nullheavy columns, and at least one calculated field that requires conditional logic, and just try to build the same thing in the new tool. If it takes three times as long and the documentation assumes you already know the tool, that's usually a signal.
What I'm less sure about is whether that's a fair test or if I'm just making it harder than it needs to be because I'm already comfortable in one environment. There's probably some bias there.
Curious what others use as a baseline when evaluating a new tool. Do you have a goto test dataset or a specific workflow you run through, or is it more of a feel thing after a few hours of use? Also wondering if there's a point where time spent evaluating stops being useful and you're just procrastinating on the actual work.