[Q] Is my supervisor doing ANOVA testing in the correct way?
Every 6 months we have to run instrument comparisons on our 4 LC/MS instruments.
We do this by running 2 blanks, 5 low controls, 5 high controls, and 10 randomized samples on all 4 instruments.
My supervisor then takes the data from these runs, puts them side by side in excel and does ANOVA: Single Factor to get a p-value.
My concern is that I thought anova testing was meant to be done when the sample type in the data sets are the same. But here, there's 4 data sample types getting all bunched together so the variance is wild. My supervisor is a phD and he's not exactly great about certain "prying" type questions so I have been a little nervous to ask.
Am I overthinking this? I am certainly no stats pro, but I am always looking for ways to improve the integrity of our data.
Thanks!