r/RiotIQTest

I've been reading about IQ tests lately and I'm curious whyat people here think. Do you think they're a useful way to udnerstand cognitive abilities, or are they too limited to say much about a person?

I'd be interested to hear both sides. :)

RIOT IQ's Chief Scientist, Dr. Russell Warne, used a method that jointly models test item responses and item response times. This study has been submitted for peer review at a journal, but it was also released as a public pre-print today.

Highlights of the results:

➡️ All 9 core RIOT subtests conform well to model expectations. Where there is misfit, it is in the hardest items, most of which few examinees see anyway. The images above displays the best, median, and worst fitting items for the fluid (first image) and spatial (second image) subtests. Even when the departures are noticeable, the models still do a good job at anticipating how long examinees will take to respond to test items.

➡️ The correlations between subtest performance and response times are spurious and are the product of a person's natural test-taking speed (which is not cognitive) and item characteristics. In other words, how long it takes someone to respond to test items cannot be used to measure intelligence.

➡️ But response times still contain valuable information. They can be used to identify unusual response behaviors, such as being rushed by a tight time limit or cheating. There was very little unusual response behavior in this sample, with the exception of the Figure Weights subtest, which has 17.5% of its examinees take statistically significantly longer to respond to items than the model expected.

There are other interesting findings in the preprint, and you are encouraged to check it out.

*Reposted from X