We are conducting an experiment in which we display three words to the participants, and we want them to choose which of the three words belongs to another semantic category (the choice is made by clicking on the word using the ‘scale’ function).
We are curious whether it is possible to compute the accuracy of the choice of the participants for each trial online. To do so, we already logged another column, in which we report the accurate answer for each trial. We could do this with R after collecting the data, but we would like to try doing it directly while collecting the data.
However, we aren’t sure whether it is possible, and if so, whether you’d rather advise us to do it after collecting the data for specific reasons.