# What statistical tests can be used to check for lexicalisation effects in a judgement task?

In a run-of-the-mill judgement rating task where participants have to rate sentences on a Likert scale (e.g. 1 to 6) and that is constructed using a Latin square design, what statistical tests can be used to check for lexicalisation effects and which is the most commonly used?

Update:

By lexicalisation, I mean checking the different realisations of each condition. So if there's a variable 'transitivity' giving two conditions, i.e. transitive and intransitive, I want to test whether any of the choices of transitive verbs behave in a different way to the other choices of verbs in that condition. Can it be shown just using t-tests?

• Mann-Whitney U test, Chi square. This is because of the data produced by Likert judgements. How you test for lexicalisation effects depends entirely on your hypotheses: what does lexicalisation mean in your particular case, and what effect would you expect it to exert on the judgements? Without working out the hypotheses first you can't "test" anything. Aug 23, 2017 at 10:13
• @FlorianBreit Thanks. By lexicalisation, I mean checking the different realisations of each condition. So if there's a variable 'transitivity' giving two conditions, i.e. transitive and intransitive, I want to test whether any of the choices of transitive verbs behave in a different way to the other choices of verbs in that condition. Can it be shown just using t-tests? Is an items analysis needed? Aug 23, 2017 at 11:26
• In principle I think yes, and I'd go with the MWU here because it's difficult to establish that the conditions for the t-test are met (but if you can, go ahead and use a regular t-test). The test can show that it is likely that the two groups (transitive and intransitive in this case) behave differently and exclude to a degree that this difference is due to chance. No test can show that they are in fact different though, and more importantly, that the underlying cognitive division is the driver of the difference, those things are up to your arguments for the experimental choices. Aug 23, 2017 at 12:27
• Thanks. I've updated the question to include the example. If you put your comments as an answer, I'll mark it as the accepted answer. Aug 23, 2017 at 13:53