I'm in the process of designing a self-paced-reading & a grammaticality-judgment-task experiment, which should be performed by second language learners. It is crucial to the study is how the subjects differ in their proficiency levels based on which their results on the SPR and GJT will be interpreted. While I need to assess proficiency, the experiment is long enough itself and, therefore, making it difficult to test them on a regular proficiency test besides the experiment they're required to do.
Since the GJT is a variable meant to be tested in the experiment, I cannot use it as a proficiency measure in addition to the limitations they may involve when it comes to testing language proficiency. Therefore, since the experiment will include many filler items (distractors), I'm trying to find a way to make use of such items to test proficiency without affecting the other target items I'm measuring.
What I'm asking is whether there are any testing possibility within this experiment's framework that can be useful to be taken as a reliable measure of language proficiency.
Note:
- The experiment involves a sentence self-paced-reading window and then follows it another window with the grammaticality judgment question.
- The self-paced reading task is intended for only part of the sentence, so other parts are open for possible use.