•It is apparent the differences between methods of testing. There are many pros and cons for each. It seems that the cons for internet based tests are related to the technology more so (e.g., screen size, load time, etc…). How can we better account for this? One thing that would help in order to better jump between questions or at least sections, would be to have a side tablet of sections viewable that you can click on if you want to go back to a question in that section. •In addition, this method seems contradictory to the current adult population regarding adult learning theory.
I wonder if test takers ability to flip through the test (i.e., on a paper and pencil test) and different sections of the test at will affects test score performance or just applicant reactions of the test?
Given the finding that some constructs may not be measured equivalently with paper and pencil and internet, should organizations forgo the advantages of internet testing until either more equivalent measures are designed or construct validity is determined with internet versions of tests?
In response to Shane's question I know there is research showing that when student's have the capability of skipping around they think they do better on tests however, there actually aren't differences in test scores.
I share your concern Vicki, if differences in perception, preference, reactions can interfere and affect criterion-related validity; and if subgroups are affected (because of comfort-level, experience, e.g. access and therefore practice, speed, confidence), do benefits currently outweight negatives?
It seems that computer-based tests produce different score distributions than do p&p type tests. This makes it preferable to use one or the other but not both as a selection tool for a particular job. Do you think the use of computer-based testing without the option of a p&p test might show adverse impact for older workers and open the organization up for legal challenges to their selection process?
It’s interesting that it showed that younger people performed better on computer mediated tests than their older counterparts. What implications might this have for adverse impact? What can we do to prevent adverse impact here?
•It is apparent the differences between methods of testing. There are many pros and cons for each. It seems that the cons for internet based tests are related to the technology more so (e.g., screen size, load time, etc…). How can we better account for this? One thing that would help in order to better jump between questions or at least sections, would be to have a side tablet of sections viewable that you can click on if you want to go back to a question in that section.
ReplyDelete•In addition, this method seems contradictory to the current adult population regarding adult learning theory.
I wonder if test takers ability to flip through the test (i.e., on a paper and pencil test) and different sections of the test at will affects test score performance or just applicant reactions of the test?
ReplyDeleteGiven the finding that some constructs may not be measured equivalently with paper and pencil and internet, should organizations forgo the advantages of internet testing until either more equivalent measures are designed or construct validity is determined with internet versions of tests?
ReplyDeleteIn response to Shane's question I know there is research showing that when student's have the capability of skipping around they think they do better on tests however, there actually aren't differences in test scores.
ReplyDeleteI share your concern Vicki, if differences in perception, preference, reactions can interfere and affect criterion-related validity; and if subgroups are affected (because of comfort-level, experience, e.g. access and therefore practice, speed, confidence), do benefits currently outweight negatives?
ReplyDeleteIt seems that computer-based tests produce different score distributions than do p&p type tests. This makes it preferable to use one or the other but not both as a selection tool for a particular job. Do you think the use of computer-based testing without the option of a p&p test might show adverse impact for older workers and open the organization up for legal challenges to their selection process?
ReplyDeleteIt’s interesting that it showed that younger people performed better on computer mediated tests than their older counterparts. What implications might this have for adverse impact? What can we do to prevent adverse impact here?
ReplyDelete