New this week in Language Testing Journal is an article by Vahid Aryadoust. It proposes two measures to enhance transparency of a test. Specifically:
- Validity reports for individual test forms.
- Clear explanations of the test’s limitations.
Number one seems challenging in a world where AI, adaptive testing and security concerns have changed what we mean when we talk about a test form.
Number two seems obvious but useful at a time where tests are increasingly adopted for off-label uses. We’ve all seen instances of test makers trying to recapture lost volumes by proposing their test for some purpose it hasn’t heretofore served (and for which some other test may be much more suitable). Meanwhile, stiff competition has caused test makers to play up the strengths of their products while downplaying their limitations.