Question

A statistics professor develops a new statistics exam to test his students' knowledge of experimental design. Which of the following is not an acceptable method of evaluating the measurement validity of this new exam as discussed in class?

1) Comparing test scores on the new exam to test scores obtained on similar statistics exams
2) Using the test scores on the new exam to predict final exam scores
3) Calculating the percentage of students who pass the exam and comparing that to the percentage of students who fail the exam
4) Determining the extent to which the new exam includes questions covering all aspects of experimental design

Answer 1

The acceptable methods for measuring the validity of the new statistics exam include comparing test scores, predicting final exam scores, and evaluating the coverage of aspects of experimental design. However, calculating the percentage of students who pass or fail the exam is not a valid method.

Step-by-step explanation:

The acceptable methods of evaluating the measurement validity of the new statistics exam are 1) Comparing test scores on the new exam to test scores obtained on similar statistics exams, 2) Using the test scores on the new exam to predict final exam scores, and 4) Determining the extent to which the new exam includes questions covering all aspects of experimental design. However, the method that is not an acceptable method of evaluating measurement validity is option 3) Calculating the percentage of students who pass the exam and comparing that to the percentage of students who fail the exam.