The MCHES examination is a criterion-referenced test that contains 165 items; 150 of the items are used for the total score and there are 15 pilot items on each exam. Examinees will be informed that there are pilot items on the exam, however, the candidate will not be told which items are being piloted and which items are being scored. Item piloting will be used to determine the psychometric properties of an item before the item is actually included as a “scored item” on an examination. The Professional Examination Service (PES), which serves as NCHEC’s consultant for examination creation and administration, has recommended that NCHEC pilot new items on the MCHES exam to ensure high statistical integrity of this certification examination. This also allows for the removal of items that do not perform at acceptable levels for certifying examinations.
Determining the Passing Point on the MCHES Exam
The passing score for each exam is determined by a modified Angoff method and represents a fixed standard of knowledge, independent of candidate performance. Essentially, this method allows subject-matter experts to establish a level of knowledge that is expected of professionals who are minimally competent. This passing point is reviewed, and statistics are analyzed to ensure reliability and validity of the MCHES exam. By using this methodology there is no curve, and candidates do not compete against one another. There is also no penalty for guessing on an item on the exam.
Reliability and Validity of the MCHES Exam
Extensive test statistics are calculated in the process of determining test reliability and validity, including item analysis for every test item on the MCHES exam. Like for the CHES exam, the reliability for the MCHES examination is also determined by using the Kuder-Richardson Formula 20 and split half reliability. Reliability coefficients above 0.80 are considered satisfactory for credentialing exams. The MCHES exam is approaching this value. However, because only a limited number of candidates have taken the MCHES examination to date and those who have may not be representative of all who are eligible for the exam, the current reliability coefficients may not be an accurate indication of the internal consistency of the exam.
| Number of Items |
150
|
| Pass Point |
103
|
| Average Raw Score |
119.48
|
| Standard Deviation |
8.32
|
| Range of Raw Scores |
95-135
|
| Average Percent Score |
79.65
|
| Number of Candidates |
67
|
| Number of Candidates who passed (pass rate) |
64 (95.5%)
|
