CAGEN
Examination Policies:
After the administration of the multiple-choice examination(s), Scantron answer sheets are shipped to the consultant psychometrician for grading. Each examination answer sheet is machine scored. After scoring, a roster of candidate scores for each examination or sections of each examination is generated. After the rosters have been generated, a determination of passing and failing scores is made based on the predetermined cut score.
After the scores are generated and verified, each exam form is subject to item
analysis procedures. The item analysis program is designed to determine t he
strength of the test item as it relates to the ability of the test item to
discriminate between candidates who know the information and candidates who
are deficient. The item analysis program also provides information regarding
the performance of individual test items in relation to a candidate's overall
performance. A KR(20) reliability coefficient and the difficulty level of
individual items are calculated. Additional statistical analysis includes
the mean, standard deviation, standard error of the measurement and the range.
The rationale for utilizing a standard error of measurement rests on the
assumption that a sampling error may occur in the selection of test items
from the content areas outlined. If warranted, the standard error of measurement
can be utilized to adjust the cut score in either direction. We do not round up scores on the written examination
but do round up within one point on the practical examination because of the
slight possibility of human error. The written exam is totally objective
with the candidate completing the scantron form and the practical is scored using
two human raters.
For those candidates who do not achieve the required cut score, diagnostic
score reports will be generated outlining the percentage scores in each of
the outlined major content areas. All passing candidates will receive a letter
indicating their successful achievement on the competency evaluation. Once
score reports have been generated and disseminated, aggregate information is
assembled into a report summarizing the examination process. All of the information
will be reported in aggregate fashion with no breach in confidentiality as
it relates to individual candidates and their respective scores. Candidates
who passed will not receive their scores because the test is not meant to discriminate
excellence but minimal qualification. Therefore, all passing scores are
simply “passing”.