CAT Exams: Development and Scoring

Development:
The CAT 2011 test development process was conducted in alignment with the Standards for Educational and Psychological Testing. The exam was designed with two sections:
(1) Quantitative Ability & Data Interpretation,
(2) Verbal Ability and Logical Reasoning

These two sections are consistent with the knowledge domains historically assessed by the IIMs and are also aligned with the content areas covered in equivalent global admission examinations that measure performance along similar scales.

Content of the examination was developed and confirmed by individuals with high levels of expertise in each of these content domains. Credentialed psychometricians to confirm the validity of the examination scores and to ensure that every candidate was provided a fair and equal opportunity to display their knowledge will conduct post-administration analysis.

Scoring:
Prometric employs an industry-standard, psychometrically-sound approach to the scoring process for all IIM candidates. The three-step process is outlined here and is supported by the Standards for Educational and Psychological Testing and the ETS Standards for Quality and Fairness.

Step 1: Raw Score is Calculated
Your raw scores are calculated for each section based on the number of questions you answered correctly, incorrectly, or that you omitted.

• +3 points for questions you answered correctly


• -1 point for questions answered incorrectly


• 0 points for questions you did not answer

This scoring methodology ensures that candidates are only awarded points for what they know, while having points deducted for inappropriate random guessing. This is a standard process in the testing industry and is a methodology employed in scoring similar admissions tests such as the Graduate Record Examination (GRE).

Step 2: Raw Score is “Equated”
Equating is a statistical process used to adjust scores on two or more alternate forms of an assessment so that the scores may be used interchangeably. Industry standard processes were used for equating, such as those outlined within the ETS Standards for Quality and Fairness.

Step3: Equated Raw Score is “Scaled”
In order to ensure appropriate interpretation of an equated raw score, the scores must be placed on a common scale or metric. A linear transformation is used for this scaling process, which is an industry standard practice (Kolen & Brennan, 2004).

The IIM scaling model is as follows:

• Section Scores = 0 to 225


• Total Exam Score = 0 to 450

Three scaled scores are presented for each candidate: an overall scaled score and two separate scaled scores for each section. As the two sections evaluate two distinct sets of knowledge and skills, scores may not correlate across sections. A high score in one section does not guarantee a high score in another section. Percentile rankings are provided for each individual section as well as for the overall exam score.

About Test Difficulty...
The CAT exam has been developed to accurately identify top performing candidates and that design makes use of a scaled score range of 0 to 450. In order to appropriately identify the top performing candidates, the CAT exam is, by design, a very difficult exam. As would be expected with the more difficult CAT exam, no candidate would likely answer 100% of the items correctly or achieves the top theoretical score. The exam design will accomplish the goal of identifying the top performing candidates who are, indeed, ranked at the top of the list. If the exam were designed to be substantially easier, it would be theoretically possible for a candidate to achieve a score of 450. However, an exam constructed to be that easy would not serve the distinct purposes of the IIMs.

Posted in: Common Admission Test (CAT)