Change in the performance standard of the Step 2 CS examination that will affect examinees testing on or after January 1, 2013
Posted: December 21, 2012
As stated in the USMLE Bulletin of Information and as explained in a previous posting to the USMLE website, the level of proficiency required to meet the recommended minimum passing level for each USMLE Step examination is reviewed periodically and may be adjusted at any time. Notice of such review and any adjustments are posted on the USMLE website.
At its December 2012 meeting, the Step 2 Committee conducted such a review for USMLE Step 2 Clinical Skills (CS). During the meeting, the Step 2 Committee considered information from multiple sources, including:
- Recommendations from independent groups of physicians who participated in content-based standard-setting activities in 2012;
- Results of surveys of various groups (e.g., state licensing representatives, medical school faculty, examinees) concerning the appropriateness of current pass/fail standards for the Step 2 CS examinations;
- Data on trends in examinee performance;
- Data on precision of pass/fail classifications.
The results of the review are described below. Because numerical scores are not reported for Step 2 CS, the decisions of the Step 2 Committee are reflected in terms of potential impact on examinees using data from recent administrations.
The Step 2 Committee decided to increase the performance levels required to receive a passing outcome on two of the three Step 2 CS subcomponents: Communication and Interpersonal Skills (CIS) and Integrated Clinical Encounter (ICE). There will be no change to minimum passing requirements for the Spoken English Proficiency (SEP) subcomponent of Step 2 CS at this time.
These changes will be applied to Step 2 CS examinees testing on or after January 1, 2013.
Because of the changes that were made to the design and content of the ICE and CIS subcomponents earlier this year, as announced, the ability to use historical trends to predict the impact of the changes in minimum passing requirements is limited. If the new minimum passing requirements were applied to the group of first-time examinees who recently tested under the new examination structure, the overall passing rate for examinees from US medical schools would be approximately three percent lower and the overall passing rate for examinees from international medical schools would be approximately eighteen percent lower.
The impact of these changes on future examinees will depend on the examinees’ performance. The overall impact will be reviewed by the Step 2 Committee when more examinees have tested under these new requirements.
Transition of test content to DSM-5 criteria and terminology
Posted: November 04, 2013
The Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) was released at the American Psychiatric Association’s Annual Meeting in May 2013. USMLE test content will be impacted by changes in criteria and terminology.
Because USMLE content pools are large, the transition from DSM-IV to DSM-5 criteria and terminology will need to be gradual and will likely take place over several years. The following principles will guide this transition:
- The highest priority has been given to test content assessing diagnoses that do not appear in DSM-5. This content has already been removed from USMLE examinations.
- USMLE will begin to transition content to include both DSM-IV and DSM-5 terminology. This process will begin in 2014. Start and end dates for this transition will vary by exam.