American College of Radiology In-Training Examination for Residents in Radiation Oncology (2004-2007)

Purpose: To review the results of the recent American College of Radiology (ACR) in-training examinations in radiation oncology and to provide information regarding the examination changes in recent years. Methods and Materials: A retrospective review of the 2004 to 2007 ACR in-training examination was undertaken. Results: The number of residents taking the in-training examination increased from 2004 to 2007, compatible with the increase in the number of radiation oncology residents in the United States and Canada. The number of questions decreased from approximately 510 in 2004 and 2005, to 405 in 2006 and 360 in 2007, most of these changes were in the clinical oncology section. Although the in-training examination showed construct validity with resident performance improving with each year of additional clinical oncology training, it did so only until Level 3 for biology and physics. Several changes have been made to the examination process, including allowing residents to keep the examination booklet for self-study, posting of the answer key and rationales to questions on the ACR Website, and providing hard copies to residency training directors. In addition, all questions are now A type or multiple choice questions with one best answer, similar to the American Board of Radiology written examination for radiation oncology. Conclusion: Several efforts by the ACR have been made in recent years to make the examination an educational tool for radiation oncology residents and residency directors