In this edition of the Focal Spot, Tyler Blackwell interviews Bas Raaymakers, PhD.
ABR Oral Exams Go Virtual
Perspectives from the ABR and a recent diplomate on the newly minted virtual exam platform.
Fast forward a year, and the landscape is entirely different. Given the enormous uncertainty regarding restrictions in 2021, the ABR took steps to create a virtual platform to ensure candidates can move past their studies into their professional roles. And while the pivot to virtual has become the new business-as-usual for pretty much everyone, it’s not as if porting this exam to the online world was exactly simple. After all, maintaining the integrity of such a high-stakes event involves thoughtful consideration.
But they did it. The ABR has two scheduled exam periods for the medical physics oral board exam to replace physical exams. For 2020 exam candidates, their opportunity is coming soon. On May 1-4, test takers will be a part of the first large-scale cohort to navigate the new platform. Candidates for 2021 that otherwise would be traveling to Tucson, AZ, where the exam is typically held, will have their opportunity in mid-August.
Virtual Exam Changes and Structure
One of the hallmarks of the ABR experience is a high level of security and integrity, which is essential for a fair and equal examination. With candidates testing from wherever (at home, the office, etc.), ensuring the same standard in the virtual environment is paramount. To meet the needs of a high-stakes exam, several measures have been developed. These include a 360-degree room scan, a front-facing webcam to mimic the in-person experience, and partnering with a third-party vendor, Proctorio, to help with security for the computer-based exam.
For the first time, the exam will be facilitated by navigators assigned to each candidate to encourage a smooth, personalized delivery. They are present alongside every candidate throughout the exam to help troubleshoot any technical issues if they arise. The navigators meet with both candidates and examiners before the live event to test the software and verify proper equipment and connectivity.
Also, two examiners will be present during each session, one serving as primary and the other standing in as a backup in case of connectivity issues. According to the ABR, the recruitment of additional examiners was a major challenge. To create this redundancy with examiners requires essentially twice the number of examiners for not just one but two exams in 2021, along with a pilot run to thoroughly test the platform.
Besides the major changes required for electronic delivery—along with a few subtle changes like longer breaks between examiners (10min) to help mitigate connectivity issues—the core structure of the exam is mostly unchanged. The testing environment was designed to be very intuitive and straightforward, similar to the on-site experience. The full exam is still a sequence of five examiners, each of whom poses five questions during a 30-minute interval, to assess the candidate’s knowledge across five broad categories based on their specialty (therapy, diagnostic, and nuclear medicine.)
Pilot Exam a Success for New Diplomate
Xenia: My experience was overwhelmingly positive. There are a lot of advantages to the virtual platform in terms of time and cost savings. Not having to travel also decreased my stress from things outside of my control that might affect the exam. The virtual format does introduce new potentially stressful factors, particularly the worry that the internet connection may fail mid-exam.
Tyler: Do you think the ABR had the right protocols to address those concerns?
Xenia: The ABR and Proctorio did a lot to address those by:
Having a pre-check of my computer system weeks before the actual exam and allowing a dry run of the exam software and interactive tools. Assigning a technical navigator to each examinee. There is always someone on the line, ready to handle any glitches. Including a backup examiner for each exam session if there’s an issue with the primary examiner. Giving very clear steps about what to do if I were to lose connection.
Tyler: Was the virtual setup easy to use?
Xenia: Yes. I installed and tested it out during the pre-exam computer test. There was another opportunity to get comfortable with it on the morning of the exam before getting started. It has very little functionality, which I think is a good thing. You can draw and zoom, and that’s about it.
The one thing that was a little tricky was that most of the questions have an image associated with them and then a bulleted list of questions underneath. It might be nice if you could zoom in on just the image itself while leaving the questions viewable at the same scale. But it wasn’t a big deal.
Tyler: Did you experience any technical issues?
Xenia: My very first examiner had a glitch on his end where the questions wouldn’t show up. The technical navigator walked him through the normal steps to resolve the issue, and as soon as those didn’t work, she switched control to the backup examiner instead. The whole thing took less than 2 minutes, and the ABR built in plenty of the time with the breaks between examiners (10 min) that I didn’t have to worry about running out of time.
Tyler: So overall, it was a success? Something the ABR should consider in the future?
Xenia: Very successful! I hope they never go back to the hotel format, which is more expensive for candidates. It’s especially inconvenient for applicants with families who have to be gone for two days just to take a three-hour exam. It was also awesome that I could just enjoy the rest of my day right after the exam instead of heading to an airport.
Tyler: Any advice for those on deck to take the exam?
Xenia: They can focus on reviewing the materials and trust that the technical setup is being taken care of for them. The only advice would be to take their time playing with the tools when they do the technical check with Proctorio, but honestly, it’s very intuitive, so it is more about comfort level than really needing to practice. Also, you’re allowed to use a small handheld whiteboard to write/draw on if you prefer. I brought one because I thought writing equations or drawing diagrams on a screen would be challenging, and it was nice to have both options available.
Future of the Exam
Written by Tyler Blackwell
Tyler is a board-certified medical physicist with extensive clinical experience in radiation therapy. He is active in several AAPM committees, has served as secretary-treasurer for the Northwest Chapter of AAPM, and is an ABR orals examiner. Tyler dabbles in real estate investing and loves preparing breakfast for his three kiddos.
Related tags: RadOnc News