AI in Medical Education Assessment: A Pilot

Eduface and Scorion are collaborating with a leading university on an innovative pilot exploring how artificial intelligence (AI) can enhance assessment processes in medical simulation-based education.
The goal is to explore how AI can support educators in structuring and processing feedback within Scorion.

Current Assessment and Feedback Workflow

In simulation training, students complete an assessment form in Scorion before the session. During the simulation, they receive verbal feedback from both the instructor and the simulated patient. The instructor then makes informal notes of this feedback outside Scorion, later refining and manually entering it into the Scorion form. Once validated, the feedback becomes visible to the student.

This process is valuable but time-consuming. The pilot explores whether AI can streamline this workflow without compromising quality or educational value.

How AI Can Improve the Process

The university sees potential for AI to convert draft notes into structured feedback mapped to the correct Scorion fields. Together with Eduface and Scorion, a structured format is developed focusing on the competency domains Communication and Professionalism, addressing key questions such as:

What is going well?

What could be improved?

AI can help make feedback more consistent and faster to process, while educators retain full control over content and interpretation.

The Test Run: First Step Toward AI Integration

To determine whether an AI model can be effectively trained, a test run is being conducted within Eduface – initially without direct integration into Scorion. This test will show whether AI can reliably and educationally responsibly structure feedback.

The test run includes five phases:

• Data collection: the university provides 10 draft versions and 10 completed Scorion forms.
• Conceptualisation: analysing what defines well-structured feedback.
• Data optimisation: expanding and refining the dataset for model consistency.
• Initial training and interim validation.
• Final validation: 90-day testing period.

The Future of AI in Medical Education Assessment

Through this pilot, Eduface, Scorion, and the university aim to explore how AI can make assessment and feedback in medical education smarter, more consistent, and more efficient – while maintaining quality and the personal value of feedback.

Data Security First

As always, data protection is a top priority. No data is shared with open AI systems or used in unclear ways.
Learn more about data security at Scorion