In this guide, you will learn how to run a session from start to finish using all of the knowledge you've gained from the previous modules in this training. We will be using a simple, custom-made scenario with three states as our example. This guide will be divided into the following sections:
Introduction to the scenario
Scenario editor settings
Checklists (critical actions)
Performance Gaps
Transitions
Dialogs
Medical Orders
Running the session (facilitator & VR view)
Debriefing
Session Feedback
Guided Questions
Post-Sim Quiz
1. Introduction to the scenario
For this tutorial, we will be using a simple, 'dummy' scenario in which the patient presents with a headache. The scenario consists of three states:
Initial State
Intermediate State
End State
The end goal is for the patient to transition from the Initial State to the End State by way of assigned conditions within each state transition. Each state will also have its own separate checklist, dialog lines, etc. In the following section, you will understand how the pieces fit together to construct a scenario and make it unfold.
2. Scenario editor settings
a. Checklists (critical actions)
You can assign a checklist of critical action items to each state, which you will be monitoring in the facilitator view while the student is in VR. Essentially, the critical actions serve as your guide for evaluating that the learner is treating the patient appropriately and understanding the learning objectives. Critical actions may consist of soft skills (such as listening that the student is introducing themselves, stating the purpose of the visit, etc.) or programmable conditions that are automatically picked up by the event log (such as performing hand hygiene, checking the EHR, checking vitals, etc.). Below are some examples of checklists for each state:
Initial State Checklist:
Intermediate State Checklist:
End State Checklist:
As the facilitator, you will be manually checking off the actions in the facilitator view as you see/hear the student perform them (you will see this in action in the facilitator view video towards the end of this guide).
You may have also noticed that some critical action items in the checklist are highlighted in blue. These are the items that have been assigned conditions which will be automatically triggered in the event log in the facilitator view:
Note: After you're finished making your changes, make sure to click the 'Save' button! This will apply to all subsequent sections of the editor as well.
b. Performance Gaps
Conversely, the performance gaps are the opposite of the critical actions that learners should be performing. These can be programmed by clicking the 'Debriefing' tab in the editor >> clicking the 'Feedback' tab >> clicking the 'Performance Gaps' row:
You can click on the double arrow to the right of the performance gap item, and then assign it a condition, as well as which state it will apply to:
In the session feedback page after the session has been completed, any action that has been explicitly assigned as a performance gap (or any condition-assigned critical action that was not checked off by the facilitator) will appear as a performance gap. You will learn more about how critical actions & performance gaps appear in the session feedback in the Debriefing section of this tutorial.
c. Transitions
With transitions, you can decide how the patient moves from one state to the next. Each state (with the exception of the final state) needs to have a condition assigned to a transition in order for the program to recognize a state change has occurred. We can see below the transitions and assigned conditions for all states:
Initial State Transition:
Here, we can see that the transition from Initial State to Intermediate State has been titled, 'Apply ice slurry pack.' But, we have 2 assigned conditions: one is an intervention, and the other is a time condition. The student will have to do both conditions (i.e. apply the ice slurry pack and wait for just over a minute) in order for the state change to occur.
Intermediate State Transition:
Here, we can see that the transition from Intermediate State to End State has been titled, 'Administer acetaminophen.' Similarly to the previous one, there are two conditions: administer the acetaminophen to the patient and wait for just over a minute. The student will need to do both in order for the patient to transition to the End State.
You can have as many or as little conditions as you wish for a state change to occur. Additionally, you can also choose to add 'OR' conditions, which allow the student to perform either one set of conditions or another in order for the state change to occur:
Transitions can consist of either active interventions (i.e. such as administering a medication to a patient), or passive interventions (i.e. such as waiting for a certain period of time, waiting for the patient's vitals to reach a certain point, etc.):
Ultimately, a scenario is considered 'finished' when the patient has transitioned from the initial state to the state in which they are feeling better. But, the critical actions in the checklist items mentioned previously are what you as the instructor will be basing your students' evaluation on. This will be discussed in greater detail in the 'session feedback' page of the Debriefing section later on in this guide.
d. Dialogs
You can record your own voice or import pre-existing audio files to add realistic dialog lines to your scenarios. The dialog lines will be available for the facilitator to click on during the session, to simulate the patient or provider speaking. Notice in the example below that you can see the available dialog lines as well as the corresponding state and who will be speaking:
Existing dialog lines
To find any existing dialog lines being used in a given scenario, you can enter the scenario editor >> click the 'Scenario' tab >> click on the preferred state >> click on 'Shared Modules' >> then click on the dialog box that is highlighted in blue (indicating that it is being used in the current state). In the example below, we will click on the 'Dialogs 1' box which is being used in the initial state:
Once you've clicked on the dialog box, you can see any and all dialog lines available for either the patient or provider to speak in that particular state:
Re-recording/importing dialog lines
You can also choose to re-record any existing dialog lines using your own voice, or import a .wav file from your computer (if you choose the latter, we recommend using either Audacity or ElevenLabs as your audio editing software).
To re-record a line using your own voice, simply click the double arrow to the right of the dialog line, then click the re-record button, and speak the line. You can also trim the line if there is too much silence or noise before/after the line can be heard:
To import a dialog line, simply click the 'Import' button, and upload the .wav file of your choice:
Creating from scratch
You can always add new dialog lines to an already existing dialog box. In the examples above, we looked at the 'Dialogs 1' box in the initial state, which only contained two lines. However, if you click on the 'new line' button, you can add as many new lines as you wish. Then, you can enter a description (or word-for-word of the line about to be spoken), assign an animation (i.e. if a simple 'yes' or 'no' response), and either record the line/import file as previously mentioned:
Note: New lines will automatically be assigned to the last category on the list (in this case, 'current symptoms). After creating the dialog lines, if you wish to recategorize them, first click the 'New Category' button and then name the category:
Then, on each individual dialog line, click the double arrow to the right, click 'Move to Another Category', and select the category from the dropdown menu:
Lastly, you can also create entire new dialog boxes from scratch. If you go back to the 'Shared Modules' page, then under the 'Dialogs' column, you can click the '+Dialog' button to create a new dialog box:
Then, click on the blank space within the dialog box to enter the same editor as before to create, import, etc. (Just make sure that after you are finished, you click the checkbox on the dialog box to highlight it in blue so that it is used on that particular state)!
e. Medical Orders
In much the same way as the modules above, you can create and add medical orders to each state in a scenario. For instance, if we wanted to add a medical order to the initial state in our 'dummy' scenario we would: go into the editor >> click the 'Scenario' tab >> click 'initial state' >> click 'Shared Modules' >> click the '+Medical Orders' button (or, click on the box if one has already been created):
OR
Once in the medical order editor, you can:
1. Select when the medical order becomes available (i.e. by tying it to a provider dialog line). In the facilitator view, if the facilitator were to click this dialog line as if the provider were responding, the learner in VR will receive a notification and the medical order will become available to them.
2. Add medications, administration times, and notes:
Note: Make sure to click the checkbox to highlight the medical order box in blue so it can be used in that state!
3. Running the session (facilitator & VR view)
With the scenario constructed, you will now see how all of these behind-the-scenes components work together and result in a playable session. This section will feature recordings of both the facilitator view as well as the point of view of an active participant in VR.
We will first start off with a recording of the session in VR:
Next, will be a recording of the facilitator view. To recap how everything is working together and what you can expect to see the facilitator doing:
The scenario consists of three states: Initial State, Intermediate State, and End State.
Each state has its own checklist containing a set of critical actions. In the facilitator view, the facilitator will check off items according to what they see in the event log (i.e. critical actions with conditions assigned to them) as well as listening to the active participant (i.e. soft skills such as introducing themselves to the patient, stating the purpose of the interaction, etc.).
Each state has its own set of dialog lines which can be triggered by the facilitator.
The Initial State and Intermediate State both have transitions with conditions assigned to them which eventually lead to the End State.
In the Intermediate State, there is a medical order that will be triggered and available to the active participant in VR after the facilitator has clicked on the 'Please administer both tablets of 500mg acetaminophen' dialog line.
4. Debriefing
Now that we have concluded our session, you can access the Debriefing to evaluate your learners' performance.
First, while logged into the web portal, click on the 'Performance' tab on the top left-hand side of the page:
Next, browse through the list of past sessions. You can read the details (i.e. scenario name, names of learners, time completed, etc.) and scroll until you find the session you wish to review, or use the search bar. Once you've located the preferred session, click on it:
Now, you will automatically be in the 'session feedback' for that session. The 'Session Feedback,' 'Guided Reflection' and 'Post-Simulation Quiz' pages are all considered the Debriefing. We will take a look at each one.
Session Feedback
In the 'session feedback' page, you can view the following:
All of the actions automatically logged by the event log in the facilitator view, indicated by the blue 'circle' symbol
All of the critical actions (i.e. checklist items) that were checked off, indicated by the green 'thumbs up' symbol
Any performance gaps (i.e. checklist items with conditions that were left unchecked) indicated by the black 'stop hand' symbol
Any state changes that occurred during the session
The name(s) of the participant(s)
An overview of how many critical actions vs performance gaps
The duration of the session
Quiz score (if submitted)
A web replay of the facilitator view (if this option has been toggled on in the Admin Settings)
Note: While performance gaps can be triggered by any condition-assigned checklist items that are left unchecked, you can also purposely create items with conditions assigned that when checked, they are counted as performance gaps. For more details, refer back to Part 2: Scenario editor settings, section b: Performance Gaps.
Guided Reflection
In the 'Guided Reflection' page, you can see any of the short-form answers that a learner has shared in response to the questions:
Note: If editing one of the 'By UbiSim' scenarios, reflection questions are based off the PEARLS debriefing framework by default.
Post-Simulation Quiz
Similarly to the page above, the 'Post-Simulation Quiz' page will show all of the answers that a learner has provided to the multiple choice questions, as long as they have submitted the quiz. You can see a sum of the total correct answers as well as which specific questions were answered correctly or incorrectly:
Note: You can edit both the 'Guided Reflection' and 'Post-Simulation Quiz' questions in the scenario editor. Review The Scenario Editor if you would like a refresher on these steps.
Congratulations! You have reached the end of the Admin tutorial. For any questions or concerns that were not covered, please don't hesitate to reach out to our dedicated support team at support@ubisimvr.com.