This guide includes the following sections:
- Where to find Crisis Simulation exercise results & reports
- Understanding 'view results'
- Understanding After Action Reports (AARs)
- Crisis Simulation reporting data
Where to find Crisis Simulation exercise results & reports
Platform Roles required: Crisis Sim Manager
- Navigate to Exercise in the main navigation menu and select Immersive Crisis Simulations.
- Search for the exercise you wish to view results for in the 'Managed by me' or 'All exercises' areas.
- Select the exercise.
You'll then be presented with two options:
- View Results: this area will display results for all participants that took part in the exercise. It includes specific results relating to decision-points and includes a CSV export option.
- View After Action Report (AAR): AAR complements 'View Results'. The AAR shares actionable insights and metrics on performance, allowing you to determine next steps.
Understanding 'view results'
For facilitated exercises (presentation):
- The overview page will display the average score and the number of participants.
- Select the specific injects to view inject-specific results and which answers were most popular.
- Note that the host/facilitator is the only user submitting the final response on behalf of participants, therefore the tabs will display the host's final votes (there will only be one vote).
For asynchronous exercises (Single Player and Drill):
- The overview page will display the scenario's average score, and the number of users that have been assigned the scenario, as well as those that have completed it.
- You can view individual results for each participant. This includes data such as overall individual scores, individual feedback for every option selected, and participants' confidence and justification for their selected response.
|
Note: Results for exercises with a deadline are only available once the deadline has been met, or once completed by the individual(s). Results for exercises without a deadline are only available once completed by all users. |
CSV exports of specific exercises
The Overview page in View Results includes an 'Export CSV' button on the right:
The CSV export includes:
- The exercise score
- Number of participants
- Total exercise time
- Role categories
- Briefing (exercise background/summary)
- Participant List
- Completion status
- Injects (title, details, and response options)
- Detailed responses per inject
- Detailed responses per participant
Understanding After Action Reports (AARs)
AARs summarize observations and key takeaways after an exercise. The reports make it easy to interpret how team members have performed individually and collectively by providing meaningful and actionable insights. The reporting provides a summary at the end of an exercise, including a suggestion of actions based on participants' performance.
Find out more on AARs by visiting our After Action Report guide.
Crisis Simulation reporting data
You can also find reporting data around Immersive Crisis Simulations in the Reports area of our platform; these range from overview-type reports, to team engagement comparisons, but also drill down to specific inject details within our Data Explorer tool.
Some of these reports will only be available if you are assigned the platform role Organization Manager. You won't be able to access this if you only have the Crisis Sim Manager role.
Navigate to Reports in the main navigation menu to access these.
The data points relevant to Immersive Crisis Simulations are summarized below:
Platform activity reports
Platform role required: Organization Manager
Overview Dashboard
- Last Crisis Sim Exercise – the date an individual user last completed a crisis sim exercise
- Exercises in Last 12 Months – the total number of Crisis Sim exercises completed in the last 12 months
Platform Usage Dashboard
- Types of Activity – the percentage split of users' activity by content type, including Crisis Sim engagement
- Sim Engagement – Crisis Sim Participants – the number of participants across all crisis sim exercises assigned within the selected date range. This is displayed alongside the previous time period for comparison.
Team Comparison Dashboard
- Assigned Exercises – Crisis Sim Completions – the percentage of crisis sim exercises completed, out of those assigned
Data Explorer Dashboard
- Crisis Sim Exercises – export data around crisis sim exercises
Our Data Explorer tool includes a variety of filters that can manipulate the data to export specific information.
Filter suggestions:
Need details for an asynchronous exercise (single player or drill), including details about who the participants were and what decisions they made?
- Column picker: email, inject name, option title
- Exercise name: filter by the specific exercise
Need details for a facilitated (presentation) exercise including details about participant numbers and how they voted?
- Column picker: participant ID, inject name, option title
- Exercise name: filter by the specific exercise
- Currently licensed section: select both 'yes' and 'no' to include all presentation mode participants
Capability by area
Platform role required: Crisis Sim Manager and/or Organization Manager
Crisis Responders Dashboard
This data available in this area is based on crisis sim exercise completions.
- Exercise activity: a breakdown of all exercises assigned to users in your organization, including individuals assigned, number of completions/engagement, average decision score, average confidence score, and when the exercise was last completed
- Low capability themes: themes with the lowest average decision score. These are high-risk themes for the organization
- Low score injects: a list of decision points your teams struggled with. This is based on the lowest average decision scores
- Low risk and higher risk teams
Low risk teams are those with the highest overall scores, based on crisis sim exercises with the highest average decision score. Higher risk teams are those with the lowest average overall score. Consider further exercising to minimize risk to your organization.
- Capability by user: a visual representation of a user’s average score across exercises, mapped against their average confidence in their decision
- Capability by inject: a visual representation of the average score across exercises, mapped against the average confidence of particular injects
The dashboard can be filtered to show results for individuals, as well as team-specific results. It can also be filtered to include results for a specific scenario, or specific exercise run.
For more information on capability by area reports, visit: