This guide contains the following sections:
Introduction
Platform Activity reports provide a dynamic picture of Immersive Labs usage across the whole organization, as well as at a team and individual level. The reports allow managers to continuously monitor how the organization is acting on areas of risk and ensure organizations are getting the most out of their access to the platform.
Available dashboards aggregate real-time telemetry of activity by focus: from understanding who is using the platform and at what difficulty level, to when a user last ran a Crisis Sim exercise.
Managers can track the progress of assigned content to ensure that skill gaps are being addressed, as well as identify which users may need assistance in completing an exercise or assigned collection, or which teams are most regularly strengthening their capabilities.
|
Note: You’ll only be able to see data and dashboards relating to your permissions on our platform. As an Organization Manager, you’ll have access to data relating to your entire organization. As a Team Admin, you’ll only be able to view reports relating to your team, or individuals within your team. |
Platform Activity Reports
The Platform Activity dashboards can be found by navigating to Reports in the main navigation bar and are comprised of the following tabs:
You can find a breakdown of what's included in each section below, as well as how you can turn the data into actionable insights for your organization.
Overview
A snapshot of key data from an organization's platform usage. This includes:
- User activity and engagement
- Labs completed (categorized by difficulty level and area)
- Data for managers related to assigned collections
- High-level overview of Crisis Sim and Workforce (if these are part of your license)
Available filters: Team name, License Type, Has Current License (Y/N)
Use this dashboard to:
- Regularly report on high-level human capability development metrics
- Identify areas of interest that need more investigation in other dashboards, allowing you to drill into that data efficiently
Platform Usage
This area captures who in your organization is engaging with our platform, as well as how they are doing so. This includes:
- Licenses used
- Orientation completion
- User engagement (broken down by role)
- Weekly lab activity
- Types of activity (broken down by product area)
- Lab engagement (broken down by content category and hours in-lab)
- User list
- Crisis Sim, Workforce, and technical exercise engagement (if these are part of your license)
Available filters: Team Name, License Type, Date Range, Has Current License (Y/N)
Use this dashboard to:
- Monitor your organization's usage of the platform and encourage teams to get best value
Assigned Activity
View how your workforce is engaging with collections and career paths assigned to them. This includes:
- Assigned activity status (not started, in progress, completed, overdue)
- Assigned activity over time (content completed v. content outstanding)
- Overdue Activities (top 10 users with overdue assigned content)
- Progress by collection/ career path
- Progress by team
- Progress by user
Available filters: Email, Team name, Content name, Content type, License type, Manager assigned (Y/N), Assigned date range, Has Current License (Y/N)
Use this dashboard to:
- Mitigate against risks based on knowledge and skills gaps
Team Overview
This area provides a comparative view of overall team performance to allow managers to see which teams are most engaged with the platform, as well as highlight teams and provide the most coverage against cyber threats.
The table includes:
- % of Active Users: the number of users in the team that have logged in at least once, divided by the team's total number of users (in the date range selected)
- Average completions per user: the median number of completions by users in the team (in the date range selected)
- Assigned content progress: the number of assigned labs completed, divided by the number of labs assigned (in the date range selected)
- Cyber capability score: A team's score is made up of two parts (MITRE ATT&CK score and Cyber Threat Intelligence score) of equal weighting. The total score is out of 1000. (The score displayed is the score on the 1st of the month of the latest month selected):
- MITRE ATT&CK Score + Cyber Threat Intelligence Score
- MITRE ATT&CK Score: How many users in a team have completed at least one lab in a technique, limited to five. If five users have, this gives a full score for the technique (25). If all techniques obtain a full score, this adds up to 500.
- Cyber Threat Intelligence (CTI) Score: Points are awarded for the first five users to complete Cyber Threat Intelligence labs published in the last six months, based on how close to the published date the user completed the lab. Each lab has a maximum score of 25. If all CTI labs published in the last six months are completed within seven days by five users in the team, this gives a full score of 500.
The table is multi-functional, allowing managers to export to CSV, as well as select the chevrons to drill into the more detailed metrics below:
| Note: Team members included in team calculations are current team members. Filtering to a previous time period will not display metrics for members that were part of the team at that particular time. |
Available filters: Team Name, License Type (Product Areas), Content Name (Collection or Career Path), Date Range (Date from - Date to), Has Current License (Y/N), Manager Assigned (Y/N)
Use this dashboard to:
- Compare activity across teams easily and encourage those that aren't engaging as much
- Compare progress on content assignment between teams
- Obtain an at-a-glance view of cyber capabilities, at team level
- Identify teams that need more support, as well as power-teams
Team comparison
This is a good Team management view where you can view how your users are allocated across teams, and how those teams are engaging with lab content at a high level by proportion of users. This includes:
- Team management information
- Platform activity by team (proportion of users that are logging on and attempting labs)
- Assigned content status by team
- Assigned exercises (Crisis Sim, Workforce and Team Sim engagement - if these are part of your license).
Available filters: Team name, License type, Date range, Has Current License (Y/N).
Use this dashboard to:
- Bring teams up to the required level of skill
- Monitor team allocation and management: ensure every individual is assigned a team and that each team has a sufficient number of Team Admins
Individual
Look at how specific individuals are engaging with the Immersive Labs platform. This includes:
- Lab activity data
- Quality/ Lab accuracy
- Content coverage by category
- Lab recommendations
- Progress (by collection, career path, labs, as well as assigned content)
Available filters: Email, Manager Assigned (Y/N), Date range
Use this dashboard to:
- Spot talent in your organization
- Identify those who may need further support
- Enhance learning gaps analyses and personal development reviews
For more information on the data points within each section visit our Data Points and Calculations guide.