Training Analytics shows how well training is landing at your site: how much of it is finished, how trainees score, where things are overdue, and which quiz questions trainees get wrong. Every figure is worked out from real training assignments and real quiz answers on the site you are working in. When the figures cannot be loaded, the screen says so rather than showing sample numbers.
Where to find it: Training > Training Analytics in the main menu.
Concepts
| Term | What it means on this screen |
|---|---|
| Assignment | One course given to one trainee. Most figures count assignments, not people. A renewal is a new assignment. |
| Completed | An assignment with the status Completed or Signed. |
| Overdue | An open assignment whose due date is before today. |
| Excused | An assignment a supervisor has waived. Excused assignments are left out of every figure, because nobody had to do them. |
| Attempt | A completed assignment that has a score. Score figures are built from attempts. |
| First attempt | Each trainee’s earliest scored attempt at a course. A retake or a renewal is a later attempt. |
| Pass mark | The passing score of the managed document the course is linked to. A course with no linked document uses 70%. |
| Department | Taken from training roles. A trainee belongs to a department by holding a training role in it. See Setting Up Training Roles and Compliance. |
| Measured difficulty | How hard trainees actually find a quiz question, from the share of wrong answers. Shown once a question has at least 5 answers. |
Quick start
- Open Training > Training Analytics.
- Check the four headline cards. A red Overdue card reading Needs attention is the first thing to follow up.
- Pick a Department to see one area of the business, or leave All Departments.
- Open By Role and click a role card to see which courses are holding its completion rate down.
- Scroll to Question-Level Analysis. Questions with a high fail rate, or a red Trainees: line, are the ones to reword or relabel.
Filters
| Filter | What it changes |
|---|---|
| Date Range | This Month, Last Month, This Quarter, This Year (the default) or Last Year. It narrows the trend charts, Assessment Score Analytics, the heatmap and Question-Level Analysis to that period. The dates chosen are shown to the right of the filters. |
| Department | Limits the figures to assignments of trainees who hold a training role in that department. The course count in Total Trainings does not change. The list offers the departments set on your active training roles. |
| Refresh | Reloads every figure. Use it after completing or assigning training in another tab. |
The screen says which figures the date range affects: “The date range applies to the trend charts, Assessment Score Analytics, the heatmap and Question-Level Analysis. The headline cards, breakdowns and Compliance Overview show the current status of all assignments.” Status figures such as overdue and completion describe where things stand today, so they are not cut to a period. Scores and answers belong to a moment, so they are.
Headline figures
| Card | How it is worked out |
|---|---|
| Total Trainings | The number of courses on the site, whatever their status. The line underneath is the number of trainees who have at least one assignment. |
| Completion Rate | Completed assignments divided by all assignments. The bar turns green at 90% and amber at 70%. |
| Average Score | The average score of completed quiz courses. Practical assessments are left out, because their score is the share of checklist items passed, not a quiz mark. |
| Overdue | Open assignments past their due date. It reads All up to date at zero and Needs attention otherwise. Use the Overdue Training Report to see who they are. |
At the foot of the page two more cards repeat parts of this in another shape:
- Compliance Overview shows the completion rate again as a ring. The non-compliant number is the Overdue count, and compliant is the number of trainees less that count.
- This Month vs Last Month counts assignments completed in each calendar month, by completion date, and the percentage change between them.
Completion trend and breakdowns
Completion Rate Trend
One point per month in the date range. Each point takes the assignments that existed by the end of that month, meaning assigned or completed by then, and shows the share of them completed by then. It can never pass 100%. A fall, as in September above, means new assignments arrived faster than they were completed. The badge at the top right compares completions this month with last month.
By Department, By Role, By Category
| Tab | Each card shows |
|---|---|
| By Department | The completion rate of all assignments held by trainees with a role in that department, and how many trainees that is. |
| By Role | The completion rate of every assignment the role’s members hold (not only the role’s own requirements), the number of trainees, and required trainings: how many courses the role requires. Documents a role requires are not in that count. Roles with no members are left out. |
| By Category | The completion rate for the courses in each course category, how many courses it has, and completed out of assigned. |
Click any card to open Trainings for <name>, which lists the courses behind the figure:
- In Progress is open assignments not yet past their due date, including those with no due date.
- Avg Score shows - for courses with no scored completions, such as document courses.
- The course with the lowest completion rate is listed first. Click a course name to open it.
Period Comparison
This compares assignments made this calendar month with those made last month: how many were made, how many of those are now complete, and their average score. It always compares calendar months, whatever the date range. Because it goes by the date training was assigned, it will not match This Month vs Last Month, which goes by the date it was completed.
Assessment Score Analytics
These figures are built from quiz course attempts completed within the date range. Practical assessments are not included: they pass or fail on their critical checklist items, so a checklist percentage would distort a quiz average.
| Figure | How it is worked out |
|---|---|
| Average Score | The average score across every attempt. |
| First-Attempt Pass Rate | Of each trainee’s first attempt at each course, the share that reached the pass mark. Which attempt was first is decided across all dates, so a retake inside the range is never counted as a first attempt just because the first try was earlier. |
| Overall Pass Rate | The share of all attempts, retakes and renewals included, that reached the pass mark. |
| Pass Rate Improvement | Overall Pass Rate minus First-Attempt Pass Rate. A large gap means trainees are passing on retakes. |
| Score Trend Over Time | The average score of attempts completed in each month (Average Score) and of first attempts only (First Attempt). A month with no attempts plots at 0%. |
| Score Distribution | How many attempts fall in each band: 0-50, 51-60, 61-70, 71-80, 81-90 and 91-100. The total number of attempts is shown underneath. |
| Scores by Department / Scores by Role | Avg Score, 1st Pass and Overall Pass for the attempts of each department’s or role’s trainees. Groups with no attempts are left out. |
| Lowest-Scoring Trainings | Up to 10 courses with attempts, lowest average score first, with Fail Rate (attempts below the pass mark) and Attempts. As the note beside the heading says, Highlighted: fail rate 30% or more. |
Training Completion Heatmap
A grid of departments against the months in the date range. Switch what the cells show with the buttons at the top right:
| Button | Each cell shows |
|---|---|
| Completion Rate | The department’s assignments completed by the end of the month, out of those made by then. Green is 80% and above, red is below 60%. |
| Avg Score | The average score of quiz attempts completed in that month. |
| Overdue Count | Open assignments whose due date falls in that month. Here green is 0 and red is more than 10. |
Click a cell to see its completion rate, average score, completed out of assigned, and overdue count together.
Question-Level Analysis
This is where you find the quiz questions that are really causing trouble. It is built from the answers trainees actually gave within the date range. That includes quiz courses and quizzes taken through Document Training (for example a document’s linked quiz such as Allergen Control Procedure Quiz).
| Column | Notes |
|---|---|
| Question / Training | The question text and the course it belongs to. Long questions are cut short; hover to read the full text. |
| Type | Multiple Choice, True/False or Scenario. |
| Difficulty | The badge is the difficulty the question was labelled with (unlabelled if none). Underneath, Trainees: easy, medium or hard is the measured difficulty. It appears once the question has 5 answers, and turns red when it disagrees with the label. |
| Attempts | How many attempts answered it in the date range, with right (green) and wrong (red) counts underneath. Click the header to sort. |
| Fail Rate | The share of answers that were wrong. The badge colours follow the key under the table: High Fail (50%+), Medium (30-49%), Low (15-29%), Very Low (<15%). The table starts sorted by fail rate, highest first. |
| Most Selected Wrong Answer | The wrong option picked most often, and how many times. Questions nobody got wrong show -. |
How measured difficulty is decided
| Trainees: | When |
|---|---|
| easy | 20% of answers or fewer are wrong |
| medium | More than 20% and up to 50% are wrong |
| hard | More than 50% are wrong |
In the example above, the chiller question was written as medium, but three of the five attempts this year chose “Carry on and check again at lunch”. A 60% fail rate makes it hard in practice. That is worth acting on: either the training does not cover the answer well, or the question needs its label changed. The course’s Quiz tab shows measured difficulty from every attempt, whatever the date, and is where you relabel the question. Its percentage can therefore differ from this table’s. See Building a Quiz.
Fewer than 5 answers is too few to judge. One unlucky trainee would swing the result, so no measured difficulty is shown until then.
A row is highlighted when its fail rate is 40% or more, or when the measured difficulty disagrees with the label. Use Filter by Training to show one quiz course. Showing N of M questions sits under the table.
Availability and permissions
- Needs the Training module.
- The screen opens for users with the Administrator or Training Coordinator role.
- Figures are for the site you are working in. Switch site to see another site’s training.
Things to know
- Status figures ignore the date range; scores and answers follow it. Switching to Last Month changes the charts, scores and question table, not the headline cards or breakdowns.
- There is nothing to flag by hand. Rows are highlighted automatically: a course with a fail rate of 30% or more, and a question with a fail rate of 40% or more or a measured difficulty that disagrees with its label.
- Practical assessments are kept out of scores. Their results appear in completion figures and in a course’s drill-down Avg Score, but not in Average Score, the pass rates, the score charts or the heatmap’s Avg Score. See Conducting a Practical Assessment.
- Document training counts only in the question table. Document quiz answers are analysed question by question, but read-and-acknowledge and document quiz records do not change completion rates, scores or overdue counts here.
- Renewals that are due but not yet assigned are not overdue. A lapsed annual course only appears as overdue once the renewal has been assigned and passed its due date. See Processing Bulk Training Renewals.
- Emailed figures match. Scheduled training reports read the same numbers as this screen. See Scheduled Training Reports.