Here we give a brief explanation of each of the 12 reports and what they can be used for. We also suggestions some useful filters that can be applied to manipulate the data to match certain criteria
Bear in mind that each of these reports are available on a customer level (view data for all programs in your organization) and on a program level. The view you have will depend on your admin permissions.
1. Program overview: a high-level summary of each program - showing the number of activities and participants in each. Also shows how many participants have graduated from each program.
- Suggestion:
- filter by number (exactly/more than/ less than) of activities/participants/graduated learners
2. Role overview: a view of the different roles in the performance hub of each program and how many participants there are in each role. No progress, just a view of who’s in there.
- Suggestion:
- filter by number of users (exactly/more than/less than)
3. Activity overview: a summary of the activities in a program, allowing you to see overall progress for each (number of participants with the activity, started, awaiting approval, finished, comments). Essentially it reflects the curriculum view in Umbraco, except all versions of an activity will appear if they belong to a participant
- Suggestions:
- Track the “flow” through programs and identify content bottlenecks – those participants haven’t completed
- Filter by activity settings such as approvals, gateways, critical learning activities (yes/no)
- Visibility of which activities are generating the most comments (discussion between the hub)
- Overview of how many activities use the hub (approvals) and perhaps identify an opportunity to introduce extra
4. Learner overview: a summary of the learners in a program, allowing you to see their overall progress. It also contains their email, tags, roles, approvers, creation date and last login date
- Suggestions:
- Visibility of learners enrolled in multiple programs and their progress in each
- Sort by learner or program depending on data you’re looking for
- Sort by last login date to see those regularly accessing the platform and identify those who have not logged in for a while
- Sort by percentage completed to show those who have made the most progress and those falling behind (if all enrolled at the same time). Filter by tags to view a specific group
- Filter by activities awaiting approval to identify those who may be prevented from progressing and require intervention
5. Hub overview: a summary of the non-learners in a program, allowing you to see the numbers of activities approved and yet to be approved. Also shows numbers of words in feedback and comments made
- Suggestions:
- Filter by number of outstanding approvals to identify latency in the performance hub
- Sort by number of activities approved/rejected – could identify differences in validation criteria (e.g. one hub member rejecting a high number of activities compared to others)
- Filter by average number of words in feedback and comments to identify those contributing more which could imply making more effort in supporting their learners
6. Activities by approver: details of all activities of all learners that require approval – the status of them and the users involved approvals and rejections for all learners. Timestamp information is also available if you need to investigate how much lag there is in a performance hub
- Suggestions:
- Compare ‘Date activity completed’ with ‘Date approver actioned’ to investigate the time it takes approve to action the approval
- Filter by ‘Waiting for approval’ to identify activities that still haven’t been action by the approver. Then if you sort by ‘Date learner completed activity’ you can identify those activities that have been awaiting approval for the longest and who is the designated approver causing this delay
7. Activities by learner: details of all activities of all learners, allowing you to see the status of each activity belonging to each learner. Any lag between finishing an activity and having them signed off will also be displayed here
- Suggestions:
- Shows the activities that each learner has in their curriculum (allows you to identify in differences with versions if changes have been made between enrolling groups)
- Sort by ‘Date activity available for approval’ and compare time between activity available for approval and date activity finished (was approved) to identify lags
- Filter by activity status ‘Waiting for approval’ and look at the date the activity was made available for approval
- Sort by ‘Number of comments left’ to see highest number. Then go to ‘Comment detail’ report and search for this learner’s activity to see dialogue
8. Quiz overview: a summary of each learner’s attempts at each quiz. Information available includes activity name, number of questions, percentage score, pass mark and whether the pass mark was attained
- Suggestion:
- Filter by quiz passed “No” to identify areas learners might be struggling
- Might give insight into the quality of the quiz – pass mark too low or high
9. Quiz detail: a detailed report listing each learner’s attempts at each quiz question
- Suggestion:
- Filter by ‘Correct?’ False to identify which questions learners find more or less difficult or which learners are doing more or less well
10. Form detail: details of each each learner’s response to each form question in all form activities. This report can be used to conduct your own program evaluations, satisfaction surveys, competence assessments etc.
- Suggestions:
- Filter by ‘Activity name’ or ‘Form question’ to see all learner’s responses
- Could also filter by ‘Learner name’ to see an individual’s responses
- Hide all columns other than form question and answer
11. Two-part form detail: similar to ‘form detail’, except this report contains responses from both the learner and the approver, because in two-part forms they both have elements to complete
- Suggestions:
- Monitor the quality of guided feedback that approvers are giving to their learners
- Filter by ‘Activity name’ to see responses of a particular activity
- Hide all columns other than who the question is for, the form question and the form answer to get a view of the responses and dialogue without seeing names
12. Comments: a detailed report listing each participant’s comments under each activity. This enables you to see the quality of coaching conversations participants are having within their performance hub. You can also see if there are any activities that generate more discussion than others. Useful if you want to analyse qualitative data.
- Suggestions:
- Hide all columns other than ‘Comment text’
- Gain insight into how the comments are being used (feedback on program/content/platform, issues, feedback between learner and hub)
- Could filter by ‘Comment date’ is after YYYY-MM-DD to see most recent
On each report:
- Data can be filtered to only display rows that match the criteria set
- You can view the data ON SCREEN or DOWNLOAD AS CSV
- Columns can be hidden to fit only relevant data
- Data can be sorted by columns (either alphabetical or chronological)
Comments
0 comments
Please sign in to leave a comment.