Forum Discussion
Remediation for Assessment
Is there a way in Articulate Storyline to provide question‑level remediation at the end of an assessment, where learners only see resources related to the questions they got wrong? The questions are fill in the blank, multiple choice, multiple answer, etc. If so, how are others approaching this?
8 Replies
I haven't had much cause to do this but love the idea, especially beyond the basic "Review Quiz" Storyline gives us access to. The more immediate the feedback, the better the knowledge transfer of course.
When you say resources, what do you have in mind? Links out to an intranet? Videos to watch? The possibilities are pretty endless.
A busy way might be to create a true/false variable for each question answered, and then toggle it to true on that slide's CorrectFeedback layer. After the quiz, one or more slides can factor in the value of those variables. For example, we could make it so that if a learner answered a question incorrectly for instance, a Next button after the quiz takes the learner to Review Slide #1, but if they answered correctly, that Next button skips the learner to Review Slide #5 instead. A number of those chained together would enable learners who did well to skip more Review content versus a learner who did poorly needing to review more.
If some of the questions are related, they could be grouped and the number of correct responses tracked with a number variable. If a quiz asks 5 pulmonology questions and 5 cardiology questions, my CorrectFeedback layers could increment a pulmonology variable or a cardiology variable based on the specific slide. After the quiz, someone who didn't get four or more of the pulmonology questions right would be funneled to a pulmonology review section but if they really knocked out the cardiology (5/5) then a Next button could skip that Review section.
How do you think your specific implementation might look?
I would like to connect them with the outside resources that exist in our LMS/help site that match up with what they missed. Ideally, after they complete the assessment, they would go to a screen where it would show the competencies they missed and then link them to the specific pieces of content to review then come back and retake the assessment. The content they would need to review would not be part of this course but be in other forms of content, so it wouldn't be sending them back to the section but other resources. So, very similar to the pulmonary/cardiology example but for other content to review.
As long as the links aren't dynamically generated, connecting people to that content should be easy. We use Workday for instance, and it's very easy to directly link learners to other content elsewhere in Workday's LMS.
I think the easiest way is going to be the cardio/pulmo method, one slide per competency so you can funnel people to the content they specifically need. An advantage of that is reduced seat time since no one can choose to pursue content they don't need to review, which is a potential downside to the second method below.
The second is to put all of the competencies on one slide like Judy offered. Showing only the content people should review though might be more complex due to how the buttons and text boxes are actually shown on the slide, especially as the number of competencies grows. It's trivial to hide an outbound button by default and only show it if the learner scores below a threshold, but if they pass, that hidden button's going to leave a blank space on the screen like she said. If you design a slide for eight competencies but only show three, the learner may attribute the empty space to bad design rather than an indication of their successes.
That can look weird depending on the configuration, so if you see benefit to having all of the recommended ones on one slide, I personally would put them all on one slide and then visually design it to recommend the ones they should/must take:
My example still allows people to review the passed competencies (in case they feel they got lucky or may want to explore it anyways) but buttons have Disabled and Hidden states that you can use on passed competencies to just outright prevent click-through.
I agree with you and think having them all in one slide would be the best option since they may miss more than one competency. Thank you for visually showing me this option. What elements did you use in this to show the percentages in each competency with the review button? Do you have any storyline files you can share?
AlissaCarpenter: As Andrew suggested, you could use T/F variables to track what questions the user misses.
For presenting links, I think the easiest option is to put buttons with links on one slide (assuming they fit).
Then use the values of the T/F variables to somehow highlight the ones they need to review. For example, change the state of the buttons. Or show X's and checkmarks next to buttons to indicate which they got wrong and which right. (Alternately, you could hide the buttons with links they don't need to review. But, if you wanted to prevent weird spacing, you'd need JavaScript to rearrange the remaining buttons on the slide.)
This is a great suggestion, thank you! Having a slide after the results slide with buttons sending them to the content to review would be ideal.
