We are working on a quiz for a course that pulls 100 questions from a selection of about 200 questions. The goal is that users have randomized questions and can't copy down the answers in case they need to re-take it. Within those 100 questions, a certain percentage of the questions should pull from different categories we had established. We first set up 4 different question banks to randomize the chance of what quiz the user gets, but the LMS would not successfully track and report the results slide.
Does Storyline have this capability, or is there a workaround we can find to help randomize our quiz?
How many results slides are you using? Just one - or one after every question bank? You could use just one total, and tell it which questions to track and which question banks, and that information should be reporting correctly to your LMS as long as you've enabled it to track that results slide in your publish settings.
You may also want to review this article on troubleshooting common LMS issues associated with reporting and tracking. Specifically I'd look at testing your course at SCORM Cloud which is an industry standard for testing SCORM content. If the course behaves as expected there, then you'll want to reach out to your LMS team.
Thanks Ashley - we are tracking one results slide, but have not been able to get it to work in the SCORM cloud. We have 4 different quizzes that could be chosen from, each with a results slide for the particular quiz. Then, the final/main results slide that tracks in the LMS is set to combine the results from the 4 results slide. If there is a different way to think about this please let me know!
So is each quiz it's own path - and therefore the user may not visit all the quizzes? Can you tell us a bit more about what is not working when testing this? If for example your four quizzes are set to a passing rate of 80% each, but the user may only see one quiz and pass it with 100%, when they view the final results slide, since it's combining the four quiz results and then determining the passing score it would look like 25%. You can change the passing score for that final results slide to accommodate it - but I know a lot of users may not want to see the 25% score in the LMS.
Correct, the user will only visit one of the 4 quizzes. we have it set to a passing score of 20% which would be the 80% passing rate combined with three 0%s from the quizzes they never saw or took.
I think the known issue you mentioned may be what is happening as the learners may be exiting and resuming to cause the issue. I'll look the branching options over to see what might be the best options for creating a randomized exam as best we can.
Thanks for the additional information. Does the score report as you'd expect prior to exiting and resuming? If so, then I think this known issue does seem to be the same situation. The link I previously shared will be updated when there is additional information to share, and we'll also try to post back in this thread as well. You may also want to enable Storyline to check for updates at start up and that way you'll be reminded of any new updates.
5 Replies
Hi Lydia and welcome to Heroes!
How many results slides are you using? Just one - or one after every question bank? You could use just one total, and tell it which questions to track and which question banks, and that information should be reporting correctly to your LMS as long as you've enabled it to track that results slide in your publish settings.
You may also want to review this article on troubleshooting common LMS issues associated with reporting and tracking. Specifically I'd look at testing your course at SCORM Cloud which is an industry standard for testing SCORM content. If the course behaves as expected there, then you'll want to reach out to your LMS team.
Thanks Ashley - we are tracking one results slide, but have not been able to get it to work in the SCORM cloud. We have 4 different quizzes that could be chosen from, each with a results slide for the particular quiz. Then, the final/main results slide that tracks in the LMS is set to combine the results from the 4 results slide. If there is a different way to think about this please let me know!
Hi Lydia,
So is each quiz it's own path - and therefore the user may not visit all the quizzes? Can you tell us a bit more about what is not working when testing this? If for example your four quizzes are set to a passing rate of 80% each, but the user may only see one quiz and pass it with 100%, when they view the final results slide, since it's combining the four quiz results and then determining the passing score it would look like 25%. You can change the passing score for that final results slide to accommodate it - but I know a lot of users may not want to see the 25% score in the LMS.
You may want to review some of these other threads on how users's handled a branching scenario with quiz results, this one has a lot of options and this one.
Also, just in case this matches your set up, I wanted to share a known issue right now that causes courses to be marked incomplete if all the following are true:
Correct, the user will only visit one of the 4 quizzes. we have it set to a passing score of 20% which would be the 80% passing rate combined with three 0%s from the quizzes they never saw or took.
I think the known issue you mentioned may be what is happening as the learners may be exiting and resuming to cause the issue. I'll look the branching options over to see what might be the best options for creating a randomized exam as best we can.
Hi Lydia,
Thanks for the additional information. Does the score report as you'd expect prior to exiting and resuming? If so, then I think this known issue does seem to be the same situation. The link I previously shared will be updated when there is additional information to share, and we'll also try to post back in this thread as well. You may also want to enable Storyline to check for updates at start up and that way you'll be reminded of any new updates.
This discussion is closed. You can start a new discussion or contact Articulate Support.