We're getting reports from a fellow content developer that when some people take the quiz in our LMS ( SABA 7.2) the score displayed on the SL results slide do not match the correct responses in the quiz. They answer the questions correctly in the quiz but the SL results slide shows they fail. I'm attaching the SL file as we use SL for several hundred quizzes in our LMS and have never seen this behavior. It also does not happen on a consistent basis from user to user. Is there a browser or pc config that could create this?
We have screenshots from a user that shows the they are getting the correct responses but they fail the quiz.
Sorry to hear about the inconsistencies - and generally when things are inconsistent a browser or user specific error tends to be the cause. We support the browsers documented here and you may also want to check with your LMS team to see if there is a particular browser they recommend as well. Also confirm if users are accessing the HTML5 vs. Flash in supported browser as well.
You'll want to look into the items I mentioned for Brian as well. Another good tool is to use SCORM Cloud which allows you to test in an industry standard LMS environment. You can see the description of how to do that here.
I did - and nothing seemed out of the ordinary to me. It looked like you were using the built in results slide with the appropriate triggers. I did see that your one final question to check if they were ready to submit was the only one that had the "submit" trigger associated with the question - and while I don't envision that being a problem, perhaps some folks are somehow skipping questions on a second attempt through? That way the results aren't being recorded on the results slide but your LMS may be reading all the data as the user progresses through? It's just a guess at this point based on the user being able to go back and modify their answers and that data is transmitted to the LMS at every slide (to help with resuming the course).
Thx for the info. We only allow 1 attempt on the quiz question in SL so they can't go back multiple times. We seem to be having this issue on Mac that do not use Flash. We use the HTML5 publishing option. Are there any known issues with SL responses and HTML5? This issue is rare but very odd and we are trying to find a possible pattern.
What browser(s) are you using on the Mac? I'd look at using Chrome or Safari as those are supported for HTML5 output.
You could also look at enabling LMS debug mode to determine what information Storyline is passing to your LMS and that should narrow down where the issue is further. Again that's something as a general check, but if the issue is still inconsistent across all users that is not likely something you want them all to run through.
Thx for the Debug option but since this calculation is happening within the SL content ( i.e. on the Results slide) and hasn't been submitted to the LMS is the issue within SL itself?
If the Storyline results slide was showing as failed, but the LMS is showing passed I'd still have to wonder what was being passed to the LMS to recognize that. I haven't seen a results slide incorrectly calculate the results unless as I mentioned the user is somehow changing their answers (on purpose or inadvertently revisiting slides and resetting them). Again since only some users are seeing it, I think you'll need to get more information about the steps they're going through or how they're taking the course to confirm where the issue is occurring.
9 Replies
UG i'm having the same issue. I hope some one replies to your or my thread
Hi Brian,
Sorry to hear about the inconsistencies - and generally when things are inconsistent a browser or user specific error tends to be the cause. We support the browsers documented here and you may also want to check with your LMS team to see if there is a particular browser they recommend as well. Also confirm if users are accessing the HTML5 vs. Flash in supported browser as well.
Hi Cecile,
You'll want to look into the items I mentioned for Brian as well. Another good tool is to use SCORM Cloud which allows you to test in an industry standard LMS environment. You can see the description of how to do that here.
Thx for the info. Did you open the SL file and see anything that was unusual?
Hi Brian,
I did - and nothing seemed out of the ordinary to me. It looked like you were using the built in results slide with the appropriate triggers. I did see that your one final question to check if they were ready to submit was the only one that had the "submit" trigger associated with the question - and while I don't envision that being a problem, perhaps some folks are somehow skipping questions on a second attempt through? That way the results aren't being recorded on the results slide but your LMS may be reading all the data as the user progresses through? It's just a guess at this point based on the user being able to go back and modify their answers and that data is transmitted to the LMS at every slide (to help with resuming the course).
Thx for the info. We only allow 1 attempt on the quiz question in SL so they can't go back multiple times. We seem to be having this issue on Mac that do not use Flash. We use the HTML5 publishing option. Are there any known issues with SL responses and HTML5? This issue is rare but very odd and we are trying to find a possible pattern.
What browser(s) are you using on the Mac? I'd look at using Chrome or Safari as those are supported for HTML5 output.
You could also look at enabling LMS debug mode to determine what information Storyline is passing to your LMS and that should narrow down where the issue is further. Again that's something as a general check, but if the issue is still inconsistent across all users that is not likely something you want them all to run through.
Thx for the Debug option but since this calculation is happening within the SL content ( i.e. on the Results slide) and hasn't been submitted to the LMS is the issue within SL itself?
Hi Brian,
If the Storyline results slide was showing as failed, but the LMS is showing passed I'd still have to wonder what was being passed to the LMS to recognize that. I haven't seen a results slide incorrectly calculate the results unless as I mentioned the user is somehow changing their answers (on purpose or inadvertently revisiting slides and resetting them). Again since only some users are seeing it, I think you'll need to get more information about the steps they're going through or how they're taking the course to confirm where the issue is occurring.
This discussion is closed. You can start a new discussion or contact Articulate Support.