Incomplete Quiz sending back a Failed status
Apr 11, 2017
Hello Storyline wonderful people, I was hoping you could help with this problem. I'm new to Storyline so hope it isn't a stupid question.
I have a module published with the reporting/tracking = Passed/Incomplete.
However if a user starts the quiz and exits before finishing (say completes 2 questions out of 10) this sends back to the LMS a status of Failed, thus translates to our LMS that the course is Complete.
1. Does it seem right that the Failed Status appears at all?
2. Is there a way if a quiz is incomplete to feed back an incomplete status back to the LMS?
thanks for your help
15 Replies
What is your tracking method (click "reporting and tracking in the LMS section of the publish settings)? Is it set to "Track using number of slides viewed" or "Track using quiz result"?
Hi Derek, its Track using quiz result
Interesting, I've not seen this issue before; I'm not sure I have an ideal solution. The only thing I can thing of, and hopefully someone else has something better, is to remake the quiz. Sometimes this fixes issues, but no guarantee.
Can you post the story file? That may help.
Hello Claire - I agree with Derek here. Taking a look at your .story file would be helpful.
Hi Claire,
Have you checked with your LMS team if there is a way to have it "in progress" or something similar? It's typically an LMS specific setting or language, so you may want to touch base with your LMS admin team.
Hi
I have checked with the LMS owners (Kallidus) and they believe that because the quiz has started, thus failed, it recognises that the course has been completed bring back the Complete status. This doesn't make sense to me. They have asked me to seek a way I can configure the Storyline file to say "if quiz failed/incomplete to return an Incomplete status" - removing the failed status, so here I am. I hope this makes sense!
please can you elaborate what you mean by the Story file, in the Output I can see 2 files named Story, one is a HTML document is it this one?
thanks
The .story file is the file you open when you are editing the module.
Hi Claire,
Storyline is sending a completion status, if the user reaches the tracking requirement, slides viewed or the results slide.
It's up to the LMS to interpret that status and report it to you as the author/learner based on the completion status and any scoring achieved and thresholds.
Have you test at SCORM Cloud? That's a good standard for how things should behave.
hi Ashley, that's exactly my issue, the module doesn't reach the results slide and brings back a Failed Module status (which the LMS reads as a Complete status) after the user completes 2 questions and exists.
I'll test it on Scorm cloud today, attached is the story file if anyone wants to take a look :)
thank you!
SCORM Cloud brings back Completion: Incomplete and Success: Unknown, what does this suggest?
Hey Claire,
Looks like you have your completion set in your file as Passed/Incomplete.
So, until the user passes the quiz, it will be incomplete.
If your LMS is reporting this as Failed (when you have not included this in your reporting option), you may want to follow up with them on why the difference if the module is really still incomplete.
Thanks Leslie, I have followed this up with them and this is their response:
"It appears that this module has a 'mastery score' attached to it. Essentially, after some testing, I can confirm that a mastery score disregards the statuses that are coming back, and concentrates only on the % score that is sent back. If it is under the defined mastery score, the LMS will give it a status of 'failed'. And if it is over, it gives 'passed'. Currently the mastery score is set to 80, meaning if the user gets under 80%, they will receive a status of failed regardless of what the content sends back"
"it is bringing back failed because the scores the content is taking back is being interpreted by the mastery score. So it's the mastery score that gives the content a status of failed. So if you remove the mastery score the lms will take the contents statuses it sends back and use them"
I'm confused by this response, don't I have to have a mastery score for my quiz to work?
hope you can help?
thanks
Let's see if I can Claire 😁
As I mentioned above, it looks like you have the course set up correctly with the Passed/Incomplete set as your tracking and your mastery score must be set - that is correct as well.
You will still need to work with your LMS team, but let's try a more technical approach.
Here's what to do:
hi Leslie
thanks for your message. sorry its taken me so long, I'm now working on the next item of e-learning and having the same problem.
I am the LMS team and I'm not technical, what do you suggest I do with the information when I enable this Debug mode, I don't entirely understand it.
thanks
Claire
Hi Claire!
Since you are unable to replicate the behavior via SCORM Cloud, this is why I recommended looking to your LMS.
I'm sure this is difficult if you are the LMS team. I mentioned the debug log because it seems that your LMS is ignoring the status sent and interpreting the score as passed/failed vs your setting of Passed/Incomplete.
You mentioned that you were using Kallidus and hopefully someone in the community familiar with that LMS will be able to chime in and assist you here.
You can check out some common LMS troubleshooting here.
This discussion is closed. You can start a new discussion or contact Articulate Support.