Incomplete Quiz sending back a Failed status

Apr 11, 2017

Hello Storyline wonderful people, I was hoping you could help with this problem. I'm new to Storyline so hope it isn't a stupid question.

I have a module published with the reporting/tracking = Passed/Incomplete.

However if a user starts the quiz and exits before finishing (say completes 2 questions out of 10) this sends back to the LMS a status of Failed, thus translates to our LMS that the course is Complete.

1. Does it seem right that the Failed Status appears at all?

2. Is there a way if a quiz is incomplete to feed back an incomplete status back to the LMS?

thanks for your help

 

 

 

15 Replies
Platform Eng12

Hi

I have checked with the LMS owners (Kallidus) and they believe that because the quiz has started, thus failed, it recognises that the course has been completed bring back the Complete status. This doesn't make sense to me. They have asked me to seek a way I can configure the Storyline file to say "if quiz failed/incomplete to return an Incomplete status" - removing the failed status, so here I am. I hope this makes sense!

please can you elaborate what you mean by the Story file, in the Output I can see 2 files named Story, one is a HTML document is it this one?

thanks

Ashley Terwilliger-Pollard

Hi Claire,

Storyline is sending a completion status, if the user reaches the tracking requirement, slides viewed or the results slide.

It's up to the LMS to interpret that status and report it to you  as the author/learner based on the completion status and any scoring achieved and thresholds.

Have you test at SCORM Cloud? That's a good standard for how things should behave.  

Platform Eng12

hi Ashley, that's exactly my issue, the module doesn't reach the results slide and brings back a Failed Module status (which the LMS reads as a Complete status) after the user completes 2 questions and exists.

I'll test it on Scorm cloud today, attached is the story file if anyone wants to take a look :)

thank you!

Leslie McKerchie

Hey Claire,

Looks like you have your completion set in your file as Passed/Incomplete.

So, until the user passes the quiz, it will be incomplete.

If your LMS is reporting this as Failed (when you have not included this in your reporting option), you may want to follow up with them on why the difference if the module is really still incomplete.

Platform Eng12

Thanks Leslie, I have followed this up with them and this is their response:

"It appears that this module has a 'mastery score' attached to it. Essentially, after some testing, I can confirm that a mastery score disregards the statuses that are coming back, and concentrates only on the % score that is sent back. If it is under the defined mastery score, the LMS will give it a status of 'failed'. And if it is over, it gives 'passed'. Currently the mastery score is set to 80, meaning if the user gets under 80%, they will receive a status of failed regardless of what the content sends back"

"it is bringing back failed because the scores the content is taking back is being interpreted by the mastery score. So it's the mastery score that gives the content a status of failed. So if you remove the mastery score the lms will take the contents statuses it sends back and use them"

I'm confused by this response, don't I have to have a mastery score for my quiz to work?

hope you can help?

thanks

Leslie McKerchie

Let's see if I can Claire 😁

As I mentioned above, it looks like you have the course set up correctly with the Passed/Incomplete set as your tracking and your mastery score must be set - that is correct as well.

You will still need to work with your LMS team, but let's try a more technical approach.

Here's what to do:

  • Enable the LMS Debug Mode for your course - instructions here
  • Those results will show that we do send status of Passed or Incomplete, but a score as well. The LMS seems to be ignoring the status and interpreting the score as Passed/Failed
Leslie McKerchie

Hi Claire!

Since you are unable to replicate the behavior via SCORM Cloud, this is why I recommended looking to your LMS. 

I'm sure this is difficult if you are the LMS team. I mentioned the debug log because it seems that your LMS is ignoring the status sent and interpreting the score as passed/failed vs your setting of Passed/Incomplete.

You mentioned that you were using Kallidus and hopefully someone in the community familiar with that LMS will be able to chime in and assist you here.

You can check out some common LMS troubleshooting here.

This discussion is closed. You can start a new discussion or contact Articulate Support.