Can I stop storyline reporting a score to the LMS?
Mar 04, 2014
Hi,
I have several courses developed in Storyline running on our LMS. They are all set to track using a quiz result, but because it seems to slow the assessments down a lot if we track using the result of an actual quiz, there is a final results page that does not track particular answers.
I have set the course to record as Complete/Incomplete.
But something odd happens when the course is live - most of the time, no score is recorded, and the LMS just says 'complete'. But about 10% of the time, the score is recorded as 0%, which is annoying people....
How can I stop this happening?
Heres what our LMS provider had to say:
it looks as though it IS the course that is reporting a 0% score at times. We're not sure why - the course developer would need to investigate their source files - but the course is at times sending "cmi.core.score.raw" = 0 and other times it is not.
So the LMS is functioning fine. Looks like the course provider will need to review the source files again to be sure,
71 Replies
Hi Rebecca,
You mentioned it only happens sometimes - do you know under what conditions? A particular browser the user accesses it through? When they resume the course after exiting? There was a known issue corrected in Update 3 about exiting a course and then resuming it the score may change to 0. We're currently on update 5 now, do you know what update you published the courses with?
Hi Ashley,
It seems to be random - it occasionally does it for me on my own computer, accross different courses, and different updates.
I noticed it happening ages ago, but didn't think it mattered that much as the user was still shown as having completed the course. However, we have recently changed the appearence of the LMS and it stands out more now, so people have noticed it and started complaining....
I am now using update 5, and it is still doing it. The score doesnt change to 0 - it will always be 0 because there are no questions associated with the results screen that tracks completion. I just dont want the LMS to show any score at all.
Hi Rebecca,
I'm not sure I'm following - only sometimes do you see a score of 0 in the LMS, even though there is no score reporting within your Storyline courses? If you're reporting based on a results slide, you may want to change the behavior to report on the number of slide viewed - but I also wanted to share this article on tracking and reporting within your LMS as they would be who I would defer to in regards to what is displaying and why within the LMS. If they're able to pinpoint something in your Storyline course, let us know.
Hi Ashely, I need to make sure the users have passed the assessment before the course is recorded as complete, so I can't do it on number of slides. And it slows the course down if I have any questions associated with my results slide. So I have a second results slide, right at the end of the course as the final slide, with no associated questions, and the course is set to use this results slide to track results. So I guess in theory, it ought to record a score of 0% every time, although I would much prefer it to report no score at all - just passed or incomplete. I really don't understand why it is only sending a score sometimes.
Hi Rebecca,
Is the final results slide tracking the first results slide, or just as a placeholder to submit the completion of the course as you don't want the users to see a score at all? Have you also tested your course at SCORM Cloud to see if this behavior is reproducible outside your LMS, as SCORM Cloud is an industry standard testing method for SCORM content. I think this will help narrow down the inconsistency of when it sends the score and also the mention that the course slows down if you have any questions associated with the results slide, as that last part sounds odd.
Hi Ashley,
The final results slide is just a placeholder, as everything slows down if I try to send a scrore to the LMS. I shall try and have a look at the SCORM Cloud to see if it still slows down. Will I also be able to teat what score it tries to sent to the LMS this way?
Regards,
Becky
Hi Rebecca,
Yes, please try it out at SCORM Cloud to see how it behaves there. Also if you'd like to see what information is being passed to your LMS and to SCORM Cloud, you could enable the LMS debug mode as described here. If everything works as expected at SCORM Cloud this will be information you could share with your LMS team.
I've also had this issue. In my case, I think I've narrowed it down to this:
I've just raised a support ticket so I'll let you know how I get one.
Note - this is currently an issue for a client, because their LMS is showing a score of 0% and a Complete status, when not score should be recorded.
I should add, I've tested the above scenario on SCORM Cloud and Reload.
Hi Steven,
How did it behave at SCORM Cloud? Did you open up a support case with our Support engineers or your LMS team? If it was with our team can you share the case number so that i can follow along? If it was with your LMS team, please keep us posted on what they're able to determine.
Hi Ashley
It behaved exactly the same on SCORM Cloud, as it did on our LMS. I've had a response back from the Support team to say that they were able to replicate the issue. They're said it looks like a bug in Storyline, so it's been passed onto the QA team for review.
My case number is #00408451.
Hi Steven,
Thanks for sending along your case number. I see your communication with Jayem and where he reported the issue to our QA team. We'll keep you posted through your support case with any other further developments and we'll also try to update this thread as well.
No probs, thanks Ashley.
Hi! did you find out what was causing the problem?
Hi Rebecca,
I don't have any updates on this to share, but do see that it was shared with our QA team and it's connected to the use of the "exit course" trigger. As a workaround, you may want to instruct your users to close the course by using the browser close button and remove that trigger.
Hi Ashley,
I am also having this problem with the most recent update (update 6). Can you please advise when the issue has been fixed? Hopefully not in the distant future!
Hi Gordon and welcome to Heroes!
I still see that this issue is with our QA team, and I don't yet have an update to share in regards to time frame for a fix for this update. I'll add this thread to the existing report with our QA team for review and share any information here when we have additional information to share.
Thanks Ashley,
I see that Rebecca first reported the issue back in early March and Steven narrowed it down very specifically at the beginning of July. My concern is that my client, Westpac (an Australian bank), won't have the patience to stand by if this is not resolved in a timely fashion. It would be a great pity if they abandon Articulate products as I think Storyline, in particular, is very user friendly and I have really enjoyed using it.
Hi Gordon,
I certainly understand the frustration with this bug and I've added it to the existing report filed with our QA team. I don't have additional information to share at this time but once I have an update I'll be able to post in this thread and since you also have a case open about this issue you'll hear about it there as well.
Hi,
The issue is not happening with 'Exit course' trigger. We can replicate the issue by doing the given below steps. I have attached the sample course, please test in LMS (I have tested in cloud SCORM).
1. Upload the course in LMS
2. Launch the course
3. Navigate to the second slide
4. Close the course
5. Re-launch the course
6. It will ask for the resume option, select Yes
7. Close the course
8. Now you can see the score set as 0 (Zero)
Please let me know the resolution for that ASAP.
Hello Vigeshwaran!
I tested your file in the SCORM Cloud, and it did work as expected. Attached are two screen shots. The first one is the score as 0% when i closed, then resumed, then closed again. The second is after passing the quiz and exiting.
If this is not working properly in your LMS, please look at the information here regarding troubleshooting your LMS.
Hello Emily Burnett,
Thank you so much for your quick response.
However our client expectation is, score has to be send once the assessment has been completed not before. But Storyline course send score 0 even before attending the assessment.
Please help me on this ASAP.
Hello Vigneshwaran!
You may want to check within your LMS to see if they are recording only the latest score that is reported. You may also need to check that they do allow more than one score to be reported.
If you let us know what LMS your are using, there may be others in the community that may be able to offer suggestions.
Hi Emily,
It's not about LMS, even you can take SCORM cloud LMS as reference for this case. All we need this that, the SCORE should not be sent before completing the Assessment (Even sending score as zero is also not accepted before completing the Assessment).
As you said "score as 0% when i closed, then resumed" it should not happen. The score should be unknown or null before completing the Assessment . Once the assessment has been completed then only the score has been updated the actual score the user got.
Now the course has been updated the score after the assessment completion what the user got. But our question/issue is why it sending score as 0% when i closed, then resumed before completing the Assessment.
Kindly let me know the resolution for this ASAP
Hello Vigneshwaran!
I took a look at the file again, and I was able to make some changes to the publish settings to get the score to not mark at 0% when a user closes the course. you can set the reporting to Passed/failed, Complete/Incomplete, or Completed/Failed and get the correct results. See attached files.