Hi, I've noticed that Storyline will send a score to the LMS after each quiz question rather than at the end of the quiz. This means that if a learner answers the first question correctly and then exits the course, the LMS will report that they have scored 100% in the quiz when actually they've only scored 1 out of 10 (or however many questions you have in your quiz). I'm using SL 1 for this.
The score should be submitted when the user reaches the completion point as described here. How are you tracking your course? Have you reviewed the troubleshooting information here and looked at testing the course within SCORM Cloud an industry standard for testing SCORM content.
I'm pulling 10 questions from a bank of 18 randomly. Directly after the quiz there's a Results Slide, and this results is set as the trigger for 'lesson_status' status.
I've tested it on SCORM Cloud. You can see the log here:
The quiz is represented by the final portion of the log. You'll see that the score is set multiple times, starting at 100 (I answered the first question correctly), then dropping to 50, then 33.33 etc. Then increasing again as I answered some more correctly.
Also, my statement earlier was incorrect. I'm using SL2 rather than 1.
Are you able to share your .story file with us here? Also, if you'd like to pull the debug log, we'd ask for you to use the one detailed here to show the information Storyline is sending.
I'm afraid it's not possible to send you the file as the course content is confidential.
I've been making various adjustments to the question bank to try and establish what is causing the strange score tracking. All that I have deduced so far is that if I reduce the number of questions in the bank from 18 to 7 the course starts to behave as expected. It's also sensitive to exactly which questions I delete, i.e. I have to delete the last 11 rather than the first 11.
Anyway, I'll just keep whittling away at the questions to try and isolate the problem one.
First, replying via email includes your signature here in the forums - so you're welcome to edit the post to remove that information if you wish.
In regards to the troubleshooting your doing - have you tried to put those 11 problematic slides into another file? It sounds like it may be something specific to this slides, so you could also try removing one at a time and seeing how it behaves that way.
Were you able to take a look at Storyline's debug log vs. the one generated by SCORM Cloud?
Hi Ashley, we've not been able to find a solution to this problem yet. As such I would like to send you the .story file for you to take a look as you had previously offered.
The Quiz is the final topic off the main menu. I've unrandomised it so that I know which question comes first. If you select the third answer and click confirm you will see in the LMS debug trace that a score of 100 is set before you have completed the remaining questions. If you then closed the course at this point the 100 value would be commited to the LMS.
Is the best way to send the file to you via the Add Atachment feature here? The file is confidential so I don't want everyone else to be able to access it.
Hi Ashley, I've submitted it again using Chrome this time. I saw the Case Submitted message. I remember seeing it last time too when using Firefox. I've also checked my junk mail. Hopefully it will turn up soon.
It's the end of the day here though, so I guess we'll need to continue this tomorrow.
I don't see it just searching your name as listed here alone - so if you still don't see the email confirmation, can you try emailing Support@articulate.com directly?
Any resolution here? I have the same issue and have submitted a ticket but they did not seem to have a resolution to this. My course was actually built in Storyline 1 last year and all I did was upgrade to Storyline 2 and started facing this issue of the course sending a score based on 100% to the LMS upon exit. My Storyline 1 built course does not work this way so I'm thinking it is related to having to upgrade the course but haven't troubleshooted any further. I did see that the only change in the published 2014 output and the 2015 output was in the SCORM2004Functions.js file which had the below line added in the 2015 output:
Line : 724 RoundToPrecision(fltNormalizedScore, 7);724 var strPercentScore = fltNormalizedScore.toString();
Just following up here with some more context if it helps troubleshooting, but if no resolution has been found, I will probably just re-create the quiz part of the course.
The ticket # is 00628216. Also, I believe I troubleshooted the issue by re-creating my Knowledge Check one brick at a time and testing with each change I made:
My quiz had custom Review layers on each of my questions since I am not using the native Player so needed to add previous and next buttons when users are in the Review Quiz function. I solved this issue by deleting each of my custom Review layers, then re-adding a new layer titled "Review" but these layers only include a Next button and no longer have a Previous button. Again, I don't understand it but it seems the following two elements have changed from Storyline 1 to Storyline 2 and cause this issue: (a) custom Review layer and (b) a Previous button on a custom Review layer. I have sacrificed providing users the ability to go to previous slides in the Review function since this false completion issue is a higher priority.
The only explanation I have is that I saw somewhere in these forums that Storyline automatically creates some specific coding if a custom review layer is named exactly, "Review." Maybe somehow between Storyline 1 and Storyline 2, this code changed and is causing some of this issue since as I said previously, I did not have this issue with this exact course last year when it was originally built in Storyline 1.
Thanks Tejas for sharing the case number so that I could check in on your submission. I see you're working with John and shared some additional information in regards to how it's behaved, but John was doing some additional testing and wasn't able to replicate the problem on new files, or on a recreation of your file with new questions. I didn't see you mention the review elements in your most recent email to him, so I'm going to update the case with that comment as well and I'll continue to follow along.
15 Replies
Hi Nick,
The score should be submitted when the user reaches the completion point as described here. How are you tracking your course? Have you reviewed the troubleshooting information here and looked at testing the course within SCORM Cloud an industry standard for testing SCORM content.
This post was removed by the author
Hi Ashely,
I'm pulling 10 questions from a bank of 18 randomly. Directly after the quiz there's a Results Slide, and this results is set as the trigger for 'lesson_status' status.
I've tested it on SCORM Cloud. You can see the log here:
http://cloud.scorm.com/sc/guest/ViewDebugLog?logId=fe91ed0a-5180-437e-9ec8-dd324d2ae799&courseTitle=ECT318+-+v30-notrandom-all+n1
The quiz is represented by the final portion of the log. You'll see that the score is set multiple times, starting at 100 (I answered the first question correctly), then dropping to 50, then 33.33 etc. Then increasing again as I answered some more correctly.
Also, my statement earlier was incorrect. I'm using SL2 rather than 1.
Nick
Hi Nick,
Are you able to share your .story file with us here? Also, if you'd like to pull the debug log, we'd ask for you to use the one detailed here to show the information Storyline is sending.
Hi Ashley,
I'm afraid it's not possible to send you the file as the course content is confidential.
I've been making various adjustments to the question bank to try and establish what is causing the strange score tracking. All that I have deduced so far is that if I reduce the number of questions in the bank from 18 to 7 the course starts to behave as expected. It's also sensitive to exactly which questions I delete, i.e. I have to delete the last 11 rather than the first 11.
Anyway, I'll just keep whittling away at the questions to try and isolate the problem one.
Nick
Hi Nick,
First, replying via email includes your signature here in the forums - so you're welcome to edit the post to remove that information if you wish.
In regards to the troubleshooting your doing - have you tried to put those 11 problematic slides into another file? It sounds like it may be something specific to this slides, so you could also try removing one at a time and seeing how it behaves that way.
Were you able to take a look at Storyline's debug log vs. the one generated by SCORM Cloud?
Hi Ashley, we've not been able to find a solution to this problem yet. As such I would like to send you the .story file for you to take a look as you had previously offered.
The Quiz is the final topic off the main menu. I've unrandomised it so that I know which question comes first. If you select the third answer and click confirm you will see in the LMS debug trace that a score of 100 is set before you have completed the remaining questions. If you then closed the course at this point the 100 value would be commited to the LMS.
Is the best way to send the file to you via the Add Atachment feature here? The file is confidential so I don't want everyone else to be able to access it.
thanks,
Nick
Hi Nick,
If you need the file to be kept confidential, you can send it along to us here.
Once you've sent it along, please let me know here.
That's done Ashley, thanks.
Nick
Thanks Nick - you should receive an email with a case number, if you can share that with me here I'll follow along.
Hi Ashley, I've submitted it again using Chrome this time. I saw the Case Submitted message. I remember seeing it last time too when using Firefox. I've also checked my junk mail. Hopefully it will turn up soon.
It's the end of the day here though, so I guess we'll need to continue this tomorrow.
Nick
Hi Nick,
I don't see it just searching your name as listed here alone - so if you still don't see the email confirmation, can you try emailing Support@articulate.com directly?
Hi Ashley/Nick,
Any resolution here? I have the same issue and have submitted a ticket but they did not seem to have a resolution to this. My course was actually built in Storyline 1 last year and all I did was upgrade to Storyline 2 and started facing this issue of the course sending a score based on 100% to the LMS upon exit. My Storyline 1 built course does not work this way so I'm thinking it is related to having to upgrade the course but haven't troubleshooted any further. I did see that the only change in the published 2014 output and the 2015 output was in the SCORM2004Functions.js file which had the below line added in the 2015 output:
Line : 724 RoundToPrecision(fltNormalizedScore, 7);724 var strPercentScore = fltNormalizedScore.toString();
Just following up here with some more context if it helps troubleshooting, but if no resolution has been found, I will probably just re-create the quiz part of the course.
Hi Tejas,
You mentioned you submitting a ticket, do you have the case number that you could share here so that I could take a look?
Hi Ashley,
The ticket # is 00628216. Also, I believe I troubleshooted the issue by re-creating my Knowledge Check one brick at a time and testing with each change I made:
My quiz had custom Review layers on each of my questions since I am not using the native Player so needed to add previous and next buttons when users are in the Review Quiz function. I solved this issue by deleting each of my custom Review layers, then re-adding a new layer titled "Review" but these layers only include a Next button and no longer have a Previous button. Again, I don't understand it but it seems the following two elements have changed from Storyline 1 to Storyline 2 and cause this issue: (a) custom Review layer and (b) a Previous button on a custom Review layer. I have sacrificed providing users the ability to go to previous slides in the Review function since this false completion issue is a higher priority.
The only explanation I have is that I saw somewhere in these forums that Storyline automatically creates some specific coding if a custom review layer is named exactly, "Review." Maybe somehow between Storyline 1 and Storyline 2, this code changed and is causing some of this issue since as I said previously, I did not have this issue with this exact course last year when it was originally built in Storyline 1.
Thanks Tejas for sharing the case number so that I could check in on your submission. I see you're working with John and shared some additional information in regards to how it's behaved, but John was doing some additional testing and wasn't able to replicate the problem on new files, or on a recreation of your file with new questions. I didn't see you mention the review elements in your most recent email to him, so I'm going to update the case with that comment as well and I'll continue to follow along.
This discussion is closed. You can start a new discussion or contact Articulate Support.