Storyline recording in Cornerstone the minimum % score achievable based on number of assessment questions
Nov 16, 2016
In the past few weeks our LMS Cornerstone has started showing a rogue % score field which wasn't there before. I've reported it to Cornerstone as this field has not been there for the past 2 years, which now only appears in any Storyline course I publish.
I can explain what the figure represents but have no idea how to stop it appearing in the LMS.
In the LMS the score is now recorded twice. In the place where it always records the % score this is 100% correct every time. However an extra score field has appeared which is not in all cases a true representation of the score. If you fail the test it scores correctly, however once you pass the test it records a % score based on the minimum number of questions you would need to correctly answer to push the score over the pass rate. I may not have explained that clearly in words but hopefully these examples below will make you understand what I mean:
Here's the outcomes of my testing:
Test 1 – Set the quiz to pass rate 80% and ask 7 questions - A user needs to answer correctly a minimum of 6 questions to achieve 80% or more. 6/7 questions = 85%.
The results were:
Number of questions correctly answered
1 = Scored 14% in both score fields = correct
2 = Scored 29% in both score fields = correct
3 = Scored 43% in both score fields = correct
4 = Scored 57% in both score fields = correct
5 = Scored 71% in both score fields = correct
6 = Scored 85% in both score fields = correct
7 = Scored 85% & 100% in score fields = incorrect
Test 2 – Set the quiz to pass rate 80% and ask 9 questions – A user needs to answer correctly a minimum of 8 questions to achieve 80% or more. 8/9 questions = 88%
Number of questions correctly answered
1 = Scored 11% in both score fields = correct
2 = Scored 22% in both score fields = correct
3 = Scored 33% in both score fields = correct
4 = Scored 44% in both score fields = correct
5 = Scored 55% in both score fields = correct
6 = Scored 66% in both score fields = correct
7 = Scored 77% in both score fields = correct
8 = Scored 88% in both score fields = correct
9 = Scored 88% & 100% in score fields = incorrect
Test 3 – Set the quiz to pass rate 80% and ask 12 questions – A user needs to answer correctly a minimum of 10 questions to achieve 80% or more. 10/12 questions = 83%
Number of questions correctly answered
1 = Scored 8% in both score fields = correct
2 = Scored 16% in both score fields = correct
3 = Scored 24% in both score fields = correct
4 = Scored 33% in both score fields = correct
5 = Scored 41% in both score fields = correct
6 = Scored 50% in both score fields = correct
7 = Scored 58% in both score fields = correct
8 = Scored 66% in both score fields = correct
9 = Scored 75% in both score fields = correct
10 = Scored 83% in both score fields = correct
11 = Scored 83% & 100% in score fields = incorrect
12 = Scored 83% & 100% in score fields = incorrect
All courses I've tested behaved in this way, however I came across one old course which recorded the score in both fields correctly. I have had this course open side by side with an affected course and I cannot see any obvious differences with the results page/publishing settings.
All courses were created in Storyline 1 and up until 31.10.16 they did not trigger this score field appearing in Cornerstone, which makes me believe it's a Cornerstone issue, however the one course recording correctly has thrown me so is it a Storyline setting? The SCORM file must contain this somewhere but is there a way of fixing it? Where does it get this figure from?
Has anyone come across this? Any help would be much appreciated as I've spent 2 days testing, which I could have done without, to put some simple updates live for courses which have been perfect for the past 2 years and due to this issue I cannot put them live.
It's worth also stating I tested them in SCORM cloud and it only recorded the one score field, as its always done and it is 100% correct each time.
Thanks
3 Replies
Hi Barry,
Thank you so much for taking the time to detail what you've been investigating so precisely here. I can certainly understand the frustration, as it's evident you've devoted a lot of energy to testing this. You definitely seem to have covered all bases here.
Since you weren't able to reproduce this in SCORM Cloud, that would indicate it being an issue limited to Cornerstone LMS itself. You mentioned that you reached out to Cornerstone about this- please be sure to keep us in the loop here on their findings and insights for anyone else using Cornerstone who may encounter this.
I know we have a number of community members here who are Cornerstone users, perhaps folks will be able to chime in with some insight here as well. I also wanted to share with you this active thread with many Cornerstone users incase there's helpful information there or you wish to reach out in it. :)
Hi Ali, Thanks for your response.
99% of what I've found would point this to Cornerstone. There was a release put live 3 weeks ago & it's only since then that the issue has occurred. Coincidence or red herring?
However, the one thing that has thrown me is why I found one course where it recorded in both places the % score. Why would this happen?
If it behaved in the same way as the others, then 100% I would be certain it's Cornerstone.
I'll update the post once I hear from Cornerstone.
Thanks Barry and glad you found our BIG thread with fellow users :)
This discussion is closed. You can start a new discussion or contact Articulate Support.