SL1 - Results.Score bug

Hi all,

A while ago I created a quite complex quiz in Storyline 1 which allows the user to revisit the questions they got wrong with multiple attempts until they get 100%.

This all worked fine until we discovered that if the questions were answered in a certain sequence the Results.Score and Results.ScorePercent subtracted the equivalent of one interaction from the end result (there are 20 questions and it took 5% off the score). This also only happens on the third attempt.

Does anyone have any idea what is going on?

I cannot upgrade this to SL 2 for two reasons:

  • SL2 seems to force a score reset for each quiz attempt
  • The client in has SL1 and wants to be able to edit it

I have uploaded the quiz and details about the question sequence.

Any help gratefully received.

Thanks.

Julian

 

10 Replies
Ashley Terwilliger

Hi Julian,

Thanks for sharing the files here including the answers - that'll be particularly helpful! So just to confirm, you have to attempt the quiz 3 times, and on the 2nd and 3rd attempts you're only seeing the ones you already got wrong, and reanswering those? You mentioned you can see where it reduces - do you see that regularly occur on the same questions or after a certain number of reanswered questions? That info would be helpful in tracking it down. 

Ashley Terwilliger

Hi Julian,

Thanks for your patience while I tested your course. I uploaded a copy to SCORM Cloud to test it within an LMS environment and you can view it here. I ran through it the first time, and got 3 wrong, so a score of 85% which I saw change consistently throughout the course. On the revisit I answered 2 correctly, and so then my score was 95% and on my third and final attempt, I answered the last question correctly as well and saw the 100% score. So I'm not seeing the same that you are? 

Perhaps you could take a look at my version and let me know if you answer particular questions right or wrong and how that impacts the behavior? If so, I'd want to know the order for those. 

Julian Stubbs

Hi Ashley,

Thanks for taking a look. It does function correctly in the majority of cases. To see the bug you have to answers them as I have outlined in the word document describing the bug. It states which ones you have to get right on each run through. 

When done in this order it takes 5% off the score when it reaches the results slide.

Julian

Ashley Terwilliger

Hi Julian,

I used the "quiz answers.doc" to work through the course but didn't see any indicating which to answer correctly vs. incorrectly? So I need to use the "results score bug" set up? Did you experience the same thing testing my version in SCORM Cloud? I just want to double check that element before I go through and cross check the two documents to make it easier to answer! :)

Also, is there a particular point at which the 5% is subtracted that I could watch for or it just updates once you're on the results slide? When you see the 95% but have answered all correctly what does the "retake button" do? Does it direct the user to a particular question that they need to answer again? I'd also be curious to know if you're seeing the correct score submitted to the LMS or that's also showing incorrectly?  

Julian Stubbs

Hi Ashley,

Sorry, not at my PC today, but the problem occurs both offline and on my clients LMS so doubt Scormcloud will make a difference. It's in my document that was upload des with the story file, called something like Bug explained (can't remember exact name, but it's in that post).

The bug occurs after you get question 20 wrong (or 19 if you've already answered 20 correctly).
On question 20 it updates my score to 85%, the as soon as I click next to go to the results slide it removes 5%. The question ticks show 3 wrong (which is correct) but instead of the expected 85% it shows 80%.

Sent from my iPhone

Julian Stubbs

Hi all,

Just wanted to let you know that I rebuilt the quiz from scratch and the error has gone. I had another module with only 12 questions which worked fine, so I used that as the template to slot in the 20 questions and all fine.  I have uploaded here in case anyone can spot what the difference is.

I actually got someone else to create the original 20 question quiz using my 12 question template. I think there might have been some kind of variable conflict or something weird.

Anyway, this type of quiz is possible in Storyline 1. Don't think it will work in Storyline 2 though because it forces the results score reset. Would it be possible to provide developers with the option not to reset it (as in Storyline 1)?