Question Bank randomly skipping questions

We have a question bank with 6 questions, set to random and the learner must answer 5.  Randomly the bank isn't firing properly so that the user will answer the first question wrong and is immediately taken to the results slide.  The next time the person takes the quiz it may do it again - on a different question - OR it will work properly taking the learner all the way through the quiz.  The next try, the learner might get the first question correct and again the quiz is over and the results slide shows. All triggers are set the same within each slide and there seems to be no pattern to when it will provide the entire quiz and when it will jump to the end after the first question.

Does this sound familiar to anyone?

I am not finding any other threads here on the Hero's website.  

To add to the mystery, (because that's not weird enough!), this course is branched, and the question bank in the other branch works perfectly fine.

13 Replies
Christie Pollick

Hi, Bridget -- Are you using an LMS, and if so, can you please share which one, as there may be others in the community who have had a similar experience and can share some insight? 

If you are seeing this behavior in your LMS, have you tried testing your course in the SCORM Cloud, as well? If you are not seeing the same behavior in the SCORM Cloud, it may be best to reach out to your LMS provider directly. 

Please feel free to share your file here and we'll be happy to take a closer look for you. 

Bridget Brown

Hi Christie.  This is NOT happening in an LMS it is happening in our testing phase before we post to the LMS.  Having said that, when we publish it for testing, we are plublishing for LMS using SCORM 1.2.  Let me know if that give you any clues. 

I have attached both question banks.  #1 seems to be working fine.  #2 is having the issues.

Christie Pollick

Hi, Bridget -- Thanks for your patience while I did some testing on your file. Unfortunately, when I tested your published output (published for Web) on as seen here on Tempshare, I was unable to reproduce the issue you have described. I took the quiz multiple times, and at no point, was I taken immediately to the end of the quiz. 

If you would like our Support Engineers to take a look at your file, please use this form to submit a case, and someone from the Support team will be in touch shortly via email. 

Bridget Brown

Christie -

We recreated the Question Bank from another one that was working and can no longer replicate THAT problem.  HOWEVER, we have another issue.  If the learner fails the quiz and clicks retry to take it again all of the answers are disabled and unclickable.  :(

Christie Pollick

Hi, Bridget -- Ok, so I think we may be in business with just a minor adjustment! If you click on Layer 2, and swap the order of the triggers, you will find that questions are now available after you click retry quiz (I tested this on the SCORM Cloud as seen here). And just so you have it for future reference, here is some information on The Order in Which Triggers are Executed.

Hope that helps and please let me know if you have any other questions! :)

 

Bridget Brown

Thanks Christie.  I will pass that along.  In the meantime between this and the question bank skipping questions, we went to a work around and if the user fails they get routed to a different scene with slightly different questions.  Same effect - different structure. 

Appreciate your help!

Daniela  Figueiredo

Hi there.

We have been testing some curses made in storyline 2 on our LMS. The result score shows 100%, but the recorded score is 88%. The quiz has 10 questions from 2 different questions banks (30 in total). We thougt it might be an issue like this:  https://community.articulate.com/discussions/articulate-storyline/storyline-recording-in-cornerstone-the-minimum-score-achievable-based-on-number-of-assessment-questions

But soon we realized that storyline seems to be skipping a question sometimes and randomly. Reports show users with 100% and 88% score when there should be 80%.

Our LMS is Cornerstone.

Scorm 1.2

Need help ASAP

Leslie McKerchie

Hey Daniela,

Thanks for linking to the similar thread.

This thread is a bit dated, so I'd like to start from scratch.

You mention that this is happening in your LMS. Is this something that you are able to replicate in SCORM Cloud as well or is it only happening in your LMS?

If you need us to take a look at your .story file, please feel free to share it here.

Daniela  Figueiredo

Hi Leslie,

Thank you for your answer.

We haven't been able to replicate this error. We have been testing the course extensivley but it has never reported a score that isn't a full number like 0%, 10%, 20%, 30%, etc.


Our reports, however, show learners with 88%, which is not a possible score to obtain. We figured that the only way to obtain this score is if questions are rated by number of questions answered e.g. 9 out of 10 which would give a score of 88%. But learners have to answer all the questions in order to obtain a score and score is submitted at the results slide.

We can not share the file due to Confidentiality agreement.

Thank you

Ashley Terwilliger

Hi Daniela, 

I understand if you're not able to share your file, but since it's the best way for us to demonstrate the problem and ensure we're testing the same set up as your course, we'd happily accept a .story project shared here privately if you change your mind.

Since you mentioned using Storyline 2, do you know what update it was published with? The latest would be Update 12.

Also, Storyline 2 had limited support for HTML5 in browsers, so it may be worth asking your learners who saw an 88% score and skipped question what browser they were using too? Here's the list of supported browsers.