Quiz Consistency Issues

May 09, 2013

I have created a 10 question multiple choice quiz that randomizes the questions and randomizes the answer choices.  The SME who is testing the course says that there are 2 questions that are telling him that he has chosen the wrong answer when he says he actually chose the correct answer.  He has taken the quiz twice and says that it is the same 2 questions that are having this issue.  I double checked my work and I did indeed have the correct answers chosen when I created the quiz.  I have taken the quiz 5 times and each time everything comes out correctly.  Is there any way that I can check to see if what the SME says is true?  Is there anything I can do to "fix" this quiz? Do I need to scrap the whole quiz and create it all over? We are at a stand still right now because we do not want to put the quiz on our LMS and then have learner complain later that the quiz is not grading the quiz properly, if the quiz is indeed faulty.  Thanks! 

7 Replies
Christine Hendrickson

Hi there Z. Welcome to E-Learning Heroes!

I think I may have spotted the problem here. How are you sharing the course with your SME? Are you sending them the published output files? 

If so, that may be causing an issue with the way the quiz is displaying or responding to answer selections. If you view a published Studio '09 presentation on your local hard drive or send it to someone else to view on their local hard drive, you'll encounter security restrictions from the computer, web browser, Flash Player, and network that'll cause various features of your content to fail.

To properly test your published content and share it with others, upload it to the environment for which it was published. Please review the following article for details:
If you upload the quiz to your LMS and the SME still experiences this problem, please let me know.
Thanks and welcome again!
Christine
Z Kalie

Normal 0 false false false oNotPromoteQF /> EN-US X-NONE X-NONE MicrosoftInternetExplorer4

/* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:10.0pt; font-family:"Times New Roman","serif";}

Hi!

I published it as output to a CD and then zipped and copied it to anetwork drive.  The SME is in the same building as I.  In the past, Inoticed that if an SME tried to open the file in the network drive that thecourse would behave strangely.  Now, the SMEs cut and paste the file fromthe network drive and then open it on their desktops. 

Thanks for your help.

Mary Katherine Johnson

We have noticed similar behavior as Georgina with two of our Articulate Quizmaker quizzes.  I think they were published with Studio '13, but I am not sure.  We have SuccessFactors LMS version b1311 and use their new JavaScript-based SCORM communication function instead of the normal Java-based SCORM communication. 

In our cases, users experienced their quiz answers being marked as Incorrect in one quiz attempt, and then in the next quiz attempt, the same question and SAME ANSWER SELECTION would be marked as Correct.  I have personally watched two users take the same quiz at the same time, on different computers, and although the questions were presented in random order and the answer choices were randomized within the question, both users would mark the SAME ANSWER for the SAME QUESTION, and one user would have the question scored as Correct (which would be accurate) while the other user would have the same question scored as Incorrect (which would be NOT accurate).  The second user might take the same quiz again, with the questions presented in a different order, and might mark the same answer choice the next time, and the question might be marked as Correct the second time.

In each of these cases, the users were all using SuccessFactors b1311 with JavaScript-based SCORM, taking the same course published using Articulate Quizmaker '13, and with an IE11 browser.  The ONLY difference between the affected vs. unaffected users, and the a consistent fact among all of the affected users, is that all of the affected users had a Browser Helper Object add-on enabled from Mind Spark Interactive.  The particular browser helper object varied between 3 different users, but disabling/uninstalling the add-on and clearing the browser cache resolved the issue.  In all cases, the affected users were then able to re-launch the same quiz again and choose the same answers to the same questions and achieve a passing score after the browser helper object add-ons were removed.

Does this ring any bells with anyone?

Help!  Thanks!
Mary Katherine

Ashley Terwilliger-Pollard

Hi Mary Katherine,

I haven't heard of that Add on, but if disabling it allows for the quiz to be scored correctly than I'd look further into what that add on is doing. Are you able to test loading a course into SCORM Cloud as well to see how the users with that Add on experience the course there?  As I mentioned it's an industry standard for testing SCORM content. 

This discussion is closed. You can start a new discussion or contact Articulate Support.