Storyline SCORM 2004 - bug in true/false quiz reporting
Jan 10, 2017
Hi everyone,
I've noted a bug in storyline scorm 2004 reporting.
The problem is only for true/false type questions : the variable "cmi.interactions.learner_response" is ALWAYS "false", even if student answers true.
BUT the score is OK, cmi.interactions.result tells me "correct" when it is correct, and "incorrect" when it is incorrect, according to what I have stated as the good answer.
So, to be more clear, storyline is OK for calculating the score and the result for these questions. There is just an error on the "cmi.interactions.learner_response" for this type of questions, which can be quite confusing for trainers who want to know what students have actually answered.
I have tested that on 2 different LMS and this is the same. I have not tested it with scorm 1.2.
Have you already heard about that problem ?
Thank you,
Mehdi
15 Replies
Hi Mehdi - Is this issue occurring in SCORM Cloud as well? I know you mentioned that it was happening in a couple of LMS systems, but I wasn't sure where you were testing.
Do you have a .story file example that you could share with our support engineers here so that we could take a look?
Hi !
I have not tested it in scorm cloud (I don't think I have access to it).
Please find attached an example .story file, as well as a screenshot of my SCORM console.
Thank you for your help.
Mehdi
Hey,
I just discovered scorm cloud (thank you for that!) and it's the same problem.
I always answer "vrai" (true), but the scorm tells me I answered false !!! But the scoring is ok, which is weird...
I swear I clicked on "true" each time ! You can check by yourself ;)
You can see the scorm cloud report in the attached screenshot
Hey Mehdi! Thanks for the additional details, that does seem strange. If the issue is persisting for you in SCORM Cloud as well, would you mind opening a case with our Support Engineers over here? They'll be able to work with you to investigate the matter fully and quickly!
Hello Mehdi,
I also tested your file in SCORM Cloud and found that though my completion and score were correct, the data indicates that I selected "False" on Question 1, when I actually selected "True".
Once you open your case, be sure to share your case number here. That way I can share a link to your course in SCORM Cloud for testing!
This post was removed by the author
Hello Alyssa,
Thank your for your help.
I'll share the case number here as soon as I find how to open a case... ;)
Hi Ali,
Could you tell me how to open a case ? I don't find where it is...
I clicked on your link but it brings me to the homepage.
Hello Mehdi!
I apologize for that! Here is the link to open a support case.
Thank you !!
Here is the case number : 00989707.
Thanks for sharing your case number, Mehdi! I'll follow along and share updates here as they are available.
Hello all,
Are there any updates / news regarding this topic?
I have exactly the same issue as Mehdi explained:
The problem is only for true/false type questions : the variable "cmi.interactions.learner_response" is ALWAYS "false", even if student answers true.
BUT the score is OK, cmi.interactions.result tells me "correct" when it is correct, and "incorrect" when it is incorrect, according to what I have stated as the good answer.
Many thanks for your support
benny
Hi Benny,
After our team investigated this we found that it occurred when an author changed the value associated with the true/false.
You can customize the true/false responses in Storyline and Quizmaker quizzes. For example, you might use yes/no or right/wrong instead.
Customized true/false questions will be scored properly, but you may find that your LMS logs show "false" for customized responses. For example, if you use yes/no responses and the correct response is "yes," you might see something like this in your log files:
Notice that the result is still correct even though the custom "yes" response is displayed in the log file as "false."
Since the LMS expects to receive only "true" and "false" options, it will consider anything else to be "false."
If you just need to track learners' results, you can safely ignore the "false" responses in your log files. On the other hand, if you need to see your custom responses in your log files, we recommend using a multiple-choice question with two answer choices (e.g., yes/no) rather than a true/false question.
Hope that helps clarify!
Hej Ashley
Many Thanks for your feedback.
I will recreate the whole quiz, but this time with multiple choice question.
Appreciate the info here. This thread helped us problem solve.
This discussion is closed. You can start a new discussion or contact Articulate Support.