Exams Marking Questions Improperly

Hi Team,

We recently added the ability for users to see their incorrect responses in the exams we have in Storyline. However, we have received screen shots from users showing questions marked as incorrect that they actually did answer correctly.

I double checked how the answers are marked in the file and they also set correctly. I checked that they are set up correctly in the question bank for all four exams.

This is very concerning as it affects user confidence, their ability to be promoted, as well as challenges the integrity of our department.

What else might we do/try to make sure the system grades the exams appropriately and reports the correct user results?

Thanks in advance!

11 Replies
Philip Deer

Thanks for clarifying.

The slide properties are all set to "When revisiting: Automatically decide."

Just to make sure we are on the same page...what happens is they submit the exam (questions are set to submit all at once), then they have the option on the results slide (via buttons) to Review Results. Some of the questions are marking as incorrect even though they answered them correctly (we have confirmed at least 6 questions so far).

Thanks again for your help.

Philip Deer

We are still trying to find a solution.

In the meantime, I was able to find some interesting information regarding one the examples.

One question during the post exam review that came up as Incorrect does not appear in the SCORM session report at all. Thus it appears that question was not presented to the user nor did it affect the score. What might cause a question not presented during an exam to show up during  a results review?

All ideas welcome Thanks in advance!

Philip Deer

So I did some more digging. In the SCORM session report for the questions being brought up, those are showing as having no user response. However, in the review, the screen shot shows the questions as answered. What makes this more concerning is that when I tested this on my end and skipped questions, they show up in the review as unanswered.

What might cause questions to:
1. show up as incorrect in the review even when they show as answered correctly?
2. show up as having no user response in the SCORM session report even though they show as answered in the review?

Thanks in advance!