Unexpected quiz results (NULL) for 1% of users
Jan 30, 2018
I have fairly straight forward course with 5 quiz questions. The last page in the course is a results slide that submits the quiz results to the LMS when the page loads. The page also executes some java script marking the course completed.
This course is locked, so the only way to get to this last page is to have answered all 5 quiz questions.
The course has been taken about 50,000 times, and we are getting some strange results from about 1% of users, where the results for each answer are showing up as "NULL".
Some users (not sure if it is the same 1%) have also mentioned that when they got to a question, it acted as though they had been there before and already answered the questions. The radio buttons were not selectable anymore, and they had to move on by selecting NEXT.
I am fishing here. I know there are a ton of variables to the LMS. I am just wondering if anybody has ever encountered anything like this before. Thanks.
5 Replies
Hi Jason. It sounds like those users are seeing the quiz review rather than the quiz.
I'm also trying to fish for clues! 😀 If you'd like to share your .story file here, we can try to test on our end, as well. We use SCORM Cloud as our standard testing engine.
Thanks for the reply.
I have not built a way for a user to review the quiz.
Unfortunately, I am not allowed share the file.
Answers to your questions are inline below:
Do your learners all have unique logins for the LMS? Yes.
Do any learners take the assessments from a common computer? A common Windows profile? No, all from their own laptop.
Do these users have a particular browser in common? They all use Internet Explorer which is loaded on their laptops. No other browser is authorized for their use.
What happens if they try the course again in another browser? They can only use Explorer. If they log back into the course after taking it, the LMS takes them to the last page of the course. They cannot take the course again.
Hi Jason and welcome to E-Learning Heroes by the way :)
That certainly does sound odd. It sounds like the users are being presented the course in Review mode.
Do you allow a Review of results? Do you know if they perhaps started this course previously? What are the resume settings for your course?
I'm sorry for so many questions, but it can be hard when you cannot re-create the issue and such a small percentage, but I want to help you the best I can.
Thanks for your reply. It does seem like the users are being presented the course in review mode. I am not sure how this would be possible though.
Do you allow a Review of results? No.
Do you know if they perhaps started this course previously? They had not. (That I know of)
What are the resume settings for your course? Standard. They are asked if they want to resume from where they left off etc.
Hi Jason,
Are they seeing this when they've met your completion requirement (i.e. visited the results slide or saw the total number of slides necessary) and returning to the course? Some LMSs force a course to be in review mode after that point, so that the user can't change their score/completion inadvertently.
Also with 1% of users, do you know if they're internet connection is unstable? If so they could be losing connect with the LMS and it's not able to properly track their answers.
Without seeing it, again these are all just educated guesses - but let us know if you're able to determine any other common threads!
This discussion is closed. You can start a new discussion or contact Articulate Support.