All answers not reported to LMS
May 18, 2017
We used SCORM 2004 2nd edition and are using SuccessFactors for our LMS and recently ran some learners through a quizmaker developed test. We found a bizarre issue that we cannot explain and are hoping someone here can help.
The first test was predominantly multiple choice with some multi-select for a total of 50 questions.
When we ran the SCORM report to evaluate the answers we found that:
Learner 1 had 0 answers (the LMS failed to record his completion)
Learner 2 had 47 answers
Learner 3 had 46 answers
As a back up we have them print their quizzes upon completion. One the printed quiz report:
Learner 1 had 50 answers (we we able to use this to give him credit)
Learner 2 had 47 answers
Learner 3 had 46 answers
The scores for the Learners are reflective of the number of answers recorded. For example learner 3 missed 10 of 46 for a score of 78.26. That score is won't hold up if the missing four questions are back in the equation.
The question I have is why and how? Why would the LMS not record 4 questions for a learner? Why would their score not be based on 50 questions, but 46? How could this happen? Is this a SCORM related issue or a network one?
We had another test offered the same day with 5 test takers with 75 questions. One of them was missing 2 questions, the other 4 all had 75 reported.
I have run through these tests several times and no matter what I continue to get either 50/50 or 75/75 and I cannot fathom what is causing these issues.
Any help you can offer is greatly appreciated.
5 Replies
Hi Edward,
The missing questions (like the scenario for learner 1) sounds like an issues with the LMS/network not being able to capture and submit the data. I'm glad that user had a printed copy to help them out! Those types of issues can be tricky to track down but some things to look into would be:
For the issues with the score - it should be calculating the score out of all the possible points. Was the score you're seeing in the LMS the same score that the users were seeing on the results slide? If those two things did not match I'd reach out to your LMS Admin to find out way. If they did match, and are still wrong - we'd want to take a look at your .quiz file!
We had concerns that it may be a network related issue. Our users are using IE (10 or 11) and Chrome. I cannot tell you for certain if the issues are happening in one browser more than another, but I've heard complaints regarding both.
The weirder issue is regarding the scores. The scores on the print outs are the same as the scores recorded in the LMS and the number of questions on the print outs match the number of questions recorded in the LMS despite the fact that 3 people took the same test and one had a score graded for 50 questions, one a score graded for 47 questions and the third a score graded for 46 questions.
Our internal theory was that it was a network related issue, but we wanted to reach out and see if anyone had any other ideas.
Thank you for your help,
edward
Hi Edward,
Where are the printouts coming from? Is that something created by the LMS? If so, I'd suspect those items to match.
Let me know if you run into any other issues or are able to pinpoint the cause!
The printouts are generated in the Quiz. One the results page we have a button for print results and a button to close the window. We are using the printouts as a backup for the SCORM reporting.
Hi Edward,
I'm going to start a case for you - I'd like our team to take a look at what's happening! This may go a bit deeper than initially suspected. Keep an eye out for an email from Support@articulate.com and they'll share directions on how to upload your project files!
This discussion is closed. You can start a new discussion or contact Articulate Support.