SCORM results not recording (seemingly) sporadically

The company I'm working with is deploying Quizmaker quizzes nationally, and we're having a very unexpected problem.  First, the layout of what we're using and how we're deploying it:

  • Scorm 1.2 export
  • Custom LMS built by our company
  • Being taken by users around the country in computer labs built for learning: the computers are locked down within an inch of their lives, but I don't think it's hardware or settings, as quizzes work MOST of the time on them.

The problem:

  • 5 - 10% of the time, quiz results don't record in our LMS.  Sometimes it will show that the quiz was taken, but the LMS doesn't seem to receive the result.  Other times, there is no record at all.  And 90% of the time, it works fine.  The apparent unpredictability is diabolical.
  • Our programmer thinks the problem may be in the "cmi.core.score.raw" parameter bringing back an inaccurate score of 0.  He has diagnostic code up on the server, but we haven't got enough data yet to diagnose.

Some info:

  • Doesn't happen to any user all the time, so it doesn't seem be related to user accounts on our LMS.
  • Doesn't happen on any particular computer all of the time, so it doesn't appear to be hardware or setting related.
  • Browser doesn't seem to matter.
  • It cannot be reproduced reliably under any circumstances we have been able to find yet.

Has anyone else experienced anything like this?  Any ideas for troubleshooting or fixes from the community?

Thanks, all.

Ben

3 Replies
Brian Batt

Hi Ben & welcome to Heroes,

If you are experiencing issues with content in your LMS, please refer to the following Word of Mouth Blog article, which outlines common issues pertaining to viewing and tracking content in an LMS:

http://www.articulate.com/blog/9-ways-to-troubleshoot-articulate-lms-issues/

Be sure to take a look at testing your content in the SCORM Test Track as noted in the link above.  If the content works as expected in the SCORM Test Track, then that means there's something on the LMS side that is causing the problem.

Keep in mind that although the score is sent to the LMS periodically through the course, it's not actually "committed" until the user exits the content.

If the issue persists, be sure to open a support case with your LMS provider, since they are your primary source of support for LMS tracking and reporting issues.

Evan Shaffer

Great, Brian.  Thanks very much!  I'll check it out.

The only problem with checking in with the LMS provider is that it's us.  We built our own from scratch.  It has been a great adventure, but frustrating when we run into problems like this.

Have many others here built their own LMS, or are we the only ones crazy enough to do that?

Again, many thanks.

Ben