LMS reporting wrong score

As it is only happening to some users I wonder if it is because of the randomisation in the group, does the user view all of the questions?

It may be them some questions have a different point score.

Thanks for the reply!

All users must complete quiz to exit the course, next buttons are restricted until question is answered. 

All the questions are set to equal 1 point.

We have also tested it with the random shuffle off.

Can you pull an LMS report on the individual questions to see what is being marked wrong?

Can the users review the quiz questions?

I can pull up the transcript to see a question was marked incorrectly, but I believe only our LMS vendor would b able to pull a detailed report on why is was incorrect. 

Yes, the users can review the quiz questions.

The report is a good start, if you can get that it may help to troubleshoot. Also the review may be the issue if the questions are set to reset to initial state. I would get the report especially if you can get the report that shows what the user answered. If that doesn't help you may need to raise a support case

I believe the setting for the review is "automatically decide" i'm not sure if that is effecting if like you said. 

I will see if we can get access to that report. We opened a case with our LMS vendor and they haven't been able to pin point the problem yet. 

Thanks for your help!

I would check each of the questions individually for how they are set, should all be automatically decide. A quick way to test is open the group and select all the slides in the sorted and paste into a new scene, this way you can go into story view and check each one individually by clicking on each slide which is a few less clicks than having to open the properties on each slide.

I would open a support case with Articulate as well, it is odd what you are seeing and worth getting them to look at it early, especially as most LMS vendors will blame the content first.

Hey Kelsey,

I see that you've reached out to our support team and that Jose is helping you out :)

Thanks for the help! 

I uploaded the .story file to support this morning. Hoping to find a solution as our LMS provider seems to think it's an Articulate issue although we have found nothing wrong.

You could try testing in scormcloud but intermittent issues are a real pain to work out, most LMS vendors will blame the authoring tool until you can prove it is the LMS (I probably would as well).

At least if you cannot replicate in scormcloud it is likely the LMS.

We have a similar problem. Scorm Cloud is fine. The LMS we use has a "tracking report" that provides us with information on the quiz responses, and in that tracking report we see the correct and incorrect answers as well as the score reported to the LMS by the course. In the LMS tracking report, the score is correct but the score recorded on the users' history and transcript is incorrect. Pass/fail information is accurate, however, meaning that somewhere the LMS is recognizing the correct score.

We've come to the conclusion that the issue is with the "player" in the LMS because it doesn't occur with an older "classic player," only a new player. We've submitted a ticket with the LMS provider, but don't have a lot of hope that they'll correct it. In the meantime, we're not reporting scores on the users' transcripts, only the pass/fail.

If anyone has any suggestions, I'm happy to hear them!

This may not help at all, but I have experienced a similar issue in the past, where the LMS seemed to record the "passing score" instead of the higher "real score", but only a small fraction of the time.

In my case, it was because the course committed data after every page, so when the "passing score" was reached, it saved/suspended the "complete/pass" value along with the score at that moment. If the session "handshake" was then interrupted abruptly in the background after that (didn't happen too often), then that was saved as the "final score".  (Of course, on the learners screen, it looked like you were still in the session so they could keep going).

Most of the time, learners made it to the last question without losing the "handshake" so everything recorded properly.

I had the LMS adjust the "timeout" setting and have not seen it happen since.

I am having the exact same problem. Have you had any progress since you posted this?

We did more testing and realized the publishing format (1.2) doesn't report correctly in our LMS. Publishing in 2004 fixed the issue. I would check with your LMS provider to see if you could try different publishing formats!