Strange quiz tracking behaviour

Aug 14, 2012

Hi all,

I have some strange tracking behaviour with Storyline that I can't solve.

When a learner successfully completes an assessment the following data is returned to the LMS:

  • Status comes back as complete (Correct)
  • First score comes back as 25% (Only one attempt, and it was successful so not sure where this is coming from?)
  • High score comes back as 100% (Correct)
  • Attempts come back as 7 (even though there was only one attempt)

I have tried to resolve this using the following steps;

  • Setting the results data to each option (eg; completed/incompleted, pass/fail)
  • Turning on and off HTML5 options
  • Speaking to our LMS vendor to determine if it is an issue at their end (they can't identify anything).

This example was with a four question assessment, however different assessments return different anomalies, and the number of attempts tends to be a random number, but consistent among a number of users. Eg; Five participants might get 10 attempts, three might get 60 attempts and another three may get 12 attempts.

I thought the attempts might be connected to duration or clicks, but testing has proven this to not be the case.

Anyone have further ideas?

14 Replies
Jase Lopuszanski

Peter Anderson said:

Hi Jase!

Have you tried running your course through SCORM Cloud yet? If you test it there and and don't experience any problems, the issue is most likely with your LMS provider. If you get the same problematic results in SCORM Cloud, please feel free to submit a ticket to our support team. Thanks!


Thanks Peter.

Testing in SCORM cloud has pointed me towards our LMS and given me some further information to take back to the vendor.

Jase Lopuszanski

Hi Peter,

My LMS vendor has suggested it might be something to do with Storyline submitting each question one at a time. I know with Articulate Studio there was an option to 'submit all answers' at once, is there a similar feature with Storyline? I have looked and not been able to find anything, but thought there might be a setting somewhere I could switch on/off.

Any thoughts?

Jase Lopuszanski

Hi Peter,

My LMS vendor has suggested it might be something to do with Storyline submitting each question one at a time. I know with Articulate Studio there was an option to 'submit all answers' at once, is there a similar feature with Storyline? I have looked and not been able to find anything, but thought there might be a setting somewhere I could switch on/off.

Any thoughts?

Jase Lopuszanski

I've almost resolved the issue!

The issue seems to be that our LMS does not support question level tracking. Therefore I needed to submit all the answers at once, rather than one at a time. To do this I used the two guides below:

http://community.articulate.com/tutorials/products/submitting-answers-all-at-once.aspx

http://community.articulate.com/tutorials/products/confirming-that-users-are-ready-to-submit-their-answers.aspx

After having done this, most of my issue was rectified however I am still receiving three attempts instead of one (the actual attempt number).

I've managed to work out that the number of attempts is one up until the point where I click submit.

Once I click submit the number of attempts jumps to three.

Any suggestions about what might be pushing my attempts up to three when I submit my answers?

Jase Lopuszanski

I think it is finally resolved!

I had to remove an exit button in my top menu that I had added, and I had to remove the "Submit Results" trigger from my results page, and then manually force completion using Javascript - with a condition that the complete status only be forced when the user score is greater than or equal to pass score.

For some reason, the exit button and the submit results trigger were counting as attempts.

All good now - fingers crossed!

This discussion is closed. You can start a new discussion or contact Articulate Support.