Strange quiz tracking behaviour
Aug 14, 2012
Hi all,
I have some strange tracking behaviour with Storyline that I can't solve.
When a learner successfully completes an assessment the following data is returned to the LMS:
- Status comes back as complete (Correct)
- First score comes back as 25% (Only one attempt, and it was successful so not sure where this is coming from?)
- High score comes back as 100% (Correct)
- Attempts come back as 7 (even though there was only one attempt)
I have tried to resolve this using the following steps;
- Setting the results data to each option (eg; completed/incompleted, pass/fail)
- Turning on and off HTML5 options
- Speaking to our LMS vendor to determine if it is an issue at their end (they can't identify anything).
This example was with a four question assessment, however different assessments return different anomalies, and the number of attempts tends to be a random number, but consistent among a number of users. Eg; Five participants might get 10 attempts, three might get 60 attempts and another three may get 12 attempts.
I thought the attempts might be connected to duration or clicks, but testing has proven this to not be the case.
Anyone have further ideas?
14 Replies
I should add that we are using IE8 - and I have tested with and without compatibility mode.
I have also tested in Chrome and get the same results.
I have the same issue when I give learners 2 chances to answer. It tracks the activity as incorrect.
Using Safari Mac (Latest greatest version)
and IE Windows (Latest greatest version)
I was starting to think I was the only one to experience such an issue!
I've done further testing with SCORM 1.2 and SCORM2004, I've tried different attempt settings etc, and nothing seems to work.
I'm not sure what to look at next.
Hi Jase!
Have you tried running your course through SCORM Cloud yet? If you test it there and and don't experience any problems, the issue is most likely with your LMS provider. If you get the same problematic results in SCORM Cloud, please feel free to submit a ticket to our support team. Thanks!
Thanks Peter.
Testing in SCORM cloud has pointed me towards our LMS and given me some further information to take back to the vendor.
Good luck, Jase Keep us posted...
Hi Peter,
My LMS vendor has suggested it might be something to do with Storyline submitting each question one at a time. I know with Articulate Studio there was an option to 'submit all answers' at once, is there a similar feature with Storyline? I have looked and not been able to find anything, but thought there might be a setting somewhere I could switch on/off.
Any thoughts?
Hi Peter,
My LMS vendor has suggested it might be something to do with Storyline submitting each question one at a time. I know with Articulate Studio there was an option to 'submit all answers' at once, is there a similar feature with Storyline? I have looked and not been able to find anything, but thought there might be a setting somewhere I could switch on/off.
Any thoughts?
I've almost resolved the issue!
The issue seems to be that our LMS does not support question level tracking. Therefore I needed to submit all the answers at once, rather than one at a time. To do this I used the two guides below:
http://community.articulate.com/tutorials/products/submitting-answers-all-at-once.aspx
http://community.articulate.com/tutorials/products/confirming-that-users-are-ready-to-submit-their-answers.aspx
After having done this, most of my issue was rectified however I am still receiving three attempts instead of one (the actual attempt number).
I've managed to work out that the number of attempts is one up until the point where I click submit.
Once I click submit the number of attempts jumps to three.
Any suggestions about what might be pushing my attempts up to three when I submit my answers?
Hey Jase!
Glad to see the progress you've made! That doesn't sound like anything I'm familiar with. Was the same thing happening when you tested in SCORM Cloud?
Great to hear that there is a possible solution. Since I was on deadline I had to change everything back to 1 try. Peter is this something we should try and get as a feature request in the future?
Hi Magda,
It actually sounds like something our support engineers might want to take a look at. Mind submitting a case describing your scenario? Thanks!
I think it is finally resolved!
I had to remove an exit button in my top menu that I had added, and I had to remove the "Submit Results" trigger from my results page, and then manually force completion using Javascript - with a condition that the complete status only be forced when the user score is greater than or equal to pass score.
For some reason, the exit button and the submit results trigger were counting as attempts.
All good now - fingers crossed!
That's awesome, Jase! Thanks for keeping us posted and sharing your updates along the way. Best of luck!
This discussion is closed. You can start a new discussion or contact Articulate Support.