Quiz Tracking and Reporting in LMS

Oct 07, 2020

Hi guys, our company is new to quiz tracking using Storyline but it seems like it has functionality for this, we're just trying to understand how in-depth it can be. I was hoping someone here could help clarify if we're able to do the following in our LMS. Thank you so much for taking the time to help us with this, the Articulate community seems full of really incredibly amazing Storyline 360 Wizards!

Scenario:

  • We use Moodle Workplace and we have a SCORM package that was made in Storyline 360. This SCORM package is a series of quiz questions. We would like to know which questions our users are getting right or wrong so we can track the trends to know where to improve our training.
3 Replies
Scott Haugsjaa

To provide a quick update. I feel like the 'heavy lifting' is going to by our LMS, in this case, Moodle Workplace. If anyone is familiar with or can point me in the right direction, I would be greatly appreciative, but I do feel this is a more LMS targeted question rather than an articulate question. Sorry about that, guys.

Leah Hemeon

You're right Scott that it's likely a question for your LMS support. I know that in standard Moodle I have been able to get some of the results out of a SCORM package published from Articulate Storyline 360. However, in the base install of Moodle, SCORM 1.2 has the best and most stable implementation of SCORM. As far as I know, they didn't ever get full SCORM 2004 support implemented. So, some of the 2004 tracking features aren't available or working in base Moodle. I'm not familiar with the Workplace version of Moodle so I can't comment on what is and isn't supported. 

Two things I can suggest to get you started:

1) Load and test your SCORM package to SCORM Cloud (accounts with up to 100 MB of storage are free). This will ensure your published zip works properly and what results are tracked. This is the gold standard, and they're the "keepers" of SCORM, so it's the best place to test any pacakge to ensure it fuctions properly. From there, you know your package works so any other tracking issues that crop up are something to do with the LMS.

2) Try it in Moodle. In the base Moodle anyway it's very easy to set up a new course. I do this all the time for "testing". Assign some users (NOT admins, managers, or teachers) to be students (enroll them in the course) and have them complete that activity. Have one "pass", one "fail" and one get between a pass and 100% (e.g. 90% if the pass is 80%) to make sure all iterations track the proper scores and results. Check the SCORM tracking on that activity to see what you get for each user and make sure what's reported to the LMS actually matches what the student achieved. The detailed reports in the SCORM activity area of a Moodle course generally have quite a lot to work with.

Finally, I find using SCORM 1.2 and a setting of "Complete/Incomplete" works best publishing from Storyline for Moodle. Regardless of whether you have a quiz or not, the complete/incomplete setting reports that quiz, score and completion. It just seems to work better with Moodle than "pass/fail". There are also some specific settings I use in Moodle but that's a whole other post ;)

Hope this helps! I've been using Storyline and tracking quizzes in Moodle for almost a decade now (8 years I think) and before that I used Captivate. It takes some playing but once you get your settings you can usually use the same for every package. Good luck!

Scott Haugsjaa

This was exceptionally helpful, Leah, thank you so much. 

In your experience, do you guys report on the specific quiz questions in a quiz to determine where users are having issues?

For example, John took the Quiz and we found out he got 4/5 questions correct. He messed up on question 3 of 5. Our teachers want to know the specific pain points our students are encountering.

You may have already answered that, I hope I'm not rephrasing the same question, but since you're familiar with Moodle I would love your insight on best practices for quizzes and Moodle.

This discussion is closed. You can start a new discussion or contact Articulate Support.