Scoring/Tracking in LMS
Jul 24, 2018
I have included my .story file and the zipped file for a course that I am working on for a client. (I guess the files are too big to attach here – it wouldn’t let me post. So I put them in a Google Drive folder). The course is being hosted on another company's LMS. The course consists of three modules with an assessment at the end of each that they must pass with a 70% or higher. These were initially built as 3 separate modules, but because of the pricing structure of the LMS they are using, they needed me to combine the 3 into one. So now completion is based off achieving a passing score on the three assessments. We are reporting using SCORM 2004, 4th edition with passed/failed and HTML5 with Flash as fallback based on the LMS company recommendations.
I received an email from the LMS company that now that the course is live, some users are experiencing an issue where they are not being prompted to resume the course when they exit and then continue the course - it is placing them back at the beginning of the course. So a user takes the first module of the course and passes that section to get to the 2nd module, but if they stop there and start again, instead of bringing them to the slide where they left off in the 2nd module, they are starting again at the first. I have tested this multiple times and cannot recreate it - in our internal LMS, their LMS, and on SCORM cloud. Is there something that would cause this to happen, but intermittently? Not all users are experiencing this, so I don't know if there is something that might cause this problem (browser compatibility?)
I have tested this in SCORM cloud and it worked as desired - I was able to start/stop at any point in the course and it would prompt to resume where I left off. It also correctly tracked my score in the course and reported it back to SCORM cloud. This is another issue that they are experiencing - some users will have the correct score reported in the LMS, while others will have the wrong score reported, though it will correctly show that they passed.
I even ran the course in their LMS in debugging mode and sent the log to the LMS. From what I can tell from the log, it is properly tracking the course and providing an accurate score, even though the score in the LMS is not the correct score (The LMS sometimes seems to record the score at the beginning of the launch of the attempt where the user passes the course instead of the score at the end of the launch). Any insight would be appreciated. What could we need to change in the .story file to address the tracking/scoring? Or does this seem like something on the LMS end that needs to be addressed?
6 Replies
Hi there Kim,
It sounds like you've already done quite a bit of troubleshooting on your own! I can appreciate that it's frustrating when only a few users are running into an issue, especially when you're unable to replicate the behavior yourself.
Smart idea to test the file in SCORM Cloud. Since the problem isn't happening there, that's a clue that the issue could be related to your LMS. What LMS are you using?
Also, do you happen to know what web browser the learners are using when they run into this issue? If we can find a trend, that will help us nail down what’s going on here!
Thanks for the response Alyssa. The LMS was created by a company called New World Now, and it is called Insight. It is their own system, so not one I am familiar with outside of this project.
I asked them to start collecting some data from the users experiencing the issue to check for a trend like you suggested - I am at a loss as to what it can be at this point. I don't believe there is an issue w/ the Storyline file, but the LMS team seems to think there is something in there that we are missing, and I am at wits end trying to figure out a solution. I believe the data is showing that it must be something with the LMS or something on the user end. I found this post (and the article in the response) yesterday after posting - do you think it could have something to do with internet connectivity? The article says Storyline 1 or 2, and we are using 360, but wondering if it could still apply. Thoughts?
I would also see if the problem is limited to just the people viewing the flash version or vice versa. And when you test it yourself, make sure you are trying both flavors.
Also, see if the issue is more common for people who start viewing on one machine, but then continue on a different machine. Sometimes one machine/browser will default to html5 while others will go for flash.
And as a side note, when I opened your story file, it was set to "prompt" for resume. On some systems/devices, prompts can get blocked. If you are running this on an LMS, I would suggest using "always resume", especially with such a large course.
Hope that helps,
Russ
Hi Russ,
Thanks for your response! I will adjust the course to always resume and see if that helps. Also, with testing the flash vs. HTML5 versions, I feel like a dummy for asking, but how do you do that?
Hey Kim,
You can usually see right in the URL which version the browser is utilizing.
At the end of the link, look for .html for Flash or html5.html for HTML5 :)
Well, there are a few ways to force the flash version to play (besides using one of the older browsers that do not support html5).
But to be honest, if it turns out that flash is the issue here, I would take the opportunity to have a discussion with your client about why they are still supporting flash when it is clearly being phased out. Of course, that may not be an option if they are telling you it must be supported.
This discussion is closed. You can start a new discussion or contact Articulate Support.