Completion and tracking Storyline course in Articulate Online

Hi Christine,

Thanks for the reply.  I must not have been clear enough about what is happening:

I am only publishing one SCO.  I have several quiz segments, but they are all being tracked by a single result slide at the end.  What I would really like to do is to have course completion based on the number of slides viewed, but also track the results of the interactions.  If I publish to Articulate Online using slides viewed, even though I submit the results slide, it does not show the results of the interactions.  If I publish it to be Complete/Incomplete based on the results slide, it shows the score in the LMS and tracks all the interactions, but never says the course is complete, even though the percentage shows correctly, it just reports incomplete.  I don't want to make it report as Passed/incomplete, since the learning requirement is really to view all the slides rather than to have a passing grade, but we want to track some interactions for "bonus points" for an overall competition.  We are using Articulate Online for the benefit of using the Player App with a LMS.  So my question is really How is tracking and reporting supposed to work between Storyline and Articulate LMS, so I can accomplish the goals of tracking interactions while basing completion on seeing all the slides.

Thanks,

Paul

Hi Paul,

I apologize for misunderstanding and for the delay. I was pretty sure that you wouldn't be able to do this, but I wanted to make sure. I spoke with our Articulate Online guru to verify. You can only track completion by slides viewed or quiz results, not both. 

One thing did occur to me that may or may not help you out, though. Since you want the interactions to be tracked, have you considered having those interactions in a separate course and then inserting them into the original as web objects? They would launch in the original course and the tracking obviously wouldn't list for the same course, but it may work for you as an alternative. 

In the meantime, if you'd like to put in a request for this type of feature, you can submit it directly to our development team. 

I hope you have a great Friday, Paul.

Thanks!

Christine,

I still may not be describing my issue/question clearly enough.  What I want to do is to base course completion on slides viewed.  But I also want to keep a record of the interactions.  So what i have found so far is that I can get completion based on slides viewed, but Articulate Online shows that there are interactions in the detail view but does not indicate what the user did on them - as if they never attempted them, which would not be possible if they viewed all the slides.  Or if I base completion on the results slide, it shows all results of the interactions, and shows a score in the LMS, but never achieves completion, even if the passing score is met and all slides are viewed. 

I will probably have to submit a case.  Maybe something is wrong with my result slide - I customized a blank result slide.  

Frustrating!

Thanks,

Paul

Good morning Paul!

I apologize for the delay in response. You mentioned in your last response that you were going to contact our support team. Have you already done so? If you have, are you able to share the case number with me? I'd like to follow the case progress and update this thread with a resolution or any suggestions from our support team.

I hope you had a great weekend, Paul.

Thanks!

Christine,

I submitted the Case #00316086: Course never marked complete on Articulate Online.  I ...    [ ref:_00D30Txo._50040Oz67E:ref ], and a feature request for AO to track interactions based on a submitted result slide even if course completion is based on Slides viewed.

Will keep you posted!

Thanks,

Paul

Hi Paul,

Thanks very much for the case information. I took a look and I see that support is currently testing the files. I'll keep an eye on it, as well.

Appreciate it,

Christine

Christine,

Just wanted to update you on this issue.  I did wind up recreating the result slide using a graded result instead of a blank result slide and it started working properly, so immediate issue is resolved.  What I think would be great would be a clearer documentation of why and how one would use a blank result slide that is offered.  I also would like to understand whether it is possible to base course completion on slides viewed while still recording the results of interactions that occur during the course.

Hope you are having a great weekend.

Thanks,

Paul

Hi,

I'm having a similar problem. I would like to know if it is possible to include in the evaluation course completion not only visited main slides, but also in an interaction layers (for example interaction of templates Tabs Interaction, Process Diagram, etc.). And vice-versa, if it is possible to exclude slides, which is used in Player Tabs.

Thank you. 

Palka

Hi Paul.

I've had issues where my Storyline courses will not report complete if the lesson is suspended and resumed. This only occurs when I'm using a result slide that is based on several other result slides. ie. - I have 4 quizzes with their own respective result slides. I created a single result slide to be considered complete when all 4 quizzes are passed. Then I used that single result slide as the basis for course completion.

Have you had similar issues. It occurs in the SCORM Cloud and using Articulate Online. I've not tried it as a SCORM package published out, but it appears to be a logic issue when resuming a course.

I have noticed that if I re-enter the course and DO NOT select to resume when prompted, I can complete the course without exiting and it will then send the completion results to the server.

I've submitted a ticket on this as it is really a show-stopper for me and the way I've structured my content.

Thanks.

I have had similar issues, not with completion, but with accurate reporting of interactions, using multiple result slides using Storyline, Tincan and Scorm Cloud.  It does not always happen, but it does happen in browsers.  My course is set to always resume because it is a long course and there are both menu and screen by screen restrictions on progress and I would not want a learner to inadvertently lose their progress 45 minutes through.  And I have quizzes that are scored separately and reported to the user during the course, but never submitted, and then a final result slide that tallies all the individual interactions for a final score at the end.   At one point I tried to use a final result slide based on combining previous result slides but no interaction data was reported. We have had no reports of being unable to complete the course, but I am finding gaps in the reporting of individual interactions in Scorm cloud.  The identical course published for SCORM reliably reports each attempt at each interaction.  It is not possible to complete the course without passing through each interaction but there is variation in the number of interactions that are reported for different users.  I cannot say for sure whether resuming is the problem with missing interaction data, but it would not surprise me.   The final score, however is reported correctly. Rather troubling, for sure.  Articulate support has stated that the fix for this is in the works and will be included in the next update, whenever that may appear. 

I have had similar issues, not with completion, but with accurate reporting of interactions, using multiple result slides using Storyline, Tincan and Scorm Cloud.  It does not always happen, but it does happen in browsers.  My course is set to always resume because it is a long course and there are both menu and screen by screen restrictions on progress and I would not want a learner to inadvertently lose their progress 45 minutes through.  And I have quizzes that are scored separately and reported to the user during the course, but never submitted, and then a final result slide that tallies all the individual interactions for a final score at the end.   At one point I tried to use a final result slide based on combining previous result slides but no interaction data was reported. We have had no reports of being unable to complete the course, but I am finding gaps in the reporting of individual interactions in Scorm cloud.  The identical course published for SCORM reliably reports each attempt at each interaction.  It is not possible to complete the course without passing through each interaction but there is variation in the number of interactions that are reported for different users.  I cannot say for sure whether resuming is the problem with missing interaction data, but it would not surprise me.   The final score, however is reported correctly. Rather troubling, for sure.  Articulate support has stated that the fix for this is in the works and will be included in the next update, whenever that may appear. 

Sorry for the repeat post earlier, I must have pressed the button twice.  This evening, ScormCloud pushed a code update which rendered storyline tincan content inoperable (loads the course but immediately gets stuck on "Connect to server" errors).  They kindly rolled back the update, and it is not clear whether it was a wider problem or just affects SL/Tincan courses.  Waiting to hear more, but just giving a heads up.

I'm almost positive they put a hard error on the requirement for URI formatted ids and broke any and all statements coming in from storyline which does not yet conform to that standard. I've seen this in other areas with their current version. Fortunately, I'm only using SCORM Cloud for Storyline issue reporting. However it's hard to demonstrate an issue when the content doesn't play well with the Cloud. 

I have built a barebones LRS that's much more forgiving with formatting. Maybe SCORM Cloud should consider doing the same and provide an error log for developers. 

I'm having the problem that I think is what Paul originally described (or close to it).  I have quizzes in multiple scenes in one Articulate Storyline module.  Each scene has a graded quiz results slide for the questions in that scene.  Then there's a final scene with a graded quiz results slide that combines points from all results slides.  (Users don't have to pass all quizzes, but their combined score has to total at least 80% total.)

If I publish the module to track using the final quiz results slide, the LMS never shows the module as complete, although it does show the score.  If I publish it to track progress using the number of slides, the score doesn't show but progress is shown as complete.  In both cases, the Reporting tab is set to report status to the LMS as  pass/fail.

Since I'm using just one SCO (the final graded quiz results slide), should the LMS be able to record both complete (for tracking) and pass/fail (for score)?

Hi Corrine,

Just curious - when you're reporting via the results slide, have you tried Pass/Incomplete, rather than Pass/Fail? If you try that, does it carry the score as well as the completion status? 

Also, which LMS are you using? 

Have you tested your course in SCORM Cloud? if so, what are you seeing on that side?

Thanks!

I'm using Cornerstone for SalesForce LMS.  Same results for Pass/Incomplete. Scorm Cloud reports either the score or the completion, but not both, so there's something wrong in my file. 

Can I send you my file for troubleshooting (via private link)?

Thank you!

Hi there Corrine,

When publishing Articulate Storyline content to a learning management system (LMS), you have four reporting options from which to choose:

• Passed/Incomplete
• Passed/Failed
• Completed/Incomplete
• Completed/Failed

Many LMSs track both a completion status and a success status. To report both statuses, choose either Passed/Incomplete or Passed/Failed when publishing Storyline content. Completed/Incomplete and Completed/Failed report only the completion status.

Depending on your LMS (Cornerstone), you can include a score and a completion status, and you'll want to track by a results slide for a score to be included. 

Also, thank you for trying SCORM Cloud and confirming that the same is happening there.

If you're still having trouble, and if the file is too large to post here, or you'd like to keep it private, you're welcome to send me a link via a private message. You can also send it to me using this method, or send it over to our support engineers for testing. 

If you do share the project files, please be sure to let me know which method you used,, so I can take a look as soon as possible.

Thank you!

Hi Christine,

This is working successfully for modules where I have one quiz and one quiz results slide.  In that case, the LMS reports both completion and the score.

The issue is when I have multiple quiz results slide and use a final quiz results slide.  That is the only case in which the LMS is not tracking both.  Since SCORM cloud is also not recognizing both, the problem must be in my Articulate Storyline file.

I'd like to share the file with you -- do you want the .story file or the zipped file?

Thank you,

Hi Corrine,

Thanks for the additional information!

This may help, but since you're using a single results slide and not trying to track the individual objects, I'm not certain:

Articulate Support - Track Multiple SCOs in the Same Course

Also, you'll want to upload the .STORY file for either myself or the support team. If you're able to upload multiple files, you can share the published version for LMS as well (zipped). Just make sure that the original project file is included.

Thank you :)

I don't think any situation would allow you to track the course based on more than one result slide, and reporting based on number of slides viewed will not track interactions.  Fortunately storyline allows you to track any question from any result slide (and you can track questions in more than one result slide) The situation I had was a little different in that I was collecting points from chapter quiz questions scattered through the module and a final assessment, and so I did not have to report the results of each chapter quiz. But I did track them separately by creating two result slides, one that had only the chapter quiz questions, and the final which had all the chapter quiz questions plus the assessment questions. On the final result slide,  the passing score was set to zero - as long as they got to that result slide, the course was marked as complete, and gave a score. That would require you to set up gating that would prevent them from getting to that final result slide unless the 80% was met, which would be simpler if you made them get 80% on each quiz before going to the next scene.  Then make the final result slide calculate the result for selected questions (from each of the individual quizzes) rather than selected result slides.  I hope this helps.

Hi Paul,

Thanks for that additional help.  I ran into another, perhaps related issue, and opened up another forum conversation about it.  No matter how I set the Final Results Slide Options and how I set the Calculate Score, the "Show User's Score" option won't stay checked.  It can't be saved.  This is only an issue in my modules with multiple quiz results slides and a final results slide.   

If you have any advice on that snafu - here's the link to the conversation -- http://community.articulate.com/forums/t/43783.aspx

Hi Corinne,

It looks like Justin and I replied to you in the other thread you mentioned, but just let us know if you need anything else. 

I did a search and came across this thread and was hoping to leverage the knowledge of the community!

I have a quiz, it's just a stand alone quiz which I want to have the completion tracked by the learner getting through to the end, so I set the completion to view by slides.  However, I also want to include the score that they received.  The LMS we're using (Skillport) is set to track completions based on a score of 80% OR all pages viewed.  

So this is my problem.  When I set the completion tracking to use the number of slides viewed, the course completes just fine, however the score is blank as it wasn't passed through to the LMS.  When I set the completion tracking to "Track using quiz result" I get the score passed through and recorded in the LMS, but if I failed (didn't score 80% or above) the quiz gets stuck in "incomplete".

The workaround I've applied is that I've altered our LMS completion criteria to mark courses as complete based on a score of 0% or all pages viewed.  However; I'm not convinced that this is the best solution.  Other quizzes that were built in Captivate allow the setting where the score is still passed through to the LMS but tracks the completion based on page views, so I'm hoping there's just a setting in Storyline that I'm missing.

Any and all thoughts are appreciated!

Hi Alex,

Storyline allows you to track by slides viewed or a results slide, and you may also want to review this article on troubleshooting common LMS issues.  You may also want to look at the navigation set up within your course, as you could use two results slides - one to force the user to retake the quiz if they have not reached 80%, and then when they do reach 80% a second results slide that would submit the results to the LMS. You'll just want to be sure you track the completion by that particular results slide.