Passed/Failed vs Passed/Incomplete Reporting

Feb 10, 2016

I've been trying to find someplace that specifies the difference between LMS Reporting for Passed/Failed and Passed/Incomplete. None of the articles I am finding seem to actually tell me what the difference is between them.

Would someone please explain? 

59 Replies
Leslie McKerchie

Hello Erica,

From those images, it looks like you understand your options of Track using course completion or Track using quiz result.

It sounds like the best option for your would be to track using course completion. The LMS will report either Complete or Incomplete, but not partially complete. It's up to the LMS if they also utilize a 'Success' status as well, which is what I believe you are asking.

Marco Giacomasso

Hi.
I exported a course with  "Passed/Incomplete" option, but on the LMS it's showed as "failed".
So I tried exporting the course with both options "Passed/Incomplete" and "Passed/Failed".
The 2 manifest files are identical: where should I find a difference?
How can I be sure to get the right LMS behaviour (Passed/Incomplete)?
THX in advance!

Alyssa Gomez

Hi Marco,

Happy to lend a hand! While there isn't a way to tell the difference between the two outputs in the manifest file, there is something we can do to narrow down the cause of the problem.

First, let's be sure the "Passed/Incomplete" file is reporting correctly. To find out, we'll need to test it in another LMS environment, like SCORM Cloud. 

SCORM Cloud is a free LMS testing tool, so you're welcome to test the course there yourself. Or, we can help you test it – just send your original project file to our team here. We'll give it a test then delete it when we're done troubleshooting. 

Leslie McKerchie

Thanks for sharing the results of your testing, Marco.

Since it's working as intended in SCORM Cloud, I'd follow up with your LMS team to understand the reporting difference.

I also wanted to let you know that your email signature came through when you replied via email. You can remove that if needed by clicking ‘Edit’ beneath your response. Here’s a quick Peek video if you need help.

Paula Obrien

Unfortunately, these settings are not working correctly in our PeopleSoft LMS. I want the course to be marked Completed if they look at a certain number of slides (I set the threshold as low as 40 out of 58). We are training doctors, and "suggest" module repeat if they don't pass but we do not want to prevent the course from being marked "complete" as long as they went through it. I need a Completed/Passed option as well because my learner got a 90% on the assessment, so it should say Completed and Passed; it shows "attended" passing status "Fail" and Completion status "not completed." 

Ren Gomez

Hi Paula,

Sorry to hear that the reporting settings do not fit how you're looking to report the course. To confirm, are you tracking by slides viewed, or by quiz result?

You can only choose one, and if you prefer grading by quiz result, I would recommend restricting the navigation so that the learner is forced to view all slides and take the assessment.

George Champlin

Paula,

Marco's comments about removing the <masteryscore> from the manifest are important. If it's there it does a couple things in our LMS (Saba)

  1. it checks Is scoring
  2. Adds a mastery score to the LMS for the content when it's attached to a class.

<masteryscore> is added to any Storyline manifest file if you have a results slide in your content, even if you are tracking slides viewed. If you publish as  SCORM 1.2 it will cause the LMS to override the tracking settings in the content and may use the score in the quiz to determine success. It may have other effects in other LMSs.

You may want to check that the content is not set to use scoring in the content repository. And you may want to try removing the <masteryscore> tag completely from the manifest.xml file.

mikki herbold

Hi

I cannot find the Passed/Failed under Reporting, I only get:

Passed/Incomplete

Complete/Incomplete

How do I achieve this, I have set up up two tries for failure and if they pass 80% or more on the third try  they should be passed.

Also, I was using Scorm 1.2 but just read your suggestion about using 4th edition now, is that correct?

 

Thanks

Mikki

 

 

Lauren Connelly

Hi Mikki!

I'm not aware of a reason why you wouldn't see the other reporting options! This is what it looks like on my end.

How are you tracking the progress of the course? Is it by results slide, course completion trigger, or the number of slides viewed?

Lastly, which version of Storyline are you using? 

We'll be here to investigate the issue with you!

mikki herbold

[cid:01837ad1-01c7-4120-aa04-27d5743af71e]
Hi Thanks for the reply. I am using Articulate 360 Rise.
I think I know what the problem is.
I have attached a print screen of what we have been doing and not seeing passed/failed.
If we 'Track by course completion', we don't see passed/failed as above.

If I export using 'Track using quiz result', I can see the Passed/Failed as below
[cid:6c5c07f6-fd14-4c9c-ba3b-daa36ff41ec3]
Wondering if scorm 2.1 is good to use or should I now use Scorm 4th edition?
Thanks Mikki

Vincent Scoma

Hi Mikki,

Thank you for sharing those details! 

Deciding which LMS standard to select is dependent on what might work better for your LMS. Each LMS can interpret statuses differently, so some standards are better at producing consistent results. After publishing your course and uploading it to your LMS, I would reccommend testing the course before distributing it to learners to make sure you get the statuses you expect. We have a great resource that provides more details about Reporting/Tracking with Rise 360 here

Please let us know if you have any questions! 

Joleen Kiesel

Hi! Adding on to this. I am working with SL360 and CSOD and running into the issue that if the student fails after the maximum attempts, it just shows as "in progress". I have tried creating complete/incomplete triggers, tried just leaving it, tried adjusting the tracking and still getting the same result. I am not sure if I did the triggers correctly or in the wrong spot or missing something completely.

I would like it not show in progress, but either "completed/failed" or "completed/incomplete" and take it off the transcript as in progress.

I know this has been a problem in the past with CSOD so I am not sure if a fix has been found.

Attached shots of my triggers as this is the only thing I can think where the issue is.

Lauren Connelly

Hi Joleen!

Thanks for sharing the screenshots! I've seen similar errors in an LMS environment, and it's usually a setting to change in the LMS! 

Before we set that as the fix, let's test the course in another LMS environment. We often use SCORM cloud. You'll want to publish the course for LMS, zip the folder, and then add the course to SCORM cloud.  You can find the next steps in this support article: How to Troubleshoot Your LMS with SCORM cloud.

Please keep me updated on what you find! If the course if behaving as expected, you'll want to contact your LMS admin for help with CSOD.

Leslie McKerchie

Hi Joleen,

Since you are able to replicate the issue in SCORM Cloud, it'd be great if our team could take a look.

With your permission, I'd like you to share your project file with our support engineers to investigate what's happening. You can share it privately by uploading it here. It will be deleted when troubleshooting is complete.