Forum Discussion
Storyline SCORM 2004 4th Edition - cmi.success_status never gets updated?
Simple course, 1 intro slide, 1 draw from question bank slide, 1 result slide. All using Storyline built-in templates. Nothing custom. I look at the SCORM Cloud logs and it's sending cmi.success_status = unknown before the Quiz is launched and then never updates. Is there a way to stop this from happening? Is this supposed to happen? My LMS reports on both cmi.success_status so my learners are seeing "Success = Unknown" after they pass the quiz and complete the course.
SCORM Cloud Log
+ [12:25:10.819] Starting the sequencing process for navigation request START. returned 'Deliver activity: CMISUCCTEST (CMISUCCTEST_SCO)' in 0.003 seconds
+ [12:25:10.820] Preparing data for delivery of "CMISUCCTEST (CMISUCCTEST_SCO)".
+ [12:25:10.822] Evaluate Possible Navigation Requests Process [EPNR] returned '' in 0.002 seconds
+ [12:25:10.822] Start of simple logs in lookahead sequencer.
+ [12:25:11.477] Initialize('') returned 'true' in 0 seconds
+ [12:25:11.477] GetValue('cmi.success_status') returned 'unknown' in 0.001 seconds
[12:25:11.478] GetLastError() returned '0' in 0 seconds
+ [12:25:11.478] GetValue('cmi.completion_status') returned 'unknown' in 0 seconds
[12:25:11.478] GetLastError() returned '0' in 0 seconds
+ [12:25:11.478] SetValue('cmi.completion_status', 'incomplete') returned 'true' in 0 seconds
+ [12:25:11.478] SetValue('cmi.exit', 'suspend') returned 'true' in 0 seconds
+ [12:25:11.478] GetValue('cmi.mode') returned 'normal' in 0 seconds
[12:25:11.478] GetLastError() returned '0' in 0 seconds
+ [12:25:11.479] GetValue('cmi.suspend_data') returned '' in 0 seconds
[12:25:11.479] GetLastError() returned '0' in 0 seconds
+ [12:25:11.479] GetValue('cmi.success_status') returned 'unknown' in 0 seconds
[12:25:11.479] GetLastError() returned '0' in 0 seconds
+ [12:25:11.479] GetValue('cmi.completion_status') returned 'incomplete' in 0 seconds
[12:25:11.479] GetLastError() returned '0' in 0 seconds
+ [12:25:11.479] SetValue('cmi.success_status', 'unknown') returned 'true' in 0 seconds
+ [12:25:11.479] SetValue('cmi.completion_status', 'incomplete') returned 'true' in 0 seconds
+ [12:25:14.167] SetValue('cmi.suspend_data', '20245070nm101101210c010121101210~22130001^1^1^1^1^1^1^H_player.5WD4lm5VW7A.5djKZXegqnH.6S9oNEnhb4p1^1^000l0jc0020304050100000002000') returned 'true' in 0 seconds
+ [12:25:16.898] SetValue('cmi.score.raw', '16.66') returned 'true' in 0 seconds
+ [12:25:16.898] SetValue('cmi.score.max', '100') returned 'true' in 0 seconds
+ [12:25:16.898] SetValue('cmi.score.min', '0') returned 'true' in 0 seconds
+ [12:25:16.898] SetValue('cmi.score.scaled', '0.1666') returned 'true' in 0 seconds
+ [12:25:16.899] GetValue('cmi.interactions._count') returned '0' in 0 seconds
[12:25:16.899] GetLastError() returned '0' in 0 seconds
+ [12:25:16.899] SetValue('cmi.interactions.0.id', 'Scene1_QuestionDraw11_Slide1_TrueFalse_0_0') returned 'true' in 0 seconds
Success status "unkown" is a valid status. I think it will not be updated until you pass/fail the quiz. SCORM 2004 has a completion and success status. You can have a completion of "completed" and a success status of "unkown", "failed" or "passed". You may need to change your Report status to "Passed/Incomplete" or "Passed/Failed" to updated the success status. The success status will only updated when the quiz is attempted.
That's the problem, the status remains unknown for the rest of the course after the test is passed. It get's definied as "unknown" before the quiz is launched and that's it.
Are you saying cmi.success_status will only get updated if I happen to choose the "correct" setting out of the 4 possible cmi.completion_status options? Honestly I'm not surprised if that's the case, it makes about as much sense as anything else does with SCORM and Storyline.
Full log
https://app.cloud.scorm.com/sc/guest/ViewDebugLog?logId=645e2dd0-72d8-452c-a408-85955e50b536&courseTitle=CMISUCCTEST and attached is the storyline file and SCORM package.
ChatGPT explain the two statuses well and how they work independently of each other, but provide a status together.
SCORM 2004 uses completion_status and success_status to track a learner's progress and performance in an eLearning course. These two elements serve distinct purposes:
1. completion_status
This status indicates whether the learner has completed the course or specific activities within it. It is a measure of progress, not performance.
Possible values:
- completed: The learner has finished the course or met all requirements defined for completion.
- incomplete: The learner has not yet completed the course.
- not attempted: The learner has not started the course.
- unknown: The system doesn't know the completion status.
Key points:
- Completion does not imply mastery or passing; it only means the course requirements have been fulfilled.
- A course could be "completed" even if the learner fails an assessment, depending on how the course is configured.
2. success_status
This status reflects whether the learner has passed or failed based on performance, such as a test score or another evaluation metric.
Possible values:
- passed: The learner has achieved the minimum performance criteria (e.g., passing score).
- failed: The learner did not meet the minimum performance criteria.
- unknown: The system doesn't know the success status (e.g., the score has not been reported).
Key points:
- Success is tied to performance and may require meeting specific criteria, like passing an exam.
- A course could be "passed" even if it’s not marked as "completed" (e.g., the learner passes an assessment without completing all activities).
Relationship Between completion_status and success_status
The two statuses work together but independently. For example:
- completed + passed: The learner finished the course and passed it.
- completed + failed: The learner finished the course but did not pass.
- incomplete + unknown: The learner has started but neither completed nor taken an assessment.
- completed + unknown: The learner completed the course, but their performance result is not available.
This separation provides greater flexibility for course designers to track both progress and achievement independently.
I'll check out you file later.
Thank you Sam I seriously appreciate your time
Hi AntVec as suspected, you would need to change it to track at least one of the one of the success_status values "Passed" or "Failed" for it to register any change on the success_status.
What this allows on the LMS it to track:
- Who has completed the training
- Who has successfully passed an assessment
These are two quite different pieces of data. It was not possible to track this in SCORM 1.2. But as the name suggests (SCORM2004), this standard is now just ticking over to 25 years old and so is dated. The next gen (xAPI) just hasn't had the same level as adoption as SCORM 1.2 did. SCORM 2004 is still very rarely used when compared to SCORM 1.2.
I hope this clarifies a few things.
