Forum Discussion

MichelleWill413's avatar
MichelleWill413
Community Member
3 years ago

Need help determining issue with SCORM 2004 v1-3 not reporting test level data to LMS for reporting purposes

Hi all! I need your expertise to figure out what may be wrong with the course I've created. I've created a test using Storyline 360, which includes a welcome slide that forces them to click "Begin" to start the test. In my original course design file, I had created a Question Bank with all of my quiz questions (True/False using "Yes/No" and Text for open-ended questions). Then, I pulled the question bank into the Storyline course. Each question requires them to submit their answers, and I created a Results slide which gives users the ability to review their quiz or Exit the test. Upon the user clicking Exit, the triggers are set to submit their responses and mark the course as complete. I then published it as SCORM 2004 version 3 and uploaded the course zip file to our LMS (Cornerstone).

I expected the course to report the test questions and answers back to the LMS. However, while the course is reporting out on the questions, it is not reporting user answers back to capture that data in the LMS. 

I was then informed I should recreate the test and place the questions on individual slides, rather than using the Question Bank. So, I created new slides in my project and inserted the graded and text questions on their own slides, leaving the welcome and Results slide in place. They had also advised me to publish it in version 1, which I did. 

I uploaded this new version to the LMS and achieved the exact same results in our SCORM data fields in our reports - no user answers being reported. 

I then engaged our LMS provider who reviewed the course and provided the information below.........

As the client indicates, if you answer "no" to either of the first questions, it bounces you to the results slide. There are no interactions set.

Debug log here: https://urldefense.com/v3/__https://cloud.scorm.com/sc/guest/ViewDebugLog?logId=ae392a5f-f99b-47c3-8156-fcb53b3d6248&courseTitle=Implementations*Skills*Assessment__;Kys!!P9vvK-4S!xR6mAK0dZiVwqrLDDOOzIJ1IR3iSQefApC_swyjhq3lvMFIPSkjGbI4KaaVseFesSGBBhQ$ 

If you answer "yes" to both, you're able to answer the subsequent questions and interactions are included in the suspend data.

Debug log here: https://urldefense.com/v3/__https://cloud.scorm.com/sc/guest/ViewDebugLog?logId=23b8b691-a1f2-41cd-9a69-9182fedb0131&courseTitle=Implementations*Skills*Assessment__;Kys!!P9vvK-4S!xR6mAK0dZiVwqrLDDOOzIJ1IR3iSQefApC_swyjhq3lvMFIPSkjGbI4KaaVseFfuHFGMsw$ 

When in the DEBUG LOG -- You can do a Ctl + F and search "interactions" to see this

Unfortunately, SCORM does not report on interactions included in suspend data. We wouldn’t be able to sift through the suspend data to figure that out as all courses will differ with how they use it.

RESOLUTION

Interactions must be set using the cmi.interactions model as specified in the SCORM specification.

Run-Time Reference here: https://urldefense.com/v3/__https://scorm.com/scorm-explained/technical-scorm/run-time/run-time-reference/__;!!P9vvK-4S!xR6mAK0dZiVwqrLDDOOzIJ1IR3iSQefApC_swyjhq3lvMFIPSkjGbI4KaaVseFe34FVM7Q$

++++++++++++++++++++

Other than having the Results slide set to trigger submitting the test and marking the course as complete, what other interactions are required to get it to report user responses back to the LMS? I'm not an expert coder and don't understand what I'm doing wrong here.

I've attached my course file for your review and convenience.

Any help you can lend is much appreciated! TIA!!

General E-Learning
  • KennaAnna's avatar
    KennaAnna
    Community Member
    11 months ago
    Michelle Williams

    Hi all! I need your expertise to figure out what may be wrong with the course I've created. I've created a test using Storyline 360, which includes a welcome slide that forces them to click "Begin" to start the test. In my original course design file, I had created a Question Bank with all of my quiz questions (True/False using "Yes/No" and Text for open-ended questions). Then, I pulled the question bank into the Storyline course. Each question requires them to submit their answers, and I created a Results slide which gives users the ability to review their quiz or Exit the test. Upon the user clicking Exit, the triggers are set to submit their responses and mark the course as complete. I then published it as SCORM 2004 version 3 and uploaded the course zip file to our LMS (Cornerstone).

    I expected the course to report the test questions and answers back to the LMS. However, while the course is reporting out on the questions, it is not reporting user answers back to capture that data in the LMS. 

    I was then informed I should recreate the test and place the questions on individual slides, rather than using the Question Bank. So, I created new slides in my project and inserted the graded and text questions on their own slides, leaving the welcome and Results slide in place. They had also advised me to publish it in version 1, which I did. 

    I uploaded this new version to the LMS and achieved the exact same results in our SCORM data fields in our reports - no user answers being reported. 

    I then engaged our LMS provider who reviewed the course and provided the information below.........

    As the client indicates, if you answer "no" to either of the first questions, it bounces you to the results slide. There are no interactions set.

    Debug log here: https://urldefense.com/v3/__https://cloud.scorm.com/sc/guest/ViewDebugLog?logId=ae392a5f-f99b-47c3-8156-fcb53b3d6248&courseTitle=Implementations*Skills*Assessment__;Kys!!P9vvK-4S!xR6mAK0dZiVwqrLDDOOzIJ1IR3iSQefApC_swyjhq3lvMFIPSkjGbI4KaaVseFesSGBBhQ$ 

    If you answer "yes" to both, you're able to answer the subsequent questions and interactions are included in the suspend data.

    Debug log here: https://urldefense.com/v3/__https://cloud.scorm.com/sc/guest/ViewDebugLog?logId=23b8b691-a1f2-41cd-9a69-9182fedb0131&courseTitle=Implementations*Skills*Assessment__;Kys!!P9vvK-4S!xR6mAK0dZiVwqrLDDOOzIJ1IR3iSQefApC_swyjhq3lvMFIPSkjGbI4KaaVseFfuHFGMsw$ 

    When in the DEBUG LOG -- You can do a Ctl + F and search "interactions" to see this

    Unfortunately, SCORM does not report on interactions included in suspend data. We wouldn’t be able to sift through the suspend data to figure that out as all courses will differ with how they use it.

    RESOLUTION

    Interactions must be set using the cmi.interactions model as specified in the SCORM specification.

    Run-Time Reference here: https://urldefense.com/v3/__https://scorm.com/scorm-explained/technical-scorm/run-time/run-time-reference/__;!!P9vvK-4S!xR6mAK0dZiVwqrLDDOOzIJ1IR3iSQefApC_swyjhq3lvMFIPSkjGbI4KaaVseFe34FVM7Q$ rice purity test

    ++++++++++++++++++++

    Other than having the Results slide set to trigger submitting the test and marking the course as complete, what other interactions are required to get it to report user responses back to the LMS? I'm not an expert coder and don't understand what I'm doing wrong here.

    I've attached my course file for your review and convenience.

    Any help you can lend is much appreciated! TIA!!

    Hi Michelle,
    I can understand your frustration with the SCORM 2004 v1-3 issue. It seems like you've already tried a few solutions, but still have no luck with capturing user answers in the LMS. It's good that you've shared the debug logs and the course file for review. Hopefully, the experts can identify the missing interactions and provide a resolution soon.

  • UsamaAsmat's avatar
    UsamaAsmat
    Community Member
    10 months ago

    It seems like you're encountering issues with your course in Storyline 360 not correctly reporting user answers back to your LMS, particularly when using the Question Bank or when the course bounces to the Results slide based on certain answers.

    Here are some potential troubleshooting steps and considerations:

    1. Check LMS Compatibility: Verify if the version of SCORM you're publishing (SCORM 2004 v3) is fully compatible with your LMS (Cornerstone). Sometimes, certain versions or configurations might not fully support specific interactions or data reporting. It might be worth checking with Cornerstone's support or documentation for any known compatibility issues.

    2. Review Reporting Settings: Within Storyline 360, check the Reporting and Tracking settings when publishing the course. Ensure that reporting of user answers is enabled and configured properly. Specifically, make sure that the reporting of interaction data is set up correctly for your question slides.

    3. Interaction ID and Reporting: Each question slide should have a unique interaction ID for the LMS to track and report user answers. Ensure that the interaction IDs for your questions are correctly set up in Storyline.

    4. Testing in SCORM Cloud: Use SCORM Cloud (a testing platform for SCORM packages) to test your published course. This allows you to isolate whether the issue is related to your LMS (Cornerstone) or something in the course content itself.

    5. Review Triggers and Navigation: Ensure that there are no conflicting triggers or navigation settings that might interfere with the reporting of user answers to the LMS. For instance, verify that when users navigate to the Results slide, it doesn't interfere with data tracking.

    6. Engage Articulate Support: If the issue persists after trying these steps, consider reaching out to Articulate Support. They might have encountered similar issues and could provide specific guidance or troubleshooting steps.

    Regarding the advice to place questions on individual slides rather than using the Question Bank, while this method might sometimes alleviate certain issues, it shouldn't inherently prevent user answers from being reported back to the LMS if the reporting settings and configurations are correct.

    Investigating these areas should help identify where the issue might be occurring and help resolve the problem with reporting user answers back to your LMS accurately.

Related Content