Is it possible to report Scorm quiz results without a (formal SL) quiz?

Dec 12, 2023

Hello all,

I've developed a series of five interactions in Storyline 360 that I would like tracked as a quiz through our LMS, Canvas. Unfortunately, I didn't build it using any of the quiz templates, form slides or freeform slides. I tried to add a results slide but can see that it isn't "acknowledging" any of my questions or answers as quiz questions. I think I would have to convert everything to a question or a free form slide, but each question has several "mini-question stages" and it would be too complicated to convert everything to Storyline's quiz formatting.

Is there any way I can "trick" my way into funneling some kind of SCORM data, such as pass/fail, percent correct, number of wrong answers, etc, by using the appropriate triggers? I can currently track the number of incorrect responses through variables and can present a "you got 5 out of 19 questions wrong" message in my own results slide, but that isn't SL's results slide. After importing into my test course as a graded course in Canvas, I don't get any data even after the test has been completed.

Thanks in advance,

Josue

7 Replies
Judy Nollet
Josue Rodriguez

Hello Judy,

Thank you so much for those guides. They have a lot of great detail. My hesitation to use the freeform feature is that I tried, and it allows for one correct selection per slide, per question.

Currently, each one of my question slides has stages: 1) Listen to audio 2) Question options are unhidden 3) User is guided to annotate between 2-6 parts of a sentence based on audio, one at a time. Each annotation (multiple choice) has a correct/incorrect layer. So each question has between 2-6 separate "choices." All I can think of is separating each choice so that there is only 1 per slide, but that would require rebuilding most of what I've done.

Is there no way to use a variable throughout that will help "talk" to a Storyline Results slide, like a "scorepoints" or "finalscore" variable? I've tried that a bit but haven't gotten that to work yet.

Judy Nollet

I'll try to clarify what I meant. 

The Freeform part of the slide would be hidden from the user. They would only see the questions you've already programmed. Triggers would select the appropriate "answer" for the hidden Freeform. Here's one way to do this:

  • Put two buttons off the slide. Or use two shapes that each have a Normal and a Selected state. 
  • Convert the slide to Freeform.
  • In FORM VIEW, indicate which of the offscreen buttons is the "correct" answer. (I suggest naming the buttons "Right" and "Wrong" or something like that. In other words, give them meaningful names.)
  • Add a trigger to the Submit button that changes the state of the "Right" button to Selected with whatever conditions are needed to verify that the user answered your question correctly. 
    • Include an "Else" action in the trigger that will change the state of the "Wrong" button to Selected (so that will happen if the "correct" conditions aren't met).
    • Be sure this trigger is before the trigger that submits the interaction/question.

That creates a standard graded question that can be scored by a Results slide and reported to an LMS/LRS. But the user will only see and interact with your custom questions.

Since you only have 5 questions, another option would be to submit the results of one disguised multiple-choice question that is Scored "By choice" (in other words, one that gives partial credit for wrong answers).  For example, let's say each of your 5 questions is worth 20 points. The FORM VIEW of the question slide would look something like this: 

The actual responses would be completely covered by something else, so the user couldn't select any of them. You would add triggers to select the appropriate "answer" based on how many of your custom questions were answered correctly. (This is similar to what is demonstrated in the "Partial Credit" tip I linked to in my previous comment.) 

By the way, this article has info about sending the value of a variable to an LMS: Storyline 360: How to Send the Value of a Variable to an LMS/LRS - Articulate Support 

Josue Rodriguez

Judy,

This is fantastic and very creative. Thank you so much!

I think the key for me will be specifying those conditions for the submit button so that the hidden buttons "report" correct and incorrect answers . I might make it so that, if a player makes, say, three incorrect choices over the course of six choices for a single question, it sets the hidden button to the "wrong" setting. The challenge for me will be deciding what conditions will meet the "right" and "wrong" settings on the hidden button for each question, but I think I can work with that. I'd also love to also add partial credit as you lay out above and in your previous answer, since it fits my needs, but I'll have to save that for later. I will continue to go through your tutorials above; there's a lot to unpack there as I learn more about SCORM reporting and Storyline quizzes. Thanks again,

-Josue

Josue Rodriguez

Follow up question: I've gone through and tested a few versions of what you lay out above. What I'm currently stuck on is the following: I have 5 questions and each is worth 20 points. I would like to subtract 4 points every time someone makes an incorrect choice (each question has between 3-6 possible choices). That way, a question isn't purely wrong or right, but offers a certain amount of points. I'd like learners to experiment a bit and work through each solution.

As it is now, each question submits the full correct amount or the incorrect amount; I can't subtract one from the other once I hit "submit". Each freeform question only allows ONE final answer to go through into the results slide. I see that you've worked around this by adding buttons that are triggered for every possible choice and will report as "multiple question score", or something to that effect (I forgot the trigger name, exactly). Is there any way for me to simply subtract from the "Quiz1Score" variable? I can create variables and triggers to do some math, but I'm afraid that if I simply create a custom Score variable it won't report correctly once it's sent into the results slide and the LMS. Nothing I do seems to let me manipulate the embedded "Quiz1Score" variable, assuming that's even the variable that sends information into the LMS.

Judy Nollet

You can't manipulate the built-in quiz-scoring variables.

If you want the option to assign partial credit when someone takes more than one try to answer a question, then use a combination of what I described above.

  • Turn each question into Freeform question.
  • Set it to score "By choice." 
  • Instead of just "Right" and "Wrong" buttons, add a button for each potential score. For example, the  correct button/response would be worth 20 points, and the other buttons/responses would be worth 16 points, 12 points, 8 points, 4 points, and 0 points. 
  • Don't add a separate slide with another hidden MC. Just use the Freeforms hidden on your custom-question slides. 

You'll have to figure out the conditions to select the button with the appropriate point value.