Hello! I am a long-time Captivate user gathering information about capabilities of Storyline. The biggest question I have is: can/does Storyline send individual question or objective results to an LMS or database? (In our case: Blackboard.) We need to be able to measure each learner's results per objective or question - not just a final score.
I did see that there is an option to print a results slide with this info, but we really need the automatic reporting.
Great question, and the answer is yes! 😀The following quiz data is communicated to an LMS by Storyline via SCORM or AICC for each question:
id: Storyline sends a series of data for this string to identify the Scene#, the QuestionDraw# (if applicable), and the Slide# in that particular scene or question draw.
type: This is the type of question (True/False, Multiple Choice, Multiple Response, etc).
student_response: This is how the learner answered the question.
correct_response: This is the correct answer to the question.
result: This designates whether the learner answered the question correctly or not.
weighting: Articulate content doesn't currently utilize this item. It'll always be set to 1.
latency: This is how long it took the learner to answer the question.
objective: Articulate content doesn't currently utilize this item. It'll always be set to 0.
Pro-tip: To send question text to your LMS, publish for SCORM 2004 or Tin Can API (also called Experience API or xAPI).
Since you mentioned you're exploring Storyline, I wanted to share its User Guide. It'll provide you with a solid foundation for using all the cool features it has to offer.
Happy creating and if there's anything else I can help answer, I'll be here!
Result slides provide learners with dynamic feedback at the end of quizzes and surveys. They also send reporting and tracking information to learning management systems, including learners' responses and scores. In order for the quiz results/learner's responses data to be tracked by an LMS, a results slide is needed.
in my course I have a mix of survey and graded questions? Which type of result slide should I use?
I used the surveys because the manager wants to have users' opinions on certain topics (in see it in the LMS) and score questions to test the knowledge. But the manager, and the user, doesn't need to see the result (percent). They just have to complete all the pages to pass the course.
What might help here is you could include multiple Results Slides to track different questions. You could have a designated Results Slide for your survey questions. How the LMS displays that or reports out on it will be LMS specific, so you may want to reach out to them directly to see what types of reports are available as well.
Please feel free to let us know if you need anything else!
So Matt, just a side note, You can use a single results slide for this. Just mark all questions and results to be tracked by it. What you show the end user on the slide is up to you. You can remove the results percentage and any text, the slide can even be blank if you want it to, but as long as the results slide is tracking all questions and surveys, it will submit it to the LMS.
Not sure if Blackboard takes it, but I recommend using SCORM 2004 to be able to more clearly see the questions and user response in your reports.
Would you be able to update this list of quiz data items communicated by Storyline 360 to LMS via SCORM? It seems the field titles have changed since this was posted.
Also, I seem to be getting some fields for some questions and not for others. Do you have any tips for how to fix this? Eg. I set up a 5 (+1 unassessed) question quiz for testing purposes and each question is reporting slightly differently. With regard to "Description" reporting . . . for 2 questions the LMS details are picking up the question field (this is what I want), for 2 others the LMS is picking up a different title field from the question slide and for the other 2 questions there is no description field at all.
Thanks for contacting us to share what you are experiencing in your project file.
The list that Katie shared above is still current. I think taking a look at your file would be helpful in understanding what you're seeing.
With your permission, please your project file so we can investigate what's happening. You can share it publicly here, or send it to me privately by uploading it here. I'll delete it when I'm done troubleshooting.
Lyndal, what are you using as tracking options when you publish out of Storyline? I find that when you are looking for question data, using Scorm 2004 v4 gives you the most accurate information.
If I have a combination of graded multiple choice questions and essay freeform essay questions, will both show up in the LMS? I want the teacher to be able to see the student responses to the essay questions as well as the score on the MC questions.
Thanks for asking that clarifying question! As mentioned above by my colleague Vincent, you can set up multiple results slides; a graded results slide to track graded questions, and a survey results slide to track the survey question. You can then add an additional results slide to track both results.
With that said, it'll be up to your LMS on what they can report out on, and they may not be able to display the survey results that users have entered. Here's the quiz data that Storyline sends to an LMS.
Once your quiz and survey are set up, you can test your course in SCORM Cloud, which is an industry standard for LMS testing, to see if it reports the data you want to track.
Let me know if you have further questions as you set up your course!
I have published my course to my LMS, I used the SCORM 2004, ed 4 to publish. But I cannot figure out how to pull the report you talk about above that shows the question responses and none of my LMS reports will show these results. Any help on how to see this report is greatly appreciated.
Please clarify. I have a client who has many short ans type Qs. He wants the answers to be evaluated by the teacher. In Storyline, I can capture these answers using data entry fields, but how can I get it displayed for the teacher to evaluate.
I know we can publish to LMS. But will it be properly displayed for the teacher to evaluate
Storyline sends the data outlined here to your LMS, and that includes short answer responses. It'll be up to the LMS to display that in a way that's readable to your teachers - so I'd suggest connecting with your LMS support team to understand what types of reports are available!
I know this is an old conversation, but we have run into a situation where we need to pull information about how specific students did on specific questions.
Our learning is published using SCORM 2004. We have two branches with separate result slides. However, our auditor wants to look at what questions students got wrong or right. I am probably not explaining this in the best way possible, but I hope it makes sense.
Our LMS is called Health LMS. I will get the vendor information tomorrow. Thanks!
I feel pretty stupid. I cannot find how to actually do this in our LMS. It's Vector Systems. Where do we select these? As we run the report using the LMS reporting tool? I'm guessing that's where we run it.
Since this can be very specific to each LMS, your best bet is to contact Vector Systems, as they will be able to guide you on finding the reporting options you're looking for.
30 Replies
Hi, A. Welcome to eLearning Heroes!
Great question, and the answer is yes! 😀The following quiz data is communicated to an LMS by Storyline via SCORM or AICC for each question:
Pro-tip: To send question text to your LMS, publish for SCORM 2004 or Tin Can API (also called Experience API or xAPI).
Since you mentioned you're exploring Storyline, I wanted to share its User Guide. It'll provide you with a solid foundation for using all the cool features it has to offer.
Happy creating and if there's anything else I can help answer, I'll be here!
Hi, can we do it without a Result slide? Because I use graded questions only. Thanks
Hey Mat,
Great question!
Result slides provide learners with dynamic feedback at the end of quizzes and surveys. They also send reporting and tracking information to learning management systems, including learners' responses and scores. In order for the quiz results/learner's responses data to be tracked by an LMS, a results slide is needed.
We have a great user guide that you may find helpful on working with result slides here: Storyline 360: Adding Result Slides.
Please let me know if you have any additional questions on this!
Hi Vincent,
in my course I have a mix of survey and graded questions? Which type of result slide should I use?
I used the surveys because the manager wants to have users' opinions on certain topics (in see it in the LMS) and score questions to test the knowledge. But the manager, and the user, doesn't need to see the result (percent). They just have to complete all the pages to pass the course.
Thanks
Hey Mat,
No problem!
What might help here is you could include multiple Results Slides to track different questions. You could have a designated Results Slide for your survey questions. How the LMS displays that or reports out on it will be LMS specific, so you may want to reach out to them directly to see what types of reports are available as well.
Please feel free to let us know if you need anything else!
Hello, on result slide for questions and another one for the survey?
In the publishing options, I have to choose a single result page? Which one should I use?
And the data of the two results slide will be sent to the LMS?
Thanks
So Matt, just a side note, You can use a single results slide for this. Just mark all questions and results to be tracked by it. What you show the end user on the slide is up to you. You can remove the results percentage and any text, the slide can even be blank if you want it to, but as long as the results slide is tracking all questions and surveys, it will submit it to the LMS.
Not sure if Blackboard takes it, but I recommend using SCORM 2004 to be able to more clearly see the questions and user response in your reports.
Ok but I need to put a passing score. But I dont need that. The graded questions is just for fun:)
You can use a passing score of 0.
Hi there Katie,
Would you be able to update this list of quiz data items communicated by Storyline 360 to LMS via SCORM? It seems the field titles have changed since this was posted.
Also, I seem to be getting some fields for some questions and not for others. Do you have any tips for how to fix this? Eg. I set up a 5 (+1 unassessed) question quiz for testing purposes and each question is reporting slightly differently. With regard to "Description" reporting . . . for 2 questions the LMS details are picking up the question field (this is what I want), for 2 others the LMS is picking up a different title field from the question slide and for the other 2 questions there is no description field at all.
I can provide the file if that would help.
Hi Lyndal and welcome to E-Learning Heroes :)
Thanks for contacting us to share what you are experiencing in your project file.
The list that Katie shared above is still current. I think taking a look at your file would be helpful in understanding what you're seeing.
With your permission, please your project file so we can investigate what's happening. You can share it publicly here, or send it to me privately by uploading it here. I'll delete it when I'm done troubleshooting.
Lyndal, what are you using as tracking options when you publish out of Storyline? I find that when you are looking for question data, using Scorm 2004 v4 gives you the most accurate information.
If I have a combination of graded multiple choice questions and essay freeform essay questions, will both show up in the LMS? I want the teacher to be able to see the student responses to the essay questions as well as the score on the MC questions.
Hi Heather,
Thanks for asking that clarifying question! As mentioned above by my colleague Vincent, you can set up multiple results slides; a graded results slide to track graded questions, and a survey results slide to track the survey question. You can then add an additional results slide to track both results.
With that said, it'll be up to your LMS on what they can report out on, and they may not be able to display the survey results that users have entered. Here's the quiz data that Storyline sends to an LMS.
Once your quiz and survey are set up, you can test your course in SCORM Cloud, which is an industry standard for LMS testing, to see if it reports the data you want to track.
Let me know if you have further questions as you set up your course!
I have published my course to my LMS, I used the SCORM 2004, ed 4 to publish. But I cannot figure out how to pull the report you talk about above that shows the question responses and none of my LMS reports will show these results. Any help on how to see this report is greatly appreciated.
Diana, what LMS are you using?
We use NetDimensions from PeopleFluent
Hi Diana,
Hopefully some community members who also use NetDimensions can weigh in on its reporting. A few more areas to consider:
Good luck, and we're also here if you have any questions!
Hi,
Please clarify. I have a client who has many short ans type Qs. He wants the answers to be evaluated by the teacher. In Storyline, I can capture these answers using data entry fields, but how can I get it displayed for the teacher to evaluate.
I know we can publish to LMS. But will it be properly displayed for the teacher to evaluate
Hi Sajna,
Storyline sends the data outlined here to your LMS, and that includes short answer responses. It'll be up to the LMS to display that in a way that's readable to your teachers - so I'd suggest connecting with your LMS support team to understand what types of reports are available!
I know this is an old conversation, but we have run into a situation where we need to pull information about how specific students did on specific questions.
Our learning is published using SCORM 2004. We have two branches with separate result slides. However, our auditor wants to look at what questions students got wrong or right. I am probably not explaining this in the best way possible, but I hope it makes sense.
Our LMS is called Health LMS. I will get the vendor information tomorrow. Thanks!
Hello Rebekah,
As mentioned by my colleague, you can check out this article to see which quiz data will be available in the reporting section of your LMS.
You auditor will be find these two items most relevant:
Let us know if you have any additional questions!
I feel pretty stupid. I cannot find how to actually do this in our LMS. It's Vector Systems. Where do we select these? As we run the report using the LMS reporting tool? I'm guessing that's where we run it.
Hi, Rebekah.
Since this can be very specific to each LMS, your best bet is to contact Vector Systems, as they will be able to guide you on finding the reporting options you're looking for.
Thank you! We are reaching out to them as we speak.