Hi. I'm pretty sure the following is not currently possible, but I wanted to ask the question just to make certain...
I am using a Storyline block in a Rise course. The Storyline block includes several questions. I would like to see how the learner responds to the questions. This is important because they're the part of the course evaluation, and we need to see what they thought of the course.
I am tracking completion using the Storyline block.
Will Rise report how the learner responded to the individual questions?
Is this the functionality that is supposed to be released within the next month?
Hi Chris. Great question. To track Storyline output, it needs to be published for LMS. When you add a Storyline interaction to Rise, it has been published for Articulate 360 and doesn’t have the language to communicate learners' quiz responses.
For Rise, we’re working toward release question-level data on Rise quiz lessons specifically.
Do you need to track the SL survey responses in an LMS, or can they come in another format?
Hi Crystal. Sorry for the delayed response. I went on vacation shortly after I posted my question. Yes, for consistency and completeness in reporting, we need to track learner feedback in our LMS.
I want to make sure I am understanding your comments regarding Storyline interactions in Rise. So if:
I create questions in Storyline
I include those questions in a Storyline block in my Rise course
I track course progress and completion using that Storyline block
I export for LMS and upload it to my LMS
Will the course communicate question-level data to the LMS?
Again, what I really need at this time, is to get a satisfaction score, and also gather any comments the learner may share about the course.
Also, do you have a timeline on when Rise quiz lessons will be able to communicate question-level data?
When you create questions in Storyline and embed them using a Storyline Block, you can use that Storyline block to track Rise course completion. This will simply communicate to the LMS whether the learner completed or did not complete the Rise course. At this time, you will not be able to capture answer data on the Storyline quiz questions.
Our team is still looking at adding a feature to allow you to track question-level data for Rise quiz questions, and we're targeting to release that feature by this quarter. Some Rise timelines may shift as we test and look at implementing new features, so we'll let you know as soon as this is ready.
Thanks for your patience as we work to make a product you can love!
Thanks again, Crystal and Alyssa. My LMS Admin did some testing, and it appears that we are now getting question-level data from Rise Quiz Lessons. This is good news! But we're still hoping for that functionality from a Storyline Block as well. Do you know if SL Block question-level reporting is planned or under development, and if so, what the timeline might be?
While quiz details are not reported for Storyline blocks at this time, I've shared your thoughts in the form of a feature request with our product team! You should receive an email confirmation about it shortly. Thanks again for letting us know how really important having such features are to you, and we'll certainly let you know once we have any updates!
My team is looking to collect question level data in Storyline activities. Has their been any progress on tracking and collecting storyline question level data? Our team looks forward to any updates you might have.
It sounds like you want to be able to track Storyline block question level data in Rise, correct? Right now, there isn’t a way to do this.
I don’t currently have any updates, but you are now subscribed to this conversation which means as we share updates here, you’ll automatically be notified.
Hi, I see that Rise can now send question-level details to the LMS. Is it possible to send/report all question-level details of every question that is answered by the learner in the entire Rise course to the LMS? Or would only the responses to questions included in the quiz that is selected as the basis for tracking/completion in the publish settings the ones that are sent to the LMS? We would like to capture all of the responses in a Rise course.
It sounds like you want access to question-level results from multiple quizzes in a Rise course is that correct?
This is possible with Rise, as we report raw data from all quizzes in a course. You’ll just need to understand how to work with your LMS to extract that detail.
I’d recommend reaching out to your LMS vendor for more information.
In the meantime, if I can help with anything else please let me know.
Hi Guys. I am working with our LMS admin to get question level data from Rise and we can't seem to get it utilizing 1.2. Going to try 2004, but unsure of the edition. Anyone have any suggestions on what has worked in your LMS?
UPDATE: Using 2nd edition we were able to get 6 out of the 10 questions specific metrics, but unsure of what is going on with the other 4. Staff?
The data being reported is limited to 64k characters, so if your text heavy it might be the problem. Also, In my experience working with Storyline, I know that any data that begins with a numerical value will fail to report. For example
Hello all. It is an issue they're working on. A work around is turning off the randomization of questions and then placing a numerical value in front of every question and it worked. Thanks for the advice.
Is it still true that quiz details for a Storyline block cannot be reported to the LMS?
Can you confirm if Jean-Guys post where he states "data that begins with a numerical value will fail to report" is correct? Is that a known issue for Rise? or Just something experienced in Storyline?
You can track the quiz score by choosing the quiz tracking option when you publish from Storyline to Review 360, and then choosing to track the Rise course by the Storyline block. In that scenario, the quiz score will be sent to the LMS, but question-level details aren't sent to the LMS for Storyline blocks.
It sounds like Jean-Guy Boulay and Justin McGee are referring to a Rise 360 quiz reporting issue, not a Storyline Block issue. Rise 360 does not send question-level details from the Storyline Block to your LMS, but I'll let our team know you need that option.
I was actually referring to just SL360, and should point out that I tested this several builds ago on two LMS's to verify it. The Quiz and question results will report just fine, but in past SL360 builds the question level details would fail to report if the answers started with a number. By details I mean if the administrator wanted to see exactly what was chosen, they would see a blank entry. The answer would still report as correct or incorrect, but fail to record the choice.
I haven't tested this in the latest build of SL360 because I've since changed the format of my question structure in order to save time in the QA process, I simply don't start my answers with numbers. If this issue was fixed then that's great news.
Now if you want to record question level details in storyline through Rise you'll need to setup cmi statements in a javascript trigger and send those details through the Rise Scorm api, which can be accessed by referencing window.top:
/*Get player to reference*/ var player = GetPlayer();
/*get LMS API*/ var lmsAPI = window.top;
I used the cmi.interactions in the scorm runtime api to record the question level data. I hope I understood the question.
Great thread. I am using a basic web space with the HTML5 files to serve to clients. Will RISE save a file to the folder web space upon completion of a quiz or do you need a specified and dedicated LMS software to hold the data?
36 Replies
Hi Chris. Great question. To track Storyline output, it needs to be published for LMS. When you add a Storyline interaction to Rise, it has been published for Articulate 360 and doesn’t have the language to communicate learners' quiz responses.
For Rise, we’re working toward release question-level data on Rise quiz lessons specifically.
Do you need to track the SL survey responses in an LMS, or can they come in another format?
Hi Crystal. Sorry for the delayed response. I went on vacation shortly after I posted my question. Yes, for consistency and completeness in reporting, we need to track learner feedback in our LMS.
I want to make sure I am understanding your comments regarding Storyline interactions in Rise. So if:
Will the course communicate question-level data to the LMS?
Again, what I really need at this time, is to get a satisfaction score, and also gather any comments the learner may share about the course.
Also, do you have a timeline on when Rise quiz lessons will be able to communicate question-level data?
Thank you so much.
Chris
Hi there Chris,
When you create questions in Storyline and embed them using a Storyline Block, you can use that Storyline block to track Rise course completion. This will simply communicate to the LMS whether the learner completed or did not complete the Rise course. At this time, you will not be able to capture answer data on the Storyline quiz questions.
Our team is still looking at adding a feature to allow you to track question-level data for Rise quiz questions, and we're targeting to release that feature by this quarter. Some Rise timelines may shift as we test and look at implementing new features, so we'll let you know as soon as this is ready.
Thanks for your patience as we work to make a product you can love!
Thank you, Alyssa.
Thanks again, Crystal and Alyssa. My LMS Admin did some testing, and it appears that we are now getting question-level data from Rise Quiz Lessons. This is good news! But we're still hoping for that functionality from a Storyline Block as well. Do you know if SL Block question-level reporting is planned or under development, and if so, what the timeline might be?
Thanks,
chris
Hi there, Chris. Your LMS admin is right! 🌟As of yesterday, Rise courses will send question-level details to an LMS – so you can observe what learners know and where they need more help.
While quiz details are not reported for Storyline blocks at this time, I've shared your thoughts in the form of a feature request with our product team! You should receive an email confirmation about it shortly. Thanks again for letting us know how really important having such features are to you, and we'll certainly let you know once we have any updates!
Thank you, Katie.
Hello,
My team is looking to collect question level data in Storyline activities. Has their been any progress on tracking and collecting storyline question level data? Our team looks forward to any updates you might have.
Hi Nicole,
It sounds like you want to be able to track Storyline block question level data in Rise, correct? Right now, there isn’t a way to do this.
I don’t currently have any updates, but you are now subscribed to this conversation which means as we share updates here, you’ll automatically be notified.
Hi, I see that Rise can now send question-level details to the LMS. Is it possible to send/report all question-level details of every question that is answered by the learner in the entire Rise course to the LMS? Or would only the responses to questions included in the quiz that is selected as the basis for tracking/completion in the publish settings the ones that are sent to the LMS? We would like to capture all of the responses in a Rise course.
Hi Angela,
It sounds like you want access to question-level results from multiple quizzes in a Rise course is that correct?
This is possible with Rise, as we report raw data from all quizzes in a course. You’ll just need to understand how to work with your LMS to extract that detail.
I’d recommend reaching out to your LMS vendor for more information.
In the meantime, if I can help with anything else please let me know.
Thank you for confirming that! I also saw this article: https://articulate.com/support/article/Rise-Quiz-Data-Sent-to-an-LMS
Is it still true that quiz details for a Storyline block cannot be reported to the LMS?
Also wanting to know the answer to this question.
Hi Angela and Joan,
That’s correct - quiz details for a Storyline block cannot be reported to the LMS.
Please let me know if I can help with anything else!
This post was removed by the author
Hi Guys. I am working with our LMS admin to get question level data from Rise and we can't seem to get it utilizing 1.2. Going to try 2004, but unsure of the edition. Anyone have any suggestions on what has worked in your LMS?
UPDATE: Using 2nd edition we were able to get 6 out of the 10 questions specific metrics, but unsure of what is going on with the other 4. Staff?
Likely, you need to use the 4th edition as it allows for more data to be returned to the LMS.
The data being reported is limited to 64k characters, so if your text heavy it might be the problem. Also, In my experience working with Storyline, I know that any data that begins with a numerical value will fail to report. For example
How may shots is a Birdie in golf?1 under par //this will not report2 under par //this will not reportOne over par //this will reportOne under par ///this will reportThis post was removed by the author
This is actually possible, it just take alot of custom programming in storyline to communicate to the LMS via the Rise scorm api.
Hello all. It is an issue they're working on. A work around is turning off the randomization of questions and then placing a numerical value in front of every question and it worked. Thanks for the advice.
Any update on this?
Hi Taren, great questions!
I was actually referring to just SL360, and should point out that I tested this several builds ago on two LMS's to verify it. The Quiz and question results will report just fine, but in past SL360 builds the question level details would fail to report if the answers started with a number. By details I mean if the administrator wanted to see exactly what was chosen, they would see a blank entry. The answer would still report as correct or incorrect, but fail to record the choice.
I haven't tested this in the latest build of SL360 because I've since changed the format of my question structure in order to save time in the QA process, I simply don't start my answers with numbers. If this issue was fixed then that's great news.
Now if you want to record question level details in storyline through Rise you'll need to setup cmi statements in a javascript trigger and send those details through the Rise Scorm api, which can be accessed by referencing window.top:
I used the cmi.interactions in the scorm runtime api to record the question level data.
I hope I understood the question.
Great thread. I am using a basic web space with the HTML5 files to serve to clients. Will RISE save a file to the folder web space upon completion of a quiz or do you need a specified and dedicated LMS software to hold the data?