I need to track in my LMS the responses that people provide to individual quiz questions (I'm up to speed on how to use a results slide to track the overall results as passed/failed, complete/incomplete). For example:
My question is this: The link above simply says WHAT is reported. My question is HOW do I do this within Storyline? Or, is it a matter of working with my LMS team to see where this data is stored within the LMS (and how to extract)?
Storyline reports the data, but it's up to your LMS how it's reported back to you or displayed within the LMS reporting/tracking set up. To see "how" it's being reported or to give your LMS more information you could enable LMS debug mode so that you can see the information going back and forth, or you could also take a look at testing your content in SCORM Cloud which is an industry standard for testing SCORM content.
I have read a lot of threads here on the forum reporting individual response to quiz question to an LMS. There are tons of valuable information about the subject but I couldn't find a single complete example of a real SL quiz, the full set of parameter used to publish it and the report produced by one of the most used LMS.
This kind of question is coming back for years and even spending hours in the forum it is very hard to have an idea of a couple of how some LMS behave in this regard.
I need to track in my LMS the responses that people provide to individual quiz questions (I'm up to speed on how to use a results slide to track the overall results as passed/failed, complete/incomplete). For example:
My question is this: The link above simply says WHAT is reported. My question is HOW do I do this within Storyline? Or, is it a matter of working with my LMS team to see where this data is stored within the LMS (and how to extract)?
Thanks in advance for your help.
Mike
Hi Mike,
Did you succeed with your detailed answers report and what is the LMS you are using?
What LMS are you using? Depending on the LMS and the settings and options you need there are a few different publishing options from Scorm 1.2, 2004, AICC or Tin Can - so it's really specific to the individual set up and your needs. I don't know that anyone's shared a full quiz, as often it's just examples of how to set something up or sections of a course they are having issues with. Our examples page may be the best place for your to look to see more fully fleshed out courses.
Thanks for your answer. However, I am afraid it does not really help. I know all you are talking about and the standard answers about reading this and this section of your support. Your example pages do not have anything to do with my question.
The only thing I would like to see is something like a five question quiz, having it published to one of the standard and see a detailed report in a couple of the well known LMS.
I do not understand that with the thousand of users you have it is just impossible to find a single example of a real life of report of a single LMS of your choice. The only answer that Articulate provides is a ten line article with the information sent by Storyline. Full stop. Then you say good bye and see the rest with your LMS provider.
Thanks Matthew for sharing that here - and here is some additional information on how you could test at SCORM Cloud which is an industry standard for testing and reviewing LMS content.
By the way I had to re-create the zip because even SCORM Cloud told me there was no course in this package.
I will contribute by testing it against a couple of LMS I use. I already tried it with TalentLMS but unfortunately they support just SCORM 1.2 :-(.
I hope other people read this and contribute themselves too. This would be invaluable for everybody to know how each LMS behaves with this simple test and with with set oa parameters.
We are on SumTotal 8.9.3 and we capture our Storyline quiz data and use it for reporting purposes, but we do it mostly on the back end. There are certain tables in the database that keep this information. You should be able to access them using Report Manager and the Assessment dataset. If you use BIDS to do your reports it's easier to get to the data. Accessing it via SQL Server Management Studio is even easier. Below is an example of a query I use to retrieve the data.
INNER JOIN [S0PLRCDW].dbo.dimActivity act on fact.ActivityID=act.ID
INNER JOIN [S0PLRCDW].dbo.dimUser emp on fact.UserID=emp.ID
INNER JOIN [S0PLRCDW].dbo.dimQuestion ques on fact.QuestionID=ques.ID
WHERE (act.Code='nnnnnnnn')
ORDER BY AttemptStartDate,QuestionIdentifier
This gets me all the information I need for our business areas. You just have to make sure that whatever quiz or survey you want captured shows up on the results slide. We've done a pre-test and post survey in the same course along with the course content and built a custom results slide with them all on there and they all showed up in the data. I've attached an example of the data we can pull.
This article describes the quiz data that Articulate Storyline communicates to learning management systems (LMSs) for SCORM and AICC content.
Hopefully some users will chime in if they have experience with that particular LMS and I wanted to share another forum thread with you, although dated, but has some conversation around this LMS.
Hi everyone! I've read through a few different threads and while helpful, I have a different situation. I am using an essay question and need to get the user's response out of the LMS (Cornerstone). I can get responses to other types of questions, but not the actual words someone has entered in the essay question. Does anyone have any suggestions or know how to do this?
Hi Kristin! First, make sure the essay question is tracked by a results slide that the learner visits. SCORM 2004 does a really good job of sending question and answer text to the LMS. I don't have experience with Cornerstone, but I know that I can get essay responses in SCORM Cloud using that publishing protocol.
I saw this quiz data before and I'm pulling the "student response", which is where the other answers populate. I also tried on SCORM Cloud and I DO get results there. I would call this confirmation of my suspicion that Cornerstone is the issue and begin working on a workaround. I will also look through their enhancement suggestions to see if I can add or upvote something. Thank you for the response!
From your Articulate Online account, click the Reports tab. Then, select the Attempt Detail report. This report will show you how your learners answered each survey question.
For more details on Articulate Online reports, click here!
Just in case Kristin is no longer subscribed to this thread, feel free to use the Contact Me button on her profile page to reach out and reference her comment!
Hello everyone! This is a really important discussion and I have a similar question. I have been trying to find reports in my SuccessFactors LMS for the quiz data but I am not getting anything. The report on SCORM details continues to be empty. Could you please help me asap because we are in a process of uploading an entire course soon. Also, could you kindly let me know is it possible to report whether the learner went through all the content AND the quiz results?
30 Replies
Hey Matthew —
Thanks for the response! I’ll give that a try. We are using SumTotal’s LMS. Any idea on “where” to tell them to “look”?
Much appreciated!
Hi Mike,
Storyline reports the data, but it's up to your LMS how it's reported back to you or displayed within the LMS reporting/tracking set up. To see "how" it's being reported or to give your LMS more information you could enable LMS debug mode so that you can see the information going back and forth, or you could also take a look at testing your content in SCORM Cloud which is an industry standard for testing SCORM content.
Thanks, Matthew and Ashley!
I'll take this to my LMS team and let them know. MUCH APPRECIATED. I love this forum!!!!
Sounds good Mike and please let us know if you need anything else!
Hi Ashley,
I have read a lot of threads here on the forum reporting individual response to quiz question to an LMS. There are tons of valuable information about the subject but I couldn't find a single complete example of a real SL quiz, the full set of parameter used to publish it and the report produced by one of the most used LMS.
This kind of question is coming back for years and even spending hours in the forum it is very hard to have an idea of a couple of how some LMS behave in this regard.
Thank you for reading
Hi Mike,
Did you succeed with your detailed answers report and what is the LMS you are using?
Thanks
Hi Dominique,
What LMS are you using? Depending on the LMS and the settings and options you need there are a few different publishing options from Scorm 1.2, 2004, AICC or Tin Can - so it's really specific to the individual set up and your needs. I don't know that anyone's shared a full quiz, as often it's just examples of how to set something up or sections of a course they are having issues with. Our examples page may be the best place for your to look to see more fully fleshed out courses.
Hi Ashley,
Thanks for your answer. However, I am afraid it does not really help. I know all you are talking about and the standard answers about reading this and this section of your support. Your example pages do not have anything to do with my question.
The only thing I would like to see is something like a five question quiz, having it published to one of the standard and see a detailed report in a couple of the well known LMS.
I do not understand that with the thousand of users you have it is just impossible to find a single example of a real life of report of a single LMS of your choice. The only answer that Articulate provides is a ten line article with the information sent by Storyline. Full stop. Then you say good bye and see the rest with your LMS provider.
Thank you
Great job Matthew. Thanks for doing that.
Thanks Matthew for sharing that here - and here is some additional information on how you could test at SCORM Cloud which is an industry standard for testing and reviewing LMS content.
Thanks Matthew! That'S great.
By the way I had to re-create the zip because even SCORM Cloud told me there was no course in this package.
I will contribute by testing it against a couple of LMS I use. I already tried it with TalentLMS but unfortunately they support just SCORM 1.2 :-(.
I hope other people read this and contribute themselves too. This would be invaluable for everybody to know how each LMS behaves with this simple test and with with set oa parameters.
Ashley, I guess SCORM Cloud is already mentionned hundreds of time in this forum since it is the only Articulate answer to LMS questions.
By the way did you notice that Matthew also posted the result obtained in SCORM cloud?
Hi everybody,
Just made the test with Docebo. They have pretty nice reports too. Plenty of other reports also provided.
Hi Dominique,
We are on SumTotal 8.9.3 and we capture our Storyline quiz data and use it for reporting purposes, but we do it mostly on the back end. There are certain tables in the database that keep this information. You should be able to access them using Report Manager and the Assessment dataset. If you use BIDS to do your reports it's easier to get to the data. Accessing it via SQL Server Management Studio is even easier. Below is an example of a query I use to retrieve the data.
SELECT [AssessmentQuestionID], emp.PrimaryJobName, emp.EmpNo, emp.EmpFName, emp.EmpLName, act.ActivityName, [QuestionID], QuestionIdentifier, ques.QuestionText, [QuestionResult], [UserResponse], [AttemptCount], [TimeSpent], [ElapsedSeconds], [AttemptStartDate], [AttemptEndDate]
FROM [S0PLRCDW].[dbo].[factAssessment] fact
INNER JOIN [S0PLRCDW].dbo.dimActivity act on fact.ActivityID=act.ID
INNER JOIN [S0PLRCDW].dbo.dimUser emp on fact.UserID=emp.ID
INNER JOIN [S0PLRCDW].dbo.dimQuestion ques on fact.QuestionID=ques.ID
WHERE (act.Code='nnnnnnnn')
ORDER BY AttemptStartDate,QuestionIdentifier
This gets me all the information I need for our business areas. You just have to make sure that whatever quiz or survey you want captured shows up on the results slide. We've done a pre-test and post survey in the same course along with the course content and built a custom results slide with them all on there and they all showed up in the data. I've attached an example of the data we can pull.
Hope this helps.
Have a great day!
James
Hi All,
This is exactly what I am looking for. We use Netdimensions as our LMS.
Anyone of you have tested in this LMS how to capture individual responses?
Thanks
Carlos
Hi Carlos!
This article describes the quiz data that Articulate Storyline communicates to learning management systems (LMSs) for SCORM and AICC content.
Hopefully some users will chime in if they have experience with that particular LMS and I wanted to share another forum thread with you, although dated, but has some conversation around this LMS.
Hi everyone! I've read through a few different threads and while helpful, I have a different situation. I am using an essay question and need to get the user's response out of the LMS (Cornerstone). I can get responses to other types of questions, but not the actual words someone has entered in the essay question. Does anyone have any suggestions or know how to do this?
Thanks!
Hi Kristin! First, make sure the essay question is tracked by a results slide that the learner visits. SCORM 2004 does a really good job of sending question and answer text to the LMS. I don't have experience with Cornerstone, but I know that I can get essay responses in SCORM Cloud using that publishing protocol.
Let me know if that works for you!
I saw this quiz data before and I'm pulling the "student response", which is where the other answers populate. I also tried on SCORM Cloud and I DO get results there. I would call this confirmation of my suspicion that Cornerstone is the issue and begin working on a workaround. I will also look through their enhancement suggestions to see if I can add or upvote something. Thank you for the response!
That's good to know, Kristin. Thanks for confirming and updating us here!
Hey folks, does anyone know how to do this in articulate online? I really need to get individual level reporting and can't figure out how to do this.
We're even asking for the person's name within the questions used for the tracking quiz. So really, being able to see data by submit would work.
Thanks!
Astha
Hello, Astha!
From your Articulate Online account, click the Reports tab. Then, select the Attempt Detail report. This report will show you how your learners answered each survey question.
For more details on Articulate Online reports, click here!
Hi Kristin,
When you pulled the data in the report, were you using reporting 2.0 or custom reporting?
Hi James!
Just in case Kristin is no longer subscribed to this thread, feel free to use the Contact Me button on her profile page to reach out and reference her comment!
Hello everyone! This is a really important discussion and I have a similar question. I have been trying to find reports in my SuccessFactors LMS for the quiz data but I am not getting anything. The report on SCORM details continues to be empty. Could you please help me asap because we are in a process of uploading an entire course soon. Also, could you kindly let me know is it possible to report whether the learner went through all the content AND the quiz results?
Regards,
Ankita