I am the admin for a Moodle 2.2 LMS. We have people that want to post courses using Articulate Storyline (as SCORM packages). Many of the courses have questions - most have several questions. They want/need to track the results/answers of those questions (on a question specific level - not just the total score) in the Moodle LMS. I love Articulate products and want to be able to support them. I would greatly appreciate your advice on how to do this - hopefully it is possible. BTW, I have already seen THIS discussion, but it does not speak to these conditions.
Yes, I have seen the interactions report, but am not seeing/getting what I need. In the response column I am seeing " " (screenshot here). The interactions report for a copy of that course for a different audience shows no question columns at all (screenshot here). I would greatly appreciate it if you could explain how to set this (i.e. settings) up on both the Articulate and Moodle side so that we can view the question-level responses of users/learners. BTW, I am new at my org and working to clean/fix how the Moodle LMS is used. I really want/need to figure this out, as some course makers have made their quizzes in the separate program Question Maker (bcs of the apparently incorrect assumption that you cannot do what I'm asking about). I'd like to simplify their life, improve the user experience, and have the question results within Moodle, not in this outside web-based program.
It would be good to take a look at the track details page of an individual response to see if the SCORM packages are actually reporting anything back to Moodle - Moodle is pretty reliant on the information provided by the SCORM package.
Usually Articulate reports interaction information by default - I'm not sure on what settings you need to make in Articulate to make sure interactions are passed to the LMS as I'm not a package developer but someone else here might be able to help.
Is there a way to test this without installing additional software - Our company does not allow employees to install software! - but I would love to run my eLearning through a web based SCORM test to check that it is outputing results but not sure if such a thing exists?
Hope all goes well. The correct/proper tracking and reporting of Storyline SCORM packages on our Mooodle LMS (version 2.6.3) is still very unclear. Course owners have one or more of the following needs - 1) track and report if a user has viewed all slides of a Storyline SCORM package, 2) track and report the aggregate score of a quiz, and 3) track which questions users got right and wrong.
I tried searching searching eLearning Heroes, but the site search is not working for me, which greatly takes away from its usefulness. Am I missing something? This is the best article that I have found for this, but it is not by you guys.http://www.inquisiqr3.com/whitepapers/scorm-publish-settings-in-articulate-studio-and-storyline-products/Do you agree with the recommendations? Do you h ave any other resources/advice?
Below are the Articulate support links that seem relevant, but they do not provide clear guidance.
Storyline only allows you to track and report completion one of two ways - either by the total number of slides viewed or by visiting a quiz results slide, and if using the latter - the quiz data link you included here is what will be sent to your LMS. With that being said, it's up to your LMS to read the results and report back on them to you. It may also help for you to review the article here on troubleshooting common LMS issues with reporting and tracking. Since each LMS may require different reporting elements or completion/passed/incomplete/failed statuses - we've included those options to allow for you to make the set up that best matches your course needs and LMS.
If you find that getting the report to look as you want within your LMS is difficult, it may also be worth connecting with them directly to see if there is a suggestion based on the needs you shared here. There are also a number of other Moodle users in the forums, so I hope that they're able to weigh in here.
Lastly in regards to the forum search - our web team is aware of some issues with it right now and they are working on some powerful updates to a future version of the Heroes community. I'm pretty excited about what's to come - but in the meantime, you'll want to use the method Adrian describes here or bookmark a page like Articusearch.
On the Reporting tab one must specify whether you want to track course completion based on the number of slides viewed or by a particular quiz in the course. Does that mean that you cannot do/pass both? If you track using quiz results, will it report the overall score AND results for each individual question? As you can imagine, course/quiz creators want to see what questions learners are getting wrong more often - pointing to a gap in learning or quality of instruction. And they often want/need a total score for passing.
As for the Reporting tab, do you know what the best options are for LMS and LMS Reporting settings for Moodle LMS (version 2.6.3)? As the most common/popular open-source LMS out there, I was hoping someone at Articulate would know.
On the Reporting tab one must specify whether you want to track course completion based on the number of slides viewed or by a particular quiz in the course. Does that mean that you cannot do/pass both? If you track using quiz results, will it report the overall score AND results for each individual question? As you can imagine, course/quiz creators want to see what questions learners are getting wrong more often - pointing to a gap in learning or quality of instruction. And they often want/need a total score for passing.
As for the Reporting tab, do you know what the best options are for LMS and LMS Reporting settings for Moodle LMS (version 2.6.3)? As the most common/popular open-source LMS out there, I was hoping someone at Articulate would know.
You can only track by quiz or by slides viewed and cannot do both.
For Moodle you want to publish to Scorm 1.2 and I would use passed/not completed. Remember to set a pass grade (the same as that set in the Scorm) in the grade book for the course in moodle or it will not be marked as complete.
I'm glad Phil was able to chime in with those details, and also the Moodle specific set up. Since Phil shared the link to that article on the data Storyline sends, it'll be up to your LMS if you're able to see the actual answers from users and help determine which ones the users get wrong most often, etc.
I am working on a project for a client and have been asked to produce an assessment for the end of the course.
The client would like to be able to run a report on each question in order to see which questions users are struggling with and also what each user is answering to each question e.g.
“For question 1, 50% of users chose answer A, 30% chose answer B, 12% chose answer C and 8% chose answer D.” This will show the client where there are specific knowledge gaps across their organisation, and identify further training requirements.
Hi Articulate Learner and welcome to E-Learning Heroes!
This thread is a bit dated, but it actually seems like the question you are asking would be more specific to the LMS that your client is utilizing. Reporting is not handled within our software.
You certainly do have the ability to add quiz slides as well as result slides within the software though.
Typically the reporting and how many users answered each element is something based within your LMS or tracking set up. If you include regular question types and a results slide to report to your LMS, we'll send this data and then I'd defer to your LMS provider for the types of reports you can pull.
We're still working on building question-level details into Rise's LMS output, and you'll get this as soon as it's ready. We'll also keep this Forum Thread updated with any developments. Thanks!
19 Replies
Have you seen the interactions report in Moodle? Does that show what you need?
Btw Moodle 2.2 is out of support - you should upgrade to a recent supported release like 2.4 or 2.5
Hi Dan,
Yes, I have seen the interactions report, but am not seeing/getting what I need. In the response column I am seeing " " (screenshot here). The interactions report for a copy of that course for a different audience shows no question columns at all (screenshot here). I would greatly appreciate it if you could explain how to set this (i.e. settings) up on both the Articulate and Moodle side so that we can view the question-level responses of users/learners. BTW, I am new at my org and working to clean/fix how the Moodle LMS is used. I really want/need to figure this out, as some course makers have made their quizzes in the separate program Question Maker (bcs of the apparently incorrect assumption that you cannot do what I'm asking about). I'd like to simplify their life, improve the user experience, and have the question results within Moodle, not in this outside web-based program.
Thanks so much, Colin
Hi Colin,
It would be good to take a look at the track details page of an individual response to see if the SCORM packages are actually reporting anything back to Moodle - Moodle is pretty reliant on the information provided by the SCORM package.
Usually Articulate reports interaction information by default - I'm not sure on what settings you need to make in Articulate to make sure interactions are passed to the LMS as I'm not a package developer but someone else here might be able to help.
Any further light to shed on this as I think its an important issue...
help anyone?
Hi Thomas,
I don't see any further posts from Colin on this issue, but did want to share with you the information on what quiz data Storyline reports to an LMS. Additionally, there was a known issue where question details were not reported to an LMS that was fixed in update 3 of Storyline. Can you confirm for us which update you're using, as we're now on update 4.
Is there a way to test this without installing additional software - Our company does not allow employees to install software! - but I would love to run my eLearning through a web based SCORM test to check that it is outputing results but not sure if such a thing exists?
Hi Noreen,
SCORM Cloud is just that thing. You can set up a free account and use it as a testing platform for your SCORM content.
Hi Ashley,
Hope all goes well. The correct/proper tracking and reporting of Storyline SCORM packages on our Mooodle LMS (version 2.6.3) is still very unclear. Course owners have one or more of the following needs - 1) track and report if a user has viewed all slides of a Storyline SCORM package, 2) track and report the aggregate score of a quiz, and 3) track which questions users got right and wrong.
I tried searching searching eLearning Heroes, but the site search is not working for me, which greatly takes away from its usefulness. Am I missing something? This is the best article that I have found for this, but it is not by you guys. http://www.inquisiqr3.com/whitepapers/scorm-publish-settings-in-articulate-studio-and-storyline-products/ Do you agree with the recommendations? Do you h ave any other resources/advice?
Below are the Articulate support links that seem relevant, but they do not provide clear guidance.
Thanks, Colin
Hi Colin,
Storyline only allows you to track and report completion one of two ways - either by the total number of slides viewed or by visiting a quiz results slide, and if using the latter - the quiz data link you included here is what will be sent to your LMS. With that being said, it's up to your LMS to read the results and report back on them to you. It may also help for you to review the article here on troubleshooting common LMS issues with reporting and tracking. Since each LMS may require different reporting elements or completion/passed/incomplete/failed statuses - we've included those options to allow for you to make the set up that best matches your course needs and LMS.
If you find that getting the report to look as you want within your LMS is difficult, it may also be worth connecting with them directly to see if there is a suggestion based on the needs you shared here. There are also a number of other Moodle users in the forums, so I hope that they're able to weigh in here.
Lastly in regards to the forum search - our web team is aware of some issues with it right now and they are working on some powerful updates to a future version of the Heroes community. I'm pretty excited about what's to come - but in the meantime, you'll want to use the method Adrian describes here or bookmark a page like Articusearch.
Thanks Ashley,
On the Reporting tab one must specify whether you want to track course completion based on the number of slides viewed or by a particular quiz in the course. Does that mean that you cannot do/pass both? If you track using quiz results, will it report the overall score AND results for each individual question? As you can imagine, course/quiz creators want to see what questions learners are getting wrong more often - pointing to a gap in learning or quality of instruction. And they often want/need a total score for passing.
As for the Reporting tab, do you know what the best options are for LMS and LMS Reporting settings for Moodle LMS (version 2.6.3)? As the most common/popular open-source LMS out there, I was hoping someone at Articulate would know.
Thanks for your help, Colin
I don't think Storyline sends the individual quiz score, it sends this info http://www.articulate.com/support/storyline/quiz-data-sent-to-an-lms-in-articulate-storyline
You can only track by quiz or by slides viewed and cannot do both.
For Moodle you want to publish to Scorm 1.2 and I would use passed/not completed. Remember to set a pass grade (the same as that set in the Scorm) in the grade book for the course in moodle or it will not be marked as complete.
Hi Colin,
I'm glad Phil was able to chime in with those details, and also the Moodle specific set up. Since Phil shared the link to that article on the data Storyline sends, it'll be up to your LMS if you're able to see the actual answers from users and help determine which ones the users get wrong most often, etc.
Thanks Ashley and Phil! Much appreciated
Hi Ashley,
I also have a similar issue to resolve.
I am working on a project for a client and have been asked to produce an assessment for the end of the course.
The client would like to be able to run a report on each question in order to see which questions users are struggling with and also what each user is answering to each question e.g.
“For question 1, 50% of users chose answer A, 30% chose answer B, 12% chose answer C and 8% chose answer D.”
This will show the client where there are specific knowledge gaps across their organisation, and identify further training requirements.
How can i achieve this using storyline?
Hi Articulate Learner and welcome to E-Learning Heroes!
This thread is a bit dated, but it actually seems like the question you are asking would be more specific to the LMS that your client is utilizing. Reporting is not handled within our software.
You certainly do have the ability to add quiz slides as well as result slides within the software though.
Hi -
Typically the reporting and how many users answered each element is something based within your LMS or tracking set up. If you include regular question types and a results slide to report to your LMS, we'll send this data and then I'd defer to your LMS provider for the types of reports you can pull.
Hi Ashley,
Does Rise SCORM 1.2 report interations/question details?
Thanks,
Chris
Good Morning, Chris.
We're still working on building question-level details into Rise's LMS output, and you'll get this as soon as it's ready. We'll also keep this Forum Thread updated with any developments. Thanks!
Special delivery 🛎Rise courses now send question-level details to an LMS – so you can observe what learners know and where they need more help!
Continue to stay in the Rise know by checking out its release notes here! Hope you enjoy, and we're here if you need anything else!
This discussion is closed. You can start a new discussion or contact Articulate Support.