I sure hope someone can help me with this. We are having a problem with our learning management system (SuccessFactors) reporting results on quizzes in e-learnings. The problem is this: if a user fails a quiz, we the report with individual question responses comes up empty, although the completion report will come up as complete. Only if they pass the quiz, can we get results on how they responded to each question. We could set the pass rate at 0%, but that will mess up the results screen as well as our other reports.
Please tell me someone has solved this problem and that it is just a settings issue. For reference, these are some of my applicable settings:
First, let's narrow down whether is issue is related to SuccessFactors or to the quiz itself. To do that, we'll want to test the quiz in another LMS, like SCORM Cloud.
Would you mind sharing the .quiz file with me? I'll test it in SCORM Cloud and let you know what I find there!
It looks like you shared the published output folder with me. Would you mind also sharing the original (unpublished) quiz file? Also, what version of Quizmaker are you using?
Sure thing. Here it is. I am using Quizmaker 360 v5.18.16333.0. I will be developing in Storyline 360 most of the time, but I was doing initial testing in Quizmaker. Hopefully if we can get it to work here, a similar solution will work in Storyline 360.
Unfortunately, we have been working with SAP, but they say that it is a setting in the authoring tool. I am not sure where to go from here...I am curious what experience the other people with the SAP SF LMS are having in regards to this issue.
We are in the process of cutting over to SAP SF LMS and in the testing phases. Our quizzes are also not working in SF but they work in ScormCloud, which sounds like the same if not similar problem you were having. Did you ever get a resolution?
I'm not sure if Melanie is still subscribed here, but you are welcome to reach out to the user directly via the 'Contact Me' option on the user profile if you do not hear back soon.
Great question -- in fact we did not get a great resolution to the problem. In general, we don' t use question-level reporting, but when we do, we know that only the responses of people who passed the training are included in the report. Happy to chat more if you'd like to -- there are a lot of "tricks" you have to know when working with the SAP SF LMS.
I'm not sure if Melanie is following this thread anymore, but you are welcome to reach out to the user directly via the 'Contact Me' option on the user profile if you don't hear back soon!
12 Replies
Hi Melanie,
Sorry you're in a bind -- I can lend a hand!
First, let's narrow down whether is issue is related to SuccessFactors or to the quiz itself. To do that, we'll want to test the quiz in another LMS, like SCORM Cloud.
Would you mind sharing the .quiz file with me? I'll test it in SCORM Cloud and let you know what I find there!
Hi Alyssa,
Thanks so much -- I really appreciate the help. This was problematic with Captivate, which is the main reason we started looking at Articulate.
If this can be solved, I would be absolutely thrilled! I have attached the sample quiz I was using in our test system.
Hey Melanie!
It looks like you shared the published output folder with me. Would you mind also sharing the original (unpublished) quiz file? Also, what version of Quizmaker are you using?
Hi Alyssa,
Sure thing. Here it is. I am using Quizmaker 360 v5.18.16333.0. I will be developing in Storyline 360 most of the time, but I was doing initial testing in Quizmaker. Hopefully if we can get it to work here, a similar solution will work in Storyline 360.
Thanks for sharing your .quiz file for us to take a look Melanie.
Even when failing the quiz, the details of how I responded populated in SCORM Cloud:
You can take a look at my published output here or perhaps conduct your own testing and work directly with your LMS on why the results vary.
Hi Leslie,
Unfortunately, we have been working with SAP, but they say that it is a setting in the authoring tool. I am not sure where to go from here...I am curious what experience the other people with the SAP SF LMS are having in regards to this issue.
Thanks for the update Melanie.
Perhaps the data that you are able to see in SCORM Cloud will give you the leverage you need to work with your LMS team a bit more on this.
I'm curious to hear if others have experience with this as well and what solutions they have to share.
I'm following along for sure :)
Hi there Melanie,
We are in the process of cutting over to SAP SF LMS and in the testing phases. Our quizzes are also not working in SF but they work in ScormCloud, which sounds like the same if not similar problem you were having. Did you ever get a resolution?
Warmest regards,
- Alis
Hi Alis,
I'm not sure if Melanie is still subscribed here, but you are welcome to reach out to the user directly via the 'Contact Me' option on the user profile if you do not hear back soon.
Hi Alis,
Great question -- in fact we did not get a great resolution to the problem. In general, we don' t use question-level reporting, but when we do, we know that only the responses of people who passed the training are included in the report. Happy to chat more if you'd like to -- there are a lot of "tricks" you have to know when working with the SAP SF LMS.
Hi Melanie - I would be interested to learn how you could export answer details to SF LMS.
Hi Bram,
I'm not sure if Melanie is following this thread anymore, but you are welcome to reach out to the user directly via the 'Contact Me' option on the user profile if you don't hear back soon!